From llvm-testresults at cs.uiuc.edu Wed Aug 1 00:07:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 02:07:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801070720.4B66E2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2549?compare_to=2548&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2549, Order: 161100, Start Time: 2012-08-01 05:51:57, End Time: 2012-08-01 07:07:47 To: 2548, Order: 161099, Start Time: 2012-08-01 04:10:10, End Time: 2012-08-01 05:23:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (730 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (54.8420 => 56.3668, std. dev.: 0.1034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.35% (2.0176 => 2.3071, std. dev.: 0.0582) SingleSource/UnitTests/ObjC++/property-reference-object: 10.26% (0.5818 => 0.6415, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.17% (0.3578 => 0.3942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.02% (0.5748 => 0.6324, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.02% (0.3623 => 0.3986, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.00% (0.3601 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3663 => 0.4027, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.90% (0.3789 => 0.4164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.84% (0.3650 => 0.4009, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 9.58% (0.3914 => 0.4289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.4003 => 0.4382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.21% (0.7061 => 0.7711, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.00% (1.3693 => 1.4789, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2781 => 0.2988, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.44% (0.4328 => 0.4650, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2782 => 0.2987, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.16% (0.2596 => 0.2782, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (3.9660 => 4.2461, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.5265 => 0.5635, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 6.96% (0.7038 => 0.7528, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.89% (0.4062 => 0.4342, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.46% (0.3485 => 0.3710, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.6959 => 0.7370, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.86% (0.3293 => 0.3486, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (0.3756 => 0.3971, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.69% (0.4390 => 0.4640, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.68% (1.2193 => 1.2886, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.3868 => 0.4083, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.44% (16.6129 => 17.5162, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9199 => 0.9696, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.36% (13.8202 => 14.5615, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.26% (0.2243 => 0.2361, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.2914 => 0.3066, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 4.98% (0.7506 => 0.7880, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2292 => 1.2895, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5711, std. dev.: 0.0075) MultiSource/Applications/Burg/burg: 4.87% (1.1061 => 1.1600, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.84% (0.3246 => 0.3403, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.77% (0.5637 => 0.5906, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.63% (1.1364 => 1.1890, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3856, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (3.8646 => 4.0425, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/football/football: 4.51% (0.8310 => 0.8685, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.49% (1.9270 => 2.0136, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3755 => 0.3920, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.36% (1.0594 => 1.1056, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.3813 => 1.4385, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6240, std. dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.90% (2.1791 => 2.2641, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.4791 => 0.4977, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.86% (4.9865 => 5.1789, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.71% (0.8698 => 0.9021, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1333 => 1.1747, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.6283 => 0.6494, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.31% (0.6135 => 0.6338, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.05% (3.1889 => 3.2861, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.1007 => 2.1630, std. dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7584, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (3.2742 => 3.3651, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2600, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 2.64% (16.2614 => 16.6915, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.5298 => 14.9024, std. dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.6250 => 0.6397, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.33% (4.6629 => 4.7717, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.9108 => 0.9268, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.56% (1.0313 => 1.0474, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.29% (3.7467 => 3.7950, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2661, std. dev.: 0.0548) SingleSource/Benchmarks/Misc/mandel-2: 8.96% (1.2998 => 1.4163, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.31% (0.9996 => 1.0527, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7523, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7063, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0261) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.27% (4.5928 => 4.6512, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1387, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.93% (0.4657 => 0.4055, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1968, std. dev.: 0.3937) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.65% (0.0997 => 0.0831, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1106, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.77% (20.3410 => 18.5573, std. dev.: 0.0233) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0128) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9202, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9486, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5017, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7672, std. dev.: 0.1254) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8579, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2300, std. dev.: 0.0354) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2482, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 00:12:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 02:12:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801071250.5148F2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2550?compare_to=2547&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2550, Order: 161100, Start Time: 2012-08-01 05:51:57, End Time: 2012-08-01 07:13:17 To: 2547, Order: 161099, Start Time: 2012-08-01 04:05:27, End Time: 2012-08-01 05:23:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (60 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (778 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.42% (0.7658 => 0.7767, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.17% (1.4230 => 1.4539, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (13.3504 => 13.1883, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.21% (10.3673 => 13.1883, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3473 => 0.3924, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 12.61% (0.3497 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.48% (0.3543 => 0.3985, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3516 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3543 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.38% (0.3561 => 0.4002, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.18% (0.3694 => 0.4144, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.29% (1.1194 => 1.2458, std. dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.62% (2.2022 => 2.3921, std. dev.: 0.0466) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.53% (1.7609 => 1.8935, std. dev.: 0.0262) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.65% (0.5925 => 0.6319, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.6030 => 0.6418, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.02% (0.7326 => 0.7767, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 4.75% (10.4361 => 10.9316, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.4879 => 0.5109, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.55% (0.7433 => 0.7771, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (9.4845 => 9.8785, std. dev.: 0.0113) MultiSource/Applications/spiff/spiff: 3.42% (0.7835 => 0.8103, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.32% (0.4636 => 0.4790, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 3.19% (1.5603 => 1.6100, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.05% (5.7591 => 5.9347, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.4103 => 0.4225, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.96% (1.1642 => 1.1987, std. dev.: 0.0085) MultiSource/Applications/treecc/treecc: 2.93% (2.0273 => 2.0867, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.88% (3.3354 => 3.4314, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.80% (0.3826 => 0.3933, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.62% (2.0665 => 2.1206, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4289 => 0.4399, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.35% (0.5105 => 0.5225, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6456 => 0.6606, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (0.4620 => 0.4721, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5859 => 1.6202, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.04% (17.1811 => 17.5308, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6675 => 0.6810, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3101, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.61% (2.2969 => 2.3338, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.20% (1.0722 => 1.0851, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.32% (4.2280 => 4.4106, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2097, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8342, std. dev.: 0.0244) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2048, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1539, std. dev.: 0.0525) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6989, std. dev.: 0.0565) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7091, std. dev.: 0.0537) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0365, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5389, std. dev.: 0.0615) MultiSource/Applications/ClamAV/clamscan: -10.05% (22.1758 => 19.9481, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.06% (3.8922 => 3.8511, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2373 => 1.1157, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.18% (19.9488 => 18.5161, std. dev.: 0.0709) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -5.43% (1.5373 => 1.4539, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.53% (1.9577 => 1.8691, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4810, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9065, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4182, std. dev.: 0.0811) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0054, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2005, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3233, std. dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4166, std. dev.: 0.0553) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: -1.01% (1.1333 => 1.1219, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 02:26:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 04:26:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801092628.9415E2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2551?compare_to=2549&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2551, Order: 161101, Start Time: 2012-08-01 08:12:59, End Time: 2012-08-01 09:26:56 To: 2549, Order: 161100, Start Time: 2012-08-01 05:51:57, End Time: 2012-08-01 07:07:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (151 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (706 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.06% (1.4942 => 1.5100, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.24% (0.5818 => 0.6414, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.12% (0.3578 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.04% (0.5748 => 0.6325, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.94% (0.3601 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.87% (0.3646 => 0.4006, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.83% (0.3623 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.81% (0.3650 => 0.4008, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3663 => 0.4021, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3789 => 0.4156, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.63% (0.3914 => 0.4291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.39% (0.4003 => 0.4379, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.39% (0.3940 => 0.4310, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7061 => 0.7710, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 7.87% (1.3693 => 1.4770, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.47% (0.7710 => 0.8286, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4328 => 0.4648, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3022 => 0.3240, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5265 => 0.5637, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (3.9660 => 4.2461, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7038 => 0.7534, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4062 => 0.4344, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (1.9828 => 2.1177, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.80% (0.2765 => 0.2953, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3107 => 0.3309, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.42% (0.3580 => 0.3810, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.2988 => 0.3178, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4379 => 0.4653, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists1: 6.14% (0.3534 => 0.3751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3453 => 0.3663, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.6959 => 0.7380, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 5.95% (0.3293 => 0.3489, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.83% (1.2193 => 1.2904, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (0.3756 => 0.3970, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.65% (0.4016 => 0.4243, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.64% (16.6129 => 17.5500, std. dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5577 => 0.5890, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 5.51% (0.3868 => 0.4081, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.50% (0.9199 => 0.9705, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.37% (13.8202 => 14.5621, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/09-vor/vor: 5.37% (0.2925 => 0.3082, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.2945 => 0.3103, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.05% (1.2292 => 1.2913, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 5.01% (0.7506 => 0.7882, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (7.2180 => 7.5754, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 4.81% (1.1061 => 1.1593, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5263, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.81% (0.3246 => 0.3402, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (13.2842 => 13.9177, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.74% (1.3245 => 1.3873, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 4.65% (3.8646 => 4.0442, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.62% (1.1364 => 1.1889, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.56% (1.9270 => 2.0148, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.7460 => 0.7795, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.0594 => 1.1069, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.48% (0.8310 => 0.8682, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.45% (0.3755 => 0.3922, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.3801 => 4.5637, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.3819 => 1.4397, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.3813 => 1.4385, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (4.4433 => 4.6258, std. dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (3.6692 => 3.8176, std. dev.: 0.0137) MultiSource/Applications/siod/siod: 3.99% (2.1791 => 2.2661, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1775, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (0.4791 => 0.4971, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.74% (0.8698 => 0.9023, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1333 => 1.1752, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.50% (0.4113 => 0.4257, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.39% (0.6283 => 0.6496, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.34% (0.6135 => 0.6340, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7587, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 3.07% (3.1889 => 3.2868, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.1007 => 2.1605, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.5754 => 6.7612, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.2742 => 3.3656, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2669, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 2.61% (16.2614 => 16.6860, std. dev.: 0.0222) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.5298 => 14.9004, std. dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6250 => 0.6400, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.30% (4.6629 => 4.7703, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.9108 => 0.9268, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: 1.57% (0.6744 => 0.6850, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.54% (1.0313 => 1.0472, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.34% (3.7467 => 3.7968, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.17% (6.2785 => 6.3521, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.14% (33.2944 => 33.6731, std. dev.: 0.0313) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5215, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2615, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel-2: 8.29% (1.2998 => 1.4075, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7554, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7077, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (2.8606 => 2.9656, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9551, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.24% (4.5928 => 4.6496, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1729, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.35% (0.0997 => 0.0824, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2308 => 1.1050, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.29% (20.3410 => 18.4507, std. dev.: 0.0532) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5898, std. dev.: 0.0114) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2369, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7686, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2295, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2487, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2292, std. dev.: 0.0205) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2450, std. dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 02:31:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 04:31:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801093137.18B732A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2552?compare_to=2550&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2552, Order: 161101, Start Time: 2012-08-01 08:13:03, End Time: 2012-08-01 09:32:04 To: 2550, Order: 161100, Start Time: 2012-08-01 05:51:57, End Time: 2012-08-01 07:13:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (90 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (746 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.24% (7.9457 => 8.0439, std. dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.06% (1.4539 => 1.4239, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.20% (10.3673 => 13.1872, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.44% (0.3561 => 0.4004, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.33% (0.3543 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (1.1194 => 1.2466, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.72% (2.2022 => 2.3943, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.52% (1.7609 => 1.8933, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 6.57% (0.5925 => 0.6314, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 6.40% (0.6030 => 0.6416, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (7.0540 => 7.4022, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.4361 => 10.9261, std. dev.: 0.0327) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (0.7433 => 0.7775, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (9.4845 => 9.8821, std. dev.: 0.0179) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (5.0018 => 5.2093, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.15% (0.8172 => 0.8511, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1476, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5569 => 0.5796, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.70% (0.5860 => 0.6077, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (4.2646 => 4.4209, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/18-imp/imp: 3.62% (0.3423 => 0.3547, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.51% (14.3668 => 14.8707, std. dev.: 0.0126) MultiSource/Applications/spiff/spiff: 3.50% (0.7835 => 0.8109, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.1363 => 8.4150, std. dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2252, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 3.18% (1.5603 => 1.6099, std. dev.: 0.0111) MultiSource/Applications/oggenc/oggenc: 3.18% (5.7591 => 5.9420, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.02% (0.4103 => 0.4227, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.99% (3.3354 => 3.4352, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1986, std. dev.: 0.0094) MultiSource/Applications/treecc/treecc: 2.95% (2.0273 => 2.0872, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.77% (1.5415 => 1.5842, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (0.3935 => 0.4044, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4289 => 0.4405, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.64% (0.3865 => 0.3967, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4636 => 0.4758, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.59% (3.8723 => 3.9726, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (2.0665 => 2.1197, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 2.44% (0.4299 => 0.4404, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9765 => 1.0003, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.43% (0.4203 => 0.4305, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.2024 => 2.2535, std. dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.6456 => 0.6605, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6213, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.12% (1.2842 => 1.3114, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.09% (17.1811 => 17.5401, std. dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.4186 => 1.4481, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8921 => 0.9104, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5981 => 0.6100, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 1.75% (2.2969 => 2.3370, std. dev.: 0.0088) MultiSource/Applications/minisat/minisat: 1.71% (0.7115 => 0.7237, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.42% (1.1840 => 1.2008, std. dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.37% (1.0722 => 1.0869, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (4.2280 => 4.3817, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8339, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5086 => 1.5322, std. dev.: 0.0013) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2206, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.24% (5.2763 => 3.1530, std. dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6989, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.71% (5.3526 => 3.7088, std. dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0019, std. dev.: 0.0306) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5461, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -10.08% (22.1758 => 19.9407, std. dev.: 0.0537) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.02% (3.8922 => 3.8526, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2373 => 1.1127, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -7.38% (1.5373 => 1.4239, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.74% (19.9488 => 18.6040, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.03% (1.9577 => 1.8593, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4816, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9054, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4229, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0019, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2009, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3253, std. dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4170, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2493, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 02:36:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 04:36:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801093611.D81482A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2553?compare_to=2544&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2553, Order: 161100, Start Time: 2012-08-01 06:51:46, End Time: 2012-08-01 09:36:39 To: 2544, Order: 161093, Start Time: 2012-08-01 00:28:52, End Time: 2012-08-01 03:12:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (75 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (807 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.20% (0.9914 => 1.0033, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (54.2556 => 54.8499, std. dev.: 0.0606) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.70% (0.3488 => 0.3966, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3442 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.52% (0.3469 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.23% (0.3643 => 0.4125, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.12% (0.3650 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.70% (0.3724 => 0.4197, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.36% (0.5826 => 0.6255, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.5889 => 0.6305, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.11% (0.5026 => 0.5333, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.89% (0.4994 => 0.5288, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (1.6211 => 1.7154, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.82% (3.5627 => 3.7699, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 5.81% (1.5932 => 1.6857, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.75% (0.5900 => 0.6239, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7171 => 0.7571, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.38% (1.3152 => 1.3860, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (0.5000 => 0.5267, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (0.4361 => 0.4584, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (0.3930 => 0.4120, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 4.73% (1.0781 => 1.1291, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 4.55% (4.2109 => 4.4025, std. dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.2866 => 0.2993, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.40% (2.7292 => 2.8492, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (1.9694 => 2.0494, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (0.4658 => 0.4842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.91% (0.2738 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (1.9966 => 2.0745, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.3903 => 0.4053, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.83% (0.3890 => 0.4039, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.80% (0.9909 => 1.0286, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 3.76% (5.5417 => 5.7498, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (2.1013 => 2.1761, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (1.8794 => 1.9452, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (4.4195 => 4.5728, std. dev.: 0.0098) MultiSource/Applications/hbd/hbd: 3.46% (0.9697 => 1.0033, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.43% (0.4139 => 0.4281, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (2.1653 => 2.2387, std. dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 3.36% (0.3004 => 0.3105, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.35% (4.6177 => 4.7722, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.20% (2.0673 => 2.1334, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.09% (0.3267 => 0.3368, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.3845 => 0.3958, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.85% (1.4269 => 1.4675, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.79% (0.7875 => 0.8095, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.75% (0.3678 => 0.3779, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.69% (23.5202 => 24.1530, std. dev.: 0.0083) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (0.4251 => 0.4351, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.36% (2.0346 => 2.0623, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 14.23% (2.5769 => 2.9436, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6560, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1705, std. dev.: 0.0281) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8868, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6366, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1896, std. dev.: 0.0156) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4979, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2209, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.31% (2.4764 => 2.4193, std. dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: -1.37% (11.9555 => 11.7920, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5230, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary2: -9.03% (0.2402 => 0.2185, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -8.80% (17.2379 => 15.7210, std. dev.: 0.1313) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7975, std. dev.: 0.1363) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -3.66% (14.0481 => 13.5337, std. dev.: 0.0120) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7996, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 04:08:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 06:08:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801110824.AD3A82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2554?compare_to=2551&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2554, Order: 161107, Start Time: 2012-08-01 09:55:11, End Time: 2012-08-01 11:08:54 To: 2551, Order: 161101, Start Time: 2012-08-01 08:12:59, End Time: 2012-08-01 09:26:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.58% (2.0176 => 2.3117, std. dev.: 0.0171) SingleSource/UnitTests/ObjC/trivial-interface: 9.89% (0.3578 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5818 => 0.6391, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3601 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.71% (0.5748 => 0.6306, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3646 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.61% (0.3663 => 0.4015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.56% (0.3650 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3789 => 0.4150, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.52% (0.3623 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.30% (0.3914 => 0.4278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.4003 => 0.4371, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.09% (0.3940 => 0.4298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.84% (0.7061 => 0.7685, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.46% (1.3693 => 1.4715, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.7710 => 0.8262, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (3.9660 => 4.2410, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7038 => 0.7515, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.43% (0.4062 => 0.4323, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2655 => 0.2818, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.11% (1.9828 => 2.1040, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.10% (0.3899 => 0.4137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.09% (0.2726 => 0.2892, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2628 => 0.2788, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.87% (0.3580 => 0.3790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.3107 => 0.3289, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2875, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.57% (0.3534 => 0.3731, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.37% (0.9199 => 0.9693, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4390 => 0.4623, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.25% (13.8202 => 14.5457, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 5.13% (16.6129 => 17.4652, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3868 => 0.4057, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.84% (0.5637 => 0.5910, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.77% (0.7506 => 0.7864, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (1.4563 => 1.5254, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5598, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.1364 => 1.1896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (13.2842 => 13.8948, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 4.55% (0.8310 => 0.8688, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.54% (1.1061 => 1.1563, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (3.8646 => 4.0368, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.41% (1.2292 => 1.2834, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.39% (1.3245 => 1.3827, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.38% (1.3819 => 1.4424, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 4.36% (1.0594 => 1.1056, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.26% (1.3813 => 1.4401, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.26% (1.9270 => 2.0090, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.3801 => 4.5598, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (4.4433 => 4.6227, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (3.6692 => 3.8150, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.64% (2.1791 => 2.2584, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (4.9865 => 5.1663, std. dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.58% (1.1333 => 1.1739, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6283 => 0.6495, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.8698 => 0.8983, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (8.4961 => 8.7572, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 3.04% (3.1889 => 3.2858, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7592, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.2742 => 3.3657, std. dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2571, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.69% (2.1007 => 2.1572, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.59% (16.2614 => 16.6827, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9050, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5188 => 1.5566, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.48% (4.6629 => 4.7787, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.6250 => 0.6369, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.44% (1.0313 => 1.0461, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (6.2785 => 6.3498, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7869, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5134, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 25.88% (1.8175 => 2.2879, std. dev.: 0.0329) SingleSource/Benchmarks/Misc/mandel-2: 7.21% (1.2998 => 1.3935, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.21% (0.9996 => 1.0517, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7513, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7044, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8146, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.36% (4.5928 => 4.6552, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.23% (10.7476 => 10.8799, std. dev.: 0.0184) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6865, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1390, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.79% (0.4657 => 0.4015, std. dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1605, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.46% (0.0997 => 0.0813, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1094, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.57% (20.3410 => 18.5983, std. dev.: 0.0304) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0077) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.96% (1.9762 => 1.9177, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5900, std. dev.: 0.0120) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9484, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2207, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7686, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8651, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2366, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2207, std. dev.: 0.0246) MultiSource/Applications/lua/lua: -1.03% (26.5159 => 26.2436, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 04:19:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 06:19:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801111900.96DC62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2555?compare_to=2552&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2555, Order: 161107, Start Time: 2012-08-01 10:00:40, End Time: 2012-08-01 11:19:30 To: 2552, Order: 161101, Start Time: 2012-08-01 08:13:03, End Time: 2012-08-01 09:32:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (97 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.57% (2.3452 => 2.3084, std. dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.33% (10.3673 => 13.3044, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3473 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.24% (0.3497 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.18% (0.3543 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.12% (0.3543 => 0.4008, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 12.94% (0.3694 => 0.4172, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3828 => 0.4302, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2455, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (2.2022 => 2.3907, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.25% (1.7609 => 1.8886, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.03% (0.6030 => 0.6454, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.61% (0.3177 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.94% (0.7326 => 0.7761, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.09% (0.4615 => 0.4850, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.91% (7.0540 => 7.4004, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 4.76% (10.4361 => 10.9327, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.69% (0.4879 => 0.5108, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (0.7433 => 0.7775, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 4.54% (0.2554 => 0.2670, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.9449 => 5.1541, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (9.4845 => 9.8759, std. dev.: 0.0156) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2081, std. dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.3121 => 0.3240, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.62% (0.7835 => 0.8119, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (4.2646 => 4.4166, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.4103 => 0.4249, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.38% (8.1363 => 8.4110, std. dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1861 => 1.2243, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (14.3668 => 14.8253, std. dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.18% (0.3935 => 0.4060, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.16% (1.5603 => 1.6096, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.14% (0.3826 => 0.3946, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.11% (5.7591 => 5.9380, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 3.10% (0.3422 => 0.3528, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.05% (0.3865 => 0.3983, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (1.5415 => 1.5880, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.3050 => 1.3439, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4636 => 0.4774, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.92% (2.0665 => 2.1269, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3684 => 0.3791, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.4064 => 0.4182, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.89% (0.3603 => 0.3707, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1978, std. dev.: 0.0062) MultiSource/Applications/d/make_dparser: 2.85% (3.3354 => 3.4306, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.75% (2.0273 => 2.0830, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4203 => 0.4317, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4299 => 0.4413, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6456 => 0.6618, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.48% (0.8067 => 0.8267, std. dev.: 0.0065) MultiSource/Applications/lua/lua: 2.41% (3.8723 => 3.9658, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.27% (1.2842 => 1.3134, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.9765 => 0.9986, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5981 => 0.6110, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6188, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.2024 => 2.2475, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.98% (1.4186 => 1.4467, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (0.6675 => 0.6800, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.86% (17.1811 => 17.5009, std. dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/football/football: 1.83% (0.8921 => 0.9084, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.47% (2.2969 => 2.3306, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.12% (1.0722 => 1.0842, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.54% (4.2280 => 4.4200, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7578, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8337, std. dev.: 0.0010) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.37% (2.2771 => 2.3084, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2320, std. dev.: 0.0412) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.06% (2.3135 => 2.3381, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1515, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6907, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7093, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0418, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.61% (2.9384 => 2.5385, std. dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: -10.14% (22.1758 => 19.9263, std. dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2373 => 1.1063, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -8.41% (1.5373 => 1.4080, std. dev.: 0.0212) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5687, std. dev.: 0.0892) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.59% (1.9577 => 1.8678, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4799, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4064, std. dev.: 0.0217) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9044, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0031, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2015, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4168, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.39% (1.8329 => 1.8074, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 05:48:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 07:48:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801124812.1CEEB3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2556?compare_to=2553&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2556, Order: 161107, Start Time: 2012-08-01 10:05:17, End Time: 2012-08-01 12:48:41 To: 2553, Order: 161100, Start Time: 2012-08-01 06:51:46, End Time: 2012-08-01 09:36:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (82 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (801 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.15% (0.2147 => 0.2279, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.07% (1.0033 => 0.9926, std. dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.96% (0.3446 => 0.3927, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.93% (0.3496 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.88% (0.3488 => 0.3972, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.83% (0.3442 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.37% (0.3650 => 0.4138, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.23% (0.5826 => 0.6247, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.5889 => 0.6304, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.04% (3.5627 => 3.7780, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.03% (0.4994 => 0.5295, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (0.5026 => 0.5327, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.85% (1.5932 => 1.6864, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (1.6211 => 1.7148, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.50% (1.3152 => 1.3876, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 5.49% (0.7171 => 0.7565, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.5900 => 0.6206, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.17% (0.3930 => 0.4133, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.5000 => 0.5250, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.89% (0.4029 => 0.4226, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 4.80% (1.0781 => 1.1299, std. dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (2.7292 => 2.8527, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.51% (4.2109 => 4.4007, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (1.9694 => 2.0466, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (1.9966 => 2.0746, std. dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 3.80% (5.5417 => 5.7522, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (0.3890 => 0.4035, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (2.1013 => 2.1793, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.70% (0.3004 => 0.3115, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.62% (0.2875 => 0.2979, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (0.4658 => 0.4825, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (0.3195 => 0.3308, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (4.4195 => 4.5742, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.46% (0.9909 => 1.0252, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (2.1653 => 2.2386, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 3.37% (4.6177 => 4.7732, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.3903 => 0.4033, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (2.0673 => 2.1351, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.10% (0.3258 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.3271 => 0.3372, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (1.8794 => 1.9360, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.95% (0.7875 => 0.8107, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 2.76% (0.3726 => 0.3829, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.73% (1.4269 => 1.4659, std. dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 2.71% (23.5202 => 24.1584, std. dev.: 0.0114) MultiSource/Applications/Burg/burg: 2.70% (0.5546 => 0.5696, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.53% (0.4146 => 0.4251, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.52% (0.6634 => 0.6801, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4251 => 0.4353, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.36% (0.9697 => 0.9926, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.08% (0.6435 => 0.6569, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.37% (2.0346 => 2.0625, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 14.90% (2.5769 => 2.9608, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6736, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6596, std. dev.: 0.0243) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1890, std. dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4933, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5913, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.29% (11.9555 => 11.8012, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5222, std. dev.: 0.0198) SingleSource/Benchmarks/Dhrystone/fldry: -7.89% (17.2379 => 15.8781, std. dev.: 0.1099) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: -4.01% (0.4438 => 0.4260, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7943, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -3.65% (14.0481 => 13.5356, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 06:55:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 08:55:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801135554.6EE8A3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2557?compare_to=2554&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2557, Order: 161110, Start Time: 2012-08-01 12:42:43, End Time: 2012-08-01 13:56:24 To: 2554, Order: 161107, Start Time: 2012-08-01 09:55:11, End Time: 2012-08-01 11:08:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.05% (1.3935 => 1.4081, std. dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.32% (2.0176 => 2.3066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.20% (0.3578 => 0.3943, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 10.11% (0.3601 => 0.3965, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.02% (0.3623 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.01% (0.3646 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.99% (0.5818 => 0.6399, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3650 => 0.4013, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3663 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.82% (0.3789 => 0.4161, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.78% (0.5748 => 0.6310, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.66% (0.3914 => 0.4292, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.52% (0.4003 => 0.4384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.44% (0.3940 => 0.4312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.88% (0.7061 => 0.7688, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.33% (1.3693 => 1.4697, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.7710 => 0.8260, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.08% (0.2782 => 0.2979, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.97% (3.9660 => 4.2424, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.41% (0.7038 => 0.7489, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.18% (0.3899 => 0.4140, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.17% (0.2966 => 0.3149, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.14% (0.3485 => 0.3699, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.12% (0.2760 => 0.2929, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.05% (1.9828 => 2.1028, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.02% (0.3022 => 0.3204, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.4379 => 0.4642, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.6959 => 0.7376, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.98% (0.3580 => 0.3794, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.3107 => 0.3289, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3192 => 0.3378, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3489 => 0.3690, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.2193 => 1.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.50% (0.3293 => 0.3474, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9199 => 0.9686, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.3534 => 0.3720, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.20% (0.5577 => 0.5867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.13% (13.8202 => 14.5293, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5708, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4244, std. dev.: 0.0181) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.66% (1.4563 => 1.5241, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.3813 => 1.4444, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (1.1364 => 1.1881, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (13.2842 => 13.8882, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.48% (1.3819 => 1.4438, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.42% (1.1061 => 1.1550, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.3245 => 1.3828, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (3.8646 => 4.0333, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.35% (1.0594 => 1.1055, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.30% (1.2292 => 1.2820, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.22% (1.9270 => 2.0084, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (4.3801 => 4.5615, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (3.6692 => 3.8210, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6217, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.81% (0.3755 => 0.3898, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (0.4791 => 0.4965, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1333 => 1.1737, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.45% (4.9865 => 5.1585, std. dev.: 0.0137) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.37% (0.8698 => 0.8991, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6135 => 0.6334, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4113 => 0.4246, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2887, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7544, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.5754 => 6.7660, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2702, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (3.2742 => 3.3629, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.70% (2.1007 => 2.1574, std. dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9131, std. dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6836, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5188 => 1.5564, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.19% (4.6629 => 4.7650, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6250 => 0.6354, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.37% (1.0313 => 1.0454, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.17% (6.2785 => 6.3522, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 1.11% (3.7467 => 3.7883, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.27% (1.8175 => 2.2767, std. dev.: 0.0464) SingleSource/Benchmarks/Misc/mandel-2: 8.33% (1.2998 => 1.4081, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7508, std. dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7064, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9567, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.33% (4.5928 => 4.6538, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.18% (10.7476 => 10.8744, std. dev.: 0.0357) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1392, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.10% (0.4657 => 0.4047, std. dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.5627 => 21.1525, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.65% (0.0997 => 0.0831, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.93% (20.3410 => 18.5251, std. dev.: 0.0776) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std. dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9460, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5950, std. dev.: 0.0263) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2351, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5134, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7689, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2428, std. dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2392, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 07:00:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 09:00:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801140056.8D5CF3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2558?compare_to=2555&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2558, Order: 161110, Start Time: 2012-08-01 12:42:50, End Time: 2012-08-01 14:01:26 To: 2555, Order: 161107, Start Time: 2012-08-01 10:00:40, End Time: 2012-08-01 11:19:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (92 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.07% (13.3044 => 13.9788, std. dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.84% (10.3673 => 13.9788, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 14.11% (0.3473 => 0.3963, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3497 => 0.3979, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 13.69% (0.3543 => 0.4028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.68% (0.3516 => 0.3997, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.63% (0.3543 => 0.4026, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 13.59% (0.3561 => 0.4045, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.26% (0.3694 => 0.4184, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3828 => 0.4325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.63% (0.3927 => 0.4423, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.32% (1.1194 => 1.2461, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/richards_benchmark: 9.62% (0.1622 => 0.1778, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.40% (2.2022 => 2.3872, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.34% (1.7609 => 1.8901, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.84% (0.7326 => 0.7754, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (7.0540 => 7.3992, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (10.4361 => 10.9207, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.37% (0.7433 => 0.7758, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.27% (0.8172 => 0.8521, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 4.27% (0.2554 => 0.2663, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8886, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1474, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (5.0018 => 5.2005, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5569 => 0.5785, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (4.2646 => 4.4258, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.57% (8.1363 => 8.4270, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5860 => 0.6068, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.53% (0.2891 => 0.2993, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.46% (0.7835 => 0.8106, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4636 => 0.4789, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1861 => 1.2234, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7949, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.96% (0.3650 => 0.3758, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.3050 => 1.3433, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.92% (1.5603 => 1.6059, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.88% (0.4103 => 0.4221, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.87% (5.7591 => 5.9243, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.80% (2.0273 => 2.0841, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 2.80% (3.3354 => 3.4288, std. dev.: 0.0096) MultiSource/Applications/Burg/burg: 2.79% (1.1642 => 1.1967, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (2.0665 => 2.1227, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5415 => 1.5829, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.4203 => 0.4312, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9710, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.8067 => 0.8269, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (0.4064 => 0.4164, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9765 => 0.9985, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.5105 => 0.5217, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.2024 => 2.2479, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3102, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4452, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.84% (17.1811 => 17.4980, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (0.6675 => 0.6796, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.78% (2.2969 => 2.3377, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 1.69% (0.8921 => 0.9072, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.47% (1.1840 => 1.2014, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (4.2280 => 4.4151, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5348, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2096, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8328, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2277, std. dev.: 0.0403) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.50% (0.8651 => 0.1687, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1499, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.49% (5.3855 => 3.6898, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.92% (5.3526 => 3.6975, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0620, std. dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5436, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -10.15% (22.1758 => 19.9259, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (3.8922 => 3.8500, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.23% (0.0998 => 0.0836, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.2373 => 1.1134, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -9.49% (1.5373 => 1.3914, std. dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.35% (19.9488 => 18.4832, std. dev.: 0.0692) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -4.84% (1.9577 => 1.8629, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4780, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8975, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4165, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0005, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2011, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3122, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2494, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 08:59:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 10:59:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801155949.5E4C03524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2559?compare_to=2556&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2559, Order: 161110, Start Time: 2012-08-01 13:16:52, End Time: 2012-08-01 16:00:19 To: 2556, Order: 161107, Start Time: 2012-08-01 10:05:17, End Time: 2012-08-01 12:48:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.54% (0.3442 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.47% (0.3792 => 0.4227, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.26% (0.5826 => 0.6249, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.01% (0.5889 => 0.6302, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (0.4994 => 0.5301, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (0.5026 => 0.5329, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.92% (3.5627 => 3.7735, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (1.6211 => 1.7155, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.70% (1.5932 => 1.6840, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.55% (0.7171 => 0.7569, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.51% (0.4029 => 0.4251, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.25% (0.5900 => 0.6210, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (1.3152 => 1.3830, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (0.5000 => 0.5257, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (0.3930 => 0.4128, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 4.81% (1.0781 => 1.1300, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.78% (4.2109 => 4.4123, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (2.7292 => 2.8571, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.21% (0.2566 => 0.2674, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 4.19% (0.3004 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.05% (0.2813 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (1.9694 => 2.0486, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.99% (0.9909 => 1.0304, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3267 => 0.3396, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.94% (2.1013 => 2.1840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2823 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2750 => 0.2857, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.89% (1.9966 => 2.0742, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.87% (5.5417 => 5.7560, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (0.4658 => 0.4838, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.80% (2.0673 => 2.1459, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.74% (0.3317 => 0.3441, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (0.3890 => 0.4035, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3726 => 0.3863, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (4.4195 => 4.5808, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2911 => 0.3017, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.62% (0.3477 => 0.3603, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3258 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.59% (0.3060 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (2.1653 => 2.2402, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 3.44% (4.6177 => 4.7766, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.3362 => 0.3477, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.3903 => 0.4035, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.35% (0.3348 => 0.3460, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.29% (0.9697 => 1.0016, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.29% (0.4139 => 0.4275, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.28% (0.3625 => 0.3744, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (1.8794 => 1.9393, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 3.15% (0.4251 => 0.4385, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3690 => 0.3803, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.03% (0.7875 => 0.8114, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.95% (0.6634 => 0.6830, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.93% (1.4269 => 1.4687, std. dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 2.90% (23.5202 => 24.2025, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.81% (0.3845 => 0.3953, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.55% (0.6435 => 0.6599, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.47% (0.5546 => 0.5683, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.51% (2.0346 => 2.0654, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9640, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1751, std. dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6362, std. dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2087, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4975, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.87% (2.4764 => 2.4053, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -1.16% (11.9555 => 11.8171, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5264, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary2: -9.41% (0.2402 => 0.2176, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -8.47% (17.2379 => 15.7784, std. dev.: 0.2549) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7871, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/moments: -4.06% (0.4438 => 0.4258, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7942, std. dev.: 0.0148) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5482, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5822, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 09:42:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 11:42:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801164202.5D7713524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2560?compare_to=2557&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2560, Order: 161112, Start Time: 2012-08-01 15:28:50, End Time: 2012-08-01 16:42:31 To: 2557, Order: 161110, Start Time: 2012-08-01 12:42:43, End Time: 2012-08-01 13:56:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.62% (3.8288 => 3.7667, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3047, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3578 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.16% (0.3601 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.09% (0.3646 => 0.4014, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.95% (0.3789 => 0.4166, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3623 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.92% (0.5818 => 0.6395, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.86% (0.3650 => 0.4010, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3663 => 0.4024, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5748 => 0.6307, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.56% (0.3914 => 0.4288, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.39% (0.4003 => 0.4379, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 9.37% (0.3940 => 0.4309, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.27% (1.3693 => 1.4688, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.25% (0.7710 => 0.8269, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.94% (0.2781 => 0.2974, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.87% (3.9660 => 4.2383, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 6.33% (0.2607 => 0.2772, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.33% (0.4062 => 0.4319, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (0.7038 => 0.7483, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.29% (0.2655 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2760 => 0.2932, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.13% (0.2726 => 0.2893, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.10% (1.9828 => 2.1038, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.06% (0.3580 => 0.3797, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3107 => 0.3291, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3192 => 0.3379, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.81% (0.3149 => 0.3332, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.54% (1.2193 => 1.2869, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3453 => 0.3643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.50% (0.3293 => 0.3474, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.38% (0.3534 => 0.3724, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9199 => 0.9683, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.24% (0.4390 => 0.4620, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.16% (0.5577 => 0.5865, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.14% (13.8202 => 14.5307, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.97% (16.6129 => 17.4393, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.90% (0.7506 => 0.7874, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (7.2180 => 7.5694, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (1.4563 => 1.5256, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (13.2842 => 13.8874, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4435, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.42% (1.1061 => 1.1550, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3819 => 1.4420, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.3245 => 1.3819, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (3.8646 => 4.0320, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0087, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.20% (3.6692 => 3.8232, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.3801 => 4.5611, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (4.4433 => 4.6200, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 3.51% (2.1791 => 2.2556, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.1333 => 1.1729, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.44% (0.4791 => 0.4956, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1523, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.6135 => 0.6327, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.12% (0.6283 => 0.6479, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.08% (3.1889 => 3.2872, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7507, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (6.5754 => 6.7656, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2661, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (3.2742 => 3.3628, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1556, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.54% (16.2614 => 16.6749, std. dev.: 0.0462) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.5298 => 14.8989, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5188 => 1.5549, std. dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 2.20% (4.6629 => 4.7654, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6250 => 0.6358, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3507, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2721, std. dev.: 0.0410) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7548, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7029, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9566, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.33% (4.5928 => 4.6541, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0310 => 1.0435, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1400, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.46% (0.4657 => 0.4030, std. dev.: 0.0170) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1232, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.15% (0.0997 => 0.0836, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.75% (1.2308 => 1.0985, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.66% (20.3410 => 18.5794, std. dev.: 0.0488) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.09% (1.3780 => 1.3217, std. dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6035, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2218, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7687, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3305 => 7.2284, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8651, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2469, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2217, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 09:47:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 11:47:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801164706.B6CB63524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2561?compare_to=2558&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2561, Order: 161112, Start Time: 2012-08-01 15:28:59, End Time: 2012-08-01 16:47:37 To: 2558, Order: 161110, Start Time: 2012-08-01 12:42:50, End Time: 2012-08-01 14:01:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (92 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (744 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.95% (1.3914 => 1.4464, std. dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 2.58% (0.5354 => 0.5492, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.39% (81.0705 => 79.9470, std. dev.: 0.3300) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.76% (10.3673 => 13.9707, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3543 => 0.4031, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.75% (0.3497 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.75% (0.3543 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.71% (0.3516 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.65% (0.3561 => 0.4047, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 13.21% (0.3694 => 0.4182, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3828 => 0.4322, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.66% (0.3886 => 0.4378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (1.1194 => 1.2437, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.68% (0.1622 => 0.1779, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.38% (0.3817 => 0.4175, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.43% (2.2022 => 2.3878, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.42% (1.7609 => 1.8915, std. dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: 7.14% (0.5925 => 0.6348, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.84% (0.7326 => 0.7754, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.86% (7.0540 => 7.3966, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (10.4361 => 10.9201, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.42% (4.9449 => 5.1637, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.8172 => 0.8528, std. dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.7433 => 0.7752, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.29% (9.4845 => 9.8912, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5569 => 0.5802, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (5.0018 => 5.2041, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (4.2646 => 4.4297, std. dev.: 0.0071) MultiSource/Applications/spiff/spiff: 3.77% (0.7835 => 0.8130, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.74% (0.2756 => 0.2859, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.54% (8.1363 => 8.4244, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.4636 => 0.4794, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.17% (0.4289 => 0.4425, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1861 => 1.2234, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.04% (0.3684 => 0.3796, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7989, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.3050 => 1.3441, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.98% (1.5603 => 1.6068, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.5415 => 1.5869, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.92% (5.7591 => 5.9270, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.89% (2.0273 => 2.0859, std. dev.: 0.0103) MultiSource/Applications/Burg/burg: 2.84% (1.1642 => 1.1973, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.82% (3.3354 => 3.4293, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (2.0665 => 2.1240, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.62% (0.4203 => 0.4313, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.51% (3.8723 => 3.9695, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6212, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9765 => 0.9980, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5105 => 0.5213, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.4186 => 1.4479, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (2.2024 => 2.2477, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.04% (1.2842 => 1.3104, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8921 => 0.9093, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.80% (17.1811 => 17.4910, std. dev.: 0.0055) MultiSource/Applications/siod/siod: 1.59% (2.2969 => 2.3335, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.36% (1.1840 => 1.2001, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.05% (1.0722 => 1.0835, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.4001, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2162, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5086 => 1.5332, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8327, std. dev.: 0.0014) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2040, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2318, std. dev.: 0.0310) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1470, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6906, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6955, std. dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0940, std. dev.: 0.0479) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.55% (2.9384 => 2.5403, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.09% (22.1758 => 19.9393, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (3.8922 => 3.8501, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2373 => 1.1119, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.88% (19.9488 => 18.5770, std. dev.: 0.0393) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.91% (1.5373 => 1.4464, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -4.44% (1.9577 => 1.8708, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4767, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (8.1563 => 7.8994, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4195, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9994, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4808 => 0.4702, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2003, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3272, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8096, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 11:23:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 13:23:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801182349.074073524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2562?compare_to=2560&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2562, Order: 161115, Start Time: 2012-08-01 17:10:32, End Time: 2012-08-01 18:24:18 To: 2560, Order: 161112, Start Time: 2012-08-01 15:28:50, End Time: 2012-08-01 16:42:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.09% (1.0985 => 1.1105, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3048, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3578 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.29% (0.3646 => 0.4021, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.25% (0.3601 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.19% (0.5818 => 0.6411, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3623 => 0.3989, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.03% (0.3650 => 0.4016, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.02% (0.3663 => 0.4030, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.92% (0.5748 => 0.6318, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.90% (0.3789 => 0.4164, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.68% (0.3914 => 0.4293, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.52% (0.4003 => 0.4384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.52% (0.3940 => 0.4315, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 9.38% (0.7061 => 0.7723, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.7710 => 0.8274, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.24% (1.3693 => 1.4685, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2781 => 0.2981, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4328 => 0.4637, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.12% (0.2782 => 0.2980, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2388, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2760 => 0.2937, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.7038 => 0.7488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.37% (0.2966 => 0.3155, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.26% (1.9828 => 2.1069, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.3022 => 0.3211, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.20% (0.3580 => 0.3802, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.11% (0.3485 => 0.3698, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.10% (0.3149 => 0.3341, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.3107 => 0.3296, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.96% (0.3489 => 0.3697, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.62% (0.3453 => 0.3647, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (1.2193 => 1.2864, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.33% (0.4016 => 0.4230, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9199 => 0.9674, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.08% (13.8202 => 14.5221, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/moments: 5.07% (0.3868 => 0.4064, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.04% (16.6129 => 17.4494, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (7.2180 => 7.5666, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.61% (1.4563 => 1.5235, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.53% (1.1364 => 1.1879, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (1.3813 => 1.4438, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (13.2842 => 13.8831, std. dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.2292 => 1.2842, std. dev.: 0.0064) MultiSource/Applications/Burg/burg: 4.44% (1.1061 => 1.1552, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.3819 => 1.4430, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 4.40% (3.8646 => 4.0345, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8310 => 0.8671, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0094, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3802, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.0594 => 1.1036, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.13% (0.3755 => 0.3910, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.3801 => 4.5575, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6174, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (3.6692 => 3.8129, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.57% (0.4791 => 0.4962, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2546, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.43% (4.9865 => 5.1576, std. dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.09% (3.1889 => 3.2873, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.98% (0.6135 => 0.6318, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.97% (8.4961 => 8.7483, std. dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7597, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2457, std. dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9047, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.54% (3.2742 => 3.3574, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6549, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5526, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.05% (4.6629 => 4.7586, std. dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.9108 => 0.9254, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.26% (1.0313 => 1.0443, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (6.2785 => 6.3448, std. dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5133, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 25.53% (1.8175 => 2.2815, std. dev.: 0.0379) SingleSource/Benchmarks/Misc/mandel-2: 8.24% (1.2998 => 1.4069, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7535, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7017, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9555, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.29% (4.5928 => 4.6521, std. dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.04% (10.7476 => 10.8589, std. dev.: 0.0183) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1280, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.64% (20.3410 => 18.5826, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3070, std. dev.: 0.0160) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5844, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9460, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2227, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.05% (6.6320 => 6.4961, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7680, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2472, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2223, std. dev.: 0.0312) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 11:33:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 13:33:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801183353.329FA3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2563?compare_to=2561&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2563, Order: 161115, Start Time: 2012-08-01 17:15:48, End Time: 2012-08-01 18:34:20 To: 2561, Order: 161112, Start Time: 2012-08-01 15:28:59, End Time: 2012-08-01 16:47:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (94 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.67% (10.3673 => 14.0651, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.70% (0.3561 => 0.4049, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3497 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.60% (0.3543 => 0.4025, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions-3: 13.59% (0.3516 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.58% (0.3543 => 0.4024, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 13.35% (0.3694 => 0.4187, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.77% (0.3828 => 0.4317, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.58% (0.3886 => 0.4375, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.45% (0.3927 => 0.4416, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.22% (1.1194 => 1.2450, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.34% (2.2022 => 2.4079, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.30% (1.7609 => 1.9070, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.19% (0.1892 => 0.2028, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5925 => 0.6337, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7326 => 0.7777, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.84% (0.4879 => 0.5164, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4615 => 0.4871, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.45% (0.3282 => 0.3461, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.31% (10.4361 => 10.9906, std. dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.26% (7.0540 => 7.4250, std. dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 4.53% (9.4845 => 9.9138, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.46% (4.9449 => 5.1655, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.8172 => 0.8531, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.33% (5.0018 => 5.2185, std. dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.01% (4.2646 => 4.4354, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.83% (0.3109 => 0.3228, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.81% (0.2758 => 0.2863, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.77% (0.7835 => 0.8130, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.71% (0.3423 => 0.3550, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.69% (8.1363 => 8.4365, std. dev.: 0.0105) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3180 => 0.3294, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.54% (1.1642 => 1.2054, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.50% (1.1861 => 1.2276, std. dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.3050 => 1.3480, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (14.3668 => 14.8304, std. dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9447, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.5105 => 0.5269, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.21% (0.3650 => 0.3767, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4636 => 0.4783, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4299 => 0.4435, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.13% (0.3422 => 0.3529, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.11% (1.5415 => 1.5895, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.09% (3.3354 => 3.4384, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.06% (1.5603 => 1.6081, std. dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 3.04% (0.3387 => 0.3490, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.03% (0.3826 => 0.3942, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.92% (0.3865 => 0.3978, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.4289 => 0.4412, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0852, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (2.0665 => 2.1245, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.81% (2.2024 => 2.2642, std. dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.70% (3.8723 => 3.9769, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.57% (0.4203 => 0.4311, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6456 => 0.6618, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9765 => 1.0010, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.34% (0.6675 => 0.6831, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.4186 => 1.4510, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6213, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (0.4620 => 0.4723, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.12% (17.1811 => 17.5451, std. dev.: 0.0206) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3111, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8921 => 0.9096, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.83% (0.7115 => 0.7245, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.76% (2.2969 => 2.3374, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 1.70% (1.1840 => 1.2041, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.00% (4.2280 => 4.3971, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2125, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.65% (11.6436 => 11.8359, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.65% (9.1159 => 9.2660, std. dev.: 0.0289) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.45% (0.8651 => 0.1691, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1616, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6991, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.78% (5.3526 => 3.7051, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0644, std. dev.: 0.0514) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5464, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -9.95% (22.1758 => 19.9702, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2373 => 1.1158, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -6.83% (1.5373 => 1.4323, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.70% (19.9488 => 18.6121, std. dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.85% (1.9577 => 1.8628, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4770, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4097, std. dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9185, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0014, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2010, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3144, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2494, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 12:12:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 14:12:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801191212.EFF013524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2564?compare_to=2559&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2564, Order: 161114, Start Time: 2012-08-01 16:28:59, End Time: 2012-08-01 19:12:42 To: 2559, Order: 161110, Start Time: 2012-08-01 13:16:52, End Time: 2012-08-01 16:00:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.54% (54.0436 => 54.8748, std. dev.: 0.0718) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.45% (0.3488 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.32% (0.3469 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.21% (0.5826 => 0.6246, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5889 => 0.6300, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.26% (0.7171 => 0.7620, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.00% (1.6211 => 1.7184, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.95% (3.5627 => 3.7746, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.81% (0.4994 => 0.5284, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.73% (0.5026 => 0.5314, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.65% (1.5932 => 1.6832, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.5900 => 0.6228, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.53% (0.4029 => 0.4252, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (1.3152 => 1.3877, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (0.4361 => 0.4600, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (0.5000 => 0.5264, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.94% (1.0781 => 1.1314, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (2.7292 => 2.8583, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 4.69% (4.2109 => 4.4082, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2792 => 0.2915, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.31% (0.2736 => 0.2854, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.23% (0.3004 => 0.3131, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (1.9694 => 2.0491, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.03% (0.9909 => 1.0308, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.97% (0.3195 => 0.3322, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (0.3890 => 0.4042, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.89% (5.5417 => 5.7574, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (1.9966 => 2.0738, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2750 => 0.2856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.85% (2.0673 => 2.1469, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.81% (0.3726 => 0.3868, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (2.1013 => 2.1812, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (0.4658 => 0.4832, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 3.72% (0.2823 => 0.2928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.68% (0.2911 => 0.3018, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.65% (0.3096 => 0.3209, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.64% (2.1653 => 2.2441, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (4.4195 => 4.5761, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3267 => 0.3382, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.46% (0.3060 => 0.3166, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.3903 => 0.4038, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.42% (4.6177 => 4.7755, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 3.41% (0.3348 => 0.3462, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.39% (0.7875 => 0.8142, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.4139 => 0.4277, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.32% (0.3678 => 0.3800, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3477 => 0.3592, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.30% (0.9697 => 1.0017, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (1.8794 => 1.9409, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (0.3625 => 0.3741, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.3981 => 0.4108, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 2.99% (23.5202 => 24.2237, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.82% (1.4269 => 1.4671, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.76% (0.6634 => 0.6817, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.69% (0.5546 => 0.5695, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.5012 => 0.5131, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.56% (2.0346 => 2.0664, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.04% (0.2162 => 0.3525, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.06% (0.5917 => 0.6690, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.25% (12.0509 => 12.6840, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1661, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6550, std. dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1983, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4981, std. dev.: 0.0218) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5912, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.79% (2.4764 => 2.4073, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: -1.20% (11.9555 => 11.8126, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5343, std. dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/fldry: -9.25% (17.2379 => 15.6436, std. dev.: 0.3482) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8054, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/moments: -3.88% (0.4438 => 0.4266, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7917, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5486, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 13:06:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 15:06:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801200602.2500D3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2565?compare_to=2562&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2565, Order: 161121, Start Time: 2012-08-01 18:52:43, End Time: 2012-08-01 20:06:30 To: 2562, Order: 161115, Start Time: 2012-08-01 17:10:32, End Time: 2012-08-01 18:24:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.31% (2.0176 => 2.3063, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.17% (0.3578 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.11% (0.3601 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.10% (0.3663 => 0.4033, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 10.00% (0.5818 => 0.6400, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.98% (0.3646 => 0.4010, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3623 => 0.3983, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.92% (0.3650 => 0.4012, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.88% (0.5748 => 0.6316, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.79% (0.3789 => 0.4160, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 9.68% (0.3914 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.4003 => 0.4382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7061 => 0.7724, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.60% (0.7710 => 0.8296, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.13% (1.3693 => 1.4669, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.98% (0.2781 => 0.2975, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2387, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.2966 => 0.3157, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.33% (0.2765 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.27% (0.2761 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.2937 => 0.3120, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.20% (0.2726 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.14% (1.9828 => 2.1045, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3580 => 0.3798, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3149 => 0.3337, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3192 => 0.3381, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.85% (0.4390 => 0.4647, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.71% (0.3453 => 0.3650, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (1.2193 => 1.2876, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 5.59% (0.3293 => 0.3477, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.55% (0.3534 => 0.3730, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9199 => 0.9703, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.40% (0.4016 => 0.4233, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.27% (0.5577 => 0.5871, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.3756 => 0.3952, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5266, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.00% (16.6129 => 17.4438, std. dev.: 0.0131) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.4563 => 1.5275, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.86% (7.2180 => 7.5685, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.73% (0.7506 => 0.7861, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.61% (1.1364 => 1.1888, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (13.2842 => 13.8813, std. dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 4.46% (1.2292 => 1.2840, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.3245 => 1.3825, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (3.8646 => 4.0333, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 4.35% (1.9270 => 2.0108, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8310 => 0.8671, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.33% (1.1061 => 1.1540, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.31% (1.0594 => 1.1051, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.21% (1.3819 => 1.4401, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.3801 => 4.5623, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.05% (0.3755 => 0.3907, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (3.6692 => 3.8156, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6193, std. dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.65% (4.9865 => 5.1687, std. dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.60% (1.1333 => 1.1741, std. dev.: 0.0093) MultiSource/Applications/siod/siod: 3.51% (2.1791 => 2.2555, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.44% (0.4791 => 0.4956, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.22% (0.8698 => 0.8978, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2884, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6283 => 0.6476, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7491, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7559, std. dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9174, std. dev.: 0.0139) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2448, std. dev.: 0.0166) MultiSource/Applications/sqlite3/sqlite3: 2.61% (16.2614 => 16.6860, std. dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.61% (3.2742 => 3.3595, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.1007 => 2.1536, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5188 => 1.5531, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.13% (4.6629 => 4.7620, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.9108 => 0.9256, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.41% (1.0313 => 1.0458, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (6.2785 => 6.3464, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7868, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5124, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel-2: 7.61% (1.2998 => 1.3987, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.24% (0.9996 => 1.0520, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7545, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7055, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.36% (4.5928 => 4.6551, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/fldry: 1.04% (1.9290 => 1.9491, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.46% (0.4657 => 0.4170, std. dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1226, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.65% (0.0997 => 0.0831, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2308 => 1.1073, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.74% (20.3410 => 18.5636, std. dev.: 0.0340) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5903, std. dev.: 0.0084) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9473, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2267, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7684, std. dev.: 0.0256) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2323, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2386, std. dev.: 0.0128) MultiSource/Applications/lua/lua: -1.03% (26.5159 => 26.2429, std. dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 13:20:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 15:20:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801202044.35E3E3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2566?compare_to=2563&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2566, Order: 161121, Start Time: 2012-08-01 19:02:46, End Time: 2012-08-01 20:21:13 To: 2563, Order: 161115, Start Time: 2012-08-01 17:15:48, End Time: 2012-08-01 18:34:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (84 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.46% (10.3673 => 14.0435, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 13.62% (0.3473 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.33% (0.3497 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.24% (0.3543 => 0.4012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.24% (0.3543 => 0.4012, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.11% (0.3561 => 0.4028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.80% (0.3694 => 0.4167, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3828 => 0.4306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.25% (0.3886 => 0.4362, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.37% (0.1622 => 0.1774, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.82% (2.2022 => 2.3965, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.80% (1.7609 => 1.8983, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5925 => 0.6345, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.10% (0.7326 => 0.7773, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.3282 => 0.3452, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.4879 => 0.5128, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (7.0540 => 7.4036, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (10.4361 => 10.9211, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.64% (0.2758 => 0.2886, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.12% (9.4845 => 9.8752, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1474, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1958, std. dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 3.83% (0.3109 => 0.3228, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4180, std. dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.5860 => 0.6062, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.40% (0.7835 => 0.8101, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (8.1363 => 8.4089, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1861 => 1.2224, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.4636 => 0.4777, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.96% (5.7591 => 5.9297, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (1.3050 => 1.3427, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7661, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4289 => 0.4404, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.62% (1.1642 => 1.1947, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.61% (0.3865 => 0.3966, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.8067 => 0.8271, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4193, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.51% (2.0273 => 2.0782, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.5415 => 1.5800, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (2.0665 => 2.1167, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.27% (3.8723 => 3.9601, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6456 => 0.6601, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.5105 => 0.5218, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9765 => 0.9958, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.95% (0.6450 => 0.6576, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.2024 => 2.2436, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.4186 => 1.4442, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5981 => 0.6088, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.69% (1.2842 => 1.3059, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 1.55% (0.8921 => 0.9059, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.50% (0.7115 => 0.7222, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.50% (2.2969 => 2.3313, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.39% (17.1811 => 17.4196, std. dev.: 0.0156) MultiSource/Benchmarks/nbench/nbench: 1.32% (1.1840 => 1.1996, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9734, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (4.2280 => 4.3968, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7565, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2113, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8322, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.20% (1.3045 => 1.3201, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1603, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6992, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7065, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0796, std. dev.: 0.0278) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5541, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.31% (22.1758 => 19.8902, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (3.8922 => 3.8494, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.13% (0.0998 => 0.0837, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2373 => 1.1076, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -6.97% (1.5373 => 1.4301, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.89% (19.9488 => 18.5737, std. dev.: 0.0713) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7609, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -4.60% (1.9577 => 1.8676, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4741, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4140, std. dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9099, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.43% (0.4808 => 0.4691, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -2.17% (12.4730 => 12.2019, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3240, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4183, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8093, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2495, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 14:47:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 16:47:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801214744.6C93C3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2567?compare_to=2565&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2567, Order: 161124, Start Time: 2012-08-01 20:34:31, End Time: 2012-08-01 21:48:11 To: 2565, Order: 161121, Start Time: 2012-08-01 18:52:43, End Time: 2012-08-01 20:06:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.31% (2.0176 => 2.3063, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.23% (0.3578 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.06% (0.5818 => 0.6403, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.03% (0.3650 => 0.4016, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.02% (0.3601 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.98% (0.3646 => 0.4010, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3663 => 0.4026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.88% (0.3623 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.85% (0.5748 => 0.6314, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3789 => 0.4159, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.71% (0.3914 => 0.4294, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.49% (0.4003 => 0.4383, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.37% (0.3940 => 0.4309, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7061 => 0.7698, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.34% (0.2781 => 0.2985, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.30% (0.7710 => 0.8273, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 7.14% (1.3693 => 1.4671, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.12% (0.2782 => 0.2980, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4328 => 0.4628, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2375, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (0.7038 => 0.7492, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.38% (0.2760 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.25% (1.9828 => 2.1068, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2696 => 0.2863, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.19% (0.3022 => 0.3209, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.16% (0.3899 => 0.4139, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.02% (0.2988 => 0.3168, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3149 => 0.3335, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.90% (0.4390 => 0.4649, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.85% (0.3489 => 0.3693, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.80% (0.3534 => 0.3739, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.65% (0.3293 => 0.3479, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.59% (0.6959 => 0.7348, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (1.2193 => 1.2864, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.44% (0.9199 => 0.9699, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.27% (0.5577 => 0.5871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.25% (0.4016 => 0.4227, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.17% (13.8202 => 14.5345, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.08% (0.2127 => 0.2235, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.99% (16.6129 => 17.4419, std. dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (7.2180 => 7.5669, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.77% (1.4563 => 1.5258, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.59% (1.1364 => 1.1886, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (13.2842 => 13.8812, std. dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.43% (1.3245 => 1.3832, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2292 => 1.2836, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.33% (0.8310 => 0.8670, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.28% (3.8646 => 4.0299, std. dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 4.28% (1.0594 => 1.1047, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.25% (1.1061 => 1.1531, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.3819 => 1.4396, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.17% (1.3813 => 1.4389, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 4.14% (1.9270 => 2.0068, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.13% (0.3755 => 0.3910, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.3801 => 4.5552, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6193, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.94% (3.6692 => 3.8139, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (4.9865 => 5.1664, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.52% (2.1791 => 2.2558, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.48% (1.1333 => 1.1727, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8698 => 0.8985, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.15% (0.6283 => 0.6481, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2876, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.03% (8.4961 => 8.7536, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (6.5754 => 6.7633, std. dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.5298 => 14.9114, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1556, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2408, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (3.2742 => 3.3593, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6733, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.5188 => 1.5559, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.13% (4.6629 => 4.7621, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.35% (1.0313 => 1.0452, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.2785 => 6.3469, std. dev.: 0.0122) MultiSource/Applications/lua/lua: 1.06% (3.7467 => 3.7863, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5182, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2720, std. dev.: 0.0440) SingleSource/Benchmarks/Misc/mandel-2: 7.34% (1.2998 => 1.3952, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7521, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7048, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8146, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5952, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9574, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.25% (4.5928 => 4.6504, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.20% (1.0310 => 1.0434, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1387, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.5627 => 21.1254, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2308 => 1.1075, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5287, std. dev.: 0.0228) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.8259 => 8.5604, std. dev.: 0.0242) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0103) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2288, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5015, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7670, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2168, std. dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.13% (7.3305 => 7.2476, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 15:07:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 17:07:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801220716.DAB2D3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2568?compare_to=2566&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2568, Order: 161124, Start Time: 2012-08-01 20:49:13, End Time: 2012-08-01 22:07:46 To: 2566, Order: 161121, Start Time: 2012-08-01 19:02:46, End Time: 2012-08-01 20:21:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (89 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (748 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.36% (78.2610 => 80.8930, std. dev.: 0.3901) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.31% (10.3673 => 14.0284, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/trivial-interface: 13.73% (0.3473 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.47% (0.3497 => 0.3968, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 13.41% (0.3543 => 0.4018, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.29% (0.3543 => 0.4014, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3561 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.89% (0.3694 => 0.4170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.43% (0.3828 => 0.4304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.25% (0.3927 => 0.4408, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.22% (0.3886 => 0.4361, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2501, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 9.49% (0.1622 => 0.1776, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.21% (2.2022 => 2.4051, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.43% (1.7609 => 1.9094, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.00% (0.5925 => 0.6340, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.92% (0.6030 => 0.6447, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.17% (0.7326 => 0.7778, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.4879 => 0.5136, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.13% (7.0540 => 7.4156, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (10.4361 => 10.9214, std. dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (9.4845 => 9.8857, std. dev.: 0.0094) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.9449 => 5.1493, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.0018 => 5.1985, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4182, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5860 => 0.6068, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (8.1363 => 8.4094, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.22% (0.7835 => 0.8087, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2221, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.00% (0.4636 => 0.4775, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.96% (5.7591 => 5.9293, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (1.3050 => 1.3427, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (14.3668 => 14.7754, std. dev.: 0.0127) MultiSource/Applications/Burg/burg: 2.78% (1.1642 => 1.1966, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.74% (1.5603 => 1.6031, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.4289 => 0.4398, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.8067 => 0.8272, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.54% (3.3354 => 3.4201, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.54% (2.0665 => 2.1189, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.54% (2.0273 => 2.0787, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 2.42% (0.4299 => 0.4403, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.5415 => 1.5781, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9597, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.5105 => 0.5218, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9765 => 0.9967, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2460, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.95% (0.6675 => 0.6805, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4462, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5981 => 0.6088, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2842 => 1.3066, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 1.56% (0.8921 => 0.9060, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4352, std. dev.: 0.0079) MultiSource/Applications/siod/siod: 1.45% (2.2969 => 2.3303, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.41% (0.7115 => 0.7215, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.35% (1.1840 => 1.2000, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (4.2280 => 4.3797, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7497, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2157, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5086 => 1.5338, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8313, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2224, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.17% (5.2763 => 3.1570, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.01% (5.3855 => 3.7155, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7216, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0553, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5476, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -10.29% (22.1758 => 19.8935, std. dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2373 => 1.1114, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.03% (19.9488 => 18.5456, std. dev.: 0.0495) SingleSource/Benchmarks/Misc/mandel-2: -6.91% (1.5373 => 1.4311, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.62% (1.9577 => 1.8673, std. dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.32% (1.5835 => 1.5151, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4839, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9019, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4173, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0035, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2014, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3149, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4182, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8099, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2495, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 15:24:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 17:24:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801222404.1D7CD3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2569?compare_to=2564&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2569, Order: 161124, Start Time: 2012-08-01 19:40:53, End Time: 2012-08-01 22:24:33 To: 2564, Order: 161114, Start Time: 2012-08-01 16:28:59, End Time: 2012-08-01 19:12:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.57% (0.3442 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.56% (0.3465 => 0.3935, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.53% (0.3496 => 0.3969, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.47% (0.3488 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3469 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.99% (0.3650 => 0.4124, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3724 => 0.4199, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5826 => 0.6256, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.5889 => 0.6298, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7157, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.78% (3.5627 => 3.7686, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.77% (0.5026 => 0.5316, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.61% (1.5932 => 1.6825, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.56% (0.7171 => 0.7570, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.21% (1.3152 => 1.3837, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.5900 => 0.6207, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.08% (0.5000 => 0.5254, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.95% (1.0781 => 1.1315, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.91% (0.4029 => 0.4227, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.57% (4.2109 => 4.4035, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.51% (2.7292 => 2.8524, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2792 => 0.2910, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 4.19% (0.3004 => 0.3130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.08% (0.9909 => 1.0313, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (1.9694 => 2.0494, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.94% (0.2738 => 0.2846, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2750 => 0.2858, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (1.9966 => 2.0750, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2780 => 0.2889, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.87% (2.0673 => 2.1474, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.82% (0.3060 => 0.3177, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.3096 => 0.3214, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.78% (0.3890 => 0.4037, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.77% (0.2729 => 0.2832, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.75% (0.2823 => 0.2929, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.71% (5.5417 => 5.7471, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.70% (0.2813 => 0.2917, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (2.1013 => 2.1775, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.61% (0.3267 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.61% (0.3271 => 0.3389, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 3.59% (0.9697 => 1.0045, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (4.4195 => 4.5776, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3258 => 0.3374, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.54% (0.3726 => 0.3858, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.3362 => 0.3477, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.42% (2.1653 => 2.2393, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.3903 => 0.4035, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.34% (0.3678 => 0.3801, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.32% (0.3348 => 0.3459, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.31% (0.3625 => 0.3745, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.31% (4.6177 => 4.7705, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (0.4139 => 0.4274, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (1.8794 => 1.9402, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.3981 => 0.4104, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.00% (0.7875 => 0.8111, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3690 => 0.3799, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.3845 => 0.3958, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.79% (23.5202 => 24.1772, std. dev.: 0.0196) MultiSource/Applications/lua/lua: 2.76% (1.4269 => 1.4663, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 2.56% (0.5546 => 0.5688, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.55% (0.5012 => 0.5140, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.52% (0.6634 => 0.6801, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.6435 => 0.6590, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.41% (2.0346 => 2.0632, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1639, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.58% (1.8057 => 1.8884, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6500, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2094, std. dev.: 0.0504) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4978, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2208, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.25% (1.0927 => 1.1064, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.83% (2.4764 => 2.4063, std. dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: -1.11% (11.9555 => 11.8224, std. dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5139, std. dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/fldry: -8.09% (17.2379 => 15.8440, std. dev.: 0.1145) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8073, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -6.20% (0.2402 => 0.2253, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8025, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5407, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 16:29:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 18:29:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801232936.963DC3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2570?compare_to=2567&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2570, Order: 161135, Start Time: 2012-08-01 22:16:24, End Time: 2012-08-01 23:30:06 To: 2567, Order: 161124, Start Time: 2012-08-01 20:34:31, End Time: 2012-08-01 21:48:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.71% (0.5489 => 0.5340, std. dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.21% (2.0176 => 2.3044, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.14% (0.5818 => 0.6408, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.09% (0.3578 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.02% (0.5748 => 0.6324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.91% (0.3601 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3646 => 0.4003, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.77% (0.3623 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.73% (0.3650 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.72% (0.3663 => 0.4019, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3789 => 0.4156, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.58% (0.3914 => 0.4289, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.29% (0.4003 => 0.4375, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.24% (0.3940 => 0.4304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.96% (0.7061 => 0.7694, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4659, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.7710 => 0.8251, std. dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.2781 => 0.2969, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.75% (3.9660 => 4.2337, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.46% (0.7038 => 0.7493, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.30% (0.4379 => 0.4655, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.2721 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2760 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.93% (1.9828 => 2.1004, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.3149 => 0.3324, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.2988 => 0.3152, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.6959 => 0.7340, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.40% (1.2193 => 1.2852, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.5577 => 0.5864, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.94% (13.8202 => 14.5033, std. dev.: 0.0153) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.91% (16.6129 => 17.4294, std. dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3868 => 0.4057, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.80% (0.7506 => 0.7866, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.4563 => 1.5244, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.61% (7.2180 => 7.5504, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (13.2842 => 13.8764, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.33% (1.1364 => 1.1856, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8310 => 0.8668, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2292 => 1.2808, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.19% (1.1061 => 1.1525, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.17% (1.9270 => 2.0074, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (1.3245 => 1.3796, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.14% (3.8646 => 4.0245, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3813 => 1.4375, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.0594 => 1.1025, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.92% (1.3819 => 1.4361, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.3801 => 4.5478, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (4.4433 => 4.6109, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.72% (3.6692 => 3.8057, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.39% (2.1791 => 2.2530, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.35% (4.9865 => 5.1533, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1712, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4791 => 0.4949, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8698 => 0.8963, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.93% (0.6135 => 0.6315, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6283 => 0.6466, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2794, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.4961 => 8.7360, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1007 => 2.1557, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (3.2742 => 3.3579, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.52% (6.5754 => 6.7409, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6670, std. dev.: 0.0253) MultiSource/Applications/ClamAV/clamscan: 2.47% (14.5298 => 14.8893, std. dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 2.47% (14.8535 => 15.2208, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5188 => 1.5533, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.83% (4.6629 => 4.7483, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 1.60% (0.6250 => 0.6350, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.50% (0.9108 => 0.9245, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.13% (1.0313 => 1.0430, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.40% (0.9996 => 1.0536, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 4.46% (7.4271 => 7.7584, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7060, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.7688 => 1.8143, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9585, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5111, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.5928 => 4.6562, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.16% (1.0310 => 1.0430, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1404, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 1.03% (10.7476 => 10.8578, std. dev.: 0.0184) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.69% (0.4657 => 0.4159, std. dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.56% (22.5627 => 21.0820, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2308 => 1.1084, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.52% (20.3410 => 18.4052, std. dev.: 0.1197) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.8259 => 8.5633, std. dev.: 0.0179) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9184, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2277, std. dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -2.00% (0.5449 => 0.5340, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7687, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2361, std. dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8711, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2272, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8467, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 16:53:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 18:53:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801235349.768723524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2571?compare_to=2568&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2571, Order: 161135, Start Time: 2012-08-01 22:35:53, End Time: 2012-08-01 23:54:19 To: 2568, Order: 161124, Start Time: 2012-08-01 20:49:13, End Time: 2012-08-01 22:07:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 3 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (749 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.04% (10.9214 => 11.0348, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.98% (19.8935 => 19.4987, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.28% (2.4051 => 2.3743, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (14.0284 => 13.8494, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.59% (10.3673 => 13.8494, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 13.88% (0.3473 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.74% (0.3516 => 0.3999, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.72% (0.3543 => 0.4029, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3497 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.52% (0.3543 => 0.4022, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.48% (0.3561 => 0.4041, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.18% (0.3694 => 0.4181, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.88% (0.3828 => 0.4321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.50% (1.1194 => 1.2481, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.81% (2.2022 => 2.3743, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.72% (1.7609 => 1.8969, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5925 => 0.6337, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.90% (0.6030 => 0.6446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7326 => 0.7769, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (10.4361 => 11.0348, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (7.0540 => 7.3838, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: 4.66% (0.3282 => 0.3435, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (0.7433 => 0.7766, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.2554 => 0.2667, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.8172 => 0.8531, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8883, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1474, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.0018 => 5.2054, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.80% (4.2646 => 4.4268, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 3.77% (0.3423 => 0.3552, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.74% (0.3180 => 0.3299, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.64% (0.7835 => 0.8120, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (8.1363 => 8.4277, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.37% (1.1861 => 1.2261, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.4636 => 0.4779, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4299 => 0.4429, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3438, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7809, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.84% (5.7591 => 5.9229, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.84% (1.5603 => 1.6046, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.79% (2.0273 => 2.0838, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.78% (0.8067 => 0.8291, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.64% (3.3354 => 3.4235, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.5415 => 1.5814, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.59% (0.5105 => 0.5237, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.56% (3.8723 => 3.9714, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9765 => 0.9996, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1153, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6456 => 0.6604, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.2024 => 2.2521, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.25% (1.5859 => 1.6216, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6675 => 0.6816, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.4186 => 1.4485, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.85% (0.8921 => 0.9086, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.77% (1.2842 => 1.3069, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.75% (2.2969 => 2.3370, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4346, std. dev.: 0.0127) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.01% (1.0722 => 1.0830, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (4.2280 => 4.4098, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7458, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2125, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8324, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2512, std. dev.: 0.0295) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (1.5086 => 1.5305, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2032, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1416, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7073, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7036, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0211, std. dev.: 0.0286) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.53% (2.9384 => 2.5407, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -12.07% (22.1758 => 19.4987, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2373 => 1.1004, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/mandel-2: -8.42% (1.5373 => 1.4078, std. dev.: 0.0170) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5729, std. dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.15% (1.9577 => 1.8569, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4790, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4096, std. dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9029, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9982, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3315, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3112, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2497, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 18:11:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 20:11:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802011119.103F23524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2572?compare_to=2570&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2572, Order: 161141, Start Time: 2012-08-01 23:58:07, End Time: 2012-08-02 01:11:47 To: 2570, Order: 161135, Start Time: 2012-08-01 22:16:24, End Time: 2012-08-01 23:30:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.87% (2.0176 => 2.3177, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.21% (0.5818 => 0.6412, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.11% (0.7061 => 0.7775, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.00% (0.5748 => 0.6323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3601 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.49% (0.3623 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.46% (0.3646 => 0.3991, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.42% (0.3650 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3663 => 0.4005, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.26% (0.3789 => 0.4140, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3914 => 0.4276, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.11% (0.3940 => 0.4299, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.26% (1.3693 => 1.4687, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.20% (0.7710 => 0.8265, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4328 => 0.4639, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.97% (0.4062 => 0.4345, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2389, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.83% (0.2782 => 0.2972, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2607 => 0.2774, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.23% (0.2761 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.11% (0.3485 => 0.3698, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.07% (0.2966 => 0.3146, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (1.9828 => 2.1015, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.90% (0.3489 => 0.3695, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.3107 => 0.3290, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.78% (0.3149 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.6959 => 0.7359, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: 5.69% (0.2988 => 0.3158, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4379 => 0.4627, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.58% (0.4390 => 0.4635, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.3192 => 0.3367, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (1.2193 => 1.2855, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.42% (0.3453 => 0.3640, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.25% (0.4016 => 0.4227, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.25% (16.6129 => 17.4846, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.13% (13.8202 => 14.5288, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (0.3756 => 0.3943, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.4563 => 1.5244, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.67% (0.5637 => 0.5900, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (7.2180 => 7.5522, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (1.1364 => 1.1875, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.39% (1.2292 => 1.2832, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8656, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.36% (1.1061 => 1.1543, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.29% (3.8646 => 4.0302, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0088, std. dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0594 => 1.1039, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.19% (0.8310 => 0.8658, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.3813 => 1.4387, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3794, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.00% (1.3819 => 1.4372, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.97% (0.3755 => 0.3904, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8084, std. dev.: 0.0106) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (4.4433 => 4.6091, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (4.3801 => 4.5416, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.66% (2.1791 => 2.2588, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.39% (1.1333 => 1.1717, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.27% (4.9865 => 5.1496, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (0.4791 => 0.4947, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8698 => 0.8974, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.02% (0.6135 => 0.6320, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.99% (0.4113 => 0.4236, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2799, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (8.4961 => 8.7351, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.80% (0.6283 => 0.6459, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1563, std. dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7484, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9048, std. dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6735, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.52% (3.2742 => 3.3566, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.8535 => 15.2137, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5524, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.15% (4.6629 => 4.7632, std. dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.6250 => 0.6364, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (0.9108 => 0.9238, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.19% (1.0313 => 1.0436, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.40% (5.7573 => 7.5074, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std. dev.: 0.0133) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.35% (0.9996 => 1.0531, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 4.53% (7.4271 => 7.7634, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5358, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.5928 => 4.6517, std. dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.16% (0.4657 => 0.4044, std. dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0985, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.79% (1.2308 => 1.0980, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.04% (20.3410 => 18.5026, std. dev.: 0.0819) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5904, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2268, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7688, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2323, std. dev.: 0.0339) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2468, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0163) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.02% (5.5401 => 5.4834, std. dev.: 0.0151) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2485, std. dev.: 0.0139) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 18:35:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 20:35:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802013551.6C5E73524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2573?compare_to=2569&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2573, Order: 161135, Start Time: 2012-08-01 22:52:44, End Time: 2012-08-02 01:36:19 To: 2569, Order: 161124, Start Time: 2012-08-01 19:40:53, End Time: 2012-08-01 22:24:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (786 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.44% (2.0862 => 2.1163, std. dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.41% (0.3460 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.39% (0.3496 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.35% (0.3469 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.30% (0.3488 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3643 => 0.4115, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.79% (0.3650 => 0.4117, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.51% (0.3724 => 0.4190, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.38% (0.3792 => 0.4072, std. dev.: 0.0106) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5826 => 0.6251, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.11% (0.5889 => 0.6308, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.58% (1.6211 => 1.7116, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (3.5627 => 3.7585, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.47% (0.7171 => 0.7563, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 5.39% (1.5932 => 1.6791, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.01% (0.4994 => 0.5244, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.99% (0.5026 => 0.5277, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.98% (1.3152 => 1.3807, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.86% (0.4361 => 0.4573, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.5900 => 0.6184, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.55% (0.3930 => 0.4109, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.44% (1.0781 => 1.1260, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.40% (4.2109 => 4.3963, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (2.7292 => 2.8486, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 4.09% (0.3004 => 0.3127, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.93% (0.2875 => 0.2988, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.90% (0.9909 => 1.0295, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2792 => 0.2899, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (1.9694 => 2.0417, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0673 => 2.1415, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (1.9966 => 2.0680, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (0.3890 => 0.4024, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.44% (2.1013 => 2.1736, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.43% (0.3124 => 0.3231, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (0.3625 => 0.3749, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3267 => 0.3377, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.36% (0.3096 => 0.3200, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.35% (0.3726 => 0.3851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (0.4658 => 0.4813, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.27% (0.3060 => 0.3160, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.22% (5.5417 => 5.7204, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (4.4195 => 4.5617, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.3362 => 0.3467, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3317 => 0.3420, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.04% (0.9697 => 0.9992, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.4139 => 0.4264, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.02% (0.3477 => 0.3582, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.3903 => 0.4018, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (1.8794 => 1.9347, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.3845 => 0.3958, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (2.1653 => 2.2288, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.83% (4.6177 => 4.7482, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3690 => 0.3794, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4146 => 0.4260, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.69% (0.7875 => 0.8087, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 2.68% (23.5202 => 24.1504, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash2: 2.61% (0.4251 => 0.4362, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.52% (1.4269 => 1.4629, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.34% (0.6634 => 0.6789, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.16% (0.5546 => 0.5666, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.5012 => 0.5115, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.6435 => 0.6562, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.99% (2.5769 => 2.9632, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.16% (0.2122 => 0.2274, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6771, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 5.15% (1.8057 => 1.8987, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6318, std. dev.: 0.0624) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1959, std. dev.: 0.0619) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4930, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.65% (2.0820 => 2.1163, std. dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.49% (2.4764 => 2.4148, std. dev.: 0.0215) MultiSource/Applications/kimwitu++/kc: -1.46% (11.9555 => 11.7812, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5404, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: -8.87% (17.2379 => 15.7087, std. dev.: 0.1802) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7885, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7977, std. dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5421, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5682, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 18:40:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 20:40:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802014011.6EC9A3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2574?compare_to=2571&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2574, Order: 161145, Start Time: 2012-08-02 00:22:21, End Time: 2012-08-02 01:40:40 To: 2571, Order: 161135, Start Time: 2012-08-01 22:35:53, End Time: 2012-08-01 23:54:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (92 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (745 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.47% (1.1004 => 1.1166, std. dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.24% (10.3673 => 13.9174, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3473 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3497 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3516 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.30% (0.3561 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3694 => 0.4141, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.72% (1.1194 => 1.2506, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.33% (1.7609 => 1.9075, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.93% (2.2022 => 2.3769, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.40% (0.1892 => 0.2032, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 7.02% (0.5925 => 0.6341, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.97% (0.6030 => 0.6450, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.14% (0.7326 => 0.7776, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.89% (10.4361 => 11.0512, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.4879 => 0.5150, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 5.09% (0.3282 => 0.3449, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (7.0540 => 7.3848, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (9.4845 => 9.8861, std. dev.: 0.0106) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.8172 => 0.8517, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.9449 => 5.1508, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1947, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (0.3121 => 0.3235, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (4.2646 => 4.4167, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.4636 => 0.4788, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.20% (8.1363 => 8.3970, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.20% (1.5603 => 1.6102, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.3423 => 0.3531, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.11% (0.7835 => 0.8079, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.04% (0.3650 => 0.3761, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.90% (5.7591 => 5.9261, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.3050 => 1.3428, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (2.0665 => 2.1259, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.80% (0.3826 => 0.3933, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.79% (1.1642 => 1.1967, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 2.79% (0.4299 => 0.4419, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7600, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.59% (0.5105 => 0.5237, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.57% (0.4203 => 0.4311, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.53% (0.4064 => 0.4167, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.53% (3.3354 => 3.4197, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5803, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4620 => 0.4733, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.31% (0.8067 => 0.8253, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.27% (3.8723 => 3.9601, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (0.6675 => 0.6818, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.14% (0.9765 => 0.9974, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.10% (1.2842 => 1.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5859 => 1.6190, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.2024 => 2.2479, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.85% (0.8921 => 0.9086, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.80% (0.6450 => 0.6566, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4435, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.52% (0.7115 => 0.7223, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.46% (17.1811 => 17.4320, std. dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 1.43% (1.1840 => 1.2009, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.19% (2.2969 => 2.3243, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.03% (2.6778 => 2.9732, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.85% (4.2280 => 4.3907, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7545, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2133, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8324, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 1.52% (2.2771 => 2.3117, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5313, std. dev.: 0.0017) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2308, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.13% (1.0313 => 1.0430, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1578, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6950, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.99% (5.3526 => 3.6936, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0549, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.47% (2.9384 => 2.5427, std. dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: -12.18% (22.1758 => 19.4745, std. dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.19% (1.6925 => 1.4185, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -7.79% (1.5373 => 1.4176, std. dev.: 0.0179) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.10% (19.9488 => 18.5333, std. dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -4.84% (1.9577 => 1.8630, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8980, std. dev.: 0.0096) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4839, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4230, std. dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0058, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2004, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3114, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 19:53:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 21:53:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802025329.3F8763524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2575?compare_to=2572&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2575, Order: 161152, Start Time: 2012-08-02 01:40:11, End Time: 2012-08-02 02:53:58 To: 2572, Order: 161141, Start Time: 2012-08-01 23:58:07, End Time: 2012-08-02 01:11:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (134 on baseline) Performance Improvements: 4 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 946 (727 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.11% (0.0845 => 0.0998, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.38% (55.2453 => 56.5576, std. dev.: 0.0354) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.0980 => 1.1105, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (27.7688 => 28.0656, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.81% (0.7775 => 0.7634, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -1.76% (0.6412 => 0.6299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.64% (0.6323 => 0.6219, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.20% (2.1015 => 2.0763, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.91% (2.0176 => 2.2983, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3601 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.56% (0.3646 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.49% (0.3663 => 0.3974, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3914 => 0.4238, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.27% (0.5818 => 0.6299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5748 => 0.6219, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7061 => 0.7634, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.7710 => 0.8214, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 6.52% (1.3693 => 1.4586, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (3.9660 => 4.2230, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.27% (0.5265 => 0.5595, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.14% (0.2721 => 0.2888, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.85% (0.4328 => 0.4581, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.68% (0.2782 => 0.2940, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.62% (0.4379 => 0.4625, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.34% (0.4062 => 0.4279, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.24% (1.2193 => 1.2832, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.20% (0.6959 => 0.7321, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9199 => 0.9652, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.91% (0.5577 => 0.5851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.78% (13.8202 => 14.4804, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.9828 => 2.0763, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3107 => 0.3250, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.58% (1.4563 => 1.5230, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5637 => 0.5891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3453 => 0.3607, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3192 => 0.3334, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3406, std. dev.: 0.0186) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.2914 => 0.3041, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.35% (7.2180 => 7.5317, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.24% (0.7506 => 0.7824, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.1364 => 1.1842, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.21% (1.3813 => 1.4394, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (13.2842 => 13.8342, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4390 => 0.4571, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (0.8310 => 0.8652, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.11% (1.3819 => 1.4387, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (1.3245 => 1.3776, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.01% (1.1061 => 1.1504, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0594 => 1.1015, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 3.96% (3.8646 => 4.0178, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (0.7460 => 0.7748, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.81% (1.9270 => 2.0005, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (3.6692 => 3.8003, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (4.4433 => 4.6012, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (4.3801 => 4.5352, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3220 => 0.3334, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.40% (1.2292 => 1.2710, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.16% (2.1791 => 2.2480, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1333 => 1.1689, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.03% (0.4791 => 0.4936, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.77% (0.6135 => 0.6305, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.68% (3.1889 => 3.2745, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.60% (4.9865 => 5.1163, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.60% (8.4961 => 8.7172, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.54% (0.8698 => 0.8919, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.53% (0.6283 => 0.6442, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.2742 => 3.3556, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (2.1007 => 2.1514, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.40% (16.2614 => 16.6515, std. dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (6.5754 => 6.7311, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2033, std. dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 2.29% (14.5298 => 14.8629, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5188 => 1.5485, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.94% (4.6629 => 4.7535, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.38% (0.9108 => 0.9234, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2655, std. dev.: 0.0508) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4037, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.45% (0.9996 => 1.0541, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.51% (7.4271 => 7.7622, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.2619 => 11.7387, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5315, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.15% (1.0310 => 1.0429, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.81% (22.5627 => 21.0263, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.82% (20.3410 => 18.5478, std. dev.: 0.0148) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9097, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6016, std. dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2252, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2206, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2495, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2234, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 20:26:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 22:26:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802032659.BBEB43524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2576?compare_to=2574&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2576, Order: 161152, Start Time: 2012-08-02 02:08:46, End Time: 2012-08-02 03:27:28 To: 2574, Order: 161145, Start Time: 2012-08-02 00:22:21, End Time: 2012-08-02 01:40:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (82 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.18% (0.0850 => 0.0996, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.63% (54.8936 => 56.3354, std. dev.: 0.1636) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.46% (79.0564 => 80.2125, std. dev.: 0.2491) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.16% (2.1259 => 2.1013, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.99% (10.3673 => 13.7876, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.07% (1.1194 => 1.2545, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.62% (0.3828 => 0.4273, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (2.2022 => 2.3917, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.18% (1.7609 => 1.9049, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 6.44% (10.4361 => 11.1080, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.70% (0.5925 => 0.6263, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.61% (0.6030 => 0.6368, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.30% (0.3282 => 0.3456, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.26% (0.7326 => 0.7711, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (7.0540 => 7.4179, std. dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (9.4845 => 9.9200, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.34% (4.9449 => 5.1594, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (5.0018 => 5.2106, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.04% (0.8172 => 0.8502, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 4.01% (0.7433 => 0.7731, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.89% (4.2646 => 4.4306, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.3121 => 0.3240, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.73% (0.3109 => 0.3225, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4288, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.36% (1.1861 => 1.2260, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.32% (0.7835 => 0.8095, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 3.12% (0.4299 => 0.4433, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8064, std. dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 2.99% (5.7591 => 5.9312, std. dev.: 0.0167) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4275, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.75% (1.1642 => 1.1962, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.8067 => 0.8278, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.61% (2.0273 => 2.0802, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.5415 => 1.5811, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4636 => 0.4754, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9679, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.5105 => 0.5231, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9765 => 0.9987, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5859 => 1.6214, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6675 => 0.6820, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6450 => 0.6590, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.06% (17.1811 => 17.5350, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2471, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5981 => 0.6102, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8921 => 0.9095, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.78% (0.6456 => 0.6571, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.68% (2.0665 => 2.1013, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.50% (1.1840 => 1.2018, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2842 => 1.3010, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.02% (1.0722 => 1.0831, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (4.2280 => 4.4028, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7468, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2149, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2221, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1625, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7169, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7142, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0761, std. dev.: 0.0958) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.82% (2.9384 => 2.5617, std. dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: -12.02% (22.1758 => 19.5106, std. dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2373 => 1.1080, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -7.95% (1.5373 => 1.4151, std. dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.83% (19.9488 => 18.5853, std. dev.: 0.0686) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8652, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.20% (8.1563 => 7.8955, std. dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4882, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4222, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0012, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2014, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3177, std. dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4176, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 21:35:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 23:35:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802043525.50F033524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2577?compare_to=2575&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2577, Order: 161154, Start Time: 2012-08-02 03:22:01, End Time: 2012-08-02 04:35:54 To: 2575, Order: 161152, Start Time: 2012-08-02 01:40:11, End Time: 2012-08-02 02:53:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (137 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (724 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.66% (2.0176 => 2.3134, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.5818 => 0.6313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.50% (0.3578 => 0.3882, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5748 => 0.6228, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.31% (0.3646 => 0.3949, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.28% (0.3601 => 0.3899, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7061 => 0.7639, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.15% (0.3914 => 0.4233, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.78% (1.3693 => 1.4621, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.64% (3.9660 => 4.2293, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.53% (0.5265 => 0.5609, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.42% (0.7710 => 0.8205, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4328 => 0.4604, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.4062 => 0.4314, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.08% (0.7038 => 0.7466, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.6959 => 0.7343, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4379 => 0.4620, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.41% (1.2193 => 1.2853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.3899 => 0.4108, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.25% (1.9828 => 2.0868, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9199 => 0.9664, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.03% (13.8202 => 14.5152, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.65% (16.6129 => 17.3860, std. dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.56% (0.4016 => 0.4199, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (7.2180 => 7.5467, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.42% (0.5637 => 0.5886, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.39% (1.4563 => 1.5202, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8656, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8310 => 0.8669, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.30% (0.7506 => 0.7829, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (1.1364 => 1.1846, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.20% (1.1061 => 1.1526, std. dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.19% (1.3813 => 1.4392, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.0594 => 1.1037, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.09% (1.3819 => 1.4384, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (1.3245 => 1.3786, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.04% (3.8646 => 4.0206, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.01% (0.7460 => 0.7759, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.00% (1.9270 => 2.0040, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8082, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2755, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (4.4433 => 4.6082, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.3801 => 4.5368, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.28% (2.1791 => 2.2506, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1333 => 1.1701, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.00% (4.9865 => 5.1361, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.6283 => 0.6470, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6135 => 0.6311, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8698 => 0.8944, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.75% (8.4961 => 8.7300, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 2.74% (3.1889 => 3.2763, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.5754 => 6.7440, std. dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2193, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.1007 => 2.1523, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.44% (16.2614 => 16.6586, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.36% (3.2742 => 3.3514, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.35% (14.5298 => 14.8713, std. dev.: 0.0194) MultiSource/Applications/oggenc/oggenc: 2.10% (4.6629 => 4.7610, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (1.5188 => 1.5499, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.61% (0.9108 => 0.9255, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.08% (1.0313 => 1.0424, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.39% (5.7573 => 7.5070, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/fbench: 24.66% (1.8175 => 2.2657, std. dev.: 0.0335) SingleSource/Benchmarks/Misc/mandel-2: 8.18% (1.2998 => 1.4061, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.07% (0.9996 => 1.0503, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: 4.54% (7.4271 => 7.7640, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.2619 => 11.7388, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9738, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.19% (1.0310 => 1.0433, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.5627 => 21.0892, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5290, std. dev.: 0.0399) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.04% (1.3780 => 1.3223, std. dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.30% (1.9762 => 1.9110, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5792, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9485, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2382, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3305 => 7.2243, std. dev.: 0.0202) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2217, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 21:47:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 23:47:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802044727.ED0D33524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2578?compare_to=2573&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2578, Order: 161152, Start Time: 2012-08-02 02:04:35, End Time: 2012-08-02 04:47:57 To: 2573, Order: 161135, Start Time: 2012-08-01 22:52:44, End Time: 2012-08-02 01:36:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (68 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (815 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.03% (0.3446 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.99% (0.3465 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.99% (0.3496 => 0.3950, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3442 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.46% (0.3643 => 0.4097, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 6.44% (0.5826 => 0.6201, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.5889 => 0.6262, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.52% (3.5627 => 3.7595, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.46% (1.6211 => 1.7096, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 5.44% (1.5932 => 1.6798, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.88% (0.4361 => 0.4574, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.86% (1.3152 => 1.3791, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 4.84% (0.7171 => 0.7518, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (0.4994 => 0.5234, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.78% (0.5900 => 0.6182, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (0.5000 => 0.5233, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.53% (0.3930 => 0.4108, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.47% (0.4029 => 0.4209, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.22% (4.2109 => 4.3888, std. dev.: 0.0115) MultiSource/Applications/d/make_dparser: 4.22% (1.0781 => 1.1236, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std. dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (2.7292 => 2.8386, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.76% (0.2736 => 0.2839, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0391, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (1.9966 => 2.0662, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (0.3890 => 0.4020, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (2.1013 => 2.1703, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.13% (5.5417 => 5.7149, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (4.4195 => 4.5574, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (2.1653 => 2.2307, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.3903 => 0.4020, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.99% (4.6177 => 4.7558, std. dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 2.95% (0.9909 => 1.0201, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.85% (0.4139 => 0.4257, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (2.0673 => 2.1241, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.56% (1.8794 => 1.9275, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 2.53% (0.4146 => 0.4251, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.48% (0.7875 => 0.8070, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.43% (23.5202 => 24.0906, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 2.37% (1.4269 => 1.4607, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.25% (0.9697 => 0.9915, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.18% (0.5546 => 0.5667, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.16% (0.2122 => 0.2274, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6674, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8919, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6723, std. dev.: 0.0461) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1943, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4911, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2269, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.78% (11.9555 => 11.7425, std. dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.07% (25.4195 => 16.5046, std. dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/ary2: -9.70% (0.2402 => 0.2169, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -8.51% (17.2379 => 15.7716, std. dev.: 0.1047) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8004, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7929, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -3.52% (14.0481 => 13.5536, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 1 22:13:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 00:13:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802051331.2B3B03524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2579?compare_to=2576&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2579, Order: 161154, Start Time: 2012-08-02 03:55:41, End Time: 2012-08-02 05:14:01 To: 2576, Order: 161152, Start Time: 2012-08-02 02:08:46, End Time: 2012-08-02 03:27:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (83 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.84% (13.7876 => 13.5339, std. dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.54% (10.3673 => 13.5339, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/trivial-interface: 12.76% (0.3473 => 0.3916, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (1.7609 => 1.9056, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (2.2022 => 2.3734, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.75% (0.3817 => 0.4113, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.19% (0.5925 => 0.6292, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.72% (0.7326 => 0.7745, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (10.4361 => 11.0047, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3828, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.8172 => 0.8519, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8786, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1430, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 3.94% (0.7433 => 0.7726, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1950, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5569 => 0.5782, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (4.2646 => 4.4139, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.5860 => 0.6062, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4084, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.27% (0.7835 => 0.8091, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.14% (1.1642 => 1.2007, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.10% (1.1861 => 1.2229, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.4103 => 0.4228, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.02% (5.7591 => 5.9333, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.3050 => 1.3424, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 2.86% (0.4299 => 0.4422, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7602, std. dev.: 0.0133) MultiSource/Applications/d/make_dparser: 2.51% (3.3354 => 3.4190, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.42% (2.0273 => 2.0764, std. dev.: 0.0103) MultiSource/Applications/hbd/hbd: 2.40% (1.5603 => 1.5978, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5415 => 1.5785, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.35% (2.0665 => 2.1150, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9609, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9765 => 0.9987, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.20% (0.6456 => 0.6598, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.19% (0.8067 => 0.8244, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.5859 => 1.6174, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6675 => 0.6806, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6450 => 0.6573, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.2024 => 2.2443, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.84% (1.2842 => 1.3078, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.4186 => 1.4433, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4604, std. dev.: 0.0189) MultiSource/Benchmarks/nbench/nbench: 1.25% (1.1840 => 1.1988, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.20% (2.2969 => 2.3245, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (4.2280 => 4.4061, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7586, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2122, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2290, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/fbench: 1.13% (2.2771 => 2.3029, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 1.10% (26.0924 => 26.3797, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1581, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7017, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7005, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0448, std. dev.: 0.0299) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5446, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.26% (22.1758 => 19.4581, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1072, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -7.84% (1.5373 => 1.4168, std. dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.06% (19.9488 => 18.5395, std. dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.91% (1.9577 => 1.8616, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4887, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9086, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4333, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0026, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3227, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4173, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.26% (1.8329 => 1.8098, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 01:02:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 03:02:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802080254.6099B3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2580?compare_to=2578&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2580, Order: 161154, Start Time: 2012-08-02 05:16:05, End Time: 2012-08-02 08:03:24 To: 2578, Order: 161152, Start Time: 2012-08-02 02:04:35, End Time: 2012-08-02 04:47:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (813 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 12.42% (0.3446 => 0.3874, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-4: 12.38% (0.3465 => 0.3894, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/synchronized: 12.28% (0.3469 => 0.3895, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: 12.27% (0.3496 => 0.3925, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.18% (0.3488 => 0.3913, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3643 => 0.4078, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 11.84% (0.3650 => 0.4082, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/parameter-passing: 11.63% (0.3724 => 0.4157, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.20% (0.5826 => 0.6187, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 6.09% (1.5932 => 1.6903, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 5.93% (0.5889 => 0.6238, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.55% (3.5627 => 3.7603, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.45% (1.6211 => 1.7095, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (0.5026 => 0.5294, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.29% (0.5900 => 0.6212, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.12% (0.5000 => 0.5256, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.07% (1.3152 => 1.3819, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (0.3930 => 0.4114, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 4.38% (1.0781 => 1.1253, std. dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.36% (2.7292 => 2.8481, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 4.22% (4.2109 => 4.3885, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.62% (5.5417 => 5.7423, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (1.9966 => 2.0686, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0392, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 3.38% (2.1653 => 2.2384, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.35% (0.9909 => 1.0241, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (0.3890 => 0.4020, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (0.4658 => 0.4811, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.26% (0.6634 => 0.6850, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 3.12% (4.6177 => 4.7616, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.4139 => 0.4266, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.06% (0.3362 => 0.3465, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (2.0673 => 2.1305, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.02% (0.3903 => 0.4021, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (4.4195 => 4.5511, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (1.8794 => 1.9344, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.55% (1.4269 => 1.4633, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4146 => 0.4250, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.49% (0.7875 => 0.8071, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4251 => 0.4354, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.18% (0.5546 => 0.5667, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.11% (0.9697 => 0.9902, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.5012 => 0.5112, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.6435 => 0.6549, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.06% (2.0346 => 2.0562, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9640, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.27% (12.0509 => 12.6854, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1643, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6570, std. dev.: 0.0296) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2139, std. dev.: 0.0507) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4951, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2281, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0339) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.46% (11.9555 => 11.7810, std. dev.: 0.0590) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.14% (25.4195 => 16.4876, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary2: -9.58% (0.2402 => 0.2172, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7949, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/fldry: -6.93% (17.2379 => 16.0433, std. dev.: 0.2805) SingleSource/Benchmarks/Shootout-C++/moments: -4.06% (0.4438 => 0.4258, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -3.46% (14.0481 => 13.5626, std. dev.: 0.1461) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 01:26:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 03:26:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802082609.4A9F23524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2581?compare_to=2577&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2581, Order: 161155, Start Time: 2012-08-02 07:12:45, End Time: 2012-08-02 08:26:38 To: 2577, Order: 161154, Start Time: 2012-08-02 03:22:01, End Time: 2012-08-02 04:35:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.76% (54.8722 => 56.3879, std. dev.: 0.1244) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.72% (2.0176 => 2.3145, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3578 => 0.3881, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.5818 => 0.6308, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3646 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.23% (0.5748 => 0.6221, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.14% (0.3623 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.11% (0.3663 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7061 => 0.7593, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.7710 => 0.8233, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.67% (1.3693 => 1.4607, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (3.9660 => 4.2260, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (0.4328 => 0.4609, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7038 => 0.7473, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.2140 => 0.2258, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.6959 => 0.7334, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2761 => 0.2909, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3485 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.30% (1.2193 => 1.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.22% (1.9828 => 2.0864, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.16% (0.3489 => 0.3669, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.06% (0.5577 => 0.5859, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.03% (0.9199 => 0.9662, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.03% (13.8202 => 14.5147, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.64% (16.6129 => 17.3830, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.61% (7.2180 => 7.5508, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.51% (0.4390 => 0.4588, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5637 => 0.5883, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (13.2842 => 13.8634, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.35% (1.4563 => 1.5197, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.29% (1.1364 => 1.1851, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.26% (0.7506 => 0.7826, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.26% (1.1061 => 1.1532, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 4.25% (0.8310 => 0.8663, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.24% (1.3813 => 1.4398, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.04% (1.3819 => 1.4377, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.03% (1.0594 => 1.1021, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.3245 => 1.3778, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.01% (1.9270 => 2.0043, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (3.8646 => 4.0181, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (0.7460 => 0.7748, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8090, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.80% (1.2292 => 1.2759, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (4.4433 => 4.6010, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (4.3801 => 4.5303, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 3.37% (2.1791 => 2.2525, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.4791 => 0.4946, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1333 => 1.1695, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.96% (4.9865 => 5.1343, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6283 => 0.6464, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8698 => 0.8944, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4113 => 0.4228, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.4961 => 8.7285, std. dev.: 0.0115) MultiSource/Applications/d/make_dparser: 2.72% (3.1889 => 3.2756, std. dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.66% (0.6135 => 0.6298, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7495, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6545, std. dev.: 0.0201) MultiSource/Applications/JM/lencod/lencod: 2.41% (14.8535 => 15.2111, std. dev.: 0.0236) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8735, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.36% (3.2742 => 3.3515, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.1007 => 2.1493, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.15% (4.6629 => 4.7632, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (1.5188 => 1.5496, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9108 => 0.9252, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.07% (1.0313 => 1.0423, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.36% (5.7573 => 7.5053, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 7.70% (1.2998 => 1.3999, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.18% (0.9996 => 1.0514, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 4.32% (7.4271 => 7.7479, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7415, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.54% (1.7688 => 1.8138, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9578, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.15% (1.0310 => 1.0429, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.5627 => 21.0713, std. dev.: 0.0233) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.18% (20.3410 => 18.4735, std. dev.: 0.0262) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3141, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.62% (0.4867 => 0.4691, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9085, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5806, std. dev.: 0.0218) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9483, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2249, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2229, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2545, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8455, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 01:31:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 03:31:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802083100.2A09F3524039@llvm.org> http://llvm.org/perf/db_default/v4/nts/2582?compare_to=2579&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2582, Order: 161155, Start Time: 2012-08-02 07:12:42, End Time: 2012-08-02 08:31:30 To: 2579, Order: 161154, Start Time: 2012-08-02 03:55:41, End Time: 2012-08-02 05:14:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (80 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.86% (3.7533 => 3.8981, std. dev.: 0.0146) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.10% (1.3168 => 1.3313, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.51% (10.3673 => 13.5308, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.24% (0.3561 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.92% (1.1194 => 1.2528, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.27% (1.7609 => 1.9066, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.76% (2.2022 => 2.3732, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.55% (0.1892 => 0.2016, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.19% (0.6030 => 0.6403, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 5.43% (10.4361 => 11.0031, std. dev.: 0.0190) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3121 => 0.3280, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.88% (7.0540 => 7.3985, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.2554 => 0.2667, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (9.4845 => 9.8800, std. dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.8172 => 0.8499, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (5.0018 => 5.2007, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1383, std. dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5860 => 0.6081, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 3.57% (0.3109 => 0.3220, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (4.2646 => 4.4137, std. dev.: 0.0093) MultiSource/Applications/spiff/spiff: 3.29% (0.7835 => 0.8093, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (8.1363 => 8.4029, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9370, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 2.93% (0.4299 => 0.4425, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.3050 => 1.3425, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1950, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (14.3668 => 14.7383, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 2.50% (2.0273 => 2.0779, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 2.48% (3.3354 => 3.4182, std. dev.: 0.0179) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.5415 => 1.5788, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.38% (2.0665 => 2.1156, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.37% (1.5603 => 1.5973, std. dev.: 0.0105) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9609, std. dev.: 0.0214) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.26% (0.4636 => 0.4741, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.5105 => 0.5219, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.12% (0.9765 => 0.9972, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (2.2024 => 2.2478, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6450 => 0.6570, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.4186 => 1.4432, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 1.72% (0.8921 => 0.9074, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4443, std. dev.: 0.0170) MultiSource/Benchmarks/nbench/nbench: 1.31% (1.1840 => 1.1995, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 1.10% (2.2969 => 2.3222, std. dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (4.2280 => 4.3900, std. dev.: 0.0117) MultiSource/Benchmarks/llubenchmark/llu: 3.18% (3.7781 => 3.8981, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2145, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (1.5086 => 1.5356, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2377, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.03% (2.8904 => 2.9201, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1616, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7042, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7005, std. dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0790, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.37% (2.9384 => 2.5454, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4901, std. dev.: 0.0331) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2373 => 1.1154, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -7.61% (1.5373 => 1.4203, std. dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.21% (19.9488 => 18.5107, std. dev.: 0.0625) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.92% (1.9577 => 1.8614, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (8.1563 => 7.8972, std. dev.: 0.0123) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4814, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4119, std. dev.: 0.0204) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0050, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3189, std. dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4189, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8101, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 03:08:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 05:08:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802100831.0652F3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2583?compare_to=2581&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2583, Order: 161159, Start Time: 2012-08-02 08:54:54, End Time: 2012-08-02 10:08:59 To: 2581, Order: 161155, Start Time: 2012-08-02 07:12:45, End Time: 2012-08-02 08:26:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.36% (0.7593 => 0.7696, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.90% (3.8274 => 3.7548, std. dev.: 0.0181) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.26% (2.0176 => 2.3054, std. dev.: 0.0159) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.99% (0.7061 => 0.7696, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.66% (0.1986 => 0.2158, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3578 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.28% (0.3646 => 0.3948, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 8.28% (0.3601 => 0.3899, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3650 => 0.3949, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3663 => 0.3963, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.01% (0.5265 => 0.5634, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 6.89% (1.3693 => 1.4637, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (3.9660 => 4.2286, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.11% (0.7038 => 0.7468, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4062 => 0.4296, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.41% (1.2193 => 1.2853, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.19% (0.3485 => 0.3666, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.9828 => 2.0836, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.04% (0.5577 => 0.5858, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.01% (13.8202 => 14.5131, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.87% (0.3489 => 0.3659, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4025, std. dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.70% (0.7506 => 0.7859, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.69% (1.4563 => 1.5246, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.50% (7.2180 => 7.5425, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5637 => 0.5888, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.43% (1.3819 => 1.4431, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8310 => 0.8678, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4390 => 0.4584, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.40% (1.1061 => 1.1548, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.35% (13.2842 => 13.8614, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.33% (1.1364 => 1.1856, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.7460 => 0.7781, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.26% (3.8646 => 4.0293, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.22% (0.3246 => 0.3383, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3802, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 4.11% (1.0594 => 1.1029, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 4.05% (1.9270 => 2.0051, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8088, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.2945 => 0.3057, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (4.4433 => 4.6080, std. dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 3.63% (1.2292 => 1.2738, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.3801 => 4.5367, std. dev.: 0.0076) MultiSource/Applications/siod/siod: 3.43% (2.1791 => 2.2539, std. dev.: 0.0202) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1712, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.28% (0.4791 => 0.4948, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.21% (0.6135 => 0.6332, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3755 => 0.3874, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1354, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.90% (0.6283 => 0.6465, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2795, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8698 => 0.8943, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (8.4961 => 8.7259, std. dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 2.54% (16.2614 => 16.6751, std. dev.: 0.0166) MultiSource/Applications/JM/ldecod/ldecod: 2.53% (6.5754 => 6.7415, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1509, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (3.2742 => 3.3523, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.38% (14.8535 => 15.2063, std. dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8736, std. dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 2.12% (4.6629 => 4.7619, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.98% (1.5188 => 1.5489, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.9108 => 0.9241, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.22% (3.7467 => 3.7923, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.12% (1.0313 => 1.0428, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/mandel-2: 8.72% (1.2998 => 1.4131, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.14% (0.9996 => 1.0510, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 4.45% (7.4271 => 7.7574, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7392, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8147, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0310 => 1.0435, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.5627 => 21.1111, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.11% (20.3410 => 18.4887, std. dev.: 0.1009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0193) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5743, std. dev.: 0.0167) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9469, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2304, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2123, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2481, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2185, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 03:17:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 05:17:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802101758.605F83524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2584?compare_to=2582&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2584, Order: 161161, Start Time: 2012-08-02 08:59:47, End Time: 2012-08-02 10:18:27 To: 2582, Order: 161155, Start Time: 2012-08-02 07:12:42, End Time: 2012-08-02 08:31:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.58% (55.0489 => 56.4709, std. dev.: 0.0925) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.15% (10.3673 => 13.4927, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.08% (1.1194 => 1.2546, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3497 => 0.3908, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.91% (1.7609 => 1.9178, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.44% (2.2022 => 2.3880, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.24% (0.5925 => 0.6295, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.57% (0.4879 => 0.5151, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 5.24% (0.3282 => 0.3454, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.23% (10.4361 => 10.9817, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.22% (0.4615 => 0.4856, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.12% (7.0540 => 7.4150, std. dev.: 0.0109) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.72% (9.4845 => 9.9321, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.34% (4.9449 => 5.1595, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (5.0018 => 5.2188, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (0.7433 => 0.7743, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.86% (0.3109 => 0.3229, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8172 => 0.8482, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (4.2646 => 4.4220, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.60% (0.5860 => 0.6071, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.49% (8.1363 => 8.4203, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.37% (0.4299 => 0.4444, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.34% (5.7591 => 5.9513, std. dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.1861 => 1.2254, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.3050 => 1.3471, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.17% (0.7835 => 0.8083, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1986, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (14.3668 => 14.7846, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (1.5415 => 1.5849, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 2.80% (3.3354 => 3.4289, std. dev.: 0.0120) MultiSource/Applications/hbd/hbd: 2.69% (1.5603 => 1.6023, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.64% (2.0273 => 2.0809, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4289 => 0.4401, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.4103 => 0.4210, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.57% (0.3935 => 0.4036, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.45% (0.8067 => 0.8265, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 2.43% (3.8723 => 3.9665, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6225, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (2.0665 => 2.1124, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9765 => 0.9980, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8921 => 0.9116, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2470, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4463, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.77% (17.1811 => 17.4847, std. dev.: 0.0242) MultiSource/Applications/hexxagon/hexxagon: 1.68% (1.2842 => 1.3058, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.1840 => 1.2029, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.56% (1.0722 => 1.0889, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 1.32% (2.2969 => 2.3272, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (4.2280 => 4.4137, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5348, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1578 => 3.2101, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2561, std. dev.: 0.0034) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2047, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.13% (26.0924 => 26.3873, std. dev.: 0.0339) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.81% (5.2763 => 3.1758, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7108, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7093, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0644, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.33% (2.9384 => 2.5468, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -12.02% (22.1758 => 19.5108, std. dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2373 => 1.1060, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -7.59% (1.5373 => 1.4206, std. dev.: 0.0161) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.58% (19.9488 => 18.6363, std. dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5543, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.84% (1.9577 => 1.8629, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.50% (1.5835 => 1.5123, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4789, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4128, std. dev.: 0.0185) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9077, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0036, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3251, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4186, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 04:15:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 06:15:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802111503.174463524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2585?compare_to=2580&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2585, Order: 161156, Start Time: 2012-08-02 08:31:54, End Time: 2012-08-02 11:15:34 To: 2580, Order: 161154, Start Time: 2012-08-02 05:16:05, End Time: 2012-08-02 08:03:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (811 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 12.46% (0.3442 => 0.3871, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3496 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3488 => 0.3912, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.75% (0.3650 => 0.4079, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.57% (0.3724 => 0.4155, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.16% (1.5932 => 1.6914, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5826 => 0.6182, std. dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference-object: 5.77% (0.5889 => 0.6229, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (0.4994 => 0.5277, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.61% (1.6211 => 1.7120, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (3.5627 => 3.7589, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (0.5026 => 0.5299, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.19% (1.3152 => 1.3834, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.02% (0.4361 => 0.4580, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (0.5000 => 0.5232, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.63% (0.3930 => 0.4112, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.56% (0.5900 => 0.6169, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.54% (1.0781 => 1.1270, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.49% (0.4029 => 0.4210, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.46% (0.7171 => 0.7491, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.43% (2.7292 => 2.8502, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 3.97% (4.2109 => 4.3782, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.68% (2.1013 => 2.1787, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 3.68% (5.5417 => 5.7457, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.59% (1.9694 => 2.0401, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.47% (23.5202 => 24.3367, std. dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (0.3890 => 0.4023, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.41% (0.4139 => 0.4280, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (1.9966 => 2.0638, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (0.9909 => 1.0222, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.06% (4.6177 => 4.7591, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (2.0673 => 2.1306, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (2.1653 => 2.2315, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (1.8794 => 1.9344, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.86% (0.7875 => 0.8100, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (4.4195 => 4.5444, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 2.75% (0.3678 => 0.3779, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.65% (0.6634 => 0.6810, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.35% (1.4269 => 1.4605, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.14% (0.9697 => 0.9905, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.13% (0.5546 => 0.5664, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.6435 => 0.6550, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.02% (2.0346 => 2.0553, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6704, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8950, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1666, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6753, std. dev.: 0.0510) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2050, std. dev.: 0.0439) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4955, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.61% (11.9555 => 11.7626, std. dev.: 0.0144) SingleSource/UnitTests/Vector/constpool: -1.49% (2.4764 => 2.4394, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.16% (25.4195 => 16.4819, std. dev.: 0.0235) SingleSource/Benchmarks/Dhrystone/fldry: -8.97% (17.2379 => 15.6908, std. dev.: 0.2732) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7882, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary2: -7.04% (0.2402 => 0.2233, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: -4.03% (0.4438 => 0.4259, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7949, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -3.44% (14.0481 => 13.5648, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 04:50:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 06:50:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802115049.5DD2C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2586?compare_to=2583&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2586, Order: 161165, Start Time: 2012-08-02 10:37:11, End Time: 2012-08-02 11:51:18 To: 2583, Order: 161159, Start Time: 2012-08-02 08:54:54, End Time: 2012-08-02 10:08:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (147 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.4327 => 56.4331, std. dev.: 0.1340) MultiSource/Benchmarks/llubenchmark/llu: 1.60% (3.7548 => 3.8150, std. dev.: 0.0188) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.63% (2.0176 => 2.3128, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.75% (0.5818 => 0.6327, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.67% (0.7061 => 0.7673, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5748 => 0.6239, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.73% (0.7710 => 0.8306, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4652, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 6.83% (0.7038 => 0.7519, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.82% (3.9660 => 4.2363, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4062 => 0.4313, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.6959 => 0.7361, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.75% (0.4379 => 0.4631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (1.2193 => 1.2881, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.54% (0.2690 => 0.2839, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.38% (0.9199 => 0.9694, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.33% (1.9828 => 2.0884, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.31% (0.3580 => 0.3770, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.21% (13.8202 => 14.5407, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.08% (1.4563 => 1.5303, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.97% (0.4390 => 0.4608, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.93% (16.6129 => 17.4320, std. dev.: 0.0141) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (7.2180 => 7.5605, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.65% (0.7506 => 0.7855, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.3813 => 1.4450, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.3819 => 1.4447, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8748, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.32% (1.9270 => 2.0103, std. dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.28% (1.3245 => 1.3812, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (3.8646 => 4.0280, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.7460 => 0.7772, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.12% (1.2292 => 1.2798, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6243, std. dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8165, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5512, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.60% (2.1791 => 2.2575, std. dev.: 0.0146) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.9865 => 5.1581, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (0.8698 => 0.8982, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4113 => 0.4245, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.6283 => 0.6484, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7467, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 2.95% (3.1889 => 3.2829, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.76% (16.2614 => 16.7097, std. dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7560, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 2.73% (14.8535 => 15.2584, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.61% (3.2742 => 3.3597, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.5298 => 14.9075, std. dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1550, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.39% (4.6629 => 4.7742, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5526, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.65% (0.6250 => 0.6353, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.22% (33.2944 => 33.7003, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 1.13% (3.7467 => 3.7889, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (6.2785 => 6.3454, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.56% (1.8175 => 2.2820, std. dev.: 0.0474) SingleSource/Benchmarks/Misc/mandel-2: 8.50% (1.2998 => 1.4103, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7558, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7390, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4566, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.29% (1.9290 => 1.9539, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.14% (1.0310 => 1.0428, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1400, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6469 => 3.6851, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.24% (22.5627 => 21.1539, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.53% (20.3410 => 18.6053, std. dev.: 0.0199) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3141, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.33% (1.9762 => 1.9104, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5884, std. dev.: 0.0123) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9468, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2123, std. dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5115, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0180) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3305 => 7.2247, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2474, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2256, std. dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 05:04:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 07:04:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802120436.8614C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2587?compare_to=2584&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2587, Order: 161165, Start Time: 2012-08-02 10:46:37, End Time: 2012-08-02 12:05:08 To: 2584, Order: 161161, Start Time: 2012-08-02 08:59:47, End Time: 2012-08-02 10:18:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (80 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.12% (13.4927 => 13.2073, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.39% (10.3673 => 13.2073, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 12.50% (0.3473 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.01% (1.1194 => 1.2538, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.67% (0.2065 => 0.2244, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (1.7609 => 1.9101, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (2.2022 => 2.3791, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.96% (0.5925 => 0.6278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.6030 => 0.6382, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.27% (0.4615 => 0.4858, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.25% (0.4879 => 0.5135, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7326 => 0.7686, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.90% (7.0540 => 7.3998, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (10.4361 => 10.9283, std. dev.: 0.0149) MultiSource/Benchmarks/mafft/pairlocalalign: 4.41% (9.4845 => 9.9030, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.22% (4.9449 => 5.1534, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (5.0018 => 5.2103, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.7433 => 0.7734, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4102, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4079, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.3050 => 1.3439, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 2.93% (0.4299 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7812, std. dev.: 0.0158) MultiSource/Applications/oggenc/oggenc: 2.86% (5.7591 => 5.9237, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.69% (2.0665 => 2.1220, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.5415 => 1.5826, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.66% (0.4103 => 0.4212, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.52% (2.0273 => 2.0784, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 2.50% (3.3354 => 3.4187, std. dev.: 0.0110) MultiSource/Applications/hbd/hbd: 2.48% (1.5603 => 1.5990, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.47% (1.1642 => 1.1930, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5105 => 0.5230, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.35% (0.4289 => 0.4390, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9609, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6456 => 0.6601, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.8067 => 0.8240, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.99% (0.9765 => 0.9959, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.97% (0.8921 => 0.9097, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.2024 => 2.2451, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.89% (1.5859 => 1.6159, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.4186 => 1.4437, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.77% (1.2842 => 1.3069, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6450 => 0.6560, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.66% (17.1811 => 17.4664, std. dev.: 0.0136) MultiSource/Benchmarks/nbench/nbench: 1.33% (1.1840 => 1.1997, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.09% (2.2969 => 2.3220, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.09% (4.2280 => 4.4009, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7588, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2142, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5339, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2325, std. dev.: 0.0353) MultiSource/Applications/lua/lua: 1.04% (26.0924 => 26.3646, std. dev.: 0.0211) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1702, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7044, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7035, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0352, std. dev.: 0.0411) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.31% (2.9384 => 2.5472, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.20% (22.1758 => 19.4700, std. dev.: 0.0464) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.21% (1.6925 => 1.4181, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2373 => 1.1075, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -7.04% (1.5373 => 1.4290, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.64% (19.9488 => 18.6234, std. dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.89% (1.9577 => 1.8620, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.19% (8.1563 => 7.8965, std. dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4851, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4152, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0023, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3150, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4168, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 07:02:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 09:02:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802140218.E5F4A2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2588?compare_to=2586&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2588, Order: 161172, Start Time: 2012-08-02 12:48:42, End Time: 2012-08-02 14:02:46 To: 2586, Order: 161165, Start Time: 2012-08-02 10:37:11, End Time: 2012-08-02 11:51:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (142 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.10% (3.7316 => 3.6906, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.62% (2.0176 => 2.3126, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.70% (0.5818 => 0.6324, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7061 => 0.7675, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (3.9660 => 4.2429, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.82% (1.3693 => 1.4627, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.54% (0.7038 => 0.7498, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (0.4328 => 0.4609, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.61% (1.2193 => 1.2877, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.5577 => 0.5889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.50% (0.6959 => 0.7342, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.47% (0.4390 => 0.4630, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.42% (0.3485 => 0.3674, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.36% (0.3580 => 0.3772, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.36% (1.9828 => 2.0891, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.28% (1.4563 => 1.5332, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.17% (0.9199 => 0.9675, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.09% (13.8202 => 14.5242, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.95% (0.3453 => 0.3624, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4236, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.62% (0.7506 => 0.7853, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5516, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.59% (0.5637 => 0.5896, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.55% (1.3819 => 1.4448, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8310 => 0.8678, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.0594 => 1.1062, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8666, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0095, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.7460 => 0.7778, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (3.8646 => 4.0287, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 4.21% (1.1061 => 1.1527, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.20% (1.3245 => 1.3801, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.3801 => 4.5607, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (3.6692 => 3.8200, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (4.4433 => 4.6135, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.82% (1.2292 => 1.2761, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.57% (2.1791 => 2.2568, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.1333 => 1.1729, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.33% (0.6283 => 0.6492, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1523, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.02% (0.6135 => 0.6320, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (8.4961 => 8.7448, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2798, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.70% (3.2742 => 3.3625, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.66% (6.5754 => 6.7502, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 2.65% (16.2614 => 16.6928, std. dev.: 0.0122) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.5298 => 14.9123, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1007 => 2.1557, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.8535 => 15.2341, std. dev.: 0.0156) MultiSource/Applications/oggenc/oggenc: 2.34% (4.6629 => 4.7720, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5188 => 1.5539, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.6250 => 0.6359, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.65% (0.9108 => 0.9258, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.18% (33.2944 => 33.6878, std. dev.: 0.0102) MultiSource/Applications/lua/lua: 1.11% (3.7467 => 3.7884, std. dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (6.2785 => 6.3434, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2559, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.49% (1.2998 => 1.3842, std. dev.: 0.0132) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.23% (0.9996 => 1.0519, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7515, std. dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7401, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.64% (1.7688 => 1.8155, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (1.5089 => 1.5320, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5940, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.22% (3.7731 => 3.8193, std. dev.: 0.0166) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1406, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8630, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.71% (20.3410 => 18.5696, std. dev.: 0.0573) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -3.28% (1.9762 => 1.9114, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9470, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6080, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3305 => 7.2237, std. dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: -1.37% (5.3167 => 5.2437, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2230, std. dev.: 0.0155) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 07:06:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 09:06:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802140639.66B262A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2589?compare_to=2587&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2589, Order: 161172, Start Time: 2012-08-02 12:48:38, End Time: 2012-08-02 14:07:09 To: 2587, Order: 161165, Start Time: 2012-08-02 10:46:37, End Time: 2012-08-02 12:05:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (80 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.66% (79.4075 => 80.7291, std. dev.: 0.1485) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (18.6234 => 18.4226, std. dev.: 0.0709) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.32% (10.3673 => 13.1998, std. dev.: 0.0134) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.11% (1.1194 => 1.2550, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.27% (0.3886 => 0.4324, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.38% (1.7609 => 1.9084, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.04% (2.2022 => 2.3792, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.96% (0.3817 => 0.4121, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.6030 => 0.6382, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.23% (0.4879 => 0.5134, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7326 => 0.7686, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (10.4361 => 10.9299, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3830, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (9.4845 => 9.8933, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.7433 => 0.7739, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.0018 => 5.2055, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.9449 => 5.1439, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.89% (0.8172 => 0.8490, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5860 => 0.6085, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5569 => 0.5771, std. dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4102, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4082, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.17% (0.7835 => 0.8083, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2228, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.00% (0.4299 => 0.4428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.3050 => 1.3434, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (14.3668 => 14.7881, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 2.83% (5.7591 => 5.9220, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.4103 => 0.4210, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.59% (3.3354 => 3.4218, std. dev.: 0.0082) MultiSource/Applications/treecc/treecc: 2.56% (2.0273 => 2.0792, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.52% (1.1642 => 1.1935, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5988, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.43% (0.5105 => 0.5229, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.34% (3.8723 => 3.9628, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.32% (1.5415 => 1.5773, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (2.0665 => 2.1136, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.00% (0.9765 => 0.9960, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.93% (0.6675 => 0.6804, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.2024 => 2.2441, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 1.74% (0.8921 => 0.9076, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.4186 => 1.4428, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.69% (0.6450 => 0.6559, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.68% (1.2842 => 1.3058, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.54% (17.1811 => 17.4451, std. dev.: 0.0283) MultiSource/Benchmarks/nbench/nbench: 1.32% (1.1840 => 1.1996, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.25% (2.2969 => 2.3255, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.16% (4.2280 => 4.4040, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2147, std. dev.: 0.0008) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2187, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3752, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.95% (5.2763 => 3.1686, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7007, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6999, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0244, std. dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5464, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -12.24% (22.1758 => 19.4621, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1165, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -8.66% (1.5373 => 1.4041, std. dev.: 0.0243) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.65% (19.9488 => 18.4226, std. dev.: 0.0709) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.85% (1.9577 => 1.8627, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4807, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9066, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4193, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9996, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2009, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4185, std. dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.38% (1.8329 => 1.8076, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 07:27:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 09:27:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802142725.F24E02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2590?compare_to=2585&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2590, Order: 161165, Start Time: 2012-08-02 11:44:01, End Time: 2012-08-02 14:27:56 To: 2585, Order: 161156, Start Time: 2012-08-02 08:31:54, End Time: 2012-08-02 11:15:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (78 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (804 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.12% (126.6495 => 130.6035, std. dev.: 0.2497) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3488 => 0.3920, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3460 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.29% (0.3465 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3469 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3496 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.89% (0.3650 => 0.4084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 11.49% (0.3724 => 0.4152, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.94% (0.3792 => 0.4169, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.69% (0.1063 => 0.1166, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.58% (1.5932 => 1.6980, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5826 => 0.6180, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (3.5627 => 3.7730, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference-object: 5.81% (0.5889 => 0.6231, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.56% (1.6211 => 1.7112, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 5.46% (0.4029 => 0.4249, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.41% (1.3152 => 1.3863, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.39% (0.4994 => 0.5263, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (0.4361 => 0.4584, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.99% (0.3930 => 0.4126, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (0.5000 => 0.5249, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.5900 => 0.6193, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 4.85% (1.0781 => 1.1304, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 4.59% (4.2109 => 4.4042, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (2.7292 => 2.8534, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference: 4.25% (0.7171 => 0.7476, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.2736 => 0.2847, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (2.1013 => 2.1864, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (1.9694 => 2.0481, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 3.85% (5.5417 => 5.7552, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.80% (0.3890 => 0.4038, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (1.9966 => 2.0697, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.53% (0.3004 => 0.3110, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.48% (2.1653 => 2.2407, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (4.4195 => 4.5671, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.4139 => 0.4277, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.29% (0.3195 => 0.3300, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.28% (4.6177 => 4.7690, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 3.26% (0.9909 => 1.0232, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 3.21% (23.5202 => 24.2760, std. dev.: 0.0149) MultiSource/Applications/treecc/treecc: 3.20% (0.7875 => 0.8127, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.3903 => 0.4024, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (2.0673 => 2.1294, std. dev.: 0.0123) MultiSource/Applications/siod/siod: 2.88% (0.6634 => 0.6825, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (1.8794 => 1.9334, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.68% (1.4269 => 1.4651, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.49% (0.5546 => 0.5684, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4251 => 0.4352, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.22% (0.9697 => 0.9912, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.72% (0.6435 => 0.6546, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.38% (2.0346 => 2.0627, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6679, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8962, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1642, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6456, std. dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4936, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2204, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.55% (11.9555 => 11.7702, std. dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: -1.26% (2.4764 => 2.4453, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.08% (25.4195 => 16.5017, std. dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/fldry: -9.38% (17.2379 => 15.6206, std. dev.: 0.2109) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7862, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7991, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5441, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5795, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 08:44:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 10:44:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802154412.84FED2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2591?compare_to=2588&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2591, Order: 161175, Start Time: 2012-08-02 14:30:53, End Time: 2012-08-02 15:44:43 To: 2588, Order: 161172, Start Time: 2012-08-02 12:48:42, End Time: 2012-08-02 14:02:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.04% (2.0176 => 2.3211, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7061 => 0.7681, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3663 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.84% (1.3693 => 1.4630, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (3.9660 => 4.2369, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4328 => 0.4617, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.7710 => 0.8216, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.51% (0.7038 => 0.7496, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.69% (0.3899 => 0.4121, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.54% (1.2193 => 1.2868, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.50% (0.6959 => 0.7342, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.45% (0.3580 => 0.3775, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.9828 => 2.0903, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.10% (13.8202 => 14.5244, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.09% (0.5577 => 0.5861, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.96% (16.6129 => 17.4368, std. dev.: 0.0094) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.66% (1.4563 => 1.5242, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.59% (1.1364 => 1.1886, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.54% (0.7506 => 0.7847, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (7.2180 => 7.5457, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.3756 => 0.3926, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.47% (0.5637 => 0.5889, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (3.8646 => 4.0371, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 4.44% (0.8310 => 0.8679, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (13.2842 => 13.8717, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3819 => 1.4420, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 4.30% (1.0594 => 1.1050, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.29% (1.1061 => 1.1535, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.24% (1.3245 => 1.3807, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.15% (1.9270 => 2.0069, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.09% (0.7460 => 0.7765, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2292 => 1.2779, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (3.6692 => 3.8128, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (4.4433 => 4.6132, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.3801 => 4.5461, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 3.60% (2.1791 => 2.2575, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1719, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.26% (0.6283 => 0.6488, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4113 => 0.4246, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1466, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (0.8698 => 0.8976, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.03% (8.4961 => 8.7539, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.88% (3.1889 => 3.2807, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.2742 => 3.3659, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1571, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.5754 => 6.7491, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.63% (16.2614 => 16.6893, std. dev.: 0.0220) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2360, std. dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.5298 => 14.8986, std. dev.: 0.0204) MultiSource/Applications/oggenc/oggenc: 2.49% (4.6629 => 4.7789, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5188 => 1.5549, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.9108 => 0.9265, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.09% (3.7467 => 3.7874, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 1.01% (33.2944 => 33.6301, std. dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5115, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0516) SingleSource/Benchmarks/Misc/mandel-2: 7.14% (1.2998 => 1.3926, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.17% (0.9996 => 1.0513, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7512, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.2619 => 11.7385, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8159, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1391, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1410, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.05% (20.3410 => 18.5004, std. dev.: 0.0796) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std. dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.32% (1.9762 => 1.9106, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9476, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6075, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.31% (6.3560 => 6.2092, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5125, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2266, std. dev.: 0.0142) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2318, std. dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 08:53:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 10:53:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802155326.D41D62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2592?compare_to=2589&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2592, Order: 161175, Start Time: 2012-08-02 14:35:16, End Time: 2012-08-02 15:53:56 To: 2589, Order: 161172, Start Time: 2012-08-02 12:48:38, End Time: 2012-08-02 14:07:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (85 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (13.1998 => 13.4903, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.56% (1.4041 => 1.4401, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.09% (55.0514 => 56.2006, std. dev.: 0.2029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.12% (10.3673 => 13.4903, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3561 => 0.3982, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (2.2022 => 2.3906, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.53% (1.7609 => 1.9111, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.17% (0.3817 => 0.4129, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7326 => 0.7742, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4615 => 0.4868, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.41% (0.4879 => 0.5143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.30% (0.3282 => 0.3456, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (10.4361 => 10.9594, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (7.0540 => 7.3989, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 4.45% (9.4845 => 9.9065, std. dev.: 0.0107) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.7433 => 0.7756, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (4.9449 => 5.1548, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.0018 => 5.2124, std. dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 4.12% (0.3109 => 0.3237, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.8172 => 0.8505, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.94% (0.3121 => 0.3244, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.78% (0.2700 => 0.2802, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.75% (0.5569 => 0.5778, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (4.2646 => 4.4214, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5860 => 0.6073, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.45% (0.7835 => 0.8105, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (8.1363 => 8.4139, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.36% (1.3050 => 1.3489, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2252, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4299 => 0.4439, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.25% (5.7591 => 5.9462, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7900, std. dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (0.5105 => 0.5248, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6037, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4262, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1957, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.65% (2.0273 => 2.0811, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.8067 => 0.8272, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.53% (3.8723 => 3.9704, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5804, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9765 => 0.9997, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.6456 => 0.6608, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.34% (0.6675 => 0.6831, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.26% (2.0665 => 2.1131, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5859 => 1.6215, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.2024 => 2.2495, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.4186 => 1.4477, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.88% (17.1811 => 17.5035, std. dev.: 0.0177) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2842 => 1.3076, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.60% (0.7115 => 0.7229, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2024, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.39% (2.2969 => 2.3288, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.16% (1.0722 => 1.0846, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (4.2280 => 4.3965, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2123, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5086 => 1.5335, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2237, std. dev.: 0.0073) MultiSource/Applications/lua/lua: 1.06% (26.0924 => 26.3695, std. dev.: 0.0361) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1629, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7108, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7094, std. dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0664, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5509, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.05% (22.1758 => 19.5029, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2373 => 1.1138, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.84% (19.9488 => 18.5844, std. dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -6.32% (1.5373 => 1.4401, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5038, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.66% (1.9577 => 1.8664, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4794, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9037, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4253, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0030, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3315, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2006, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.74% (12.5348 => 12.3166, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8080, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 10:26:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 12:26:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802172632.CD2132A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2593?compare_to=2591&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2593, Order: 161180, Start Time: 2012-08-02 16:12:44, End Time: 2012-08-02 17:27:03 To: 2591, Order: 161175, Start Time: 2012-08-02 14:30:53, End Time: 2012-08-02 15:44:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (142 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.90% (2.0176 => 2.3182, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.5818 => 0.6375, std. dev.: 0.0084) SingleSource/UnitTests/ObjC++/Hello: 9.45% (0.5748 => 0.6291, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.99% (0.7061 => 0.7696, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 8.86% (0.3623 => 0.3944, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.85% (0.3650 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.69% (0.3914 => 0.4254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.48% (0.3940 => 0.4274, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.44% (0.4003 => 0.4341, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 7.04% (1.3693 => 1.4657, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2388, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4328 => 0.4618, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7038 => 0.7502, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.51% (0.2782 => 0.2963, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.47% (0.7710 => 0.8209, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.44% (0.5265 => 0.5604, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.10% (0.2607 => 0.2766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.74% (1.2193 => 1.2893, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0934, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.6959 => 0.7343, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9199 => 0.9687, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2988 => 0.3146, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.26% (13.8202 => 14.5472, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.09% (16.6129 => 17.4578, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.97% (0.4390 => 0.4608, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.89% (0.3293 => 0.3454, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (1.4563 => 1.5269, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.71% (0.3868 => 0.4050, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (7.2180 => 7.5519, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.59% (0.5637 => 0.5896, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (13.2842 => 13.8778, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8310 => 0.8678, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (1.1364 => 1.1864, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.0594 => 1.1060, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.35% (1.1061 => 1.1542, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3811, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.3819 => 1.4399, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.7460 => 0.7772, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (3.8646 => 4.0251, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.3813 => 1.4385, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.14% (1.9270 => 2.0067, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.07% (1.2292 => 1.2792, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (3.6692 => 3.8169, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6183, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5476, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.55% (2.1791 => 2.2564, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.55% (1.1333 => 1.1735, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.4113 => 0.4254, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.38% (4.9865 => 5.1551, std. dev.: 0.0114) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.16% (0.8698 => 0.8973, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (8.4961 => 8.7644, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.00% (3.1889 => 3.2845, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.91% (3.2742 => 3.3696, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.87% (2.1007 => 2.1609, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7081, std. dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.5754 => 6.7530, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.67% (14.8535 => 15.2498, std. dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.5298 => 14.8982, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5188 => 1.5565, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.37% (4.6629 => 4.7735, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.80% (0.9108 => 0.9272, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.6250 => 0.6359, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.46% (1.0313 => 1.0464, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2785 => 6.3481, std. dev.: 0.0125) MultiSource/Benchmarks/Bullet/bullet: 1.00% (33.2944 => 33.6283, std. dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/mandel-2: 7.47% (1.2998 => 1.3969, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.83% (1.5824 => 1.6746, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7550, std. dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7397, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0310 => 1.0435, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.5627 => 21.1368, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.41% (1.2308 => 1.1150, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.83% (20.3410 => 18.5447, std. dev.: 0.0175) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.36% (1.9762 => 1.9098, std. dev.: 0.0099) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9468, std. dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5988, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.23% (6.3560 => 6.2144, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5003, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2262, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8720, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2288, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 10:39:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 12:39:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802173920.67F332A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2594?compare_to=2590&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2594, Order: 161175, Start Time: 2012-08-02 14:56:12, End Time: 2012-08-02 17:39:51 To: 2590, Order: 161165, Start Time: 2012-08-02 11:44:01, End Time: 2012-08-02 14:27:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.44% (0.3465 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3488 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.34% (0.3469 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3496 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3643 => 0.4078, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.49% (0.3724 => 0.4152, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5826 => 0.6208, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.48% (1.5932 => 1.6965, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.5889 => 0.6261, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (0.4994 => 0.5279, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (3.5627 => 3.7631, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (1.6211 => 1.7103, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.18% (1.3152 => 1.3833, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (0.5000 => 0.5255, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.94% (0.7171 => 0.7525, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.5900 => 0.6179, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (0.3930 => 0.4115, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.62% (1.0781 => 1.1279, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 4.49% (0.4029 => 0.4210, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.36% (4.2109 => 4.3946, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3195 => 0.3334, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (2.7292 => 2.8475, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2875 => 0.2995, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.09% (0.3004 => 0.3127, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.02% (0.9909 => 1.0307, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.2736 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2792 => 0.2900, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.78% (0.3124 => 0.3242, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2780 => 0.2885, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.76% (2.0673 => 2.1450, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.74% (0.2811 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.70% (0.2729 => 0.2830, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (1.9694 => 2.0418, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 3.67% (0.3267 => 0.3387, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.64% (5.5417 => 5.7432, std. dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (2.1013 => 2.1776, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 3.62% (0.3096 => 0.3208, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.2823 => 0.2925, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.59% (0.2813 => 0.2914, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.2911 => 0.3015, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3258 => 0.3374, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0671, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (0.4658 => 0.4821, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.46% (0.3060 => 0.3166, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (0.3890 => 0.4024, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.40% (0.3678 => 0.3803, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.39% (23.5202 => 24.3187, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3726 => 0.3850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4146 => 0.4280, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (0.3348 => 0.3456, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (2.1653 => 2.2338, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.3271 => 0.3374, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3625 => 0.3738, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3477 => 0.3585, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (4.4195 => 4.5560, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.3903 => 0.4023, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (1.8794 => 1.9370, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.06% (0.9697 => 0.9994, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.04% (4.6177 => 4.7580, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.87% (0.4251 => 0.4373, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.3981 => 0.4093, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.3845 => 0.3952, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.59% (0.7875 => 0.8079, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.56% (1.4269 => 1.4634, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.38% (0.5546 => 0.5678, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.5012 => 0.5131, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.32% (0.6634 => 0.6788, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.6435 => 0.6575, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.18% (2.0346 => 2.0586, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 14.99% (2.5769 => 2.9632, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6681, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1655, std. dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6795, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1979, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4960, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2214, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.27% (11.9555 => 11.8033, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5329, std. dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -8.35% (17.2379 => 15.7992, std. dev.: 0.1101) SingleSource/Benchmarks/Shootout-C++/ary2: -8.16% (0.2402 => 0.2206, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7939, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7993, std. dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -3.51% (14.0481 => 13.5544, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 10:39:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 12:39:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802173954.05EC72A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2595?compare_to=2592&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2595, Order: 161180, Start Time: 2012-08-02 16:21:59, End Time: 2012-08-02 17:40:25 To: 2592, Order: 161175, Start Time: 2012-08-02 14:35:16, End Time: 2012-08-02 15:53:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (82 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.57% (13.4903 => 13.8370, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.22% (7.9570 => 8.0540, std. dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.47% (10.3673 => 13.8370, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.95% (0.3516 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.94% (0.3543 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3927 => 0.4355, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.83% (1.7609 => 1.9163, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.78% (0.3817 => 0.4152, std. dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.55% (2.2022 => 2.3905, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1892 => 0.2014, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5925 => 0.6304, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.37% (0.6030 => 0.6414, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.39% (0.3282 => 0.3459, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7326 => 0.7709, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (7.0540 => 7.4181, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (10.4361 => 10.9296, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 4.61% (9.4845 => 9.9221, std. dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (4.9449 => 5.1472, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (5.0018 => 5.2050, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.86% (0.3109 => 0.3229, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (4.2646 => 4.4263, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.75% (0.5569 => 0.5778, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5860 => 0.6073, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.44% (8.1363 => 8.4165, std. dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 3.39% (5.7591 => 5.9541, std. dev.: 0.0125) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.24% (1.3050 => 1.3473, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1861 => 1.2243, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.13% (0.4636 => 0.4781, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.07% (0.4299 => 0.4431, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.00% (0.5105 => 0.5258, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7910, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 2.85% (1.5603 => 1.6048, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.84% (1.1642 => 1.1973, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.5415 => 1.5835, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.63% (3.3354 => 3.4232, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0795, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.56% (0.4103 => 0.4208, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.8067 => 0.8270, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.49% (3.8723 => 3.9686, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.49% (0.6675 => 0.6841, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.2024 => 2.2565, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5859 => 1.6248, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9765 => 1.0003, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.4289 => 0.4389, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (2.0665 => 2.1123, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6450 => 0.6582, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8921 => 0.9095, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2049, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.71% (1.2842 => 1.3062, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4723, std. dev.: 0.0055) MultiSource/Applications/minisat/minisat: 1.63% (0.7115 => 0.7231, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.45% (2.2969 => 2.3301, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.08% (1.0722 => 1.0838, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (4.2280 => 4.4147, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2041, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0313 => 1.0439, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3708, std. dev.: 0.0343) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1630, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7172, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7141, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0638, std. dev.: 0.0581) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.52% (2.9384 => 2.5411, std. dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: -11.99% (22.1758 => 19.5178, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2373 => 1.1158, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -7.04% (1.5373 => 1.4291, std. dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.95% (19.9488 => 18.5623, std. dev.: 0.0407) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.71% (1.9577 => 1.8654, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4711, std. dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9095, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4311, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0030, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2004, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3179, std. dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4173, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 12:11:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 14:11:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802191153.A3EEC2A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2596?compare_to=2593&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2596, Order: 161183, Start Time: 2012-08-02 17:55:04, End Time: 2012-08-02 19:08:54 To: 2593, Order: 161180, Start Time: 2012-08-02 16:12:44, End Time: 2012-08-02 17:27:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.33% (54.7787 => 56.6011, std. dev.: 0.0116) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.42% (2.0176 => 2.3086, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.65% (0.5818 => 0.6321, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5748 => 0.6238, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.33% (0.3578 => 0.3876, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.16% (0.3601 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.09% (0.3646 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.05% (0.3663 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.92% (0.3650 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.66% (0.3940 => 0.4242, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4651, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.7710 => 0.8241, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2378, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.53% (0.5265 => 0.5609, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.3899 => 0.4125, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.74% (1.2193 => 1.2893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.63% (0.4390 => 0.4637, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.49% (1.9828 => 2.0917, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.36% (0.5577 => 0.5876, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.32% (0.9199 => 0.9688, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.18% (13.8202 => 14.5365, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 4.97% (16.6129 => 17.4392, std. dev.: 0.0171) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.79% (1.4563 => 1.5261, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5518, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.58% (0.8310 => 0.8691, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (13.2842 => 13.8921, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3246 => 0.3394, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.54% (1.0594 => 1.1075, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (1.1364 => 1.1875, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4435, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3834, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.44% (0.7506 => 0.7839, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2995 => 0.3126, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.35% (1.1061 => 1.1542, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.29% (1.3813 => 1.4405, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.22% (3.8646 => 4.0276, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (0.7460 => 0.7774, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.20% (1.9270 => 2.0080, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8162, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.2292 => 1.2772, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.4433 => 4.6151, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.3801 => 4.5488, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.65% (4.9865 => 5.1684, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 3.63% (2.1791 => 2.2583, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.6283 => 0.6505, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.53% (0.4113 => 0.4258, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.1333 => 1.1723, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.8698 => 0.8988, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.4961 => 8.7789, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.19% (0.6135 => 0.6331, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.01% (3.2742 => 3.3727, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.93% (2.1007 => 2.1622, std. dev.: 0.0146) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2799, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.5754 => 6.7616, std. dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: 2.70% (14.8535 => 15.2539, std. dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: 2.63% (4.6629 => 4.7855, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6881, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (1.5188 => 1.5586, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8962, std. dev.: 0.0156) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.11% (0.9108 => 0.9300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6250 => 0.6371, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.09% (33.2944 => 33.6584, std. dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (6.2785 => 6.3457, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7862, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.25% (5.7573 => 7.4989, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0363) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3972, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 4.49% (7.4271 => 7.7605, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7390, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9664, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (1.9290 => 1.9514, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6856, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.5627 => 21.1526, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8630, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2308 => 1.0996, std. dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (20.3410 => 18.6143, std. dev.: 0.0499) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.36% (1.9762 => 1.9098, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5972, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2190, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2153, std. dev.: 0.0276) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2484, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 12:29:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 14:29:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802192951.4C4BF2A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2597?compare_to=2595&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2597, Order: 161183, Start Time: 2012-08-02 18:08:30, End Time: 2012-08-02 19:27:00 To: 2595, Order: 161180, Start Time: 2012-08-02 16:21:59, End Time: 2012-08-02 17:40:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (87 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.47% (10.3673 => 13.8371, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3473 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.12% (0.3497 => 0.3921, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.08% (0.3543 => 0.3971, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3516 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.05% (0.3543 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.90% (0.3817 => 0.4195, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.16% (1.7609 => 1.9222, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.71% (2.2022 => 2.3941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.4879 => 0.5150, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.51% (0.3282 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7326 => 0.7712, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.24% (0.4615 => 0.4857, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.11% (7.0540 => 7.4142, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (10.4361 => 10.9673, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 4.55% (9.4845 => 9.9159, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 4.24% (0.7433 => 0.7748, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.9449 => 5.1464, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (5.0018 => 5.2034, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8172 => 0.8482, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.76% (0.3109 => 0.3226, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (4.2646 => 4.4222, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.53% (0.5860 => 0.6067, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.34% (5.7591 => 5.9517, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.32% (8.1363 => 8.4061, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.24% (0.7835 => 0.8089, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.24% (1.1861 => 1.2245, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (1.3050 => 1.3458, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 3.12% (0.4299 => 0.4433, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8017, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.4636 => 0.4776, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.5105 => 0.5247, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4275, std. dev.: 0.0101) MultiSource/Applications/hbd/hbd: 2.67% (1.5603 => 1.6019, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.66% (2.0273 => 2.0812, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1951, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5810, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.50% (0.6675 => 0.6842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.4289 => 0.4395, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.46% (0.4103 => 0.4204, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.41% (3.8723 => 3.9658, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6240, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (2.0665 => 2.1130, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.2024 => 2.2514, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.20% (0.6456 => 0.6598, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.16% (0.9765 => 0.9976, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6450 => 0.6588, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8921 => 0.9102, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.4186 => 1.4473, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 1.78% (1.1840 => 1.2051, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.2842 => 1.3060, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4716, std. dev.: 0.0136) MultiSource/Applications/minisat/minisat: 1.52% (0.7115 => 0.7223, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.41% (2.2969 => 2.3293, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.14% (1.0722 => 1.0844, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.27% (4.2280 => 4.4085, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2119, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5086 => 1.5331, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 1.54% (2.2771 => 2.3122, std. dev.: 0.0122) MultiSource/Applications/aha/aha: 1.45% (3.1595 => 3.2052, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2244, std. dev.: 0.0173) MultiSource/Applications/lua/lua: 1.09% (26.0924 => 26.3766, std. dev.: 0.0468) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.03% (2.8904 => 2.9201, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.91% (5.2763 => 3.1705, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.02% (5.3855 => 3.7151, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7123, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -15.06% (54.1659 => 46.0091, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5431, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -12.09% (22.1758 => 19.4950, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1165, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -9.00% (1.5373 => 1.3989, std. dev.: 0.0239) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.96% (19.9488 => 18.5601, std. dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -4.70% (1.9577 => 1.8657, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4716, std. dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.13% (8.6802 => 8.4082, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9081, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0028, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2004, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3160, std. dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4178, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8093, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 13:51:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 15:51:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802205132.100792A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2598?compare_to=2594&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2598, Order: 161183, Start Time: 2012-08-02 18:08:05, End Time: 2012-08-02 20:52:01 To: 2594, Order: 161175, Start Time: 2012-08-02 14:56:12, End Time: 2012-08-02 17:39:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (80 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (803 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.66% (124.0453 => 129.8223, std. dev.: 0.7911) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (2.0692 => 2.0921, std. dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.29% (0.3792 => 0.4258, std. dev.: 0.0112) SingleSource/UnitTests/ObjC/exceptions-2: 12.28% (0.3446 => 0.3869, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 12.21% (0.3465 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3460 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.16% (0.3496 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3488 => 0.3912, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3442 => 0.3859, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.11% (0.3469 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.69% (0.3643 => 0.4069, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.62% (0.3650 => 0.4074, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.40% (1.5932 => 1.6951, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5826 => 0.6192, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5889 => 0.6241, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.41% (3.5627 => 3.7556, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (1.6211 => 1.7062, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.89% (0.4994 => 0.5238, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.72% (0.4361 => 0.4567, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (0.5000 => 0.5236, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (1.3152 => 1.3767, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.5900 => 0.6171, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.57% (0.7171 => 0.7499, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.41% (1.0781 => 1.1256, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.39% (0.4029 => 0.4206, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (0.5026 => 0.5240, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 4.21% (4.2109 => 4.3883, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.97% (2.7292 => 2.8376, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.2866 => 0.2975, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (1.9694 => 2.0433, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (0.3195 => 0.3310, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (0.3890 => 0.4029, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.57% (5.5417 => 5.7397, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.55% (0.2875 => 0.2977, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.43% (0.3004 => 0.3107, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.39% (1.9966 => 2.0642, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 3.36% (0.9909 => 1.0242, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (2.1013 => 2.1710, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (2.0673 => 2.1333, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (0.4658 => 0.4806, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 3.15% (0.3267 => 0.3370, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.10% (23.5202 => 24.2489, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary: 3.07% (0.3258 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.3271 => 0.3371, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (2.1653 => 2.2300, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (1.8794 => 1.9335, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (4.4195 => 4.5435, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.4139 => 0.4255, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.77% (4.6177 => 4.7457, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: 2.75% (0.3678 => 0.3779, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.74% (0.7875 => 0.8091, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.68% (0.3726 => 0.3826, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.57% (1.4269 => 1.4635, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4146 => 0.4250, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.50% (0.6634 => 0.6800, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.38% (0.9697 => 0.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (0.4251 => 0.4351, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.25% (0.5546 => 0.5671, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.5012 => 0.5115, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.6435 => 0.6553, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.06% (0.5917 => 0.6690, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6753, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1634, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6734, std. dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2131, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5031, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5903, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.39% (11.9555 => 11.7898, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5225, std. dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -7.67% (17.2379 => 15.9157, std. dev.: 0.1068) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8063, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: -6.95% (0.2402 => 0.2235, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -4.03% (0.4438 => 0.4259, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.66% (14.0481 => 13.5342, std. dev.: 0.0132) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 13:57:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 15:57:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802205725.A4E3C2A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2599?compare_to=2596&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2599, Order: 161198, Start Time: 2012-08-02 19:40:29, End Time: 2012-08-02 20:54:21 To: 2596, Order: 161183, Start Time: 2012-08-02 17:55:04, End Time: 2012-08-02 19:08:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.79% (79.3113 => 80.7339, std. dev.: 0.4286) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.19% (2.0176 => 2.3241, std. dev.: 0.0182) SingleSource/UnitTests/ObjC++/property-reference: 8.58% (0.7061 => 0.7667, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.5818 => 0.6309, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5748 => 0.6232, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.99% (0.3578 => 0.3864, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.94% (0.3663 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3646 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.75% (0.3650 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3914 => 0.4217, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.4003 => 0.4307, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.30% (1.3693 => 1.4692, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (3.9660 => 4.2422, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.7710 => 0.8201, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.00% (0.3899 => 0.4133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.6959 => 0.7358, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (1.2193 => 1.2892, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.57% (1.9828 => 2.0932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.48% (0.3485 => 0.3676, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9199 => 0.9696, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.27% (13.8202 => 14.5484, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 5.05% (16.6129 => 17.4516, std. dev.: 0.0146) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (1.4563 => 1.5259, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 4.78% (0.8310 => 0.8707, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.77% (1.0594 => 1.1099, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (1.1364 => 1.1898, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3868 => 0.4049, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.3245 => 1.3849, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (7.2180 => 7.5458, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.53% (13.2842 => 13.8861, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (3.8646 => 4.0391, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 4.51% (1.9270 => 2.0139, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0065) MultiSource/Applications/Burg/burg: 4.35% (1.1061 => 1.1542, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.24% (1.3819 => 1.4405, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.18% (1.3813 => 1.4390, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (3.6692 => 3.8217, std. dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: 4.06% (1.2292 => 1.2791, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.03% (0.4791 => 0.4984, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.96% (2.1791 => 2.2653, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (4.3801 => 4.5508, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (4.4433 => 4.6156, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.66% (4.9865 => 5.1692, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.49% (0.6283 => 0.6502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.47% (0.8698 => 0.9000, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.4113 => 0.4254, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.29% (0.6135 => 0.6337, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (8.4961 => 8.7737, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.19% (3.2742 => 3.3786, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.18% (2.1007 => 2.1675, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.03% (3.1889 => 3.2854, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.94% (16.2614 => 16.7390, std. dev.: 0.0174) MultiSource/Applications/JM/lencod/lencod: 2.90% (14.8535 => 15.2849, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7622, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 2.83% (4.6629 => 4.7948, std. dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.5298 => 14.9279, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (1.5188 => 1.5596, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.12% (0.9108 => 0.9301, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6250 => 0.6366, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.64% (1.0313 => 1.0482, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7898, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (6.2785 => 6.3418, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5192, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2720, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/mandel-2: 8.04% (1.2998 => 1.4043, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.22% (0.9996 => 1.0518, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 4.47% (7.4271 => 7.7589, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7390, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.34% (0.9692 => 0.9919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.44% (2.0200 => 2.0491, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.20% (1.0310 => 1.0434, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6857, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1690, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2308 => 1.1096, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.63% (20.3410 => 18.5862, std. dev.: 0.0772) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0058) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.45% (1.3780 => 1.3167, std. dev.: 0.0073) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.39% (1.9762 => 1.9092, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9481, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.42% (8.8259 => 8.6127, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2256, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5059, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3305 => 7.2249, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2200, std. dev.: 0.0359) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 14:30:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 16:30:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802213041.9C11E2A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2600?compare_to=2597&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2600, Order: 161207, Start Time: 2012-08-02 20:12:43, End Time: 2012-08-02 21:31:12 To: 2597, Order: 161183, Start Time: 2012-08-02 18:08:30, End Time: 2012-08-02 19:27:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (87 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.65% (13.8371 => 14.3417, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.38% (1.3989 => 1.4322, std. dev.: 0.0091) MultiSource/Applications/siod/siod: 1.30% (3.2542 => 3.2964, std. dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.34% (10.3673 => 14.3417, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 12.18% (0.3497 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3516 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3561 => 0.3989, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.75% (0.3694 => 0.4128, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.93% (0.3817 => 0.4158, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.88% (2.2022 => 2.3978, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.42% (1.7609 => 1.9091, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.60% (7.0540 => 7.4488, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.4879 => 0.5148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.50% (0.7326 => 0.7729, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 5.45% (0.3282 => 0.3461, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (10.4361 => 10.9675, std. dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.47% (9.4845 => 9.9088, std. dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 4.43% (0.7433 => 0.7762, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2078, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1474, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (4.2646 => 4.4254, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.76% (0.3109 => 0.3226, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.72% (0.5860 => 0.6078, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (8.1363 => 8.4186, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: 3.33% (0.7835 => 0.8096, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.1861 => 1.2248, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (14.3668 => 14.8229, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.3050 => 1.3462, std. dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 3.11% (5.7591 => 5.9384, std. dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.91% (1.1642 => 1.1981, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 2.88% (0.4299 => 0.4423, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.5415 => 1.5859, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (0.5105 => 0.5249, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.82% (2.0273 => 2.0844, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.77% (3.3354 => 3.4278, std. dev.: 0.0084) MultiSource/Applications/hbd/hbd: 2.65% (1.5603 => 1.6016, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.59% (0.4636 => 0.4756, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.8067 => 0.8272, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.46% (3.8723 => 3.9675, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.43% (0.9765 => 1.0002, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.43% (0.6675 => 0.6837, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6240, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.2024 => 2.2539, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5981 => 0.6104, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.03% (17.1811 => 17.5299, std. dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6456 => 0.6587, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.02% (0.8921 => 0.9101, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4468, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.84% (1.1840 => 1.2058, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.83% (2.0665 => 2.1044, std. dev.: 0.0116) MultiSource/Applications/minisat/minisat: 1.64% (0.7115 => 0.7232, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.61% (2.2969 => 2.3338, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 1.36% (1.2842 => 1.3017, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0848, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (4.2280 => 4.4083, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7577, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2150, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5340, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 1.60% (11.6436 => 11.8302, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 1.45% (2.2771 => 2.3101, std. dev.: 0.0012) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2262, std. dev.: 0.0313) MultiSource/Applications/lua/lua: 1.11% (26.0924 => 26.3817, std. dev.: 0.0346) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.11% (5.2763 => 3.1602, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.96% (5.3855 => 3.7180, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.60% (5.3526 => 3.7145, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0362, std. dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5462, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.06% (22.1758 => 19.5015, std. dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2373 => 1.1105, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5501, std. dev.: 0.1097) SingleSource/Benchmarks/Misc/mandel-2: -6.84% (1.5373 => 1.4322, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.98% (1.9577 => 1.8603, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4895, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (8.1563 => 7.9009, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4144, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0032, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.20% (12.4730 => 12.1992, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3198, std. dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0049) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4185, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8079, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 15:39:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 17:39:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802223913.5311D2A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2601?compare_to=2599&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2601, Order: 161207, Start Time: 2012-08-02 21:25:57, End Time: 2012-08-02 22:39:43 To: 2599, Order: 161198, Start Time: 2012-08-02 19:40:29, End Time: 2012-08-02 20:54:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (145 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.07% (54.8514 => 56.5380, std. dev.: 0.1437) MultiSource/Applications/siod/siod: 1.45% (3.2539 => 3.3011, std. dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.48% (2.0176 => 2.3299, std. dev.: 0.0110) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.5818 => 0.6313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.37% (0.5748 => 0.6229, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.02% (0.3578 => 0.3865, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.97% (0.3601 => 0.3888, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.95% (0.3646 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.92% (0.3650 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.86% (0.3789 => 0.4087, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3663 => 0.3951, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 7.82% (0.3914 => 0.4220, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 7.44% (0.7061 => 0.7586, std. dev.: 0.0037) MultiSource/Applications/hbd/hbd: 7.40% (1.3693 => 1.4706, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.92% (3.9660 => 4.2405, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 6.72% (0.7038 => 0.7511, std. dev.: 0.0156) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.7710 => 0.8224, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4328 => 0.4612, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2781 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.3899 => 0.4125, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.2193 => 1.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.68% (0.3485 => 0.3683, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.6959 => 0.7354, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.61% (0.3580 => 0.3781, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9199 => 0.9703, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.48% (1.9828 => 2.0914, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.34% (0.3149 => 0.3317, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2988 => 0.3146, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5336, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/sieve: 4.95% (0.3453 => 0.3624, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.94% (16.6129 => 17.4340, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.90% (1.4563 => 1.5277, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 4.89% (0.3293 => 0.3454, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4390 => 0.4601, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.8310 => 0.8704, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.72% (1.0594 => 1.1094, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (1.1364 => 1.1898, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.57% (7.2180 => 7.5476, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.50% (13.2842 => 13.8816, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.46% (0.7506 => 0.7841, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3835, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (1.3819 => 1.4427, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.39% (1.1061 => 1.1547, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.31% (0.3246 => 0.3386, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4408, std. dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 4.27% (0.2995 => 0.3123, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (3.8646 => 4.0284, std. dev.: 0.0105) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (3.6692 => 3.8224, std. dev.: 0.0081) MultiSource/Applications/treecc/treecc: 4.16% (1.9270 => 2.0071, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.97% (1.2292 => 1.2780, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5512, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.4433 => 4.6154, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 3.70% (2.1791 => 2.2598, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 3.53% (0.4113 => 0.4258, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3755 => 0.3887, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (1.1333 => 1.1731, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (8.4961 => 8.7796, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8698 => 0.8985, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1505, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (3.2742 => 3.3775, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.06% (3.1889 => 3.2866, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.99% (2.1007 => 2.1636, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.92% (14.8535 => 15.2878, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.5754 => 6.7663, std. dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 2.86% (16.2614 => 16.7268, std. dev.: 0.0149) MultiSource/Applications/oggenc/oggenc: 2.77% (4.6629 => 4.7922, std. dev.: 0.0165) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9225, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.59% (1.5188 => 1.5581, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.17% (0.9108 => 0.9306, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6250 => 0.6356, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.58% (1.0313 => 1.0476, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (6.2785 => 6.3462, std. dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 26.63% (1.8175 => 2.3015, std. dev.: 0.0370) SingleSource/Benchmarks/Misc/mandel-2: 8.37% (1.2998 => 1.4086, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.99% (0.9996 => 1.0595, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 4.53% (7.4271 => 7.7632, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7039, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5111, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1934, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (1.9290 => 1.9513, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1404, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.06% (10.7476 => 10.8612, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1309, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.63% (1.2308 => 1.1123, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.60% (20.3410 => 18.5916, std. dev.: 0.0690) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.43% (1.3780 => 1.3169, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9474, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5987, std. dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5011, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2315, std. dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2072, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4919, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2182, std. dev.: 0.0409) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2502, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 16:17:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 18:17:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802231711.682412A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2602?compare_to=2600&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2602, Order: 161211, Start Time: 2012-08-02 21:59:12, End Time: 2012-08-02 23:17:41 To: 2600, Order: 161207, Start Time: 2012-08-02 20:12:43, End Time: 2012-08-02 21:31:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (85 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.20% (28.3808 => 29.5742, std. dev.: 0.1304) SingleSource/Regression/C/uint64_to_float: 1.97% (0.5328 => 0.5433, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.61% (10.3673 => 14.3702, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.91% (0.3886 => 0.4310, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.04% (0.3817 => 0.4162, std. dev.: 0.0117) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.68% (2.2022 => 2.3934, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.89% (1.7609 => 1.8999, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.77% (0.6030 => 0.6378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.76% (0.5925 => 0.6266, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.49% (0.4879 => 0.5147, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (7.0540 => 7.4389, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.36% (0.3282 => 0.3458, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.00% (10.4361 => 10.9583, std. dev.: 0.0197) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.64% (0.7326 => 0.7666, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 4.61% (9.4845 => 9.9220, std. dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: 4.41% (0.7433 => 0.7761, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.9449 => 5.1410, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (5.0018 => 5.1970, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.84% (0.8172 => 0.8486, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (4.2646 => 4.4253, std. dev.: 0.0121) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.67% (0.5860 => 0.6075, std. dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 3.67% (0.3109 => 0.3223, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.39% (8.1363 => 8.4119, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1861 => 1.2242, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.3050 => 1.3460, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.05% (5.7591 => 5.9350, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (14.3668 => 14.8033, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 3.00% (0.4299 => 0.4428, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.86% (1.1642 => 1.1975, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.80% (1.5415 => 1.5847, std. dev.: 0.0074) MultiSource/Applications/d/make_dparser: 2.78% (3.3354 => 3.4280, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.74% (0.5105 => 0.5245, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.74% (0.4636 => 0.4763, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.73% (2.0273 => 2.0827, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.63% (3.8723 => 3.9743, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.53% (1.5603 => 1.5997, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5859 => 1.6256, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.50% (0.6675 => 0.6842, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.2024 => 2.2566, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9765 => 1.0001, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.6456 => 0.6590, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8921 => 0.9106, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5981 => 0.6104, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.4186 => 1.4474, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.93% (17.1811 => 17.5123, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 1.84% (1.1840 => 1.2058, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.82% (2.2969 => 2.3387, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.73% (2.0665 => 2.1022, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.45% (0.7115 => 0.7218, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.28% (1.2842 => 1.3006, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (4.2280 => 4.4163, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7502, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5351, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8325, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 1.59% (3.1578 => 3.2079, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2468, std. dev.: 0.0051) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.51% (0.8651 => 0.1686, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.03% (5.2763 => 3.1640, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7040, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7042, std. dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1304, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.14% (2.9384 => 2.5524, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -12.18% (22.1758 => 19.4749, std. dev.: 0.0255) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2373 => 1.1094, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -9.27% (1.5373 => 1.3948, std. dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5690, std. dev.: 0.0552) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -4.67% (1.9577 => 1.8662, std. dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4737, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9005, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4278, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9996, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2017, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3148, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4192, std. dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8096, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 17:03:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 19:03:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120803000308.E741F2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2603?compare_to=2598&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2603, Order: 161207, Start Time: 2012-08-02 21:20:14, End Time: 2012-08-03 00:03:39 To: 2598, Order: 161183, Start Time: 2012-08-02 18:08:05, End Time: 2012-08-02 20:52:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 1 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (810 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.37% (1.6951 => 1.6719, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 22.15% (0.3792 => 0.4632, std. dev.: 0.0191) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.13% (0.3465 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3442 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3469 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.96% (0.3496 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.95% (0.3460 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3488 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.52% (0.3643 => 0.4099, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.41% (0.3650 => 0.4103, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.14% (0.3724 => 0.4176, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.90% (0.5826 => 0.6228, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.74% (0.5889 => 0.6286, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.21% (3.5627 => 3.7484, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.18% (1.6211 => 1.7050, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.17% (0.7171 => 0.7542, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (0.3930 => 0.4132, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.94% (1.5932 => 1.6719, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.77% (0.4994 => 0.5232, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.5900 => 0.6178, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (0.5026 => 0.5262, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.65% (0.4361 => 0.4564, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.2866 => 0.2996, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.36% (1.3152 => 1.3725, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (0.5000 => 0.5217, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.03% (1.0781 => 1.1215, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 3.91% (4.2109 => 4.3756, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (1.9694 => 2.0447, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.80% (2.7292 => 2.8329, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (0.3195 => 0.3308, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.51% (5.5417 => 5.7364, std. dev.: 0.0118) MultiSource/Applications/hexxagon/hexxagon: 3.33% (0.9909 => 1.0239, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.28% (1.9966 => 2.0621, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.22% (2.0673 => 2.1338, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.11% (0.3890 => 0.4011, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.3903 => 0.4024, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.10% (2.1013 => 2.1664, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.4139 => 0.4266, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (4.4195 => 4.5531, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (0.4658 => 0.4798, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 2.96% (1.8794 => 1.9351, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 2.80% (0.6634 => 0.6820, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.79% (23.5202 => 24.1758, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/sieve: 2.76% (0.3726 => 0.3829, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.76% (0.7875 => 0.8092, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.61% (4.6177 => 4.7380, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 2.59% (2.1653 => 2.2214, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.43% (1.4269 => 1.4616, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.40% (0.9697 => 0.9930, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.20% (0.5546 => 0.5668, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.6435 => 0.6547, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.03% (2.5769 => 2.9641, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6732, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1640, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7075, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1950, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4986, std. dev.: 0.0260) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5912, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.63% (11.9555 => 11.7602, std. dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -1.32% (2.4764 => 2.4436, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5396, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: -8.46% (17.2379 => 15.7798, std. dev.: 0.0521) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9783, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8035, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: -4.03% (0.4438 => 0.4259, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8015, std. dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5430, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5775, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 17:20:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 19:20:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803002058.BCA542A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2604?compare_to=2601&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2604, Order: 161222, Start Time: 2012-08-02 23:07:41, End Time: 2012-08-03 00:21:27 To: 2601, Order: 161207, Start Time: 2012-08-02 21:25:57, End Time: 2012-08-02 22:39:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (146 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.31% (1.4086 => 1.3902, std. dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.29% (2.0176 => 2.3260, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 8.82% (0.5818 => 0.6331, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3601 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.63% (0.3663 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5748 => 0.6240, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3650 => 0.3960, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 8.47% (0.3623 => 0.3930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3789 => 0.4110, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.80% (0.7061 => 0.7612, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.73% (1.3693 => 1.4751, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.97% (3.9660 => 4.2426, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4328 => 0.4628, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.5265 => 0.5618, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.52% (0.7710 => 0.8213, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.2937 => 0.3114, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2655 => 0.2815, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 6.02% (0.2690 => 0.2852, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.78% (0.3580 => 0.3787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.71% (1.9828 => 2.0961, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.68% (1.2193 => 1.2885, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.59% (0.6959 => 0.7348, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.2988 => 0.3149, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5503, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/sieve: 5.24% (0.3453 => 0.3634, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.9199 => 0.9677, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.18% (0.5577 => 0.5866, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3534 => 0.3717, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.01% (16.6129 => 17.4455, std. dev.: 0.0180) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.01% (0.4390 => 0.4610, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.00% (0.4016 => 0.4217, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (0.3756 => 0.3943, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.92% (1.4563 => 1.5279, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.91% (0.3868 => 0.4058, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.70% (7.2180 => 7.5575, std. dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (13.2842 => 13.9060, std. dev.: 0.0163) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (1.1364 => 1.1892, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.58% (0.8310 => 0.8691, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 4.58% (0.7506 => 0.7850, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.57% (1.0594 => 1.1078, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.46% (1.1061 => 1.1554, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0113, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.36% (3.8646 => 4.0331, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.3245 => 1.3817, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2292 => 1.2818, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.3819 => 1.4399, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.3813 => 1.4388, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.7460 => 0.7766, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (3.6692 => 3.8188, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.99% (4.3801 => 4.5547, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6191, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.88% (2.1791 => 2.2637, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.75% (0.3755 => 0.3896, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (4.9865 => 5.1623, std. dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.50% (1.1333 => 1.1730, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.41% (0.8698 => 0.8995, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.39% (0.6283 => 0.6496, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (8.4961 => 8.7648, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.15% (3.1889 => 3.2892, std. dev.: 0.0145) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.98% (2.1007 => 2.1632, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.93% (16.2614 => 16.7385, std. dev.: 0.0216) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (6.5754 => 6.7680, std. dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.5298 => 14.9495, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (3.2742 => 3.3681, std. dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 2.80% (14.8535 => 15.2699, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5188 => 1.5573, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.28% (4.6629 => 4.7694, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.87% (0.9108 => 0.9278, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.56% (1.0313 => 1.0474, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.17% (3.7467 => 3.7904, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.08% (33.2944 => 33.6524, std. dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.05% (6.2785 => 6.3445, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5131, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 25.49% (1.8175 => 2.2808, std. dev.: 0.0202) SingleSource/Benchmarks/Misc/mandel-2: 6.95% (1.2998 => 1.3902, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.32% (7.4271 => 7.7482, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7034, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5089 => 1.5361, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1967, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 1.15% (10.7476 => 10.8708, std. dev.: 0.0409) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (3.1071 => 3.1385, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.56% (0.4657 => 0.3979, std. dev.: 0.0097) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1872, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2308 => 1.1027, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.72% (20.3410 => 18.5677, std. dev.: 0.0149) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5851, std. dev.: 0.0147) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2283, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5124, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2129, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2333, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.07% (3.8887 => 3.8472, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 18:04:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 20:04:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803010400.0FC342A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2605?compare_to=2602&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2605, Order: 161222, Start Time: 2012-08-02 23:45:42, End Time: 2012-08-03 01:04:30 To: 2602, Order: 161211, Start Time: 2012-08-02 21:59:12, End Time: 2012-08-02 23:17:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (83 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.29% (78.8008 => 80.6076, std. dev.: 0.6123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.92% (55.4847 => 56.5493, std. dev.: 0.1152) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.80% (14.3702 => 13.9679, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.73% (10.3673 => 13.9679, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.83% (1.1194 => 1.2518, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.80% (0.3694 => 0.4130, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.45% (2.2022 => 2.3882, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.30% (1.7609 => 1.9071, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.52% (7.0540 => 7.4433, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 5.37% (0.6030 => 0.6354, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.35% (0.5925 => 0.6242, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.31% (0.4879 => 0.5138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.24% (0.3282 => 0.3454, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.08% (0.7326 => 0.7698, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.95% (10.4361 => 10.9529, std. dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (9.4845 => 9.9203, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2078, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (4.9449 => 5.1470, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.76% (0.8172 => 0.8479, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 3.63% (0.3109 => 0.3222, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (4.2646 => 4.4175, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.43% (0.5860 => 0.6061, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4080, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 3.27% (5.7591 => 5.9474, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (14.3668 => 14.8319, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.18% (1.1861 => 1.2238, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.09% (0.7835 => 0.8077, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.08% (1.3050 => 1.3452, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.98% (0.4299 => 0.4427, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.96% (0.5105 => 0.5256, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.93% (1.5603 => 1.6060, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.4636 => 0.4764, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.70% (3.3354 => 3.4253, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.60% (2.0273 => 2.0801, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 2.58% (1.1642 => 1.1942, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.55% (1.5415 => 1.5808, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.2024 => 2.2546, std. dev.: 0.0188) MultiSource/Applications/lua/lua: 2.35% (3.8723 => 3.9633, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.34% (1.5859 => 1.6230, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.9765 => 0.9986, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8921 => 0.9106, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6456 => 0.6585, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.93% (17.1811 => 17.5119, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.91% (1.4186 => 1.4457, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.85% (2.0665 => 2.1047, std. dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 1.83% (1.1840 => 1.2057, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.46% (0.7115 => 0.7219, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.33% (2.2969 => 2.3274, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.15% (1.0722 => 1.0845, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.19% (4.2280 => 4.4052, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7592, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 1.82% (3.1578 => 3.2153, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (1.5086 => 1.5356, std. dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8342, std. dev.: 0.0003) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2048, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2400, std. dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 1.17% (2.2771 => 2.3037, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.19% (5.2763 => 3.1558, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7254, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.44% (5.3526 => 3.7233, std. dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -15.05% (54.1659 => 46.0152, std. dev.: 0.0405) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5437, std. dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: -11.94% (22.1758 => 19.5280, std. dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2373 => 1.1079, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -8.38% (1.5373 => 1.4084, std. dev.: 0.0197) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.14% (19.9488 => 18.5246, std. dev.: 0.0723) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.95% (1.9577 => 1.8608, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4874, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9002, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4280, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0019, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4808 => 0.4702, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2009, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3256, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.34% (1.8329 => 1.8083, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 19:02:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 21:02:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803020245.2B26B2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2606?compare_to=2604&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2606, Order: 161227, Start Time: 2012-08-03 00:49:28, End Time: 2012-08-03 02:03:15 To: 2604, Order: 161222, Start Time: 2012-08-02 23:07:41, End Time: 2012-08-03 00:21:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.88% (1.3902 => 1.4164, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.20% (2.0176 => 2.3243, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.82% (0.3663 => 0.3986, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3601 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3646 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.65% (0.5818 => 0.6321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.52% (0.3650 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5748 => 0.6233, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7061 => 0.7648, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.29% (0.4003 => 0.4335, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.26% (0.1986 => 0.2150, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.73% (1.3693 => 1.4751, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.28% (3.9660 => 4.2547, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.98% (0.4328 => 0.4630, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.7710 => 0.8241, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 6.62% (0.2781 => 0.2965, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.57% (0.3899 => 0.4155, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (0.4379 => 0.4650, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.6959 => 0.7383, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.02% (0.5577 => 0.5913, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4062 => 0.4305, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.2193 => 1.2922, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2760 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.89% (0.9199 => 0.9741, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.75% (0.3580 => 0.3786, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2765 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.63% (13.8202 => 14.5987, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.57% (1.9828 => 2.0933, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.2988 => 0.3150, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4390 => 0.4621, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.18% (16.6129 => 17.4731, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.4563 => 1.5314, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 5.16% (0.7506 => 0.7893, std. dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (1.1364 => 1.1931, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.98% (1.0594 => 1.1122, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.95% (0.5637 => 0.5916, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.95% (0.8310 => 0.8721, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.94% (7.2180 => 7.5744, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 4.92% (1.1061 => 1.1605, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/moments: 4.91% (0.3868 => 0.4058, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (1.3245 => 1.3882, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.78% (0.3246 => 0.3401, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.76% (1.9270 => 2.0187, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (13.2842 => 13.9155, std. dev.: 0.0189) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (3.8646 => 4.0452, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.61% (1.3819 => 1.4456, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.51% (0.2995 => 0.3130, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.49% (2.1791 => 2.2770, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.7460 => 0.7795, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.49% (1.3813 => 1.4433, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.38% (3.6692 => 3.8300, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.37% (1.2292 => 1.2829, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 4.25% (0.3220 => 0.3357, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.24% (4.4433 => 4.6319, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.21% (4.3801 => 4.5643, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.94% (0.4791 => 0.4980, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.93% (1.1333 => 1.1778, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 3.77% (0.3131 => 0.3249, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.75% (0.6135 => 0.6365, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.64% (0.6283 => 0.6512, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.62% (0.4113 => 0.4262, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.62% (8.4961 => 8.8033, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.56% (4.9865 => 5.1641, std. dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.45% (0.8698 => 0.8998, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.39% (3.1889 => 3.2970, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.38% (3.2742 => 3.3850, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.27% (2.1007 => 2.1693, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.12% (6.5754 => 6.7805, std. dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 3.11% (14.5298 => 14.9820, std. dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 3.08% (14.8535 => 15.3114, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.06% (1.5188 => 1.5653, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.98% (4.6629 => 4.8019, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.95% (16.2614 => 16.7414, std. dev.: 0.0117) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.27% (0.9108 => 0.9315, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.80% (1.0313 => 1.0499, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.76% (0.6744 => 0.6863, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.46% (6.2785 => 6.3702, std. dev.: 0.0091) MultiSource/Applications/lua/lua: 1.45% (3.7467 => 3.8009, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0520) SingleSource/Benchmarks/Misc/mandel-2: 8.97% (1.2998 => 1.4164, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.12% (0.9996 => 1.0508, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 4.30% (7.4271 => 7.7465, std. dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7071, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.53% (1.7688 => 1.8135, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9587, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.09% (1.0310 => 1.0422, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1402, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.90% (0.4657 => 0.4103, std. dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1903, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.37% (1.2308 => 1.1032, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.68% (20.3410 => 18.5756, std. dev.: 0.0471) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5891, std. dev.: 0.0101) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9475, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2270, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5095, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2122, std. dev.: 0.0263) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2527, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 19:50:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 21:50:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803025030.C24762A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2607?compare_to=2605&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2607, Order: 161229, Start Time: 2012-08-03 01:32:36, End Time: 2012-08-03 02:51:01 To: 2605, Order: 161222, Start Time: 2012-08-02 23:45:42, End Time: 2012-08-03 01:04:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (96 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.23% (0.5326 => 0.5445, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.10% (13.9679 => 13.8143, std. dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.25% (10.3673 => 13.8143, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3473 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.84% (0.3497 => 0.3946, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.79% (0.3543 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.64% (0.3561 => 0.4011, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 12.62% (0.3694 => 0.4160, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.51% (1.1194 => 1.2594, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 12.07% (0.3828 => 0.4290, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3927 => 0.4387, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.46% (2.2022 => 2.3884, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.68% (1.7609 => 1.8961, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.97% (0.2065 => 0.2209, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.66% (0.1892 => 0.2018, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.04% (0.6030 => 0.6394, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7326 => 0.7741, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.57% (0.4879 => 0.5151, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4615 => 0.4867, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.42% (0.3282 => 0.3460, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (7.0540 => 7.4280, std. dev.: 0.0146) MultiSource/Applications/JM/ldecod/ldecod: 5.15% (10.4361 => 10.9737, std. dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 4.82% (0.2554 => 0.2677, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.76% (0.7433 => 0.7787, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 4.64% (9.4845 => 9.9249, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.38% (4.9449 => 5.1613, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (5.0018 => 5.2190, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.27% (0.5569 => 0.5807, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.8172 => 0.8519, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.18% (0.5860 => 0.6105, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.02% (4.2646 => 4.4360, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.89% (0.2700 => 0.2805, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 3.86% (0.3109 => 0.3229, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.83% (0.3423 => 0.3554, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.68% (0.7835 => 0.8123, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.62% (8.1363 => 8.4308, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1861 => 1.2283, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 3.56% (0.3092 => 0.3202, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.45% (1.5603 => 1.6142, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 3.34% (5.7591 => 5.9517, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.31% (14.3668 => 14.8417, std. dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.3050 => 1.3481, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.19% (0.5105 => 0.5268, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.14% (1.1642 => 1.2008, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4299 => 0.4434, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.12% (2.0273 => 2.0906, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.5415 => 1.5883, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.03% (3.3354 => 3.4364, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.8067 => 0.8298, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.83% (3.8723 => 3.9820, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.9765 => 1.0033, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.67% (0.3935 => 0.4040, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.6456 => 0.6628, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (2.2024 => 2.2610, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5859 => 1.6276, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.56% (0.6675 => 0.6846, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (2.0665 => 2.1194, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (0.4064 => 0.4166, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.35% (1.4186 => 1.4520, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5981 => 0.6120, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (0.4620 => 0.4727, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6450 => 0.6595, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8921 => 0.9112, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.97% (1.1840 => 1.2073, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 1.94% (1.2842 => 1.3091, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.92% (17.1811 => 17.5115, std. dev.: 0.0132) MultiSource/Applications/minisat/minisat: 1.91% (0.7115 => 0.7251, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.85% (2.2969 => 2.3394, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.39% (1.0722 => 1.0871, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.69% (4.2280 => 4.3841, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (3.6395 => 3.7452, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2123, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5086 => 1.5338, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8326, std. dev.: 0.0010) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2246, std. dev.: 0.0126) MultiSource/Applications/lua/lua: 1.06% (26.0924 => 26.3691, std. dev.: 0.0314) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.97% (5.2763 => 3.1671, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.80% (5.3855 => 3.7269, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7218, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0604, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.11% (2.9384 => 2.5532, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -11.84% (22.1758 => 19.5510, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.24% (1.6925 => 1.4176, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2373 => 1.1122, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -9.39% (1.5373 => 1.3930, std. dev.: 0.0198) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.19% (19.9488 => 18.5138, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -4.87% (1.9577 => 1.8623, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4805, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9125, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4234, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9992, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.37% (0.4808 => 0.4694, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2008, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3209, std. dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4171, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.35% (1.8329 => 1.8082, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 20:14:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 22:14:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120803031442.498BE2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2608?compare_to=2603&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2608, Order: 161224, Start Time: 2012-08-03 00:31:40, End Time: 2012-08-03 03:15:11 To: 2603, Order: 161207, Start Time: 2012-08-02 21:20:14, End Time: 2012-08-03 00:03:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (72 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (811 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.06% (1.6719 => 1.6897, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.52% (124.6614 => 130.2939, std. dev.: 0.4971) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.46% (0.3446 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.33% (0.3496 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.32% (0.3460 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.29% (0.3469 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3643 => 0.4114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.51% (0.3724 => 0.4190, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.39% (0.5826 => 0.6198, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.5889 => 0.6257, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.06% (1.5932 => 1.6897, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.81% (3.5627 => 3.7697, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (1.6211 => 1.7118, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (0.5026 => 0.5300, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.5900 => 0.6211, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.09% (0.4361 => 0.4583, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (0.3930 => 0.4128, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.03% (0.4994 => 0.5245, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.98% (1.3152 => 1.3807, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (0.5000 => 0.5246, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 4.74% (0.7171 => 0.7511, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 4.54% (1.0781 => 1.1270, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.48% (2.7292 => 2.8516, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.45% (4.2109 => 4.3981, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (1.9694 => 2.0495, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (1.9966 => 2.0736, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 3.83% (5.5417 => 5.7537, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 3.78% (2.1013 => 2.1807, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.62% (0.3890 => 0.4031, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (0.4658 => 0.4814, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.3903 => 0.4028, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (4.4195 => 4.5606, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.14% (0.9909 => 1.0220, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.13% (4.6177 => 4.7623, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3195 => 0.3295, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.12% (2.0673 => 2.1319, std. dev.: 0.0142) MultiSource/Applications/siod/siod: 3.11% (0.6634 => 0.6840, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.10% (2.1653 => 2.2325, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 3.00% (0.7875 => 0.8111, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.96% (1.8794 => 1.9350, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.4139 => 0.4256, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.79% (1.4269 => 1.4667, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.74% (0.9697 => 0.9963, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.42% (0.5546 => 0.5680, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.20% (23.5202 => 24.0384, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (0.6435 => 0.6551, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.11% (2.0346 => 2.0572, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.74% (0.2122 => 0.2265, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6735, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std. dev.: 0.0212) SingleSource/Benchmarks/Misc/flops-2: 4.56% (1.8057 => 1.8881, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7083, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2098, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4972, std. dev.: 0.0247) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5910, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.70% (11.9555 => 11.7521, std. dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5235, std. dev.: 0.0199) SingleSource/Benchmarks/Dhrystone/fldry: -8.35% (17.2379 => 15.7984, std. dev.: 0.1441) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8005, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: -3.94% (0.4438 => 0.4263, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7942, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5408, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5719, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 20:44:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 22:44:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803034446.50A662A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2609?compare_to=2606&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2609, Order: 161229, Start Time: 2012-08-03 02:31:13, End Time: 2012-08-03 03:45:15 To: 2606, Order: 161227, Start Time: 2012-08-03 00:49:28, End Time: 2012-08-03 02:03:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.38% (2.0176 => 2.3078, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 9.78% (0.3578 => 0.3928, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.67% (0.3650 => 0.4003, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 9.61% (0.3601 => 0.3947, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 9.60% (0.3646 => 0.3996, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 9.52% (0.3623 => 0.3968, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 9.47% (0.3663 => 0.4010, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 9.40% (0.3914 => 0.4282, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3789 => 0.4143, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 9.11% (0.3940 => 0.4299, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 9.11% (0.7061 => 0.7704, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 9.09% (0.4003 => 0.4367, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.5818 => 0.6341, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5748 => 0.6256, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 7.50% (1.3693 => 1.4720, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (3.9660 => 4.2407, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.2781 => 0.2969, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.65% (0.7038 => 0.7506, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (0.4328 => 0.4609, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.32% (0.2721 => 0.2893, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2607 => 0.2765, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.95% (0.3899 => 0.4131, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2761 => 0.2921, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (1.2193 => 1.2892, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.55% (1.9828 => 2.0929, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.2988 => 0.3150, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3107 => 0.3274, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.30% (13.8202 => 14.5520, std. dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.25% (0.9199 => 0.9682, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.3534 => 0.3710, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.4016 => 0.4216, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.94% (16.6129 => 17.4336, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.90% (1.4563 => 1.5276, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.79% (7.2180 => 7.5639, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (1.3819 => 1.4473, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (1.3813 => 1.4456, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (1.1364 => 1.1892, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (13.2842 => 13.8790, std. dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (3.8646 => 4.0373, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.47% (0.3246 => 0.3391, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.3868 => 0.4040, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.41% (1.1061 => 1.1549, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.41% (1.3245 => 1.3829, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0112, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8310 => 0.8669, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.28% (1.0594 => 1.1047, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.12% (1.2292 => 1.2798, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (3.6692 => 3.8172, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6212, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5528, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.94% (2.1791 => 2.2649, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (1.1333 => 1.1731, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (4.9865 => 5.1514, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.17% (0.4791 => 0.4943, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.15% (3.1889 => 3.2893, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.08% (0.8698 => 0.8966, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (8.4961 => 8.7529, std. dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.98% (0.6135 => 0.6318, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.93% (0.6283 => 0.6467, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.87% (16.2614 => 16.7276, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.5298 => 14.9284, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.5754 => 6.7525, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 2.65% (14.8535 => 15.2472, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.2742 => 3.3599, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.45% (4.6629 => 4.7772, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5188 => 1.5542, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6250 => 0.6354, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.59% (0.9108 => 0.9253, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.51% (1.0313 => 1.0469, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.23% (3.7467 => 3.7929, std. dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2785 => 6.3479, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.60% (1.8175 => 2.2646, std. dev.: 0.0375) SingleSource/Benchmarks/Misc/mandel-2: 7.44% (1.2998 => 1.3965, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7524, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7039, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6879, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1390, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.72% (0.4657 => 0.4018, std. dev.: 0.0180) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1413, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.75% (1.2308 => 1.0985, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.90% (20.3410 => 18.5301, std. dev.: 0.0603) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.15% (0.3139 => 0.2946, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9201, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5871, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9459, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.29% (0.6589 => 0.6438, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2183, std. dev.: 0.0216) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.64% (7.3305 => 7.2100, std. dev.: 0.0332) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2527, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2338, std. dev.: 0.0331) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 21:36:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 23:36:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803043647.865242A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2610?compare_to=2607&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2610, Order: 161230, Start Time: 2012-08-03 03:18:56, End Time: 2012-08-03 04:37:18 To: 2607, Order: 161229, Start Time: 2012-08-03 01:32:36, End Time: 2012-08-03 02:51:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (94 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (745 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.21% (13.8143 => 13.9816, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.52% (55.0765 => 56.4644, std. dev.: 0.0951) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.46% (78.1226 => 80.0463, std. dev.: 0.5987) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.13% (1.2594 => 1.2452, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.86% (10.3673 => 13.9816, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 13.56% (0.3473 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.38% (0.3543 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.34% (0.3516 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.34% (0.3561 => 0.4036, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.27% (0.3497 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.24% (0.3543 => 0.4012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.97% (0.3694 => 0.4173, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3828 => 0.4308, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.17% (0.3886 => 0.4359, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.24% (1.1194 => 1.2452, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.54% (2.2022 => 2.3682, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.31% (0.2065 => 0.2216, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.04% (1.7609 => 1.8849, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1892 => 0.2022, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.96% (0.5925 => 0.6278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7326 => 0.7742, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4615 => 0.4866, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.97% (7.0540 => 7.4044, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (0.7433 => 0.7765, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.8172 => 0.8535, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.43% (10.4361 => 10.8989, std. dev.: 0.0119) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (9.4845 => 9.8815, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.9449 => 5.1491, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.09% (0.5569 => 0.5797, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.0018 => 5.2056, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.97% (0.3121 => 0.3245, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.88% (4.2646 => 4.4302, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5860 => 0.6085, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.59% (0.7835 => 0.8116, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (8.1363 => 8.4272, std. dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.43% (0.3180 => 0.3289, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.34% (0.4636 => 0.4791, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1861 => 1.2257, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.13% (1.5603 => 1.6091, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.3050 => 1.3455, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.07% (5.7591 => 5.9361, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 3.07% (0.4299 => 0.4431, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (14.3668 => 14.7981, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.98% (1.1642 => 1.1989, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.96% (0.3650 => 0.3758, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.92% (0.3865 => 0.3978, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0853, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.85% (0.4103 => 0.4220, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.79% (2.0665 => 2.1242, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4275, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (0.3935 => 0.4042, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.4289 => 0.4403, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.65% (3.8723 => 3.9750, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.5415 => 1.5822, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.64% (0.3826 => 0.3927, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.5105 => 0.5236, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.8067 => 0.8271, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (0.4064 => 0.4166, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.50% (0.4203 => 0.4308, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.46% (0.6456 => 0.6615, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.42% (0.9765 => 1.0001, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (0.4620 => 0.4727, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (1.5859 => 1.6221, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.2024 => 2.2520, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6675 => 0.6824, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5981 => 0.6114, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.10% (1.4186 => 1.4484, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3101, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 1.88% (0.8921 => 0.9089, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.69% (0.7115 => 0.7235, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.62% (1.1840 => 1.2032, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.54% (2.2969 => 2.3323, std. dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4444, std. dev.: 0.0165) MultiSource/Applications/lemon/lemon: 1.11% (1.0722 => 1.0841, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (4.2280 => 4.3867, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7584, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5086 => 1.5352, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8348, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.43% (3.1578 => 3.2028, std. dev.: 0.0057) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2044, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2302, std. dev.: 0.0375) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.49% (0.8651 => 0.1688, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.25% (5.2763 => 3.1527, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.37% (5.3855 => 3.6962, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.06% (5.3526 => 3.6900, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1447, std. dev.: 0.0264) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.46% (2.9384 => 2.5430, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.21% (22.1758 => 19.4677, std. dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -9.92% (1.2373 => 1.1146, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -8.44% (1.5373 => 1.4076, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5548, std. dev.: 0.0973) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5539, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.94% (1.9577 => 1.8609, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4880, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9026, std. dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4171, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0012, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2014, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3196, std. dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4188, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.39% (1.8329 => 1.8074, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 22:26:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 00:26:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803052650.66AF62A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2611?compare_to=2609&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2611, Order: 161230, Start Time: 2012-08-03 04:13:22, End Time: 2012-08-03 05:27:20 To: 2609, Order: 161229, Start Time: 2012-08-03 02:31:13, End Time: 2012-08-03 03:45:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (148 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 4.12% (2.2646 => 2.3578, std. dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.89% (54.6966 => 56.2784, std. dev.: 0.1170) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.83% (2.0176 => 2.3168, std. dev.: 0.0139) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3578 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.28% (0.3601 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.22% (0.3646 => 0.3982, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.20% (0.3663 => 0.4000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.18% (0.3650 => 0.3985, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 9.18% (0.7061 => 0.7709, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.11% (0.3623 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.08% (0.3789 => 0.4133, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3914 => 0.4261, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.80% (0.5748 => 0.6254, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.68% (0.3940 => 0.4282, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.65% (1.3693 => 1.4740, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (3.9660 => 4.2470, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 6.99% (0.7038 => 0.7530, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.7710 => 0.8245, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.86% (0.5265 => 0.5626, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4328 => 0.4623, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2782 => 0.2964, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.33% (0.3899 => 0.4146, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4062 => 0.4318, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2655 => 0.2818, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.13% (0.2690 => 0.2855, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.04% (0.2765 => 0.2932, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.4379 => 0.4642, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.97% (0.2628 => 0.2785, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.92% (0.6959 => 0.7371, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 5.90% (0.2761 => 0.2924, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.2966 => 0.3141, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.75% (1.2193 => 1.2894, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.71% (1.9828 => 2.0960, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.68% (0.2696 => 0.2849, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.66% (0.2988 => 0.3157, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5577 => 0.5890, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.54% (13.8202 => 14.5856, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.50% (0.9199 => 0.9705, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3192 => 0.3366, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.30% (16.6129 => 17.4941, std. dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3534 => 0.3721, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (1.4563 => 1.5295, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.97% (1.3813 => 1.4499, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.94% (1.3819 => 1.4502, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.92% (7.2180 => 7.5733, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.77% (1.1364 => 1.1906, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (13.2842 => 13.9168, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.75% (1.1061 => 1.1586, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.5637 => 0.5901, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.68% (3.8646 => 4.0453, std. dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 4.63% (1.0594 => 1.1085, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.60% (0.8310 => 0.8692, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.48% (1.3245 => 1.3838, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 4.44% (1.9270 => 2.0126, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.38% (0.7460 => 0.7787, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 4.34% (2.1791 => 2.2736, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.29% (1.2292 => 1.2819, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (3.6692 => 3.8225, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.09% (4.4433 => 4.6251, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.3801 => 4.5585, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.97% (0.3755 => 0.3904, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.90% (4.9865 => 5.1811, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.77% (1.1333 => 1.1760, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (0.8698 => 0.9003, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.44% (0.6283 => 0.6499, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.37% (3.1889 => 3.2963, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (8.4961 => 8.7775, std. dev.: 0.0093) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.18% (0.6135 => 0.6330, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (6.5754 => 6.7800, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 3.04% (16.2614 => 16.7561, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3724, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.95% (14.5298 => 14.9581, std. dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.8535 => 15.2751, std. dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5188 => 1.5611, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.63% (4.6629 => 4.7857, std. dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/bigfib: 2.05% (0.6250 => 0.6378, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.80% (0.9108 => 0.9272, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.69% (1.0313 => 1.0487, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.59% (0.6744 => 0.6851, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.41% (3.7467 => 3.7997, std. dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (6.2785 => 6.3661, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 1.14% (33.2944 => 33.6737, std. dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 29.73% (1.8175 => 2.3578, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7518, std. dev.: 0.0213) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7083, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.7688 => 1.8143, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5346, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5107, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.27% (1.9290 => 1.9535, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.77% (22.5627 => 21.2604, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8630, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2308 => 1.1071, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.54% (20.3410 => 18.6032, std. dev.: 0.0521) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3082, std. dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5759, std. dev.: 0.0259) MultiSource/Applications/spiff/spiff: -2.71% (3.0263 => 2.9442, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2299, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.65% (7.3305 => 7.2095, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2534, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2320, std. dev.: 0.0400) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0142) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 23:23:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 01:23:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803062308.12D382A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2612?compare_to=2610&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2612, Order: 161232, Start Time: 2012-08-03 05:05:13, End Time: 2012-08-03 06:23:38 To: 2610, Order: 161230, Start Time: 2012-08-03 03:18:56, End Time: 2012-08-03 04:37:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (96 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.12% (2.3682 => 2.3948, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.92% (1.4076 => 1.4487, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/lowercase: 1.12% (7.9621 => 8.0514, std. dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.83% (13.9816 => 13.5854, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.04% (10.3673 => 13.5854, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3473 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.78% (0.3497 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3543 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 12.68% (0.3516 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.61% (0.3561 => 0.4010, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.20% (1.1194 => 1.2560, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.15% (0.3828 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.66% (0.3927 => 0.4385, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.75% (2.2022 => 2.3948, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.59% (0.1432 => 0.1555, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.23% (0.3817 => 0.4093, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.95% (0.6030 => 0.6389, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 5.61% (0.3282 => 0.3466, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.42% (7.0540 => 7.4363, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.40% (0.4615 => 0.4864, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.4879 => 0.5141, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.26% (10.4361 => 10.9851, std. dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference: 4.98% (0.7326 => 0.7691, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 4.72% (9.4845 => 9.9323, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: 4.58% (0.2554 => 0.2671, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 4.55% (0.7433 => 0.7771, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.33% (0.8172 => 0.8526, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (4.9449 => 5.1514, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (5.0018 => 5.2102, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (4.2646 => 4.4293, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.78% (0.3121 => 0.3239, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.74% (0.2700 => 0.2801, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.70% (0.3109 => 0.3224, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.65% (0.3423 => 0.3548, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.57% (0.7835 => 0.8115, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.56% (8.1363 => 8.4260, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1861 => 1.2271, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.39% (5.7591 => 5.9545, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.3050 => 1.3472, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.15% (0.5105 => 0.5266, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 3.15% (1.5603 => 1.6095, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4299 => 0.4429, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.01% (1.1642 => 1.1993, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (14.3668 => 14.7965, std. dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.97% (2.0273 => 2.0876, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.80% (1.5415 => 1.5846, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.79% (3.3354 => 3.4283, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.75% (0.8067 => 0.8289, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.75% (3.8723 => 3.9787, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.6456 => 0.6627, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.4289 => 0.4402, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (1.5859 => 1.6275, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9765 => 1.0012, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.2024 => 2.2580, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.52% (0.4636 => 0.4753, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.48% (2.0665 => 2.1178, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.37% (0.6675 => 0.6833, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.31% (1.4186 => 1.4513, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5981 => 0.6115, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.22% (0.6450 => 0.6593, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (0.4620 => 0.4722, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.96% (1.2842 => 1.3094, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.82% (2.2969 => 2.3387, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.75% (17.1811 => 17.4811, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 1.74% (1.1840 => 1.2046, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.25% (1.0722 => 1.0856, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (4.2280 => 4.4154, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7471, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8323, std. dev.: 0.0023) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std. dev.: 0.0172) MultiSource/Applications/lua/lua: 1.24% (26.0924 => 26.4150, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.07% (5.2763 => 3.1619, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.79% (5.3855 => 3.7275, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.43% (5.3526 => 3.7239, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0691, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.13% (2.9384 => 2.5526, std. dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: -11.92% (22.1758 => 19.5329, std. dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0979, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.15% (19.9488 => 18.5233, std. dev.: 0.0515) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -5.76% (1.5373 => 1.4487, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.66% (1.9577 => 1.8665, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5117, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4809, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4108, std. dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9076, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0065, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6777, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3224, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4178, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.40% (1.8329 => 1.8073, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 2 23:26:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 01:26:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120803062608.4C22C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2613?compare_to=2608&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2613, Order: 161230, Start Time: 2012-08-03 03:43:15, End Time: 2012-08-03 06:26:39 To: 2608, Order: 161224, Start Time: 2012-08-03 00:31:40, End Time: 2012-08-03 03:15:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (72 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (811 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.19% (0.3465 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.15% (0.3460 => 0.3915, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3446 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.04% (0.3496 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.03% (0.3469 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.02% (0.3488 => 0.3942, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 12.76% (0.3643 => 0.4108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.52% (0.3650 => 0.4107, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.24% (0.3724 => 0.4180, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5826 => 0.6188, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.20% (1.5932 => 1.6919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.93% (0.5889 => 0.6238, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.70% (3.5627 => 3.7656, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.41% (0.4994 => 0.5264, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.37% (1.6211 => 1.7082, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.24% (0.5000 => 0.5262, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.24% (0.5900 => 0.6209, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (0.4361 => 0.4589, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 5.16% (0.4029 => 0.4237, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.97% (1.3152 => 1.3806, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (0.3930 => 0.4116, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 4.69% (0.7171 => 0.7507, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (2.7292 => 2.8560, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 4.46% (4.2109 => 4.3988, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 4.45% (1.0781 => 1.1261, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.2866 => 0.2985, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.2736 => 0.2846, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (2.1013 => 2.1779, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (1.9694 => 2.0409, std. dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 3.61% (5.5417 => 5.7417, std. dev.: 0.0153) MultiSource/Applications/hexxagon/hexxagon: 3.42% (0.9909 => 1.0248, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.41% (1.9966 => 2.0646, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.37% (0.4658 => 0.4815, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.3271 => 0.3381, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.20% (4.6177 => 4.7654, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 3.15% (2.1653 => 2.2335, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.4139 => 0.4266, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (1.8794 => 1.9370, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.3903 => 0.4022, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.98% (2.0673 => 2.1289, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.95% (0.7875 => 0.8107, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.3625 => 0.3730, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (4.4195 => 4.5448, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 2.64% (0.6634 => 0.6809, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.54% (1.4269 => 1.4632, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.43% (23.5202 => 24.0927, std. dev.: 0.0125) MultiSource/Applications/hbd/hbd: 2.41% (0.9697 => 0.9931, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.24% (0.5546 => 0.5670, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (0.6435 => 0.6536, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.11% (0.2122 => 0.2294, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8970, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.64% (15.4430 => 16.1598, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2016, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.06% (105.3826 => 107.5557, std. dev.: 0.0744) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4943, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5116, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.59% (11.9555 => 11.7649, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5394, std. dev.: 0.0143) SingleSource/Benchmarks/Dhrystone/fldry: -11.97% (17.2379 => 15.1748, std. dev.: 0.2743) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7851, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary2: -6.08% (0.2402 => 0.2256, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -3.88% (0.4438 => 0.4266, std. dev.: 0.0058) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7975, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5473, std. dev.: 0.0196) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5706, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 00:11:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 02:11:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803071138.C2F9E2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2614?compare_to=2611&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2614, Order: 161233, Start Time: 2012-08-03 05:55:24, End Time: 2012-08-03 07:12:09 To: 2611, Order: 161230, Start Time: 2012-08-03 04:13:22, End Time: 2012-08-03 05:27:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 1 (26 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.42% (2.3578 => 2.2772, std. dev.: 0.0162) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.06% (2.0176 => 2.3013, std. dev.: 0.0611) SingleSource/UnitTests/ObjC/trivial-interface: 9.75% (0.3578 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3601 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.57% (0.3646 => 0.3995, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3789 => 0.4148, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.45% (0.3650 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.45% (0.3663 => 0.4009, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.38% (0.3623 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3914 => 0.4275, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.99% (0.7061 => 0.7696, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.5818 => 0.6340, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 8.97% (0.4003 => 0.4362, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.96% (0.3940 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.70% (0.5748 => 0.6248, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0072) MultiSource/Applications/hbd/hbd: 7.46% (1.3693 => 1.4714, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.2781 => 0.2969, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4062 => 0.4329, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.41% (0.7038 => 0.7489, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2655 => 0.2814, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.77% (0.3485 => 0.3686, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.2988 => 0.3155, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.34% (0.3149 => 0.3317, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3534 => 0.3717, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.13% (0.4390 => 0.4615, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 5.06% (13.8202 => 14.5195, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.89% (16.6129 => 17.4249, std. dev.: 0.2980) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.86% (0.7506 => 0.7871, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.43% (1.1061 => 1.1551, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2995 => 0.3126, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.34% (1.9270 => 2.0106, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 4.00% (1.2292 => 1.2784, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.85% (2.1791 => 2.2631, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.35% (4.9865 => 5.1536, std. dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.15% (0.6283 => 0.6481, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.05% (8.4961 => 8.7552, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.87% (3.1889 => 3.2805, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.83% (3.2742 => 3.3668, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.76% (2.1007 => 2.1587, std. dev.: 0.0194) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.5754 => 6.7552, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.69% (14.8535 => 15.2529, std. dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9192, std. dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 2.63% (16.2614 => 16.6888, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5188 => 1.5566, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.42% (4.6629 => 4.7756, std. dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6250 => 0.6352, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 25.29% (1.8175 => 2.2772, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/mandel-2: 6.78% (1.2998 => 1.3879, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.26% (0.9996 => 1.0522, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 4.45% (7.4271 => 7.7575, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7094, std. dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0392) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (1.9290 => 1.9563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1403, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1437, std. dev.: 0.0434) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0142) SingleSource/Benchmarks/McGill/chomp: -10.06% (1.2308 => 1.1070, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.73% (20.3410 => 18.5653, std. dev.: 0.0557) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.02% (0.3139 => 0.2950, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.37% (1.3780 => 1.3040, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9829, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9477, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2258, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5047, std. dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: -1.66% (7.3305 => 7.2085, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 01:12:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 03:12:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803081253.3B9712A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2615?compare_to=2612&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2615, Order: 161233, Start Time: 2012-08-03 06:51:40, End Time: 2012-08-03 08:13:24 To: 2612, Order: 161232, Start Time: 2012-08-03 05:05:13, End Time: 2012-08-03 06:23:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (86 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 3.00% (0.5326 => 0.5486, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 1.33% (1.0979 => 1.1125, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -3.09% (1.4487 => 1.4039, std. dev.: 0.0166) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.04% (10.3673 => 13.5849, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3473 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.78% (0.3497 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.70% (0.3543 => 0.3993, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.64% (0.3561 => 0.4011, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.62% (0.3543 => 0.3990, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.37% (0.3694 => 0.4151, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.24% (1.1194 => 1.2564, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3927 => 0.4387, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.74% (2.2022 => 2.3947, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 8.59% (0.1432 => 0.1555, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.86% (1.7609 => 1.8993, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1892 => 0.2017, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5925 => 0.6285, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 5.95% (0.6030 => 0.6389, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/oourafft: 5.82% (0.3282 => 0.3473, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.43% (0.4879 => 0.5144, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.42% (0.4615 => 0.4865, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.40% (7.0540 => 7.4351, std. dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 5.38% (10.4361 => 10.9973, std. dev.: 0.0830) SingleSource/UnitTests/ObjC++/property-reference: 5.00% (0.7326 => 0.7692, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.8172 => 0.8557, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 4.55% (9.4845 => 9.9158, std. dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda: 4.51% (0.7433 => 0.7768, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.45% (4.9449 => 5.1651, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.35% (0.2758 => 0.2878, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.25% (0.5860 => 0.6109, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5569 => 0.5805, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.19% (5.0018 => 5.2116, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.88% (4.2646 => 4.4299, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.62% (0.3423 => 0.3547, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (8.1363 => 8.4278, std. dev.: 0.0094) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1861 => 1.2267, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 3.26% (1.5603 => 1.6112, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.25% (1.3050 => 1.3474, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.17% (0.4103 => 0.4233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.10% (0.3387 => 0.3492, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (14.3668 => 14.7968, std. dev.: 0.0127) MultiSource/Benchmarks/McCat/05-eks/eks: 2.93% (0.4299 => 0.4425, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.5415 => 1.5863, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4636 => 0.4770, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.4289 => 0.4412, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (0.5105 => 0.5248, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.65% (3.8723 => 3.9748, std. dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.64% (0.3935 => 0.4039, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.64% (2.0665 => 2.1211, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.57% (0.5981 => 0.6135, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 2.52% (0.6456 => 0.6619, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6450 => 0.6612, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9765 => 1.0010, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (2.2024 => 2.2575, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (0.4064 => 0.4165, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.43% (1.5859 => 1.6244, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.35% (1.4186 => 1.4520, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.26% (0.6675 => 0.6826, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (0.4620 => 0.4724, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.04% (0.8921 => 0.9103, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3097, std. dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2049, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 1.74% (0.7115 => 0.7239, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.68% (17.1811 => 17.4703, std. dev.: 0.0160) MultiSource/Applications/lemon/lemon: 1.31% (1.0722 => 1.0862, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.92% (4.2280 => 4.3937, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5086 => 1.5334, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 1.59% (11.6436 => 11.8283, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 1.47% (2.2771 => 2.3106, std. dev.: 0.0036) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2290, std. dev.: 0.0284) MultiSource/Applications/lua/lua: 1.11% (26.0924 => 26.3823, std. dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1616, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.70% (5.3855 => 3.7319, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.35% (5.3526 => 3.7280, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0267, std. dev.: 0.0370) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.20% (2.9384 => 2.5506, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -11.81% (22.1758 => 19.5561, std. dev.: 0.0407) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -10.09% (1.2373 => 1.1125, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -8.68% (1.5373 => 1.4039, std. dev.: 0.0166) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.05% (19.9488 => 18.5416, std. dev.: 0.0538) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.82% (1.9577 => 1.8634, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5952, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4731, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (8.1563 => 7.8984, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4193, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0036, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2009, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6780, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3202, std. dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4176, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.17% (1.8329 => 1.8114, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 02:39:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 04:39:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120803093953.59CFD2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2616?compare_to=2613&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2616, Order: 161233, Start Time: 2012-08-03 06:54:37, End Time: 2012-08-03 09:40:24 To: 2613, Order: 161230, Start Time: 2012-08-03 03:43:15, End Time: 2012-08-03 06:26:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 13 (85 on baseline) Performance Improvements: 7 (18 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 934 (791 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 19.12% (0.4462 => 0.5315, std. dev.: 0.0249) MultiSource/Benchmarks/PAQ8p/paq8p: 3.83% (0.4886 => 0.5073, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.12% (0.9931 => 1.0142, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (2.1779 => 2.2091, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.34% (2.0539 => 2.0814, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 1.09% (4.3988 => 4.4466, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.02% (15.1748 => 15.9362, std. dev.: 0.1460) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.4266 => 0.4460, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 4.44% (3.4585 => 3.6121, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (41.5926 => 42.5338, std. dev.: 0.0062) MultiSource/Applications/lua/lua: 1.50% (49.7987 => 50.5471, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/almabench: 1.24% (12.4261 => 12.5806, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.04% (3.2226 => 3.2561, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -7.92% (2.2829 => 2.1020, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1054 => 1.9533, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.86% (3.3720 => 3.2418, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5830 => 5.4968, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.38% (16.1963 => 15.9721, std. dev.: 0.0317) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.37% (5.7947 => 5.7155, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (80.0449 => 79.0926, std. dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 40.16% (0.3792 => 0.5315, std. dev.: 0.0249) SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3446 => 0.3918, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.68% (0.3488 => 0.3965, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.60% (0.3442 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.55% (0.3460 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.52% (0.3469 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 13.12% (0.3643 => 0.4121, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.65% (0.3724 => 0.4195, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.1620 => 0.1751, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.47% (0.5826 => 0.6203, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.5889 => 0.6262, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.18% (1.5932 => 1.6916, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.11% (0.5026 => 0.5333, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.05% (0.4361 => 0.4625, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (3.5627 => 3.7744, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.92% (0.5900 => 0.6249, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.89% (1.3152 => 1.3927, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (1.6211 => 1.7146, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.67% (0.3930 => 0.4153, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 5.60% (4.2109 => 4.4466, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.40% (0.5000 => 0.5270, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.37% (0.2736 => 0.2883, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.31% (0.4994 => 0.5259, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.13% (2.1013 => 2.2091, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.09% (0.2866 => 0.3012, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.98% (0.7171 => 0.7528, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.90% (1.0781 => 1.1309, std. dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 4.66% (0.4847 => 0.5073, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (2.7292 => 2.8558, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 4.59% (0.9697 => 1.0142, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.43% (0.3362 => 0.3511, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.40% (0.9909 => 1.0345, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 4.21% (5.5417 => 5.7752, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.10% (0.3195 => 0.3326, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.08% (1.9694 => 2.0497, std. dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.3004 => 0.3126, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (2.0673 => 2.1501, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (1.9966 => 2.0747, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.89% (0.3060 => 0.3179, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 3.86% (4.6177 => 4.7960, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.74% (0.2911 => 0.3020, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (0.4658 => 0.4830, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 3.66% (2.1653 => 2.2445, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (1.8794 => 1.9478, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.59% (0.3124 => 0.3236, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (0.3890 => 0.4029, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.53% (0.6634 => 0.6868, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.3903 => 0.4039, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.48% (0.4139 => 0.4283, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.35% (0.3282 => 0.3392, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.25% (0.7875 => 0.8131, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 3.20% (1.4269 => 1.4725, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (4.4195 => 4.5604, std. dev.: 0.0078) MultiSource/Applications/Burg/burg: 2.81% (0.5546 => 0.5702, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.3845 => 0.3949, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.6435 => 0.6584, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.30% (2.0346 => 2.0814, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 2.24% (23.5202 => 24.0479, std. dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0185) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 14.38% (2.5769 => 2.9475, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (12.0509 => 12.6440, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8878, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.69% (105.3826 => 108.2217, std. dev.: 0.0483) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.64% (3.1722 => 3.2561, std. dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5002, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 1.80% (15.8721 => 16.1582, std. dev.: 0.0266) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.77% (41.7953 => 42.5338, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.44% (12.4025 => 12.5806, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.38% (1.0927 => 1.1078, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.28% (1.0142 => 1.0272, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.22% (11.9701 => 12.1163, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.39% (11.9555 => 11.7897, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.24% (25.4195 => 16.2064, std. dev.: 0.1606) SingleSource/Benchmarks/Shootout-C++/ary2: -8.49% (0.2402 => 0.2198, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8081, std. dev.: 0.1043) SingleSource/Benchmarks/Dhrystone/fldry: -7.55% (17.2379 => 15.9362, std. dev.: 0.1460) SingleSource/Benchmarks/Misc/fbench: -7.49% (2.2722 => 2.1020, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: -7.48% (2.1113 => 1.9533, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7995, std. dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -3.54% (14.0481 => 13.5501, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5747, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9721, std. dev.: 0.0317) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.05% (79.9355 => 79.0926, std. dev.: 0.0107) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (3.3991 => 3.3643, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 03:30:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 05:30:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803103043.326182A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2617?compare_to=2614&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2617, Order: 161236, Start Time: 2012-08-03 09:17:06, End Time: 2012-08-03 10:31:09 To: 2614, Order: 161233, Start Time: 2012-08-03 05:55:24, End Time: 2012-08-03 07:12:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.19% (1.3879 => 1.4044, std. dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.92% (2.0176 => 2.2985, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.30% (0.3601 => 0.3972, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 10.23% (0.3578 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.09% (0.3646 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.96% (0.3663 => 0.4028, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.96% (0.3623 => 0.3984, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3650 => 0.4013, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 9.79% (0.3789 => 0.4160, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.71% (0.3914 => 0.4294, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.49% (0.4003 => 0.4383, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.37% (0.3940 => 0.4309, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5748 => 0.6262, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.13% (0.7061 => 0.7635, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.41% (1.3693 => 1.4708, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.12% (0.7710 => 0.8259, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.82% (3.9660 => 4.2363, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.69% (0.5265 => 0.5617, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.65% (0.2781 => 0.2966, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.38% (0.7038 => 0.7487, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 5.83% (0.2760 => 0.2921, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (1.2193 => 1.2881, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.61% (0.3580 => 0.3781, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0922, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.36% (0.5577 => 0.5876, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9199 => 0.9692, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.09% (13.8202 => 14.5242, std. dev.: 0.0327) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.3534 => 0.3710, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.90% (16.6129 => 17.4262, std. dev.: 0.0202) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4390 => 0.4602, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 4.81% (0.7506 => 0.7867, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.77% (7.2180 => 7.5625, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (1.3819 => 1.4473, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.3813 => 1.4465, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.63% (1.4563 => 1.5237, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1876, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 4.41% (1.1061 => 1.1549, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (3.8646 => 4.0319, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.3245 => 1.3817, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.31% (0.3246 => 0.3386, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (13.2842 => 13.8499, std. dev.: 0.0120) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.7460 => 0.7776, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.0594 => 1.1042, std. dev.: 0.0127) MultiSource/Applications/treecc/treecc: 4.12% (1.9270 => 2.0063, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (4.4433 => 4.6239, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.01% (1.2292 => 1.2785, std. dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3220 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (3.6692 => 3.8143, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (4.3801 => 4.5508, std. dev.: 0.0162) MultiSource/Applications/siod/siod: 3.82% (2.1791 => 2.2624, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.52% (1.1333 => 1.1732, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.36% (0.4113 => 0.4251, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.9865 => 5.1499, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.13% (0.8698 => 0.8970, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.06% (0.6135 => 0.6323, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7507, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.6283 => 0.6470, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.88% (3.1889 => 3.2807, std. dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 2.72% (16.2614 => 16.7041, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.71% (2.1007 => 2.1576, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (3.2742 => 3.3609, std. dev.: 0.0143) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7494, std. dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2408, std. dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 2.57% (14.5298 => 14.9027, std. dev.: 0.0196) MultiSource/Applications/oggenc/oggenc: 2.37% (4.6629 => 4.7735, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.25% (1.5188 => 1.5530, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.82% (0.9108 => 0.9274, std. dev.: 0.0040) MultiSource/Applications/lemon/lemon: 1.25% (1.0313 => 1.0442, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (6.2785 => 6.3532, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 1.10% (3.7467 => 3.7879, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 25.85% (1.8175 => 2.2873, std. dev.: 0.0363) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7502, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.7688 => 1.8143, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (1.5089 => 1.5326, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9551, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.18% (1.0310 => 1.0432, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.00% (3.6469 => 3.6835, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1294, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2308 => 1.0968, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.88% (20.3410 => 18.5357, std. dev.: 0.0438) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.8259 => 8.5772, std. dev.: 0.0291) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9475, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2272, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5071, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2052, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (5.3167 => 5.2449, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std. dev.: 0.0071) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2164, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 03:35:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 05:35:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803103542.D025E2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2618?compare_to=2615&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2618, Order: 161236, Start Time: 2012-08-03 09:17:01, End Time: 2012-08-03 10:36:13 To: 2615, Order: 161233, Start Time: 2012-08-03 06:51:40, End Time: 2012-08-03 08:13:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (740 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.06% (10.3673 => 13.5877, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3473 => 0.3940, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.32% (0.3543 => 0.4015, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.07% (0.3497 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3543 => 0.4005, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.03% (0.3561 => 0.4025, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.72% (0.3694 => 0.4164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3828 => 0.4306, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.13% (1.1194 => 1.2552, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.58% (2.2022 => 2.3912, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.92% (1.7609 => 1.9004, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1584 => 0.1701, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.50% (0.1892 => 0.2015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5925 => 0.6289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.02% (0.4615 => 0.4893, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 5.85% (0.3282 => 0.3474, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.8172 => 0.8650, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.80% (0.4879 => 0.5162, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.60% (7.0540 => 7.4488, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7326 => 0.7732, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.32% (10.4361 => 10.9917, std. dev.: 0.0276) MultiSource/Applications/lambda-0_1_3/lambda: 4.98% (0.7433 => 0.7803, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.5569 => 0.5843, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.73% (9.4845 => 9.9328, std. dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.59% (4.9449 => 5.1721, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3121 => 0.3263, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.54% (0.7835 => 0.8191, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2554 => 0.2668, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.43% (0.3092 => 0.3229, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.27% (5.0018 => 5.2152, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.22% (0.5860 => 0.6107, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.01% (4.2646 => 4.4358, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.1861 => 1.2330, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.89% (0.2700 => 0.2805, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.83% (8.1363 => 8.4480, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 3.80% (0.3423 => 0.3553, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.3050 => 1.3498, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.41% (0.8067 => 0.8342, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.31% (0.5105 => 0.5274, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 3.30% (5.7591 => 5.9489, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 3.26% (1.5603 => 1.6111, std. dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4636 => 0.4785, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4299 => 0.4436, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.5415 => 1.5904, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 3.17% (2.0273 => 2.0915, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (14.3668 => 14.8205, std. dev.: 0.0086) MultiSource/Applications/Burg/burg: 3.14% (1.1642 => 1.2007, std. dev.: 0.0076) MultiSource/Applications/lua/lua: 3.03% (3.8723 => 3.9898, std. dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 3.01% (0.3387 => 0.3489, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.98% (0.3826 => 0.3940, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.97% (3.3354 => 3.4343, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (1.5859 => 1.6307, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.68% (0.6450 => 0.6623, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4289 => 0.4404, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.64% (0.3935 => 0.4039, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.2024 => 2.2601, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9765 => 1.0012, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 2.48% (0.6456 => 0.6616, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.46% (2.0665 => 2.1174, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (0.4064 => 0.4164, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.43% (0.6675 => 0.6837, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.37% (0.5981 => 0.6123, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.5020 => 0.5138, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.23% (1.4186 => 1.4502, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 2.12% (2.2969 => 2.3455, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.11% (1.2842 => 1.3113, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8921 => 0.9106, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.98% (0.7115 => 0.7256, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.80% (17.1811 => 17.4905, std. dev.: 0.0122) MultiSource/Applications/lemon/lemon: 1.36% (1.0722 => 1.0868, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (7.9617 => 8.0578, std. dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (4.2280 => 4.4102, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7493, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2147, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5342, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8323, std. dev.: 0.0012) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2332, std. dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.01% (26.0924 => 26.3563, std. dev.: 0.0269) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1597, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.81% (5.3855 => 3.7263, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.41% (5.3526 => 3.7251, std. dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -15.02% (54.1659 => 46.0316, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5521, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -11.72% (22.1758 => 19.5768, std. dev.: 0.0315) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2373 => 1.1120, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -8.10% (1.5373 => 1.4128, std. dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.00% (19.9488 => 18.5531, std. dev.: 0.0661) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -4.60% (1.9577 => 1.8677, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4742, std. dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4106, std. dev.: 0.0286) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9111, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0025, std. dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2015, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3149, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4187, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8099, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 05:24:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 07:24:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803122407.F23E62A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2619?compare_to=2617&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2619, Order: 161237, Start Time: 2012-08-03 11:10:58, End Time: 2012-08-03 12:24:38 To: 2617, Order: 161236, Start Time: 2012-08-03 09:17:06, End Time: 2012-08-03 10:31:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.98% (2.0176 => 2.2997, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.26% (0.3578 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.19% (0.3601 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.12% (0.3646 => 0.4015, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.05% (0.3623 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.00% (0.3650 => 0.4015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.99% (0.3663 => 0.4029, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.81% (0.3914 => 0.4298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3789 => 0.4159, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.69% (0.4003 => 0.4391, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.44% (0.3940 => 0.4312, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.18% (0.5818 => 0.6352, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5748 => 0.6264, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7061 => 0.7644, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.51% (1.3693 => 1.4722, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.7710 => 0.8255, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.89% (3.9660 => 4.2394, std. dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 6.87% (0.2781 => 0.2972, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7038 => 0.7520, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.80% (0.5265 => 0.5623, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.33% (0.3899 => 0.4146, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.95% (0.2690 => 0.2850, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.86% (0.6959 => 0.7367, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2761 => 0.2921, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.68% (0.3485 => 0.3683, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.66% (1.2193 => 1.2883, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.56% (1.9828 => 2.0930, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2988 => 0.3151, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.42% (0.5577 => 0.5879, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9199 => 0.9696, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5330, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary2: 5.14% (0.3192 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.08% (0.2127 => 0.2235, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.07% (0.3534 => 0.3713, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.99% (16.6129 => 17.4419, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.94% (7.2180 => 7.5744, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.83% (0.4016 => 0.4210, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.78% (1.3819 => 1.4480, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.71% (1.3813 => 1.4464, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.66% (0.7506 => 0.7856, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (1.4563 => 1.5238, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.61% (1.1364 => 1.1888, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.60% (1.1061 => 1.1570, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (3.8646 => 4.0418, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3246 => 0.3394, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (13.2842 => 13.8742, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.37% (1.3245 => 1.3824, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.37% (0.8310 => 0.8673, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.31% (1.9270 => 2.0101, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0594 => 1.1039, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 4.07% (1.2292 => 1.2792, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (4.4433 => 4.6236, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 4.05% (2.1791 => 2.2673, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.3801 => 4.5553, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (3.6692 => 3.8157, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.68% (0.3755 => 0.3893, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.59% (1.1333 => 1.1740, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.48% (0.4113 => 0.4256, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (4.9865 => 5.1571, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.21% (0.6135 => 0.6332, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (0.6283 => 0.6477, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (8.4961 => 8.7576, std. dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.07% (0.8698 => 0.8965, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.94% (3.1889 => 3.2827, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7601, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.72% (2.1007 => 2.1578, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.72% (3.2742 => 3.3631, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9179, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6875, std. dev.: 0.0184) MultiSource/Applications/JM/lencod/lencod: 2.55% (14.8535 => 15.2328, std. dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 2.45% (4.6629 => 4.7770, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.79% (0.9108 => 0.9271, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.32% (1.0313 => 1.0449, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (6.2785 => 6.3572, std. dev.: 0.0161) MultiSource/Applications/lua/lua: 1.11% (3.7467 => 3.7884, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2608, std. dev.: 0.0579) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4033, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.89% (1.5824 => 1.6756, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.14% (0.9996 => 1.0510, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7523, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7048, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.64% (1.7688 => 1.8155, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9579, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.31% (0.4657 => 0.4037, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1452, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.96% (1.2308 => 1.1082, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.98% (20.3410 => 18.5151, std. dev.: 0.0689) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0086) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5930, std. dev.: 0.0144) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9482, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2239, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5024, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.65% (7.3305 => 7.2095, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8592, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4922, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2254, std. dev.: 0.0366) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.05% (3.8887 => 3.8477, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 05:30:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 07:30:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803123004.440FE2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2620?compare_to=2618&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2620, Order: 161237, Start Time: 2012-08-03 11:11:39, End Time: 2012-08-03 12:30:36 To: 2618, Order: 161236, Start Time: 2012-08-03 09:17:01, End Time: 2012-08-03 10:36:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (95 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.06% (10.3673 => 13.5872, std. dev.: 0.0259) SingleSource/UnitTests/ObjC/block-byref-aggr: 24.65% (0.3817 => 0.4758, std. dev.: 0.0335) SingleSource/UnitTests/ObjC/trivial-interface: 13.53% (0.3473 => 0.3943, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: 13.20% (0.3561 => 0.4031, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.18% (0.3543 => 0.4010, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3497 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.08% (0.3516 => 0.3976, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.04% (0.3543 => 0.4005, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 12.86% (0.3694 => 0.4169, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3828 => 0.4302, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 12.15% (0.3886 => 0.4358, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.12% (1.1194 => 1.2551, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.53% (2.2022 => 2.3901, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.78% (1.7609 => 1.8979, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.3177 => 0.3382, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.19% (0.3282 => 0.3485, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.13% (0.5925 => 0.6288, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4615 => 0.4894, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 5.75% (0.7326 => 0.7747, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (7.0540 => 7.4390, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.43% (0.8172 => 0.8616, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.41% (0.4879 => 0.5143, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 5.34% (10.4361 => 10.9931, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.83% (0.5569 => 0.5838, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.73% (9.4845 => 9.9332, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 4.71% (0.7433 => 0.7783, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.68% (0.7835 => 0.8202, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.54% (0.2554 => 0.2670, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.53% (0.2758 => 0.2883, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.46% (4.9449 => 5.1653, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5860 => 0.6113, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.24% (5.0018 => 5.2141, std. dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.01% (0.3121 => 0.3246, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.94% (4.2646 => 4.4325, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.83% (0.3109 => 0.3228, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.2700 => 0.2803, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.76% (8.1363 => 8.4424, std. dev.: 0.0047) MultiSource/Applications/hbd/hbd: 3.63% (1.5603 => 1.6170, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.59% (0.3423 => 0.3546, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.56% (0.4636 => 0.4801, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1861 => 1.2283, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.34% (5.7591 => 5.9512, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.31% (1.3050 => 1.3482, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.28% (1.5415 => 1.5920, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (14.3668 => 14.8165, std. dev.: 0.0298) MultiSource/Applications/Burg/burg: 3.07% (1.1642 => 1.1999, std. dev.: 0.0047) MultiSource/Applications/treecc/treecc: 3.04% (2.0273 => 2.0889, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4299 => 0.4429, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.01% (0.3387 => 0.3489, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.95% (3.3354 => 3.4338, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.94% (0.8067 => 0.8304, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.84% (3.8723 => 3.9822, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4289 => 0.4409, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.4064 => 0.4176, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (1.5859 => 1.6259, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6456 => 0.6618, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (2.2024 => 2.2575, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9765 => 1.0008, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.46% (2.0665 => 2.1174, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.6450 => 0.6607, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.43% (0.4203 => 0.4305, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.38% (0.6675 => 0.6834, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (0.4620 => 0.4722, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.4186 => 1.4499, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.19% (0.5981 => 0.6112, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.13% (0.5020 => 0.5127, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8921 => 0.9111, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3097, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.79% (2.2969 => 2.3381, std. dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.78% (17.1811 => 17.4875, std. dev.: 0.0160) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2049, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.63% (0.7115 => 0.7231, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.20% (1.0722 => 1.0851, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (4.2280 => 4.4041, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7537, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 1.67% (3.1578 => 3.2105, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8329, std. dev.: 0.0009) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2247, std. dev.: 0.0235) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1625, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.80% (5.3855 => 3.7269, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7217, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0474, std. dev.: 0.0317) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.18% (2.9384 => 2.5511, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -11.76% (22.1758 => 19.5674, std. dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4270, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1078, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -8.84% (1.5373 => 1.4014, std. dev.: 0.0243) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.74% (19.9488 => 18.6048, std. dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.03% (1.9577 => 1.8593, std. dev.: 0.0086) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.23% (8.1563 => 7.8929, std. dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4824, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4247, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0064, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2005, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6779, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3225, std. dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4187, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 05:51:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 07:51:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120803125145.00E4A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2621?compare_to=2616&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2621, Order: 161236, Start Time: 2012-08-03 10:08:34, End Time: 2012-08-03 12:52:17 To: 2616, Order: 161233, Start Time: 2012-08-03 06:54:37, End Time: 2012-08-03 09:40:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (111 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 10.69% (14.6063 => 16.1672, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 1.90% (16.2064 => 16.5142, std. dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.42% (54.1271 => 54.8936, std. dev.: 0.0468) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 30.78% (0.3792 => 0.4959, std. dev.: 0.0203) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.33% (0.3488 => 0.3988, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 14.13% (0.3446 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.12% (0.3442 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.11% (0.3465 => 0.3954, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.10% (0.3460 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3496 => 0.3986, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.48% (0.3650 => 0.4142, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.21% (0.3724 => 0.4216, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.64% (0.5826 => 0.6213, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.57% (0.5026 => 0.5356, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 6.47% (1.5932 => 1.6963, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5889 => 0.6269, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.28% (0.4029 => 0.4282, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.5900 => 0.6266, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.17% (0.4361 => 0.4630, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.06% (1.3152 => 1.3949, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.05% (3.5627 => 3.7781, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (1.6211 => 1.7173, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.90% (0.2866 => 0.3035, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.78% (0.5000 => 0.5289, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.78% (4.2109 => 4.4541, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.63% (0.4994 => 0.5275, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 5.55% (0.7171 => 0.7569, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.2736 => 0.2885, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.2014 => 0.2123, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.34% (0.3930 => 0.4140, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 5.34% (1.0781 => 1.1357, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 5.23% (2.1013 => 2.2111, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (2.7292 => 2.8621, std. dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 4.79% (0.4847 => 0.5079, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.73% (0.9697 => 1.0156, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.37% (0.9909 => 1.0342, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.33% (5.5417 => 5.7816, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2792 => 0.2912, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.22% (1.9966 => 2.0809, std. dev.: 0.0068) MultiSource/Applications/siod/siod: 4.21% (0.6634 => 0.6913, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3195 => 0.3327, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.13% (0.2738 => 0.2851, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.08% (1.9694 => 2.0498, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 4.05% (4.6177 => 4.8046, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 4.03% (0.3004 => 0.3125, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.00% (0.2823 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2813 => 0.2925, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.96% (0.2780 => 0.2890, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (2.0673 => 2.1486, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2750 => 0.2858, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2811 => 0.2921, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2803 => 0.2912, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (0.4658 => 0.4837, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3124 => 0.3244, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.76% (0.3271 => 0.3394, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.75% (2.1653 => 2.2464, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.74% (0.2911 => 0.3020, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3362 => 0.3486, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.67% (0.3267 => 0.3387, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.63% (1.8794 => 1.9476, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 3.62% (0.3317 => 0.3437, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.59% (0.3060 => 0.3170, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.55% (0.4139 => 0.4286, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3258 => 0.3373, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.44% (0.7875 => 0.8146, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.3678 => 0.3804, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (4.4195 => 4.5688, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.34% (0.3625 => 0.3746, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.3903 => 0.4033, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3282 => 0.3391, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.3845 => 0.3972, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.30% (0.3726 => 0.3849, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.26% (0.3348 => 0.3457, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 3.24% (1.4269 => 1.4732, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 3.21% (0.4146 => 0.4279, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.19% (0.3477 => 0.3588, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.19% (0.5546 => 0.5723, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3690 => 0.3799, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.3981 => 0.4093, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.54% (2.0346 => 2.0863, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.41% (23.5202 => 24.0868, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.6435 => 0.6582, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2122 => 0.2243, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6717, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.75% (105.3826 => 108.2812, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2036, std. dev.: 0.0104) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.97% (3.1722 => 3.2347, std. dev.: 0.0184) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4988, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.75% (41.7953 => 42.5248, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5910, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.44% (12.4025 => 12.5811, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.29% (1.0142 => 1.0273, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.22% (11.9701 => 12.1156, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.44% (11.9555 => 11.7837, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5142, std. dev.: 0.0219) SingleSource/Benchmarks/Dhrystone/fldry: -8.96% (17.2379 => 15.6935, std. dev.: 0.1451) SingleSource/Benchmarks/Shootout-C++/ary2: -8.78% (0.2402 => 0.2191, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7899, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/tsp/tsp: -7.47% (2.1113 => 1.9536, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -6.79% (2.2722 => 2.1179, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7957, std. dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/dry: -3.50% (14.0481 => 13.5560, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9676, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (79.9355 => 79.1212, std. dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (3.3991 => 3.3646, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 08:21:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 10:21:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803152140.4CE5C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2622?compare_to=2619&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2622, Order: 161240, Start Time: 2012-08-03 14:08:34, End Time: 2012-08-03 15:22:10 To: 2619, Order: 161237, Start Time: 2012-08-03 11:10:58, End Time: 2012-08-03 12:24:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (145 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.13% (54.8290 => 56.5448, std. dev.: 0.0765) SingleSource/Benchmarks/Misc/fbench: 1.76% (2.2608 => 2.3005, std. dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.06% (2.0176 => 2.3013, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3578 => 0.3949, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.08% (0.3601 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.99% (0.3663 => 0.4029, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.98% (0.3646 => 0.4010, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3650 => 0.4013, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.85% (0.3623 => 0.3980, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.79% (0.3789 => 0.4160, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.63% (0.3914 => 0.4291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.49% (0.4003 => 0.4383, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7061 => 0.7634, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.43% (1.3693 => 1.4710, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.7710 => 0.8251, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.92% (3.9660 => 4.2405, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.7038 => 0.7488, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.14% (0.4379 => 0.4648, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2760 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.76% (0.6959 => 0.7360, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2765 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.2193 => 1.2880, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.48% (1.9828 => 2.0914, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2988 => 0.3151, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.32% (0.9199 => 0.9688, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.20% (13.8202 => 14.5382, std. dev.: 0.0151) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.3192 => 0.3355, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.95% (1.3819 => 1.4503, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5711, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 4.85% (16.6129 => 17.4194, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.77% (1.3813 => 1.4472, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (1.4563 => 1.5253, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.5637 => 0.5901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3868 => 0.4049, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.66% (0.7506 => 0.7856, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.61% (1.1364 => 1.1888, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (3.8646 => 4.0418, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.38% (1.1061 => 1.1545, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.3245 => 1.3819, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (13.2842 => 13.8593, std. dev.: 0.0187) MultiSource/Benchmarks/nbench/nbench: 4.31% (1.0594 => 1.1051, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.27% (1.9270 => 2.0093, std. dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (3.6692 => 3.8176, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.04% (1.2292 => 1.2788, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6218, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.3801 => 4.5557, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 3.93% (2.1791 => 2.2647, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.54% (1.1333 => 1.1734, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.50% (0.4113 => 0.4257, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.43% (4.9865 => 5.1575, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.21% (0.8698 => 0.8977, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (8.4961 => 8.7573, std. dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (2.1007 => 2.1650, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.98% (3.1889 => 3.2839, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.2742 => 3.3659, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (6.5754 => 6.7543, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.71% (16.2614 => 16.7023, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9214, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2370, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 2.53% (4.6629 => 4.7807, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5188 => 1.5555, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.44% (1.0313 => 1.0462, std. dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.23% (6.2785 => 6.3560, std. dev.: 0.0095) MultiSource/Applications/lua/lua: 1.21% (3.7467 => 3.7921, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 26.57% (1.8175 => 2.3005, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 6.59% (1.2998 => 1.3854, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.85% (0.9996 => 1.0581, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 4.33% (7.4271 => 7.7485, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7059, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (1.5089 => 1.5359, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.91% (0.4657 => 0.4056, std. dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1606, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.75% (1.2308 => 1.1108, std. dev.: 0.0246) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.67% (20.3410 => 18.5775, std. dev.: 0.0238) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.77% (1.3780 => 1.3123, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9450, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6045, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2212, std. dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2053, std. dev.: 0.0237) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (5.3167 => 5.2451, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.17% (3.8887 => 3.8433, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2293, std. dev.: 0.0407) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 08:27:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 10:27:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803152731.CBE632A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2623?compare_to=2620&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2623, Order: 161240, Start Time: 2012-08-03 14:08:52, End Time: 2012-08-03 15:28:03 To: 2620, Order: 161237, Start Time: 2012-08-03 11:11:39, End Time: 2012-08-03 12:30:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.12% (54.8405 => 56.5536, std. dev.: 0.0552) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.10% (10.3673 => 13.5911, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/block-byref-aggr: 25.02% (0.3817 => 0.4772, std. dev.: 0.0297) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3473 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.24% (0.3497 => 0.3960, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 13.18% (0.3543 => 0.4010, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.11% (0.3516 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3543 => 0.4006, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 12.89% (0.3694 => 0.4170, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.28% (0.3828 => 0.4298, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.09% (0.3886 => 0.4356, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.07% (1.1194 => 1.2545, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.02% (0.3927 => 0.4399, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.59% (0.1432 => 0.1555, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.55% (2.2022 => 2.3904, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.90% (1.7609 => 1.9000, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.26% (0.1584 => 0.1699, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.98% (0.1906 => 0.2039, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3177 => 0.3389, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.50% (0.1892 => 0.2015, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 6.49% (0.1695 => 0.1805, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.37% (0.4615 => 0.4909, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5925 => 0.6289, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.76% (0.7326 => 0.7748, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 5.61% (0.3282 => 0.3466, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.48% (7.0540 => 7.4408, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.31% (0.4879 => 0.5138, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.29% (10.4361 => 10.9884, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 4.71% (9.4845 => 9.9308, std. dev.: 0.0132) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.67% (0.8172 => 0.8554, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.66% (4.9449 => 5.1754, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.63% (0.5569 => 0.5827, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7433 => 0.7772, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 4.30% (0.3092 => 0.3225, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.28% (5.0018 => 5.2157, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 4.21% (0.3423 => 0.3567, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3121 => 0.3250, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.99% (4.2646 => 4.4347, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 3.91% (0.7835 => 0.8141, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.88% (1.1861 => 1.2321, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5860 => 0.6086, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.81% (8.1363 => 8.4462, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.81% (0.2758 => 0.2863, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.78% (0.2700 => 0.2802, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.76% (0.3109 => 0.3226, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.58% (1.5603 => 1.6161, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.44% (1.3050 => 1.3499, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.38% (5.7591 => 5.9535, std. dev.: 0.0150) MultiSource/Benchmarks/sim/sim: 3.25% (0.3387 => 0.3497, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.24% (0.4636 => 0.4786, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.15% (2.0273 => 2.0911, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 3.12% (0.4299 => 0.4433, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.3668 => 14.8123, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.5415 => 1.5892, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.07% (0.8067 => 0.8315, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.02% (3.3354 => 3.4360, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1986, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.93% (3.8723 => 3.9857, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash: 2.91% (0.4289 => 0.4414, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.88% (0.5105 => 0.5252, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6450 => 0.6633, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.69% (0.3826 => 0.3929, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.63% (2.0665 => 2.1209, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.9765 => 1.0017, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 2.52% (0.6456 => 0.6619, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.52% (0.6675 => 0.6843, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5859 => 1.6247, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.2024 => 2.2551, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (0.4620 => 0.4727, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.31% (0.5981 => 0.6119, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.4186 => 1.4504, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.16% (1.2842 => 1.3119, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8921 => 0.9112, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 2.04% (0.7115 => 0.7260, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.01% (1.1840 => 1.2078, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.87% (17.1811 => 17.5030, std. dev.: 0.0091) MultiSource/Applications/siod/siod: 1.58% (2.2969 => 2.3332, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.27% (1.0722 => 1.0858, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (4.2280 => 4.3995, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7575, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2111, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 1.60% (11.6436 => 11.8301, std. dev.: 0.0025) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2373, std. dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.01% (26.0924 => 26.3557, std. dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1583, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.74% (5.3855 => 3.7300, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.48% (5.3526 => 3.7213, std. dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0173, std. dev.: 0.0418) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5521, std. dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: -11.77% (22.1758 => 19.5656, std. dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2373 => 1.1060, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -8.49% (1.5373 => 1.4068, std. dev.: 0.0217) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.81% (19.9488 => 18.5905, std. dev.: 0.0515) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.39% (1.5835 => 1.4981, std. dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: -4.98% (1.9577 => 1.8603, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4845, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9039, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4270, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9999, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2017, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3202, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.34% (1.8329 => 1.8084, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 09:03:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 11:03:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120803160333.EAB3C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2624?compare_to=2621&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2624, Order: 161237, Start Time: 2012-08-03 13:20:23, End Time: 2012-08-03 16:04:06 To: 2621, Order: 161236, Start Time: 2012-08-03 10:08:34, End Time: 2012-08-03 12:52:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 21.68% (0.3792 => 0.4614, std. dev.: 0.0271) SingleSource/UnitTests/ObjC/exceptions-4: 14.17% (0.3465 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.15% (0.3442 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.13% (0.3446 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3460 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.04% (0.3496 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.99% (0.3488 => 0.3976, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 13.53% (0.3643 => 0.4136, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.45% (0.3650 => 0.4141, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.13% (0.3724 => 0.4213, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.1619 => 0.1732, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.68% (0.4029 => 0.4298, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.64% (0.5826 => 0.6213, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.50% (0.5889 => 0.6272, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.40% (1.5932 => 1.6952, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.15% (0.5026 => 0.5335, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.05% (0.4361 => 0.4625, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.03% (3.5627 => 3.7775, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.79% (1.6211 => 1.7149, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.72% (1.3152 => 1.3904, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7171 => 0.7576, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (0.4994 => 0.5273, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 5.44% (4.2109 => 4.4400, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.37% (0.2736 => 0.2883, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (0.5900 => 0.6215, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.16% (0.5000 => 0.5258, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.94% (2.1013 => 2.2052, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 4.90% (1.0781 => 1.1309, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.88% (2.7292 => 2.8625, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 4.66% (0.4847 => 0.5073, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 4.65% (0.9697 => 1.0148, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.36% (0.3004 => 0.3135, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.22% (5.5417 => 5.7754, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.16% (0.3195 => 0.3328, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.16% (0.3845 => 0.4005, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.16% (0.9909 => 1.0321, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.08% (0.2792 => 0.2906, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2750 => 0.2862, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (1.9694 => 2.0490, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2823 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.2780 => 0.2892, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (2.0673 => 2.1495, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (1.9966 => 2.0757, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2811 => 0.2921, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2813 => 0.2923, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.79% (0.3060 => 0.3176, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.78% (4.6177 => 4.7922, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3362 => 0.3488, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 3.75% (0.3096 => 0.3212, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.73% (0.3267 => 0.3389, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (0.4658 => 0.4831, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2911 => 0.3019, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (0.3890 => 0.4034, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.68% (0.6634 => 0.6878, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3258 => 0.3376, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.60% (2.1653 => 2.2433, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.53% (1.8794 => 1.9457, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.3678 => 0.3804, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3282 => 0.3393, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.38% (0.3726 => 0.3852, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.33% (0.7875 => 0.8137, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.32% (0.3348 => 0.3459, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.31% (0.3625 => 0.3745, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3477 => 0.3592, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.3903 => 0.4030, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.24% (0.4139 => 0.4273, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.21% (1.4269 => 1.4727, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (4.4195 => 4.5606, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.3271 => 0.3372, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 3.04% (0.4146 => 0.4272, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.04% (0.3690 => 0.3802, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.94% (0.3981 => 0.4098, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.76% (0.5546 => 0.5699, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.36% (23.5202 => 24.0760, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.36% (2.0346 => 2.0826, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.6435 => 0.6580, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.23% (0.5012 => 0.5124, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.2122 => 0.2281, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6753, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8946, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std. dev.: 0.0393) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.71% (105.3826 => 108.2368, std. dev.: 0.0454) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2093, std. dev.: 0.0434) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.02% (3.1722 => 3.2362, std. dev.: 0.0137) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4962, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.75% (41.7953 => 42.5264, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5905, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.44% (12.4025 => 12.5810, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.28% (1.0142 => 1.0272, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.22% (11.9701 => 12.1157, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.51% (11.9555 => 11.7749, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5312, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -10.44% (17.2379 => 15.4379, std. dev.: 0.3883) SingleSource/Benchmarks/Shootout-C++/ary2: -9.87% (0.2402 => 0.2165, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8086, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/fbench: -7.57% (2.2722 => 2.1002, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: -7.47% (2.1113 => 1.9536, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7938, std. dev.: 0.0141) SingleSource/Benchmarks/Dhrystone/dry: -3.63% (14.0481 => 13.5377, std. dev.: 0.0278) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9584, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (79.9355 => 79.1065, std. dev.: 0.0119) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (3.3991 => 3.3647, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 10:03:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 12:03:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803170339.00A3A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2625?compare_to=2622&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2625, Order: 161241, Start Time: 2012-08-03 15:50:17, End Time: 2012-08-03 17:04:10 To: 2622, Order: 161240, Start Time: 2012-08-03 14:08:34, End Time: 2012-08-03 15:22:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (149 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.84% (77.7352 => 81.4948, std. dev.: 0.2467) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.21% (1.3123 => 1.3282, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: 1.10% (1.3854 => 1.4006, std. dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.55% (2.0176 => 2.3112, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.59% (0.3578 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3650 => 0.4032, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.39% (0.3601 => 0.3975, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.37% (0.3646 => 0.4024, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3623 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.24% (0.3663 => 0.4038, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.13% (0.3789 => 0.4173, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.94% (0.3914 => 0.4303, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.87% (0.4003 => 0.4398, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.72% (0.3940 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.63% (0.5818 => 0.6378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.43% (0.5748 => 0.6290, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.47% (0.7061 => 0.7659, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.97% (0.1819 => 0.1964, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 7.79% (1.3693 => 1.4760, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.64% (0.7710 => 0.8299, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.38% (3.9660 => 4.2588, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.35% (0.2721 => 0.2921, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5265 => 0.5645, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.20% (0.2596 => 0.2783, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7038 => 0.7525, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.75% (0.4062 => 0.4336, std. dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.35% (0.4379 => 0.4657, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.24% (0.6959 => 0.7393, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.06% (1.2193 => 1.2932, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2760 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.80% (0.9199 => 0.9733, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.77% (0.3899 => 0.4124, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.69% (13.8202 => 14.6061, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5577 => 0.5892, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.53% (1.9828 => 2.0924, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/matrix: 5.52% (0.2988 => 0.3153, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.48% (0.2243 => 0.2366, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.2925 => 0.3084, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.2914 => 0.3070, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.34% (0.2023 => 0.2131, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.32% (0.7506 => 0.7905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.31% (7.2180 => 7.6013, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.22% (1.3819 => 1.4540, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3534 => 0.3717, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.17% (0.4390 => 0.4617, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.16% (1.3813 => 1.4526, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (1.4563 => 1.5307, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.5637 => 0.5920, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.01% (16.6129 => 17.4455, std. dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.98% (1.1364 => 1.1930, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.96% (0.4016 => 0.4215, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.95% (1.1061 => 1.1609, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (13.2842 => 13.9398, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.87% (0.3246 => 0.3404, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.82% (3.8646 => 4.0508, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.82% (1.3245 => 1.3883, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.78% (1.9270 => 2.0192, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.75% (0.8310 => 0.8705, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.69% (0.7460 => 0.7810, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.63% (1.0594 => 1.1084, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.47% (0.3220 => 0.3364, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 4.41% (0.2995 => 0.3127, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.40% (3.6692 => 3.8308, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.40% (4.4433 => 4.6386, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.33% (4.3801 => 4.5697, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 4.15% (1.2292 => 1.2802, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.94% (1.1333 => 1.1779, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.92% (2.1791 => 2.2646, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 3.79% (0.4113 => 0.4269, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.70% (0.3131 => 0.3247, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6135 => 0.6356, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (4.9865 => 5.1626, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 3.49% (8.4961 => 8.7925, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 3.45% (3.1889 => 3.2988, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6283 => 0.6495, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.20% (6.5754 => 6.7861, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.8698 => 0.8969, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.07% (2.1007 => 2.1651, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 3.06% (16.2614 => 16.7596, std. dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: 3.04% (14.5298 => 14.9715, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 3.01% (14.8535 => 15.3002, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3723, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.87% (4.6629 => 4.7967, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.85% (1.5188 => 1.5621, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.10% (0.9108 => 0.9299, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6250 => 0.6356, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.65% (1.0313 => 1.0483, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.59% (3.7467 => 3.8064, std. dev.: 0.0090) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.53% (6.2785 => 6.3748, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 25.95% (1.8175 => 2.2892, std. dev.: 0.0370) SingleSource/Benchmarks/Misc/mandel-2: 7.76% (1.2998 => 1.4006, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7552, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7064, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5089 => 1.5338, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: 1.59% (1.9290 => 1.9597, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5952, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0492, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (1.9433 => 1.9655, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1405, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.60% (0.4657 => 0.4117, std. dev.: 0.0197) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.02% (22.5627 => 21.2034, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -9.87% (1.2308 => 1.1093, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (20.3410 => 18.6534, std. dev.: 0.0202) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.61% (1.3780 => 1.3282, std. dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5857, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9476, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2261, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2145, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2490, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2234, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8466, std. dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 10:14:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 12:14:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803171428.5A6082A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2626?compare_to=2623&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2626, Order: 161241, Start Time: 2012-08-03 15:56:17, End Time: 2012-08-03 17:15:00 To: 2623, Order: 161240, Start Time: 2012-08-03 14:08:52, End Time: 2012-08-03 15:28:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (86 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.46% (3.6887 => 3.7427, std. dev.: 0.0156) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.32% (10.3673 => 13.7179, std. dev.: 0.0136) SingleSource/UnitTests/ObjC/trivial-interface: 13.01% (0.3473 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3543 => 0.4001, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.68% (0.3516 => 0.3962, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3543 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.64% (0.3561 => 0.4011, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.15% (0.3828 => 0.4293, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.66% (0.3927 => 0.4385, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.51% (2.2022 => 2.3897, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.36% (1.7609 => 1.8905, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.86% (0.5925 => 0.6272, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.85% (0.6030 => 0.6383, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 5.69% (10.4361 => 11.0296, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.3282 => 0.3465, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (0.4615 => 0.4872, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.48% (7.0540 => 7.4408, std. dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: 5.43% (0.7326 => 0.7724, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.21% (0.4879 => 0.5133, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.8172 => 0.8557, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.68% (0.3121 => 0.3267, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (0.7433 => 0.7769, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.45% (9.4845 => 9.9065, std. dev.: 0.0074) MultiSource/Benchmarks/McCat/08-main/main: 4.35% (0.2554 => 0.2665, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.29% (5.0018 => 5.2162, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.25% (4.9449 => 5.1549, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.17% (0.5569 => 0.5801, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.96% (0.2700 => 0.2807, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.89% (4.2646 => 4.4306, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5860 => 0.6086, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.2758 => 0.2861, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 3.70% (0.7835 => 0.8125, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.70% (0.3109 => 0.3224, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.66% (8.1363 => 8.4337, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 3.65% (0.3423 => 0.3548, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.53% (1.1861 => 1.2280, std. dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.3050 => 1.3480, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 3.29% (5.7591 => 5.9485, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4299 => 0.4436, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (14.3668 => 14.8208, std. dev.: 0.0120) MultiSource/Applications/treecc/treecc: 3.15% (2.0273 => 2.0912, std. dev.: 0.0066) MultiSource/Applications/hbd/hbd: 3.09% (1.5603 => 1.6085, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 3.03% (1.1642 => 1.1995, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4636 => 0.4774, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.88% (3.8723 => 3.9839, std. dev.: 0.0079) MultiSource/Applications/d/make_dparser: 2.88% (3.3354 => 3.4315, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.86% (1.5415 => 1.5856, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.75% (0.8067 => 0.8289, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (0.5105 => 0.5242, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.63% (0.4103 => 0.4211, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.51% (2.2024 => 2.2576, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9765 => 1.0007, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.45% (2.0665 => 2.1172, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.43% (1.5859 => 1.6245, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.28% (0.6450 => 0.6597, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.26% (0.5981 => 0.6116, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.6675 => 0.6825, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.18% (1.4186 => 1.4495, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.89% (17.1811 => 17.5064, std. dev.: 0.0487) MultiSource/Applications/hexxagon/hexxagon: 1.76% (1.2842 => 1.3068, std. dev.: 0.0062) MultiSource/Applications/siod/siod: 1.72% (2.2969 => 2.3363, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: 1.67% (0.7115 => 0.7234, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.29% (1.0722 => 1.0860, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.80% (4.2280 => 4.3887, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7578, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8317, std. dev.: 0.0035) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2338, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout/ary3: 1.17% (3.6994 => 3.7427, std. dev.: 0.0156) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1515, std. dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.77% (5.3855 => 3.7284, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7215, std. dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0741, std. dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.28% (2.9384 => 2.5482, std. dev.: 0.0085) MultiSource/Applications/ClamAV/clamscan: -11.95% (22.1758 => 19.5268, std. dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2373 => 1.1155, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -7.32% (1.5373 => 1.4248, std. dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.10% (19.9488 => 18.5332, std. dev.: 0.0756) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.58% (1.9577 => 1.8680, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.49% (1.5835 => 1.5124, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.21% (8.1563 => 7.8947, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4769, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4261, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9998, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.1995, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.81% (12.5348 => 12.3074, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6775, std. dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 11:45:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 13:45:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803184533.1B5682A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2627?compare_to=2625&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2627, Order: 161243, Start Time: 2012-08-03 17:32:11, End Time: 2012-08-03 18:46:04 To: 2625, Order: 161241, Start Time: 2012-08-03 15:50:17, End Time: 2012-08-03 17:04:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.04% (1.4006 => 1.4152, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.69% (81.4948 => 80.1152, std. dev.: 0.3686) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.62% (2.0176 => 2.3125, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3578 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.59% (0.3646 => 0.4032, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3601 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3650 => 0.4028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.29% (0.3663 => 0.4040, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3623 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.13% (0.3789 => 0.4173, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.99% (0.3914 => 0.4305, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 9.97% (0.4003 => 0.4402, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.75% (0.3940 => 0.4324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5818 => 0.6373, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.45% (0.5748 => 0.6291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.08% (0.7061 => 0.7702, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.81% (0.1819 => 0.1961, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 7.67% (1.3693 => 1.4743, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.43% (0.7710 => 0.8283, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (3.9660 => 4.2567, std. dev.: 0.0158) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.20% (0.5265 => 0.5644, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.16% (0.2596 => 0.2782, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.94% (0.2781 => 0.2974, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.76% (0.7038 => 0.7514, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4328 => 0.4612, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4379 => 0.4653, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.15% (0.6959 => 0.7387, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.12% (0.2760 => 0.2929, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4062 => 0.4309, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.02% (1.2193 => 1.2927, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.90% (0.2765 => 0.2928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.2966 => 0.3138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.77% (0.3485 => 0.3686, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.76% (0.5577 => 0.5898, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.75% (0.9199 => 0.9728, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.66% (0.2988 => 0.3157, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.64% (0.3580 => 0.3782, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.59% (13.8202 => 14.5933, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.55% (1.9828 => 2.0928, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3534 => 0.3725, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1865 => 0.1965, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.31% (0.2243 => 0.2362, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.29% (0.2023 => 0.2130, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.28% (0.2914 => 0.3068, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.24% (7.2180 => 7.5965, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 5.23% (0.2925 => 0.3078, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.21% (1.3819 => 1.4539, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.3813 => 1.4524, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.14% (1.4563 => 1.5311, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.13% (0.5637 => 0.5926, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.03% (1.1364 => 1.1936, std. dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 5.00% (16.6129 => 17.4432, std. dev.: 0.0151) MultiSource/Applications/spiff/spiff: 4.98% (0.7506 => 0.7880, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.97% (1.1061 => 1.1611, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.97% (0.4390 => 0.4608, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.96% (0.4016 => 0.4215, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.3756 => 0.3940, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.84% (13.2842 => 13.9277, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 4.79% (3.8646 => 4.0499, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3246 => 0.3400, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.73% (0.7460 => 0.7813, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.72% (1.3245 => 1.3870, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.69% (0.8310 => 0.8700, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.64% (1.9270 => 2.0164, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.58% (1.0594 => 1.1079, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 4.44% (0.3220 => 0.3363, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (3.6692 => 3.8277, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.31% (4.3801 => 4.5687, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.30% (4.4433 => 4.6344, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.2292 => 1.2813, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3755 => 0.3900, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.86% (1.1333 => 1.1770, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.80% (2.1791 => 2.2618, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 3.67% (0.3131 => 0.3246, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.65% (0.4113 => 0.4263, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (4.9865 => 5.1644, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 3.47% (3.1889 => 3.2996, std. dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (8.4961 => 8.7862, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.41% (0.6283 => 0.6497, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.37% (0.6135 => 0.6342, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (6.5754 => 6.7775, std. dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 3.03% (14.5298 => 14.9707, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.02% (2.1007 => 2.1641, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.99% (14.8535 => 15.2973, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 2.96% (16.2614 => 16.7429, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.94% (3.2742 => 3.3706, std. dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 2.91% (4.6629 => 4.7985, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.78% (1.5188 => 1.5610, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.03% (0.9108 => 0.9293, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.72% (1.0313 => 1.0490, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.68% (0.6250 => 0.6355, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.53% (0.6744 => 0.6847, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.48% (6.2785 => 6.3712, std. dev.: 0.0100) MultiSource/Applications/lua/lua: 1.44% (3.7467 => 3.8007, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.67% (1.8175 => 2.2659, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/mandel-2: 8.88% (1.2998 => 1.4152, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.22% (0.9996 => 1.0518, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7535, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7044, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.52% (1.7688 => 1.8134, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1399, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1861, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.92% (20.3410 => 18.5267, std. dev.: 0.0580) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5939, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9471, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2234, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5106, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2162, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0045, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2453, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2324, std. dev.: 0.0132) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 12:01:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 14:01:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803190119.839712A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2628?compare_to=2626&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2628, Order: 161243, Start Time: 2012-08-03 17:43:12, End Time: 2012-08-03 19:01:52 To: 2626, Order: 161241, Start Time: 2012-08-03 15:56:17, End Time: 2012-08-03 17:15:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (89 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (54.9940 => 56.5225, std. dev.: 0.0916) MultiSource/Benchmarks/llubenchmark/llu: 1.87% (3.7779 => 3.8485, std. dev.: 0.0182) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.32% (10.3673 => 13.7183, std. dev.: 0.0151) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3473 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.87% (0.3497 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3516 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.76% (0.3543 => 0.3995, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3543 => 0.3994, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.72% (0.3561 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.45% (0.3694 => 0.4154, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.23% (0.3828 => 0.4296, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.90% (1.1194 => 1.2526, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.69% (0.3927 => 0.4386, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.47% (2.2022 => 2.3888, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.35% (1.7609 => 1.8903, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.92% (0.1892 => 0.2023, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.81% (0.5925 => 0.6269, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.79% (0.3282 => 0.3472, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.74% (0.6030 => 0.6376, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.65% (10.4361 => 11.0254, std. dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.53% (0.4615 => 0.4870, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.50% (7.0540 => 7.4422, std. dev.: 0.0084) SingleSource/UnitTests/ObjC++/property-reference: 5.45% (0.7326 => 0.7725, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.21% (0.4879 => 0.5133, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.8172 => 0.8546, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.43% (0.7433 => 0.7762, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.41% (9.4845 => 9.9029, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 4.35% (0.2554 => 0.2665, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5569 => 0.5808, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.28% (4.9449 => 5.1563, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.19% (5.0018 => 5.2115, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.03% (0.5860 => 0.6096, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.88% (0.3121 => 0.3242, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.85% (4.2646 => 4.4290, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.2758 => 0.2861, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 3.70% (0.3109 => 0.3224, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.68% (0.3423 => 0.3549, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.65% (0.7835 => 0.8121, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.64% (8.1363 => 8.4322, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 3.56% (0.3092 => 0.3202, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.43% (0.3180 => 0.3289, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1861 => 1.2266, std. dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 3.29% (5.7591 => 5.9488, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.25% (1.3050 => 1.3474, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4299 => 0.4434, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (14.3668 => 14.8100, std. dev.: 0.0191) MultiSource/Applications/Burg/burg: 3.08% (1.1642 => 1.2000, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.5415 => 1.5883, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.02% (1.5603 => 1.6074, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4636 => 0.4774, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.90% (3.3354 => 3.4322, std. dev.: 0.0060) MultiSource/Applications/treecc/treecc: 2.90% (2.0273 => 2.0861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.8067 => 0.8298, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.73% (0.4103 => 0.4215, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.64% (3.8723 => 3.9744, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.5105 => 0.5238, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.55% (2.0665 => 2.1192, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.5859 => 1.6249, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.42% (0.4289 => 0.4393, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9765 => 1.0000, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.39% (0.6456 => 0.6610, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (2.2024 => 2.2543, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.6675 => 0.6825, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5981 => 0.6114, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.16% (1.4186 => 1.4493, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.08% (0.6450 => 0.6584, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.86% (17.1811 => 17.5015, std. dev.: 0.0284) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2842 => 1.3076, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.68% (1.1840 => 1.2039, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.68% (2.2969 => 2.3355, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.66% (0.7115 => 0.7233, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.30% (1.0722 => 1.0861, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9733, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.12% (4.2280 => 4.4024, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 1.86% (3.7781 => 3.8485, std. dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2146, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8348, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.57% (1.5086 => 1.5323, std. dev.: 0.0013) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2043, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.11% (26.0924 => 26.3819, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 1.11% (9.1159 => 9.2167, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.45% (0.8651 => 0.1691, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1538, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.77% (5.3855 => 3.7283, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.40% (5.3526 => 3.7254, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0658, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5460, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -11.94% (22.1758 => 19.5279, std. dev.: 0.0276) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2373 => 1.1098, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -8.12% (1.5373 => 1.4124, std. dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.35% (19.9488 => 18.4817, std. dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -4.65% (1.9577 => 1.8666, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4696, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.20% (8.1563 => 7.8953, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4174, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0062, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6780, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3193, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4189, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 12:15:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 14:15:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120803191511.D8C0C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2629?compare_to=2624&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2629, Order: 161243, Start Time: 2012-08-03 16:32:08, End Time: 2012-08-03 19:15:43 To: 2624, Order: 161237, Start Time: 2012-08-03 13:20:23, End Time: 2012-08-03 16:04:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (109 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.58% (1.6952 => 1.7220, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.24% (2.2052 => 2.2326, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.08% (2.0771 => 2.0340, std. dev.: 0.0151) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 14.35% (0.3442 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.31% (0.3446 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.30% (0.3496 => 0.3996, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.30% (0.3469 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.26% (0.3465 => 0.3959, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.13% (0.3488 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.13% (0.3460 => 0.3949, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.70% (0.3643 => 0.4142, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.64% (0.3650 => 0.4148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3724 => 0.4220, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1063 => 0.1174, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1620 => 0.1757, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 8.08% (1.5932 => 1.7220, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.1619 => 0.1745, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.16% (0.5026 => 0.5386, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 6.95% (0.4029 => 0.4309, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.75% (1.6211 => 1.7306, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.75% (3.5627 => 3.8031, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.72% (0.4361 => 0.4654, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.68% (1.3152 => 1.4031, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.63% (0.5826 => 0.6212, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.50% (0.5889 => 0.6272, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.44% (0.5000 => 0.5322, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.35% (0.4994 => 0.5311, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 6.25% (2.1013 => 2.2326, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 6.20% (4.2109 => 4.4718, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.5900 => 0.6254, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.99% (0.2736 => 0.2900, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.2014 => 0.2133, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.90% (0.3930 => 0.4162, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.90% (0.2866 => 0.3035, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 5.86% (1.0781 => 1.1413, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (2.7292 => 2.8882, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7171 => 0.7577, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 5.49% (0.4847 => 0.5113, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 4.97% (5.5417 => 5.8169, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.65% (1.9694 => 2.0610, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 4.62% (4.6177 => 4.8310, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.60% (1.9966 => 2.0885, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 4.52% (0.2566 => 0.2682, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 4.51% (0.6634 => 0.6933, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.49% (0.2738 => 0.2861, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (0.4658 => 0.4863, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (2.1653 => 2.2585, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 4.27% (0.7875 => 0.8211, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (0.3890 => 0.4055, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (1.8794 => 1.9589, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 4.16% (0.9697 => 1.0100, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.11% (0.4139 => 0.4309, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.07% (4.4195 => 4.5994, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2875 => 0.2991, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.3004 => 0.3124, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.99% (0.9909 => 1.0304, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 3.96% (1.4269 => 1.4834, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3362 => 0.3488, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.3903 => 0.4048, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2792 => 0.2895, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.66% (0.2729 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2803 => 0.2904, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.57% (2.0673 => 2.1410, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.56% (0.3060 => 0.3169, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.55% (0.3096 => 0.3206, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.3845 => 0.3979, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.48% (0.5546 => 0.5739, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3267 => 0.3377, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3258 => 0.3366, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3317 => 0.3425, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.23% (0.3625 => 0.3742, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3726 => 0.3846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3678 => 0.3795, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.17% (0.3282 => 0.3386, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3477 => 0.3585, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.05% (0.3348 => 0.3450, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.02% (23.5202 => 24.2309, std. dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 3.01% (2.0346 => 2.0958, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.92% (0.4146 => 0.4267, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3690 => 0.3795, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.61% (0.3981 => 0.4085, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.6435 => 0.6595, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.19% (0.5012 => 0.5122, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (11.6398 => 11.7817, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.06% (0.5917 => 0.6690, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6686, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8942, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1622, std. dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.76% (3.1722 => 3.2599, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.74% (105.3826 => 108.2705, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1987, std. dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4988, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.74% (41.7953 => 42.5212, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5902, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.44% (12.4025 => 12.5809, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.28% (1.0142 => 1.0272, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 1.21% (11.9701 => 12.1154, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.09% (11.9555 => 11.8251, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5349, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ary2: -8.58% (0.2402 => 0.2196, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -8.25% (17.2379 => 15.8156, std. dev.: 0.1636) SingleSource/Benchmarks/Misc/fbench: -8.20% (2.2722 => 2.0858, std. dev.: 0.0151) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8068, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/tsp/tsp: -7.44% (2.1113 => 1.9543, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8049, std. dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -3.49% (14.0481 => 13.5583, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (2.0820 => 2.0340, std. dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5712, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (16.2163 => 15.9769, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.05% (79.9355 => 79.0986, std. dev.: 0.0100) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (3.3991 => 3.3645, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 13:27:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 15:27:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803202742.898012A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2630?compare_to=2627&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2630, Order: 161250, Start Time: 2012-08-03 19:14:08, End Time: 2012-08-03 20:28:13 To: 2627, Order: 161243, Start Time: 2012-08-03 17:32:11, End Time: 2012-08-03 18:46:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (151 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.33% (2.0176 => 2.3067, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0819 => 0.0927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3578 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.34% (0.3646 => 0.4023, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.25% (0.3601 => 0.3970, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3650 => 0.4022, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3623 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.16% (0.3663 => 0.4035, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.13% (0.3789 => 0.4173, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 9.89% (0.3914 => 0.4301, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.72% (0.4003 => 0.4392, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.62% (0.3940 => 0.4319, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.5818 => 0.6362, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.25% (0.7061 => 0.7714, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.24% (0.1819 => 0.1987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5748 => 0.6275, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.47% (0.7710 => 0.8363, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.70% (1.3693 => 1.4747, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.63% (0.2596 => 0.2794, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.35% (0.2721 => 0.2921, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (3.9660 => 4.2536, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 7.24% (0.4062 => 0.4356, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.18% (0.5265 => 0.5643, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 7.08% (0.2781 => 0.2978, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.86% (0.7038 => 0.7521, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.86% (0.4328 => 0.4625, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2782 => 0.2964, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2760 => 0.2935, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.30% (0.4379 => 0.4655, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2690 => 0.2857, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.12% (0.3022 => 0.3207, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.11% (0.6959 => 0.7384, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.10% (0.3899 => 0.4137, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.10% (0.5577 => 0.5917, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1789 => 0.1898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2628 => 0.2788, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2655 => 0.2815, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.97% (1.9828 => 2.1012, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.97% (1.2193 => 1.2921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.83% (0.2023 => 0.2141, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.82% (0.2988 => 0.3162, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.76% (0.4390 => 0.4643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.76% (0.3107 => 0.3286, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 5.75% (0.3149 => 0.3330, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.73% (0.3580 => 0.3785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.69% (0.9199 => 0.9722, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 5.68% (0.3453 => 0.3649, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 5.55% (13.8202 => 14.5867, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary2: 5.51% (0.3192 => 0.3368, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.2925 => 0.3084, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 5.43% (0.3534 => 0.3726, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.2243 => 0.2364, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (1.3813 => 1.4556, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.37% (7.2180 => 7.6056, std. dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.2914 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.33% (0.2140 => 0.2254, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.30% (0.7506 => 0.7904, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4016 => 0.4225, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.17% (16.6129 => 17.4710, std. dev.: 0.0219) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.12% (1.4563 => 1.5308, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (1.3819 => 1.4525, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.5637 => 0.5924, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.96% (1.1061 => 1.1610, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (13.2842 => 13.9376, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (1.1364 => 1.1919, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 4.87% (3.8646 => 4.0528, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.87% (0.3246 => 0.3404, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3868 => 0.4054, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.77% (0.8310 => 0.8706, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.76% (0.7460 => 0.7815, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.75% (1.9270 => 2.0185, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.74% (1.3245 => 1.3873, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.63% (4.4433 => 4.6491, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 4.63% (0.3220 => 0.3369, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.56% (1.0594 => 1.1077, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.2292 => 1.2851, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.51% (3.6692 => 3.8347, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.48% (4.3801 => 4.5765, std. dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 4.13% (2.1791 => 2.2691, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.86% (1.1333 => 1.1770, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.65% (0.4113 => 0.4263, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (4.9865 => 5.1666, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.39% (0.6135 => 0.6343, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 3.33% (3.1889 => 3.2950, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (8.4961 => 8.7769, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.8698 => 0.8984, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.12% (6.5754 => 6.7805, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.10% (0.6283 => 0.6478, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.02% (14.8535 => 15.3025, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 3.00% (16.2614 => 16.7497, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.1007 => 2.1631, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.96% (14.5298 => 14.9599, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.82% (3.2742 => 3.3664, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5188 => 1.5611, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.67% (4.6629 => 4.7876, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 2.03% (0.6744 => 0.6881, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.95% (0.9108 => 0.9286, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.69% (1.0313 => 1.0487, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.65% (6.2785 => 6.3822, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 1.49% (3.7467 => 3.8025, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.45% (5.7573 => 7.5102, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 25.24% (1.8175 => 2.2763, std. dev.: 0.0410) SingleSource/Benchmarks/Misc/mandel-2: 8.07% (1.2998 => 1.4047, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 4.44% (7.4271 => 7.7567, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7053, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4566, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9660, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.11% (3.1071 => 3.1415, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6857, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.11% (22.5627 => 21.1844, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.84% (20.3410 => 18.5425, std. dev.: 0.0493) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3086, std. dev.: 0.0078) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9477, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6043, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2236, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2134, std. dev.: 0.0274) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0120) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2215, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 13:47:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 15:47:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803204757.0BF902A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2631?compare_to=2628&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2631, Order: 161250, Start Time: 2012-08-03 19:29:53, End Time: 2012-08-03 20:48:28 To: 2628, Order: 161243, Start Time: 2012-08-03 17:43:12, End Time: 2012-08-03 19:01:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (731 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.65% (13.7183 => 14.2187, std. dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.15% (10.3673 => 14.2187, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3473 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.62% (0.3543 => 0.3990, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.36% (0.3561 => 0.4001, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3694 => 0.4141, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.97% (1.1194 => 1.2534, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3828 => 0.4283, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.45% (0.3886 => 0.4331, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.19% (2.2022 => 2.4046, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.10% (0.2065 => 0.2253, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (1.7609 => 1.9021, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1892 => 0.2021, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.61% (0.3177 => 0.3387, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.26% (0.5925 => 0.6296, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.6030 => 0.6407, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 6.19% (0.3282 => 0.3485, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.08% (7.0540 => 7.4827, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 6.02% (10.4361 => 11.0645, std. dev.: 0.0168) SingleSource/UnitTests/ObjC++/property-reference: 5.87% (0.7326 => 0.7756, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.4879 => 0.5157, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4615 => 0.4871, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.78% (0.7433 => 0.7788, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.3121 => 0.3269, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.61% (9.4845 => 9.9222, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.60% (0.2758 => 0.2885, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.52% (0.8172 => 0.8541, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2554 => 0.2669, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.45% (4.9449 => 5.1651, std. dev.: 0.0132) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (5.0018 => 5.2225, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.27% (0.5860 => 0.6110, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5569 => 0.5805, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.23% (4.2646 => 4.4450, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: 4.12% (0.7835 => 0.8158, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.11% (0.2700 => 0.2811, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.99% (0.3180 => 0.3307, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.84% (8.1363 => 8.4488, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.84% (0.4636 => 0.4814, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.74% (0.3423 => 0.3551, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 3.73% (0.3109 => 0.3225, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 3.68% (0.2905 => 0.3012, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1861 => 1.2297, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.3092 => 0.3205, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.3050 => 1.3497, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.42% (5.7591 => 5.9559, std. dev.: 0.0070) MultiSource/Applications/hbd/hbd: 3.36% (1.5603 => 1.6128, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (14.3668 => 14.8493, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.8067 => 0.8336, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.22% (1.1642 => 1.2017, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.22% (0.3136 => 0.3237, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4299 => 0.4436, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.17% (0.4103 => 0.4233, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.15% (2.0665 => 2.1316, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.13% (1.5415 => 1.5897, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.10% (0.3865 => 0.3985, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.09% (2.0273 => 2.0899, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3935 => 0.4056, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.05% (0.4289 => 0.4420, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 3.04% (3.3354 => 3.4369, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 2.98% (0.3422 => 0.3524, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.96% (0.6456 => 0.6647, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.95% (0.3826 => 0.3939, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.93% (3.8723 => 3.9857, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3684 => 0.3791, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (0.4064 => 0.4181, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 2.86% (0.3603 => 0.3706, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (0.5105 => 0.5250, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.4203 => 0.4319, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.75% (1.5859 => 1.6295, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9765 => 1.0019, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.60% (0.4620 => 0.4740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.53% (0.6675 => 0.6844, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.2024 => 2.2579, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.44% (0.5981 => 0.6127, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.34% (1.2842 => 1.3142, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8921 => 0.9129, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.4186 => 1.4516, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6450 => 0.6596, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 1.89% (1.1840 => 1.2064, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.88% (17.1811 => 17.5045, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.76% (2.2969 => 2.3374, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.44% (1.0722 => 1.0876, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (7.9617 => 8.0609, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.69% (4.2280 => 4.3842, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7607, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.83% (3.7781 => 3.8473, std. dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8348, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5086 => 1.5321, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2508, std. dev.: 0.0257) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2041, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1518, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.42% (5.3855 => 3.7475, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.04% (5.3526 => 3.7445, std. dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0561, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.38% (2.9384 => 2.5451, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -11.58% (22.1758 => 19.6089, std. dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.67% (1.6925 => 1.4273, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.80% (1.2373 => 1.1037, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.58% (19.9488 => 18.4370, std. dev.: 0.1429) SingleSource/Benchmarks/Misc/mandel-2: -7.57% (1.5373 => 1.4210, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4890, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -4.64% (1.9577 => 1.8668, std. dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.19% (8.1563 => 7.8961, std. dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4813, std. dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4227, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0007, std. dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2007, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.86% (12.5348 => 12.3015, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4178, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.39% (1.8329 => 1.8074, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 15:12:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 17:12:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803221216.2EC432A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2632?compare_to=2630&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2632, Order: 161255, Start Time: 2012-08-03 20:58:47, End Time: 2012-08-03 22:12:44 To: 2630, Order: 161250, Start Time: 2012-08-03 19:14:08, End Time: 2012-08-03 20:28:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (149 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.40% (0.8363 => 0.8246, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.76% (2.0176 => 2.3154, std. dev.: 0.0071) SingleSource/UnitTests/ObjC++/property-reference-object: 9.44% (0.5818 => 0.6367, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 9.42% (0.7061 => 0.7726, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.24% (0.5748 => 0.6279, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.97% (0.3601 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.94% (0.3646 => 0.3972, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 8.87% (0.3663 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.74% (0.3650 => 0.3969, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.61% (0.3914 => 0.4251, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 8.43% (0.3940 => 0.4272, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 8.34% (0.4003 => 0.4337, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.34% (0.3130 => 0.3391, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.26% (0.1986 => 0.2150, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.31% (0.2721 => 0.2920, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.30% (1.3693 => 1.4692, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4328 => 0.4641, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.12% (0.5265 => 0.5640, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (3.9660 => 4.2453, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4062 => 0.4346, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.97% (0.2782 => 0.2976, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.7710 => 0.8246, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.48% (0.7038 => 0.7494, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.23% (0.3485 => 0.3702, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.20% (0.2726 => 0.2895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.18% (0.3899 => 0.4140, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.17% (0.2966 => 0.3149, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.2937 => 0.3118, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.10% (0.3149 => 0.3341, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2761 => 0.2929, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4390 => 0.4657, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.05% (1.9828 => 2.1027, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.03% (0.4379 => 0.4643, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.99% (0.3489 => 0.3698, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.2696 => 0.2857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.95% (0.3107 => 0.3292, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3580 => 0.3793, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.92% (0.6959 => 0.7371, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.90% (1.2193 => 1.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.82% (0.2988 => 0.3162, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.71% (0.9199 => 0.9724, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 5.70% (0.3192 => 0.3374, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.54% (0.5577 => 0.5886, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4016 => 0.4235, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3534 => 0.3725, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.39% (13.8202 => 14.5653, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists: 5.28% (0.3293 => 0.3467, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.21% (16.6129 => 17.4778, std. dev.: 0.0184) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (1.3819 => 1.4525, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (13.2842 => 13.9433, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.96% (1.4563 => 1.5285, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (7.2180 => 7.5752, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.93% (1.3813 => 1.4494, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.87% (1.1364 => 1.1917, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.81% (0.3246 => 0.3402, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.76% (0.7506 => 0.7863, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.73% (3.8646 => 4.0474, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.68% (0.8310 => 0.8699, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 4.63% (1.1061 => 1.1573, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.57% (1.0594 => 1.1078, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (1.3245 => 1.3848, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.51% (1.2292 => 1.2846, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.43% (1.9270 => 2.0124, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.7460 => 0.7788, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 4.27% (0.2995 => 0.3123, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (3.6692 => 3.8255, std. dev.: 0.0120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.20% (4.4433 => 4.6298, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (4.3801 => 4.5616, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.99% (0.3755 => 0.3905, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.80% (1.1333 => 1.1764, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 3.76% (2.1791 => 2.2610, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.9865 => 5.1722, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (0.4791 => 0.4968, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.44% (0.8698 => 0.8997, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.39% (8.4961 => 8.7843, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.22% (3.1889 => 3.2915, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (6.5754 => 6.7831, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.07% (2.1007 => 2.1651, std. dev.: 0.0122) MultiSource/Applications/JM/lencod/lencod: 3.03% (14.8535 => 15.3038, std. dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 3.01% (16.2614 => 16.7507, std. dev.: 0.0115) MultiSource/Applications/ClamAV/clamscan: 2.92% (14.5298 => 14.9538, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.90% (3.2742 => 3.3692, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5188 => 1.5584, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.56% (4.6629 => 4.7821, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.6250 => 0.6379, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.02% (0.9108 => 0.9292, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.47% (6.2785 => 6.3708, std. dev.: 0.0085) MultiSource/Applications/lua/lua: 1.34% (3.7467 => 3.7968, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.89% (1.8175 => 2.2698, std. dev.: 0.0442) SingleSource/Benchmarks/Misc/mandel-2: 6.94% (1.2998 => 1.3900, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.84% (1.5824 => 1.6748, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.06% (0.9996 => 1.0502, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7544, std. dev.: 0.0163) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7094, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9742, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8147, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5325, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.39% (10.7476 => 10.8971, std. dev.: 0.0240) SingleSource/Benchmarks/Misc/flops: 1.28% (9.0760 => 9.1924, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.97% (22.5627 => 21.2149, std. dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2308 => 1.1007, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.00% (20.3410 => 18.5108, std. dev.: 0.0541) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3111, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5932, std. dev.: 0.0062) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9469, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2255, std. dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5058, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2127, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2470, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8489, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 15:26:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 17:26:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120803222652.1C2A22A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2633?compare_to=2629&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2633, Order: 161250, Start Time: 2012-08-03 19:43:47, End Time: 2012-08-03 22:27:24 To: 2629, Order: 161243, Start Time: 2012-08-03 16:32:08, End Time: 2012-08-03 19:15:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (113 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.04% (126.7771 => 130.6255, std. dev.: 0.5733) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.22% (0.3465 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.17% (0.3446 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3442 => 0.3895, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3469 => 0.3925, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.71% (0.3643 => 0.4106, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1063 => 0.1175, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1620 => 0.1771, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.91% (1.5932 => 1.7192, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.1619 => 0.1738, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.34% (0.5026 => 0.5395, std. dev.: 0.0080) MultiSource/Applications/spiff/spiff: 7.15% (0.4029 => 0.4317, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.90% (0.5826 => 0.6228, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.81% (1.3152 => 1.4048, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.74% (0.5889 => 0.6286, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (3.5627 => 3.7973, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.54% (0.4361 => 0.4646, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.53% (0.5900 => 0.6285, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (0.4994 => 0.5315, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.28% (1.6211 => 1.7229, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.26% (0.5000 => 0.5313, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.14% (4.2109 => 4.4696, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference: 6.00% (0.7171 => 0.7601, std. dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 5.92% (0.4847 => 0.5134, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (2.1013 => 2.2256, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.2736 => 0.2895, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.78% (0.3930 => 0.4157, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.70% (1.0781 => 1.1395, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.58% (0.2866 => 0.3026, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.49% (2.7292 => 2.8791, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 5.11% (0.6634 => 0.6973, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 5.03% (5.5417 => 5.8204, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.01% (0.2714 => 0.2850, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.88% (1.9694 => 2.0656, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 4.84% (0.2725 => 0.2857, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.75% (4.6177 => 4.8369, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.73% (0.2875 => 0.3011, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.73% (1.9966 => 2.0910, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (0.4658 => 0.4877, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 4.68% (0.9909 => 1.0373, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3195 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.43% (0.2729 => 0.2850, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.43% (0.3004 => 0.3137, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.40% (0.3271 => 0.3415, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.40% (0.2750 => 0.2871, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (0.3890 => 0.4061, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.38% (0.3060 => 0.3194, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2780 => 0.2901, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.33% (0.2566 => 0.2677, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.32% (0.2803 => 0.2924, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.30% (2.1653 => 2.2584, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.3096 => 0.3228, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.25% (0.7875 => 0.8210, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.25% (2.0673 => 2.1551, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.22% (0.9697 => 1.0106, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.2823 => 0.2942, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.21% (1.8794 => 1.9586, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.16% (0.2813 => 0.2930, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 4.12% (0.2691 => 0.2802, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.12% (0.2911 => 0.3031, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.10% (0.3267 => 0.3401, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3317 => 0.3453, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.3845 => 0.3999, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3258 => 0.3388, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.99% (0.3362 => 0.3496, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (4.4195 => 4.5940, std. dev.: 0.0097) MultiSource/Applications/lua/lua: 3.88% (1.4269 => 1.4823, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3625 => 0.3763, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3282 => 0.3406, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.77% (0.3477 => 0.3608, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3678 => 0.3816, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.73% (0.3726 => 0.3865, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.64% (0.3348 => 0.3470, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.64% (0.4146 => 0.4297, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.61% (0.3903 => 0.4044, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3690 => 0.3817, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.34% (0.4251 => 0.4393, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.27% (0.3981 => 0.4111, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 3.26% (0.5546 => 0.5727, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 3.17% (23.5202 => 24.2655, std. dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 3.10% (2.0346 => 2.0977, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.6435 => 0.6616, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.71% (0.5012 => 0.5148, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.35% (11.6398 => 11.7966, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9640, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6701, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.52% (1.8057 => 1.8873, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.70% (105.3826 => 108.2296, std. dev.: 0.0227) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 2.37% (3.1722 => 3.2473, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2068, std. dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4984, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.77% (41.7953 => 42.5344, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.44% (12.4025 => 12.5812, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.28% (1.0142 => 1.0272, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.21% (11.9701 => 12.1150, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.09% (25.4195 => 16.5006, std. dev.: 0.0266) SingleSource/Benchmarks/Dhrystone/fldry: -9.41% (17.2379 => 15.6152, std. dev.: 0.2284) SingleSource/Benchmarks/Shootout-C++/ary2: -9.03% (0.2402 => 0.2185, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fbench: -7.77% (2.2722 => 2.0957, std. dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8037, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: -7.46% (2.1113 => 1.9537, std. dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7914, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5407, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5831, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9575, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.03% (79.9355 => 79.1101, std. dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (3.3991 => 3.3645, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 15:34:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 17:34:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120803223427.DB5E82A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2634?compare_to=2631&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2634, Order: 161255, Start Time: 2012-08-03 21:16:36, End Time: 2012-08-03 22:34:59 To: 2631, Order: 161250, Start Time: 2012-08-03 19:29:53, End Time: 2012-08-03 20:48:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (80 on baseline) Performance Improvements: 8 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 926 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.78% (14.2187 => 13.5387, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.26% (7.4827 => 7.3883, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.20% (2.4046 => 2.3757, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.09% (3.7475 => 3.7068, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.05% (3.7445 => 3.7051, std. dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: -1.02% (11.0645 => 10.9512, std. dev.: 0.0063) MultiSource/Applications/hbd/hbd: -1.02% (1.6128 => 1.5963, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.01% (8.0609 => 7.9796, std. dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.59% (10.3673 => 13.5387, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3473 => 0.3904, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.94% (0.3543 => 0.3966, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 11.91% (0.3543 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2502, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3694 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.94% (0.3886 => 0.4311, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3927 => 0.4355, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.88% (2.2022 => 2.3757, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8980, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.66% (0.6030 => 0.6371, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.94% (10.4361 => 10.9512, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 4.78% (0.3282 => 0.3439, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (7.0540 => 7.3883, std. dev.: 0.0065) SingleSource/UnitTests/ObjC++/property-reference: 4.72% (0.7326 => 0.7672, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.05% (0.8172 => 0.8503, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 3.98% (0.7433 => 0.7729, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.89% (9.4845 => 9.8535, std. dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.9449 => 5.1342, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5569 => 0.5782, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (5.0018 => 5.1904, std. dev.: 0.0121) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.5860 => 0.6062, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.39% (4.2646 => 4.4092, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.25% (8.1363 => 8.4007, std. dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1861 => 1.2215, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4299 => 0.4421, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.83% (1.3050 => 1.3419, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.83% (0.4636 => 0.4767, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.71% (5.7591 => 5.9150, std. dev.: 0.0045) MultiSource/Applications/Burg/burg: 2.68% (1.1642 => 1.1954, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.8067 => 0.8280, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.52% (14.3668 => 14.7294, std. dev.: 0.0172) MultiSource/Applications/treecc/treecc: 2.43% (2.0273 => 2.0766, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (2.0665 => 2.1149, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 2.34% (3.3354 => 3.4133, std. dev.: 0.0126) MultiSource/Applications/hbd/hbd: 2.31% (1.5603 => 1.5963, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.30% (1.5415 => 1.5770, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6456 => 0.6597, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.14% (3.8723 => 3.9551, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5105 => 0.5213, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.08% (0.9765 => 0.9968, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.2024 => 2.2443, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.89% (1.5859 => 1.6159, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6450 => 0.6565, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4436, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 1.63% (0.8921 => 0.9066, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3044, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.35% (17.1811 => 17.4129, std. dev.: 0.0076) MultiSource/Applications/siod/siod: 1.14% (2.2969 => 2.3230, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.14% (4.2280 => 4.4030, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7549, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5086 => 1.5336, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.59% (11.6436 => 11.8291, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 1.58% (3.1578 => 3.2077, std. dev.: 0.0037) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2038, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2297, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1537, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7068, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.78% (5.3526 => 3.7051, std. dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0692, std. dev.: 0.0286) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.20% (2.9384 => 2.5506, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -12.32% (22.1758 => 19.4429, std. dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.05% (3.8922 => 3.8515, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1061, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.19% (19.9488 => 18.5142, std. dev.: 0.1191) SingleSource/Benchmarks/Misc/mandel-2: -6.50% (1.5373 => 1.4373, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.83% (1.9577 => 1.8632, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4798, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9080, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4169, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.75% (1.3677 => 1.3301, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0017, std. dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2003, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3234, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 16:54:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 18:54:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120803235401.E212A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2635?compare_to=2632&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2635, Order: 161266, Start Time: 2012-08-03 22:40:51, End Time: 2012-08-03 23:54:33 To: 2632, Order: 161255, Start Time: 2012-08-03 20:58:47, End Time: 2012-08-03 22:12:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.91% (79.9264 => 78.4038, std. dev.: 0.4256) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.05% (2.0176 => 2.3212, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7061 => 0.7724, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.38% (0.5818 => 0.6364, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5748 => 0.6275, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3578 => 0.3885, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.31% (0.3646 => 0.3949, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.16% (0.3650 => 0.3948, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.4003 => 0.4319, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.25% (1.3693 => 1.4686, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.89% (3.9660 => 4.2394, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.49% (0.7038 => 0.7495, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.35% (0.4328 => 0.4603, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2782 => 0.2946, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.79% (0.5577 => 0.5900, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.68% (1.2193 => 1.2886, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (1.3819 => 1.4592, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.49% (1.3813 => 1.4572, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9199 => 0.9696, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.24% (1.9828 => 2.0867, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.22% (0.4390 => 0.4619, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.15% (13.8202 => 14.5323, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.99% (0.2988 => 0.3137, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.92% (16.6129 => 17.4295, std. dev.: 0.0141) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3192 => 0.3345, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.78% (7.2180 => 7.5629, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.72% (1.4563 => 1.5251, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.65% (13.2842 => 13.9023, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists1: 4.61% (0.3534 => 0.3697, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.59% (1.1364 => 1.1886, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.50% (0.8310 => 0.8684, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.3868 => 0.4039, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.38% (1.0594 => 1.1058, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.38% (1.1061 => 1.1545, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 4.35% (3.8646 => 4.0328, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.3245 => 1.3817, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.32% (1.9270 => 2.0102, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (3.6692 => 3.8166, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6146, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.2292 => 1.2765, std. dev.: 0.0104) MultiSource/Applications/siod/siod: 3.85% (2.1791 => 2.2629, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.3801 => 4.5457, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.48% (1.1333 => 1.1727, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.38% (4.9865 => 5.1552, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.14% (8.4961 => 8.7629, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.8698 => 0.8964, std. dev.: 0.0089) MultiSource/Applications/d/make_dparser: 3.03% (3.1889 => 3.2856, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.03% (0.6135 => 0.6321, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.91% (3.2742 => 3.3695, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.1007 => 2.1600, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.79% (16.2614 => 16.7152, std. dev.: 0.0153) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.5754 => 6.7586, std. dev.: 0.0190) MultiSource/Applications/ClamAV/clamscan: 2.78% (14.5298 => 14.9339, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.8535 => 15.2514, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5188 => 1.5576, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.15% (4.6629 => 4.7630, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.75% (0.9108 => 0.9267, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3508, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 1.02% (3.7467 => 3.7850, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.45% (1.2998 => 1.3836, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7546, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7069, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9749, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (1.5089 => 1.5373, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0310 => 1.0439, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.5627 => 21.1532, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.57% (0.2670 => 0.2548, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.88% (1.2308 => 1.1092, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (20.3410 => 18.6095, std. dev.: 0.0280) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0084) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.39% (8.8259 => 8.6151, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2309, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5074, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.64% (7.3305 => 7.2101, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2146, std. dev.: 0.0159) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2495, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 17:21:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 19:21:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804002100.2D3652A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2636?compare_to=2634&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2636, Order: 161270, Start Time: 2012-08-03 23:03:00, End Time: 2012-08-04 00:21:32 To: 2634, Order: 161255, Start Time: 2012-08-03 21:16:36, End Time: 2012-08-03 22:34:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (85 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (13.5387 => 13.6832, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.98% (10.3673 => 13.6832, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3473 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3516 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3497 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.59% (1.1194 => 1.2491, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.14% (2.2022 => 2.3814, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.82% (1.7609 => 1.8986, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5925 => 0.6304, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.17% (0.6030 => 0.6402, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.45% (7.0540 => 7.4384, std. dev.: 0.0129) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7326 => 0.7712, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (10.4361 => 10.9614, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.81% (0.4615 => 0.4837, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.4879 => 0.5109, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (9.4845 => 9.8785, std. dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.03% (0.8172 => 0.8501, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.9449 => 5.1324, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (5.0018 => 5.1894, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5569 => 0.5775, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (4.2646 => 4.4145, std. dev.: 0.0177) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5860 => 0.6060, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.33% (8.1363 => 8.4073, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.22% (1.5603 => 1.6106, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.14% (0.7835 => 0.8081, std. dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 2.99% (5.7591 => 5.9313, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2208, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7800, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.3050 => 1.3421, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.68% (2.0665 => 2.1219, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1950, std. dev.: 0.0117) MultiSource/Applications/treecc/treecc: 2.60% (2.0273 => 2.0800, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 2.56% (3.3354 => 3.4208, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.54% (1.5415 => 1.5806, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.46% (0.6456 => 0.6615, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9600, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5859 => 1.6217, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (0.4620 => 0.4724, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9765 => 0.9967, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2842 => 1.3107, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.2024 => 2.2473, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6450 => 0.6569, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.68% (17.1811 => 17.4689, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 1.66% (0.8921 => 0.9069, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4421, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.43% (0.7115 => 0.7217, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.23% (2.2969 => 2.3252, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.25% (4.2280 => 4.4079, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7598, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5348, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8333, std. dev.: 0.0013) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2370, std. dev.: 0.0279) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.28% (1.0313 => 1.0445, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3727, std. dev.: 0.0206) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.33% (5.2763 => 3.1482, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.71% (5.3855 => 3.7314, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.34% (5.3526 => 3.7288, std. dev.: 0.0093) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0544, std. dev.: 0.0347) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.67% (2.9384 => 2.5367, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.02% (22.1758 => 19.5112, std. dev.: 0.0248) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.75% (0.0400 => 0.0201, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2373 => 1.1158, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.71% (19.9488 => 18.6103, std. dev.: 0.0415) SingleSource/Benchmarks/Misc/mandel-2: -6.69% (1.5373 => 1.4344, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.09% (1.5835 => 1.5029, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.64% (1.9577 => 1.8668, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5952, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4716, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9000, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4302, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2007, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3187, std. dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4178, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 18:35:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 20:35:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120804013543.8BF182A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2637?compare_to=2635&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2637, Order: 161283, Start Time: 2012-08-04 00:22:35, End Time: 2012-08-04 01:36:15 To: 2635, Order: 161266, Start Time: 2012-08-03 22:40:51, End Time: 2012-08-03 23:54:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (140 on baseline) Performance Improvements: 2 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.16% (1.3836 => 1.4135, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.06% (55.6242 => 56.2144, std. dev.: 0.1763) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.44% (1.4592 => 1.4382, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.38% (1.4572 => 1.4371, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3042, std. dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference-object: 9.61% (0.5818 => 0.6377, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5748 => 0.6297, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.79% (0.3650 => 0.3971, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 8.72% (0.3623 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.62% (0.7061 => 0.7670, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4003 => 0.4338, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.35% (0.3940 => 0.4269, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.37% (1.3693 => 1.4702, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.80% (0.2781 => 0.2970, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.69% (0.7710 => 0.8226, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.46% (3.9660 => 4.2223, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.44% (0.5265 => 0.5604, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.18% (0.2655 => 0.2819, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.2937 => 0.3117, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 6.10% (0.7038 => 0.7467, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.02% (0.3022 => 0.3204, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.97% (0.2765 => 0.2930, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2761 => 0.2925, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.91% (0.3485 => 0.3691, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.87% (1.9828 => 2.0992, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.3899 => 0.4125, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.2988 => 0.3155, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.55% (0.3192 => 0.3369, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3534 => 0.3725, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.24% (0.3453 => 0.3634, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (1.2193 => 1.2831, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.6959 => 0.7323, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 5.22% (0.3293 => 0.3465, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.04% (0.9199 => 0.9663, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.5577 => 0.5852, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.75% (13.8202 => 14.4761, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.66% (16.6129 => 17.3876, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.60% (0.2914 => 0.3048, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.45% (7.2180 => 7.5395, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.37% (1.4563 => 1.5199, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.29% (1.1364 => 1.1852, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.25% (0.7506 => 0.7825, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.20% (1.1061 => 1.1526, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2292 => 1.2808, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (13.2842 => 13.8368, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.7460 => 0.7766, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.07% (1.3819 => 1.4382, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.04% (1.3813 => 1.4371, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (1.3245 => 1.3774, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (3.8646 => 4.0184, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/football/football: 3.95% (0.8310 => 0.8638, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.91% (1.0594 => 1.1008, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.81% (1.9270 => 2.0005, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.81% (0.3755 => 0.3898, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (4.4433 => 4.6097, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (4.3801 => 4.5418, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (3.6692 => 3.8018, std. dev.: 0.0111) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3220 => 0.3333, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2995 => 0.3099, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.9865 => 5.1474, std. dev.: 0.0121) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.17% (0.4791 => 0.4943, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.16% (1.1333 => 1.1691, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.00% (2.1791 => 2.2444, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.94% (0.6283 => 0.6468, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.94% (0.8698 => 0.8954, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.82% (3.1889 => 3.2788, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6135 => 0.6306, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.75% (8.4961 => 8.7295, std. dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.5754 => 6.7445, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6722, std. dev.: 0.0110) MultiSource/Applications/JM/lencod/lencod: 2.39% (14.8535 => 15.2090, std. dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8747, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (3.2742 => 3.3491, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.1007 => 2.1486, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 2.26% (4.6629 => 4.7683, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (1.5188 => 1.5480, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.24% (0.9108 => 0.9221, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.08% (1.0313 => 1.0424, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5099, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2732, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/mandel-2: 8.75% (1.2998 => 1.4135, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.30% (0.9996 => 1.0526, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7520, std. dev.: 0.0122) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7069, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5357, std. dev.: 0.0101) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0310 => 1.0439, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.22% (10.7476 => 10.8785, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.61% (0.4657 => 0.4023, std. dev.: 0.0134) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.5627 => 21.1088, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0983, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.75% (20.3410 => 18.5608, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0071) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5881, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9555, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5002, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2339, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2167, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2148, std. dev.: 0.0410) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2516, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.16% (3.8887 => 3.8436, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8722, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 18:38:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 20:38:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120804013812.0E68A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2638?compare_to=2633&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2638, Order: 161270, Start Time: 2012-08-03 22:55:31, End Time: 2012-08-04 01:38:44 To: 2633, Order: 161250, Start Time: 2012-08-03 19:43:47, End Time: 2012-08-03 22:27:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (76 on baseline) Performance Improvements: 12 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 938 (803 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 8.24% (2.0957 => 2.2683, std. dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: 2.13% (15.6152 => 15.9478, std. dev.: 0.0583) MultiSource/Applications/siod/siod: 1.20% (6.9750 => 7.0586, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (79.1101 => 80.0294, std. dev.: 0.0207) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.21% (0.5134 => 0.4918, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -1.86% (1.7192 => 1.6872, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.43% (2.1551 => 2.1242, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.42% (2.2256 => 2.1939, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -1.28% (1.0373 => 1.0240, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.23% (2.0977 => 2.0718, std. dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: -1.21% (4.4696 => 4.4153, std. dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: -1.21% (4.8369 => 4.7783, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.18% (1.4048 => 1.3882, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: -1.12% (1.1395 => 1.1267, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.10% (2.0656 => 2.0428, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.60% (130.6255 => 123.3079, std. dev.: 2.6000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 12.56% (0.3496 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3460 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.49% (0.3442 => 0.3872, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 12.48% (0.3469 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.13% (0.3643 => 0.4085, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.05% (0.3650 => 0.4090, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3724 => 0.4162, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.57% (0.3792 => 0.4193, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.04% (0.1619 => 0.1733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5826 => 0.6196, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.31% (0.4994 => 0.5309, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.5889 => 0.6257, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.02% (3.5627 => 3.7771, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.95% (1.6211 => 1.7175, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.90% (1.5932 => 1.6872, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (0.4361 => 0.4612, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.5900 => 0.6237, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.68% (0.4029 => 0.4258, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.55% (1.3152 => 1.3882, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.2014 => 0.2124, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (0.5026 => 0.5297, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.32% (0.5000 => 0.5266, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (2.7292 => 2.8632, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.85% (4.2109 => 4.4153, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: 4.82% (0.7171 => 0.7517, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.2866 => 0.2998, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.51% (1.0781 => 1.1267, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.41% (2.1013 => 2.1939, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 4.07% (5.5417 => 5.7673, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.90% (0.2566 => 0.2666, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (0.3890 => 0.4041, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (0.4658 => 0.4837, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (1.9694 => 2.0428, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.70% (1.9966 => 2.0705, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 3.59% (0.7875 => 0.8158, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.48% (4.6177 => 4.7783, std. dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (1.8794 => 1.9447, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.3903 => 0.4036, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (4.4195 => 4.5700, std. dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (2.1653 => 2.2388, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 3.34% (0.9909 => 1.0240, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.24% (0.4139 => 0.4273, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.23% (0.6634 => 0.6848, std. dev.: 0.0062) MultiSource/Applications/lua/lua: 3.02% (1.4269 => 1.4700, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 2.83% (0.5546 => 0.5703, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (2.0673 => 2.1242, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.50% (23.5202 => 24.1081, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.83% (2.0346 => 2.0718, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.82% (0.6435 => 0.6552, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8965, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6601, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1917, std. dev.: 0.0095) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (41.7953 => 42.6309, std. dev.: 0.0186) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4959, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2206, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.07% (6.9842 => 7.0586, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.36% (11.9555 => 11.7926, std. dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5221, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7995, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -7.48% (17.2379 => 15.9478, std. dev.: 0.0583) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7880, std. dev.: 0.0137) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5437, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5721, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9712, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 19:07:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 21:07:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804020723.5CAC62A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2639?compare_to=2636&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2639, Order: 161287, Start Time: 2012-08-04 00:49:37, End Time: 2012-08-04 02:07:55 To: 2636, Order: 161270, Start Time: 2012-08-03 23:03:00, End Time: 2012-08-04 00:21:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (85 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.41% (55.0110 => 56.3359, std. dev.: 0.0931) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.54% (13.6832 => 13.4719, std. dev.: 0.0099) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.95% (10.3673 => 13.4719, std. dev.: 0.0099) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.88% (0.3543 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2512, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3694 => 0.4124, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.82% (2.2022 => 2.3745, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.60% (1.7609 => 1.8947, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 6.98% (0.1432 => 0.1532, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.80% (0.5925 => 0.6328, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.70% (0.6030 => 0.6434, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.60% (0.7326 => 0.7736, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (10.4361 => 10.9830, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (7.0540 => 7.4037, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.76% (0.4879 => 0.5111, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.31% (0.7433 => 0.7753, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.10% (0.8172 => 0.8507, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (9.4845 => 9.8668, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.9449 => 5.1405, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1958, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5860 => 0.6073, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4180, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4080, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 3.32% (0.7835 => 0.8095, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.28% (14.3668 => 14.8381, std. dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4636 => 0.4783, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9414, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.15% (1.1861 => 1.2235, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.3050 => 1.3455, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.87% (2.0273 => 2.0854, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.77% (1.1642 => 1.1964, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.73% (3.3354 => 3.4265, std. dev.: 0.0154) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4299 => 0.4416, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.5415 => 1.5823, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.62% (1.5603 => 1.6012, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 2.49% (3.8723 => 3.9689, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.44% (0.4103 => 0.4203, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.43% (0.5105 => 0.5229, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.35% (0.9765 => 0.9994, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.2024 => 2.2539, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5859 => 1.6228, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.15% (2.0665 => 2.1110, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (0.6675 => 0.6818, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.6456 => 0.6588, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.97% (0.6450 => 0.6577, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.94% (1.4186 => 1.4461, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.91% (0.8921 => 0.9091, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.79% (17.1811 => 17.4886, std. dev.: 0.0223) MultiSource/Applications/hexxagon/hexxagon: 1.69% (1.2842 => 1.3059, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.61% (2.2969 => 2.3339, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.46% (1.1840 => 1.2013, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.41% (0.7115 => 0.7215, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.09% (1.0722 => 1.0839, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.32% (4.2280 => 4.4105, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7551, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1578 => 3.2102, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 1.59% (11.6436 => 11.8292, std. dev.: 0.0025) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2041, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2321, std. dev.: 0.0081) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3747, std. dev.: 0.0315) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.03% (2.8904 => 2.9201, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.45% (0.8651 => 0.1691, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.21% (5.2763 => 3.1545, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7222, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7173, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0863, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.58% (2.9384 => 2.5394, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -11.92% (22.1758 => 19.5326, std. dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2373 => 1.1137, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -8.63% (1.5373 => 1.4046, std. dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.21% (19.9488 => 18.5111, std. dev.: 0.0830) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.89% (1.9577 => 1.8620, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4725, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9074, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4203, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0007, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2011, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3230, std. dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4182, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 20:17:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 22:17:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120804031722.C59472A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2640?compare_to=2637&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2640, Order: 161291, Start Time: 2012-08-04 02:04:16, End Time: 2012-08-04 03:17:54 To: 2637, Order: 161283, Start Time: 2012-08-04 00:22:35, End Time: 2012-08-04 01:36:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.10% (1.0983 => 1.1104, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.32% (2.0176 => 2.3066, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.03% (0.3578 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.5818 => 0.6343, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3646 => 0.3969, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.86% (0.3601 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.80% (0.5748 => 0.6254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.76% (0.3789 => 0.4121, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3663 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.69% (0.3623 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.68% (0.3650 => 0.3967, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 8.43% (0.3940 => 0.4272, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.06% (0.7061 => 0.7630, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.55% (1.3693 => 1.4727, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.08% (0.7710 => 0.8256, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.89% (3.9660 => 4.2391, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.88% (0.5265 => 0.5627, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.86% (0.4328 => 0.4625, std. dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.76% (0.2782 => 0.2970, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.61% (0.7038 => 0.7503, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.3899 => 0.4147, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2760 => 0.2934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3022 => 0.3212, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.27% (0.2966 => 0.3152, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.05% (0.3485 => 0.3696, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2761 => 0.2928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.2937 => 0.3114, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.00% (1.9828 => 2.1018, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.2696 => 0.2857, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.83% (0.3107 => 0.3288, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.82% (0.3489 => 0.3692, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.69% (0.2988 => 0.3158, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.56% (1.2193 => 1.2871, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3453 => 0.3643, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.38% (0.3534 => 0.3724, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9199 => 0.9692, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.21% (16.6129 => 17.4783, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.15% (0.4016 => 0.4223, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4390 => 0.4616, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.10% (13.8202 => 14.5253, std. dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.96% (0.3868 => 0.4060, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.86% (0.2140 => 0.2244, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.80% (0.7506 => 0.7866, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.75% (1.3813 => 1.4469, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.69% (7.2180 => 7.5568, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (1.4563 => 1.5238, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.57% (1.1061 => 1.1567, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (1.1364 => 1.1875, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.47% (3.8646 => 4.0372, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (1.3819 => 1.4428, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.40% (1.2292 => 1.2833, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.7460 => 0.7785, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.35% (13.2842 => 13.8621, std. dev.: 0.0076) MultiSource/Applications/treecc/treecc: 4.30% (1.9270 => 2.0099, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.28% (1.3245 => 1.3812, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/football/football: 4.24% (0.8310 => 0.8662, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.0594 => 1.1025, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3220 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5544, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (4.4433 => 4.6200, std. dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (3.6692 => 3.8127, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.89% (0.3755 => 0.3901, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (4.9865 => 5.1676, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 3.55% (2.1791 => 2.2565, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: 3.45% (0.4113 => 0.4255, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.35% (0.8698 => 0.8989, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1712, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.11% (0.6135 => 0.6326, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.11% (3.1889 => 3.2880, std. dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 3.01% (8.4961 => 8.7515, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.5754 => 6.7617, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.68% (16.2614 => 16.6967, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1563, std. dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2441, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (3.2742 => 3.3588, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.57% (14.5298 => 14.9033, std. dev.: 0.0249) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5188 => 1.5555, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.29% (4.6629 => 4.7696, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.6250 => 0.6364, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.38% (1.0313 => 1.0455, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.27% (6.2785 => 6.3584, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.12% (3.7467 => 3.7888, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 30.43% (5.7573 => 7.5091, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 24.98% (1.8175 => 2.2716, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel-2: 8.38% (1.2998 => 1.4087, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6760, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.12% (0.9996 => 1.0508, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: 4.51% (7.4271 => 7.7622, std. dev.: 0.0122) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7094, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.58% (1.7688 => 1.8144, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5089 => 1.5347, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9585, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.10% (1.0310 => 1.0423, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6858, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1387, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.37% (0.4657 => 0.3988, std. dev.: 0.0089) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1661, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2308 => 1.1104, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (20.3410 => 18.6390, std. dev.: 0.0414) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9529, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.39% (8.8259 => 8.6148, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2351, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5113, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2165, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2513, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2263, std. dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 20:53:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 22:53:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804035350.9011A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2641?compare_to=2639&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2641, Order: 161292, Start Time: 2012-08-04 02:35:56, End Time: 2012-08-04 03:54:21 To: 2639, Order: 161287, Start Time: 2012-08-04 00:49:37, End Time: 2012-08-04 02:07:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (752 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.10% (7.9593 => 8.0469, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.20% (10.3673 => 13.3941, std. dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.76% (1.1194 => 1.2622, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3516 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 11.18% (0.3561 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3828 => 0.4237, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.42% (0.3886 => 0.4291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.3927 => 0.4329, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.54% (1.7609 => 1.9112, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.44% (2.2022 => 2.3881, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 5.86% (0.5925 => 0.6272, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.70% (0.6030 => 0.6374, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.69% (10.4361 => 11.0298, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.38% (7.0540 => 7.4333, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.3282 => 0.3450, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 4.87% (0.7326 => 0.7683, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.20% (9.4845 => 9.8831, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (5.0018 => 5.2027, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.9449 => 5.1435, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.94% (0.8172 => 0.8494, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.92% (0.5860 => 0.6090, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.74% (0.2700 => 0.2801, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (4.2646 => 4.4128, std. dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (8.1363 => 8.4095, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9414, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1861 => 1.2223, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (14.3668 => 14.8002, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.3050 => 1.3443, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.00% (0.4636 => 0.4775, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4299 => 0.4418, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.75% (1.1642 => 1.1962, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.73% (0.4103 => 0.4215, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (0.5105 => 0.5242, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.68% (3.3354 => 3.4249, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0795, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 2.56% (1.5603 => 1.6002, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.54% (1.5415 => 1.5806, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.39% (0.8067 => 0.8260, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.39% (3.8723 => 3.9647, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (1.5859 => 1.6232, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6456 => 0.6604, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.24% (2.2024 => 2.2517, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.21% (0.9765 => 0.9981, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (2.0665 => 2.1078, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8921 => 0.9095, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.84% (0.6450 => 0.6569, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.82% (1.4186 => 1.4444, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.73% (17.1811 => 17.4783, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.65% (1.2842 => 1.3054, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.52% (0.7115 => 0.7223, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.46% (2.2969 => 2.3305, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 1.41% (1.1840 => 1.2007, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.01% (1.0722 => 1.0830, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.3999, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7457, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.84% (1.5086 => 1.5363, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2125, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.58% (11.6436 => 11.8276, std. dev.: 0.0028) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2360, std. dev.: 0.0402) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3753, std. dev.: 0.0139) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.82% (5.2763 => 3.1753, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.36% (5.3855 => 3.7504, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.06% (5.3526 => 3.7435, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1369, std. dev.: 0.0357) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.04% (2.9384 => 2.5551, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: -11.72% (22.1758 => 19.5766, std. dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2373 => 1.1089, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -8.13% (1.5373 => 1.4123, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5538, std. dev.: 0.0550) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.47% (1.9577 => 1.8702, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4813, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.16% (8.6802 => 8.4062, std. dev.: 0.0189) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9043, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -1.70% (12.5348 => 12.3215, std. dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4177, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8099, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 21:51:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 23:51:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120804045158.A1CE02A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2642?compare_to=2638&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2642, Order: 161292, Start Time: 2012-08-04 02:08:51, End Time: 2012-08-04 04:52:30 To: 2638, Order: 161270, Start Time: 2012-08-03 22:55:31, End Time: 2012-08-04 01:38:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (110 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (769 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (2.1242 => 2.1538, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.18% (0.9949 => 1.0066, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.02% (1.0240 => 1.0344, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.41% (54.0081 => 54.7686, std. dev.: 0.1141) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.25% (0.3465 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.17% (0.3446 => 0.3900, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3442 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3469 => 0.3922, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 12.85% (0.3643 => 0.4111, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.63% (0.3650 => 0.4111, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3724 => 0.4185, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1063 => 0.1168, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5826 => 0.6251, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.04% (0.1619 => 0.1733, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.01% (0.5889 => 0.6302, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.71% (1.5932 => 1.7001, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.5900 => 0.6276, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.27% (0.4994 => 0.5307, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.25% (0.5026 => 0.5340, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (3.5627 => 3.7785, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.00% (1.3152 => 1.3941, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.00% (1.6211 => 1.7183, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (0.4361 => 0.4611, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 5.62% (0.7171 => 0.7574, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.2014 => 0.2124, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.20% (0.2866 => 0.3015, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.16% (0.5000 => 0.5258, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (0.3930 => 0.4132, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.11% (0.4029 => 0.4235, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 5.00% (1.0781 => 1.1320, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2738 => 0.2873, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.89% (4.2109 => 4.4167, std. dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (2.7292 => 2.8598, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.71% (0.2736 => 0.2865, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.41% (0.3195 => 0.3336, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.39% (0.9909 => 1.0344, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.36% (0.3004 => 0.3135, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 4.29% (0.2750 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.26% (0.2792 => 0.2911, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.26% (1.9694 => 2.0532, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.18% (2.0673 => 2.1538, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (2.1013 => 2.1890, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: 4.14% (0.2780 => 0.2895, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 4.13% (0.2566 => 0.2672, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (0.4658 => 0.4850, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2811 => 0.2926, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.08% (1.9966 => 2.0780, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2823 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.98% (0.3890 => 0.4045, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 3.98% (0.2813 => 0.2925, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3267 => 0.3396, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.94% (5.5417 => 5.7601, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3124 => 0.3246, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.3096 => 0.3216, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.86% (0.3060 => 0.3178, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3258 => 0.3383, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.83% (0.3317 => 0.3444, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.81% (0.9697 => 1.0066, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3477 => 0.3606, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (4.4195 => 4.5824, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.3362 => 0.3485, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.62% (0.3678 => 0.3811, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3348 => 0.3468, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.58% (2.1653 => 2.2429, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.3903 => 0.4040, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 3.50% (4.6177 => 4.7794, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sieve: 3.46% (0.3726 => 0.3855, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.45% (1.8794 => 1.9443, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.43% (0.4139 => 0.4281, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.3981 => 0.4115, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.37% (0.7875 => 0.8140, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3690 => 0.3810, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.21% (0.4146 => 0.4279, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 3.19% (1.4269 => 1.4724, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.3845 => 0.3967, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.15% (0.6634 => 0.6843, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.3271 => 0.3374, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.11% (0.4251 => 0.4383, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.08% (23.5202 => 24.2438, std. dev.: 0.0109) MultiSource/Applications/Burg/burg: 2.85% (0.5546 => 0.5704, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.6435 => 0.6598, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.5012 => 0.5135, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.82% (2.0346 => 2.0716, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6703, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1718, std. dev.: 0.1036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6348, std. dev.: 0.0290) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2009, std. dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (41.7953 => 42.6373, std. dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5012, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5903, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2216, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.05% (6.9842 => 7.0575, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.07% (11.9555 => 11.8281, std. dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.12% (25.4195 => 16.4915, std. dev.: 0.0197) SingleSource/Benchmarks/Dhrystone/fldry: -9.62% (17.2379 => 15.5790, std. dev.: 0.1881) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8028, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7952, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5461, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9615, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 21:59:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 3 Aug 2012 23:59:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120804045916.282392A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2643?compare_to=2640&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2643, Order: 161295, Start Time: 2012-08-04 03:45:58, End Time: 2012-08-04 04:59:46 To: 2640, Order: 161291, Start Time: 2012-08-04 02:04:16, End Time: 2012-08-04 03:17:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.55% (79.2320 => 81.2503, std. dev.: 0.5031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.88% (2.0176 => 2.2976, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5818 => 0.6366, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.12% (0.5748 => 0.6272, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.94% (0.3646 => 0.3972, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.88% (0.7061 => 0.7688, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 8.79% (0.3914 => 0.4258, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.79% (0.3789 => 0.4122, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4003 => 0.4345, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.50% (0.3940 => 0.4275, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 6.96% (1.3693 => 1.4646, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (3.9660 => 4.2290, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (0.7038 => 0.7463, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.64% (0.4379 => 0.4626, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.56% (0.4062 => 0.4288, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.6959 => 0.7331, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.29% (1.9828 => 2.0877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.24% (1.2193 => 1.2832, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.12% (0.3107 => 0.3266, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.99% (0.9199 => 0.9658, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.98% (0.5577 => 0.5855, std. dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 4.97% (13.8202 => 14.5076, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 4.95% (0.3192 => 0.3350, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.4390 => 0.4605, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 4.78% (16.6129 => 17.4078, std. dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (7.2180 => 7.5605, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.60% (0.2914 => 0.3048, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (1.4563 => 1.5215, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.46% (0.7506 => 0.7841, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.43% (0.4016 => 0.4194, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8660, std. dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.33% (0.5637 => 0.5881, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.29% (1.1364 => 1.1851, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.28% (1.1061 => 1.1534, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.27% (1.3819 => 1.4409, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.17% (3.8646 => 4.0258, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3793, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3246 => 0.3380, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.13% (1.9270 => 2.0065, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.7460 => 0.7766, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.02% (0.8310 => 0.8644, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2945 => 0.3062, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.90% (1.0594 => 1.1007, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (4.4433 => 4.6141, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.3801 => 4.5469, std. dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.79% (1.2292 => 1.2758, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (3.6692 => 3.8059, std. dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (4.9865 => 5.1499, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.24% (2.1791 => 2.2497, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1333 => 1.1698, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (0.4791 => 0.4939, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6283 => 0.6466, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.87% (0.4113 => 0.4231, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7640, std. dev.: 0.0112) MultiSource/Applications/d/make_dparser: 2.87% (3.1889 => 3.2803, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.85% (8.4961 => 8.7385, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.80% (0.6135 => 0.6307, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9094, std. dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6839, std. dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2265, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.38% (3.2742 => 3.3521, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.1007 => 2.1481, std. dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 2.21% (4.6629 => 4.7661, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5188 => 1.5506, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.42% (0.9108 => 0.9237, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.10% (1.0313 => 1.0426, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (6.2785 => 6.3457, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5141, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 26.44% (1.8175 => 2.2981, std. dev.: 0.0357) SingleSource/Benchmarks/Misc/mandel-2: 7.45% (1.2998 => 1.3966, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.12% (0.9996 => 1.0508, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7537, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7075, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4566, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5089 => 1.5332, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.58% (1.9290 => 1.9594, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1394, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.13% (0.4657 => 0.3999, std. dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1422, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2308 => 1.1104, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.03% (20.3410 => 18.5047, std. dev.: 0.0383) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.37% (0.3139 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5910, std. dev.: 0.0152) MultiSource/Applications/spiff/spiff: -2.33% (3.0263 => 2.9559, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2257, std. dev.: 0.0108) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5019, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3305 => 7.2191, std. dev.: 0.0273) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8624, std. dev.: 0.0122) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2493, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2258, std. dev.: 0.0166) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 3 22:40:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 00:40:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804054012.6BFB52A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2644?compare_to=2641&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2644, Order: 161295, Start Time: 2012-08-04 04:22:20, End Time: 2012-08-04 05:40:45 To: 2641, Order: 161292, Start Time: 2012-08-04 02:35:56, End Time: 2012-08-04 03:54:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (89 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.81% (10.3673 => 13.4581, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.58% (1.1194 => 1.2602, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.55% (2.2022 => 2.3905, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.43% (1.7609 => 1.9093, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.46% (0.5925 => 0.6308, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.42% (0.3177 => 0.3381, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.6030 => 0.6411, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.71% (0.7326 => 0.7744, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.64% (0.4879 => 0.5154, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.60% (10.4361 => 11.0210, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.55% (7.0540 => 7.4455, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.3282 => 0.3453, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.56% (9.4845 => 9.9171, std. dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: 4.37% (0.7433 => 0.7758, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.35% (0.2554 => 0.2665, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.20% (4.9449 => 5.1525, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.19% (0.8172 => 0.8514, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (5.0018 => 5.2103, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.2700 => 0.2803, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5860 => 0.6081, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (4.2646 => 4.4227, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.67% (0.3109 => 0.3223, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (0.3121 => 0.3235, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.54% (8.1363 => 8.4241, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.40% (0.7835 => 0.8101, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2253, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.3050 => 1.3481, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.27% (5.7591 => 5.9473, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (14.3668 => 14.8295, std. dev.: 0.0075) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4299 => 0.4435, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.06% (0.4636 => 0.4778, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.04% (1.1642 => 1.1996, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.92% (3.3354 => 3.4328, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.5415 => 1.5860, std. dev.: 0.0103) MultiSource/Applications/hbd/hbd: 2.87% (1.5603 => 1.6051, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.80% (2.0273 => 2.0841, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.8067 => 0.8290, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.74% (0.5105 => 0.5245, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.66% (3.8723 => 3.9752, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.49% (0.4103 => 0.4205, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5859 => 1.6248, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.44% (2.2024 => 2.2561, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9765 => 0.9999, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.4289 => 0.4389, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.28% (0.6675 => 0.6827, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.19% (0.6450 => 0.6591, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (2.0665 => 2.1106, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.4186 => 1.4476, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.88% (17.1811 => 17.5036, std. dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 1.78% (1.2842 => 1.3071, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.76% (0.7115 => 0.7240, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.63% (1.1840 => 1.2033, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.61% (2.2969 => 2.3338, std. dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (4.2280 => 4.4070, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7543, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8311, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5086 => 1.5318, std. dev.: 0.0030) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2247, std. dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.12% (1.0313 => 1.0428, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3748, std. dev.: 0.0278) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.00% (2.2771 => 2.2999, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.84% (5.2763 => 3.1741, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.62% (5.3855 => 3.7364, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.30% (5.3526 => 3.7308, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2200, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.03% (2.9384 => 2.5554, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -11.80% (22.1758 => 19.5594, std. dev.: 0.0233) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2373 => 1.1080, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -8.53% (1.5373 => 1.4062, std. dev.: 0.0157) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.13% (19.9488 => 18.5274, std. dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.99% (1.9577 => 1.8600, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4847, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (8.1563 => 7.8996, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4162, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0017, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2011, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3144, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 01:05:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 03:05:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120804080548.752DF2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2645?compare_to=2642&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2645, Order: 161295, Start Time: 2012-08-04 05:20:29, End Time: 2012-08-04 08:06:20 To: 2642, Order: 161292, Start Time: 2012-08-04 02:08:51, End Time: 2012-08-04 04:52:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (776 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.76% (2.0576 => 2.1144, std. dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.14% (1.6176 => 1.5992, std. dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.46% (0.3446 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.45% (0.3465 => 0.3931, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.32% (0.3460 => 0.3921, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.30% (0.3488 => 0.3952, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 13.30% (0.3496 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.26% (0.3469 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3643 => 0.4116, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.97% (0.1063 => 0.1169, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.84% (0.5826 => 0.6283, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.5889 => 0.6331, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.14% (1.5932 => 1.7070, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.33% (0.4994 => 0.5310, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (3.5627 => 3.7855, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.14% (1.6211 => 1.7206, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (0.5900 => 0.6257, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (0.5026 => 0.5329, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.01% (1.3152 => 1.3942, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 6.00% (0.7171 => 0.7601, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (0.5000 => 0.5285, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.53% (0.4361 => 0.4602, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (0.3930 => 0.4136, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 5.13% (4.2109 => 4.4268, std. dev.: 0.0077) MultiSource/Applications/d/make_dparser: 5.05% (1.0781 => 1.1325, std. dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.94% (2.7292 => 2.8640, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.73% (0.2875 => 0.3011, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.2736 => 0.2862, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.2866 => 0.2996, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3195 => 0.3339, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.44% (0.2792 => 0.2916, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.40% (0.9909 => 1.0345, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 4.36% (0.2750 => 0.2870, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.35% (0.2738 => 0.2857, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (2.1013 => 2.1919, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hello: 4.31% (0.2714 => 0.2831, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.29% (0.2729 => 0.2846, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (1.9694 => 2.0530, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.2780 => 0.2898, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.21% (0.2566 => 0.2674, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (1.9966 => 2.0795, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.14% (0.2803 => 0.2919, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3096 => 0.3224, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2823 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.05% (0.2813 => 0.2927, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3258 => 0.3390, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.01% (0.3317 => 0.3450, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.98% (0.3267 => 0.3397, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.96% (5.5417 => 5.7610, std. dev.: 0.0073) MultiSource/Applications/hbd/hbd: 3.95% (0.9697 => 1.0080, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.94% (0.3348 => 0.3480, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 3.81% (2.1653 => 2.2479, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (4.4195 => 4.5880, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.80% (0.3890 => 0.4038, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.78% (0.4658 => 0.4834, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.64% (4.6177 => 4.7856, std. dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3726 => 0.3861, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.61% (0.3903 => 0.4044, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.57% (0.3477 => 0.3601, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.56% (0.3625 => 0.3754, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.46% (1.8794 => 1.9445, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.45% (0.4139 => 0.4282, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (0.3845 => 0.3975, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 3.30% (0.7875 => 0.8135, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3690 => 0.3811, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.4251 => 0.4387, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.17% (1.4269 => 1.4721, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.17% (0.3981 => 0.4107, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 3.16% (0.4146 => 0.4277, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.3271 => 0.3374, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.90% (0.5546 => 0.5707, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.82% (0.6634 => 0.6821, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 2.77% (0.5012 => 0.5151, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.6435 => 0.6594, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6708, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std. dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (105.3826 => 107.5996, std. dev.: 0.0638) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (41.7953 => 42.6530, std. dev.: 0.2857) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1904, std. dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4947, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (2.0820 => 2.1144, std. dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.50% (3.1722 => 3.2199, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std. dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.08% (6.9842 => 7.0595, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.07% (2.4764 => 2.4498, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -1.06% (11.9555 => 11.8286, std. dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5462, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -8.91% (17.2379 => 15.7025, std. dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8030, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7928, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.66% (14.0481 => 13.5344, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9608, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 04:38:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 06:38:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120804113834.C63E62A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2646?compare_to=2643&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2646, Order: 161296, Start Time: 2012-08-04 10:25:08, End Time: 2012-08-04 11:39:08 To: 2643, Order: 161295, Start Time: 2012-08-04 03:45:58, End Time: 2012-08-04 04:59:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.58% (55.3304 => 56.7598, std. dev.: 0.0533) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3003, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.61% (0.5818 => 0.6377, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.45% (0.3578 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.34% (0.5748 => 0.6285, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.33% (0.3601 => 0.3937, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3650 => 0.3990, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.30% (0.3646 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3623 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3789 => 0.4138, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.20% (0.3663 => 0.4000, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.04% (0.3914 => 0.4268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7061 => 0.7664, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 7.20% (1.3693 => 1.4679, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.19% (0.7710 => 0.8264, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.5265 => 0.5635, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.97% (3.9660 => 4.2423, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7038 => 0.7513, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.03% (0.4379 => 0.4643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2655 => 0.2814, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.86% (0.6959 => 0.7367, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.77% (0.3485 => 0.3686, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (1.2193 => 1.2881, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.47% (0.5577 => 0.5882, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.44% (1.9828 => 2.0906, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.44% (0.9199 => 0.9699, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.42% (0.3580 => 0.3774, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.32% (13.8202 => 14.5557, std. dev.: 0.0149) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.26% (0.2243 => 0.2361, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.23% (16.6129 => 17.4824, std. dev.: 0.0181) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.94% (7.2180 => 7.5744, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.82% (0.7506 => 0.7868, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.82% (1.3813 => 1.4479, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.79% (0.5637 => 0.5907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (13.2842 => 13.9170, std. dev.: 0.0166) MultiSource/Applications/Burg/burg: 4.76% (1.1061 => 1.1587, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.72% (1.4563 => 1.5250, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 4.71% (3.8646 => 4.0467, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3246 => 0.3398, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.60% (1.1364 => 1.1887, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.50% (0.7460 => 0.7796, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.47% (1.9270 => 2.0131, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (1.3245 => 1.3833, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8310 => 0.8678, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.34% (1.3819 => 1.4419, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.24% (1.0594 => 1.1043, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.22% (4.4433 => 4.6306, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 4.16% (0.3220 => 0.3354, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.15% (4.3801 => 4.5617, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.09% (1.2292 => 1.2795, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.00% (3.6692 => 3.8161, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 3.82% (2.1791 => 2.2623, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (4.9865 => 5.1680, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.61% (1.1333 => 1.1742, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3755 => 0.3886, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.46% (0.4791 => 0.4957, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.41% (0.6135 => 0.6344, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 3.40% (0.4113 => 0.4253, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.21% (3.1889 => 3.2912, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (6.5754 => 6.7854, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6283 => 0.6480, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (8.4961 => 8.7606, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.08% (0.8698 => 0.8966, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.93% (16.2614 => 16.7381, std. dev.: 0.0145) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.5298 => 14.9305, std. dev.: 0.0192) MultiSource/Applications/JM/lencod/lencod: 2.73% (14.8535 => 15.2587, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (2.1007 => 2.1566, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.55% (3.2742 => 3.3576, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 2.53% (4.6629 => 4.7810, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5188 => 1.5552, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.63% (1.0313 => 1.0481, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.46% (6.2785 => 6.3703, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 1.40% (3.7467 => 3.7992, std. dev.: 0.0138) MultiSource/Benchmarks/Bullet/bullet: 1.19% (33.2944 => 33.6891, std. dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3924, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.32% (0.9996 => 1.0528, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 4.53% (7.4271 => 7.7634, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7065, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.79% (1.9144 => 1.9870, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5089 => 1.5342, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.20% (1.9290 => 1.9521, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.19% (1.0310 => 1.0433, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1391, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 1.00% (1.1560 => 1.1676, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1790, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0957, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (20.3410 => 18.6420, std. dev.: 0.0432) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9189, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5867, std. dev.: 0.0105) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9521, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2240, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5087, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2147, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0044, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0201) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2453, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2343, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 04:41:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 06:41:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804114123.C7B5F2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2647?compare_to=2644&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2647, Order: 161296, Start Time: 2012-08-04 10:23:07, End Time: 2012-08-04 11:41:57 To: 2644, Order: 161295, Start Time: 2012-08-04 04:22:20, End Time: 2012-08-04 05:40:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (85 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.26% (80.0587 => 81.0692, std. dev.: 0.0510) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.54% (10.3673 => 13.3263, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.34% (1.1194 => 1.2575, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.55% (0.3516 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.46% (0.3543 => 0.3949, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.35% (0.3543 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.33% (2.2022 => 2.3856, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.25% (1.7609 => 1.9062, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5925 => 0.6285, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.4879 => 0.5146, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 5.37% (10.4361 => 10.9966, std. dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (7.0540 => 7.4328, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.3282 => 0.3447, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7326 => 0.7690, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.38% (9.4845 => 9.8995, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.7433 => 0.7752, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 4.23% (0.2554 => 0.2662, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1433, std. dev.: 0.0157) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.8172 => 0.8499, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (5.0018 => 5.1999, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.75% (0.5569 => 0.5778, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.68% (0.3423 => 0.3549, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.60% (0.3109 => 0.3221, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.56% (8.1363 => 8.4263, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (4.2646 => 4.4163, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.33% (0.7835 => 0.8096, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1861 => 1.2243, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (14.3668 => 14.8265, std. dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9402, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.3050 => 1.3454, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 3.07% (0.4299 => 0.4431, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.77% (2.0273 => 2.0835, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 2.76% (1.1642 => 1.1963, std. dev.: 0.0096) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4262, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 2.69% (1.5603 => 1.6023, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.60% (1.5415 => 1.5816, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.5105 => 0.5236, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4636 => 0.4754, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.49% (0.4103 => 0.4205, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9681, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.2024 => 2.2547, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9765 => 0.9996, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5859 => 1.6234, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6675 => 0.6817, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5981 => 0.6107, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8921 => 0.9106, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.6456 => 0.6588, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (2.0665 => 2.1079, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.95% (0.6450 => 0.6576, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4458, std. dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 1.77% (17.1811 => 17.4846, std. dev.: 0.0146) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2842 => 1.3052, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.55% (2.2969 => 2.3324, std. dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 1.51% (1.1840 => 1.2019, std. dev.: 0.0054) MultiSource/Applications/lemon/lemon: 1.10% (1.0722 => 1.0840, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (4.2280 => 4.3866, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7596, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.67% (3.1578 => 3.2105, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5086 => 1.5337, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8325, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2259, std. dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.90% (5.2763 => 3.1709, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7250, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.52% (5.3526 => 3.7189, std. dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1663, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5535, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -11.94% (22.1758 => 19.5272, std. dev.: 0.0557) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2373 => 1.1170, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.27% (19.9488 => 18.4990, std. dev.: 0.0764) SingleSource/Benchmarks/Misc/mandel-2: -6.75% (1.5373 => 1.4335, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -4.67% (1.9577 => 1.8662, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (8.1563 => 7.8967, std. dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4776, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4206, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0007, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2010, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.79% (12.5348 => 12.3110, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.32% (1.8329 => 1.8087, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 06:08:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 08:08:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120804130802.251282A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2648?compare_to=2645&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2648, Order: 161296, Start Time: 2012-08-04 10:24:44, End Time: 2012-08-04 13:08:35 To: 2645, Order: 161295, Start Time: 2012-08-04 05:20:29, End Time: 2012-08-04 08:06:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (108 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (771 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.10% (1.5992 => 1.6168, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.04% (54.1999 => 54.7660, std. dev.: 0.1130) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.03% (0.3446 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.02% (0.3465 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3488 => 0.3940, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 12.90% (0.3442 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3460 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.79% (0.3496 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3643 => 0.4095, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.25% (0.3650 => 0.4097, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 11.90% (0.3724 => 0.4167, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.75% (0.5826 => 0.6219, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.47% (0.5889 => 0.6270, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.45% (0.4994 => 0.5316, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (3.5627 => 3.7853, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (1.6211 => 1.7193, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.05% (1.3152 => 1.3948, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 6.03% (1.5932 => 1.6892, std. dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.00% (0.1968 => 0.2086, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.71% (0.4361 => 0.4610, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.56% (0.2014 => 0.2126, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.49% (0.5900 => 0.6224, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (0.5026 => 0.5302, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.48% (0.5000 => 0.5274, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.46% (0.4029 => 0.4249, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (0.3930 => 0.4134, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.16% (1.0781 => 1.1337, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 5.12% (4.2109 => 4.4267, std. dev.: 0.0133) SingleSource/UnitTests/ObjC++/property-reference: 5.10% (0.7171 => 0.7537, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.95% (2.7292 => 2.8643, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.91% (0.2566 => 0.2692, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.2736 => 0.2863, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 4.38% (2.1013 => 2.1933, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.25% (1.9694 => 2.0531, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 4.24% (5.5417 => 5.7768, std. dev.: 0.0087) SingleSource/Regression/C++/ofstream_ctor: 4.16% (0.3004 => 0.3129, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (0.3890 => 0.4051, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (0.2691 => 0.2801, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.06% (0.9909 => 1.0311, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.3903 => 0.4061, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2875 => 0.2991, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.02% (2.1653 => 2.2524, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (1.9966 => 2.0766, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0673 => 2.1500, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (0.4658 => 0.4841, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 3.92% (4.6177 => 4.7989, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.85% (0.3195 => 0.3318, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (4.4195 => 4.5889, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.78% (0.9697 => 1.0064, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.77% (0.2729 => 0.2832, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.76% (0.7875 => 0.8171, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2780 => 0.2883, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.69% (1.8794 => 1.9488, std. dev.: 0.0081) MultiSource/Applications/siod/siod: 3.68% (0.6634 => 0.6878, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.56% (0.2811 => 0.2911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4146 => 0.4289, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.40% (1.4269 => 1.4754, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 3.39% (0.3096 => 0.3201, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.30% (0.3362 => 0.3473, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.3678 => 0.3799, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3267 => 0.3374, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.27% (0.3060 => 0.3160, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3258 => 0.3363, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.4139 => 0.4271, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.3271 => 0.3373, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.11% (0.3282 => 0.3384, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3317 => 0.3420, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.08% (0.3477 => 0.3584, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.05% (0.5546 => 0.5715, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.3625 => 0.3733, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (0.3726 => 0.3836, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.78% (23.5202 => 24.1746, std. dev.: 0.0251) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.3845 => 0.3946, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.59% (0.4251 => 0.4361, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.3981 => 0.4082, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.11% (0.5012 => 0.5118, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.07% (2.0346 => 2.0767, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.04% (0.6435 => 0.6566, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 14.89% (2.5769 => 2.9606, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.36% (0.2122 => 0.2257, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6779, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 5.12% (1.8057 => 1.8981, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 4.64% (15.4430 => 16.1601, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6949, std. dev.: 0.0447) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2020, std. dev.: 0.0438) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5027, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.81% (41.7953 => 42.5517, std. dev.: 0.0348) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5917, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (2.0820 => 2.1112, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.05% (6.9842 => 7.0578, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.16% (11.9555 => 11.8165, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.02% (25.4195 => 16.5181, std. dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: -8.18% (17.2379 => 15.8278, std. dev.: 0.1700) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8120, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.74% (0.2402 => 0.2240, std. dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -3.77% (11.2080 => 10.7855, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5485, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5791, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9609, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5008, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 06:21:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 08:21:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120804132111.49D502A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2649?compare_to=2646&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2649, Order: 161298, Start Time: 2012-08-04 12:07:39, End Time: 2012-08-04 13:21:42 To: 2646, Order: 161296, Start Time: 2012-08-04 10:25:08, End Time: 2012-08-04 11:39:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 1 (28 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.30% (1.0957 => 1.1099, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.36% (56.7598 => 55.9889, std. dev.: 0.2152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.54% (2.0176 => 2.3109, std. dev.: 0.0090) SingleSource/UnitTests/ObjC++/property-reference-object: 9.61% (0.5818 => 0.6377, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3578 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.43% (0.5748 => 0.6290, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.39% (0.3601 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3646 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3650 => 0.3991, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.25% (0.3663 => 0.4002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3623 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.11% (0.3789 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.10% (0.3914 => 0.4270, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.88% (0.3940 => 0.4290, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.51% (0.7061 => 0.7662, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.48% (0.7710 => 0.8287, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.23% (1.3693 => 1.4683, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.5265 => 0.5635, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.97% (3.9660 => 4.2425, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.62% (0.7038 => 0.7504, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.45% (0.4062 => 0.4324, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4328 => 0.4604, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.6959 => 0.7361, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2765 => 0.2922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.63% (0.4390 => 0.4637, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.57% (1.2193 => 1.2872, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.3107 => 0.3277, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0911, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9199 => 0.9700, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.39% (0.3580 => 0.3773, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2988 => 0.3144, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.18% (13.8202 => 14.5367, std. dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.2925 => 0.3075, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.07% (16.6129 => 17.4560, std. dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 5.01% (0.3534 => 0.3711, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.94% (1.4563 => 1.5283, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.88% (7.2180 => 7.5703, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.3293 => 0.3450, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (13.2842 => 13.9068, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5637 => 0.5898, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (3.8646 => 4.0420, std. dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (1.3245 => 1.3848, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (1.1364 => 1.1881, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.53% (1.1061 => 1.1562, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.50% (0.7460 => 0.7796, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.46% (1.9270 => 2.0129, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3819 => 1.4420, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.0594 => 1.1036, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (3.6692 => 3.8199, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (4.3801 => 4.5591, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (4.4433 => 4.6230, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 4.04% (1.2292 => 1.2789, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.73% (4.9865 => 5.1724, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.56% (2.1791 => 2.2566, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.55% (1.1333 => 1.1735, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4113 => 0.4246, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 3.14% (3.1889 => 3.2891, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7586, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.02% (0.6283 => 0.6473, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (6.5754 => 6.7695, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.8698 => 0.8948, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.5298 => 14.9441, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7224, std. dev.: 0.0202) MultiSource/Applications/JM/lencod/lencod: 2.73% (14.8535 => 15.2587, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (3.2742 => 3.3588, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.56% (2.1007 => 2.1544, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.50% (4.6629 => 4.7795, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.13% (1.5188 => 1.5512, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.64% (0.9108 => 0.9257, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.44% (1.0313 => 1.0461, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (6.2785 => 6.3668, std. dev.: 0.0078) MultiSource/Applications/lua/lua: 1.32% (3.7467 => 3.7960, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.10% (33.2944 => 33.6613, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.23% (1.8175 => 2.2761, std. dev.: 0.0449) SingleSource/Benchmarks/Misc/mandel-2: 7.91% (1.2998 => 1.4026, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.19% (0.9996 => 1.0515, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: 4.49% (7.4271 => 7.7606, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7058, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5089 => 1.5322, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5071, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1930, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (3.1071 => 3.1384, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1724, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.74% (20.3410 => 18.5626, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std. dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.8259 => 8.5651, std. dev.: 0.0289) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9536, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.35% (0.6589 => 0.6434, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2197, std. dev.: 0.0120) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5020, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2151, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 06:27:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 08:27:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804132746.5AEB22A6C076@llvm.org> http://llvm.org/perf/db_default/v4/nts/2650?compare_to=2647&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2650, Order: 161298, Start Time: 2012-08-04 12:10:00, End Time: 2012-08-04 13:28:19 To: 2647, Order: 161296, Start Time: 2012-08-04 10:23:07, End Time: 2012-08-04 11:41:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (83 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.52% (10.3673 => 13.3237, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.29% (1.1194 => 1.2570, std. dev.: 0.0123) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3543 => 0.3946, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.26% (0.3694 => 0.4110, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.30% (2.2022 => 2.3850, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.26% (1.7609 => 1.9063, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.49% (0.4879 => 0.5147, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.42% (10.4361 => 11.0019, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.38% (7.0540 => 7.4333, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/oourafft: 5.06% (0.3282 => 0.3448, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.00% (0.7326 => 0.7692, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.69% (0.3817 => 0.3996, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.30% (9.4845 => 9.8924, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 4.24% (0.7433 => 0.7748, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (5.0018 => 5.2008, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.98% (0.8172 => 0.8497, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.9449 => 5.1415, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.5569 => 0.5783, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.5860 => 0.6074, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.60% (0.3109 => 0.3221, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (4.2646 => 4.4164, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.40% (8.1363 => 8.4126, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.33% (0.7835 => 0.8096, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.3050 => 1.3464, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1861 => 1.2237, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.12% (5.7591 => 5.9390, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (14.3668 => 14.8048, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: 3.05% (0.4299 => 0.4430, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.94% (1.1642 => 1.1984, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 2.75% (3.3354 => 3.4271, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.68% (2.0273 => 2.0816, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.66% (1.5415 => 1.5825, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.64% (1.5603 => 1.6015, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.48% (0.8067 => 0.8267, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.46% (0.4103 => 0.4204, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5859 => 1.6247, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.43% (3.8723 => 3.9664, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.42% (0.4636 => 0.4748, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.2024 => 2.2551, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.32% (0.9765 => 0.9992, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (0.6675 => 0.6819, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5981 => 0.6106, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6456 => 0.6585, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4463, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8921 => 0.9095, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.93% (2.0665 => 2.1063, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.68% (17.1811 => 17.4700, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 1.62% (1.2842 => 1.3050, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2023, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.55% (2.2969 => 2.3324, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.22% (1.0722 => 1.0853, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9740, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.28% (4.2280 => 4.4090, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8346, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2033, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.88% (5.2763 => 3.1719, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.84% (5.3855 => 3.7244, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.49% (5.3526 => 3.7204, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1942, std. dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.06% (2.9384 => 2.5545, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -11.85% (22.1758 => 19.5484, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2373 => 1.1087, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.84% (19.9488 => 18.5840, std. dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -6.27% (1.5373 => 1.4409, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -4.73% (1.9577 => 1.8651, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5952, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4746, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9106, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4243, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0001, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2001, std. dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3255, std. dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4178, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8080, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 08:06:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 10:06:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120804150618.B77A42A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2651?compare_to=2649&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2651, Order: 161299, Start Time: 2012-08-04 13:52:48, End Time: 2012-08-04 15:06:50 To: 2649, Order: 161298, Start Time: 2012-08-04 12:07:39, End Time: 2012-08-04 13:21:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.13% (2.0176 => 2.3026, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.38% (0.5818 => 0.6364, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5748 => 0.6277, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.50% (0.3601 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.47% (0.7061 => 0.7659, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3650 => 0.3953, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.15% (1.3693 => 1.4672, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.11% (0.7710 => 0.8258, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.66% (3.9660 => 4.2302, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (0.4328 => 0.4609, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.43% (0.4062 => 0.4323, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.41% (0.7038 => 0.7489, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2690 => 0.2854, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.3899 => 0.4125, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.68% (0.3485 => 0.3683, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.56% (0.6959 => 0.7346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.48% (1.9828 => 2.0914, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.45% (1.2193 => 1.2858, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9199 => 0.9683, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.2988 => 0.3144, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.18% (0.5577 => 0.5866, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.13% (16.6129 => 17.4651, std. dev.: 0.0172) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (1.4563 => 1.5298, std. dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 4.99% (13.8202 => 14.5105, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4390 => 0.4602, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5637 => 0.5898, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.59% (7.2180 => 7.5491, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1364 => 1.1876, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.3868 => 0.4042, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (13.2842 => 13.8775, std. dev.: 0.0266) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.41% (0.7506 => 0.7837, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.39% (1.1061 => 1.1547, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (3.8646 => 4.0317, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.24% (1.3813 => 1.4399, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8310 => 0.8660, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.3245 => 1.3797, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.13% (1.0594 => 1.1032, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 4.11% (1.9270 => 2.0062, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.10% (1.2292 => 1.2796, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3819 => 1.4380, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (3.6692 => 3.8111, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5474, std. dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (4.4433 => 4.6124, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 3.64% (2.1791 => 2.2584, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9865 => 5.1553, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1333 => 1.1707, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.17% (0.6283 => 0.6482, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2877, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.02% (0.8698 => 0.8961, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7511, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 2.99% (0.4113 => 0.4236, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.91% (16.2614 => 16.7340, std. dev.: 0.0169) MultiSource/Applications/JM/ldecod/ldecod: 2.74% (6.5754 => 6.7553, std. dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9104, std. dev.: 0.0187) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.8535 => 15.2343, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.50% (3.2742 => 3.3560, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.49% (4.6629 => 4.7791, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1526, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (1.5188 => 1.5545, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.9108 => 0.9256, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.01% (3.7467 => 3.7845, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.55% (1.8175 => 2.2637, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/mandel-2: 7.62% (1.2998 => 1.3989, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7558, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7077, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.53% (1.7688 => 1.8135, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9565, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.01% (10.7476 => 10.8559, std. dev.: 0.0394) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1484, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2308 => 1.1115, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.97% (20.3410 => 18.5160, std. dev.: 0.0550) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0102) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9184, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5821, std. dev.: 0.0104) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9524, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5060, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2358, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3305 => 7.2107, std. dev.: 0.0278) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0162) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2473, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2228, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 08:16:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 10:16:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804151622.BD38C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2652?compare_to=2650&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2652, Order: 161300, Start Time: 2012-08-04 13:58:40, End Time: 2012-08-04 15:16:54 To: 2650, Order: 161298, Start Time: 2012-08-04 12:10:00, End Time: 2012-08-04 13:28:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (86 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.05% (13.3237 => 13.4635, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.36% (55.2096 => 56.5137, std. dev.: 0.0928) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.87% (10.3673 => 13.4635, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.25% (1.1194 => 1.2565, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3497 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (2.2022 => 2.3791, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8981, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.19% (0.4879 => 0.5132, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 5.08% (0.7326 => 0.7698, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.03% (7.0540 => 7.4090, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.87% (0.3817 => 0.4003, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (10.4361 => 10.9390, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.72% (0.4615 => 0.4833, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.7433 => 0.7739, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (9.4845 => 9.8671, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.92% (0.8172 => 0.8492, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1948, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.9449 => 5.1319, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.43% (4.2646 => 4.4110, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.14% (0.7835 => 0.8081, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3911, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.04% (1.3050 => 1.3447, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.96% (1.1861 => 1.2212, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.94% (1.5603 => 1.6061, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (14.3668 => 14.7853, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.88% (5.7591 => 5.9252, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.4636 => 0.4765, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.64% (1.1642 => 1.1949, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.61% (0.4299 => 0.4411, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (2.0665 => 2.1197, std. dev.: 0.0113) MultiSource/Applications/treecc/treecc: 2.51% (2.0273 => 2.0781, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.50% (0.4203 => 0.4308, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.46% (3.3354 => 3.4173, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.44% (1.5415 => 1.5791, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.43% (0.5105 => 0.5229, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.40% (0.4289 => 0.4392, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9765 => 0.9988, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (1.5859 => 1.6205, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.15% (3.8723 => 3.9555, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.12% (0.5981 => 0.6108, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.2024 => 2.2484, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.07% (0.6675 => 0.6813, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3097, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.82% (1.4186 => 1.4444, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6450 => 0.6567, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.77% (0.8921 => 0.9079, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4526, std. dev.: 0.0241) MultiSource/Benchmarks/nbench/nbench: 1.38% (1.1840 => 1.2003, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.28% (2.2969 => 2.3264, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.50% (4.2280 => 4.3761, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7519, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2158, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5086 => 1.5342, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8318, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 1.57% (2.2771 => 2.3128, std. dev.: 0.0050) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2288, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1611, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7101, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7056, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1628, std. dev.: 0.0298) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.18% (2.9384 => 2.5511, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -12.04% (22.1758 => 19.5063, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1010, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -8.16% (1.5373 => 1.4119, std. dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.06% (19.9488 => 18.5412, std. dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8652, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4672, std. dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9005, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4124, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9993, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2010, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3156, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.38% (1.8329 => 1.8076, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 09:20:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 11:20:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120804162016.90A492A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2653?compare_to=2648&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2653, Order: 161298, Start Time: 2012-08-04 13:36:54, End Time: 2012-08-04 16:20:49 To: 2648, Order: 161296, Start Time: 2012-08-04 10:24:44, End Time: 2012-08-04 13:08:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (776 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.65% (2.8275 => 2.7809, std. dev.: 0.0148) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 26.05% (0.3792 => 0.4780, std. dev.: 0.0360) SingleSource/UnitTests/ObjC/exceptions-2: 12.97% (0.3446 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3442 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.72% (0.3460 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3496 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3643 => 0.4094, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.19% (0.3650 => 0.4095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.98% (0.3724 => 0.4170, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.71% (0.5826 => 0.6217, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.5889 => 0.6269, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (3.5627 => 3.7830, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.04% (1.6211 => 1.7190, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.02% (0.5900 => 0.6255, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.01% (1.5932 => 1.6890, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.96% (1.3152 => 1.3936, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.75% (0.4994 => 0.5281, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (0.4361 => 0.4611, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 5.65% (0.7171 => 0.7576, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.56% (0.2014 => 0.2126, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 5.53% (0.2566 => 0.2708, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (0.5026 => 0.5302, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 5.44% (1.0781 => 1.1368, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (0.3930 => 0.4138, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 5.19% (4.2109 => 4.4296, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: 5.19% (0.4029 => 0.4238, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.18% (0.5000 => 0.5259, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.97% (2.7292 => 2.8648, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.2736 => 0.2864, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.30% (1.9694 => 2.0540, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.29% (0.4658 => 0.4858, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (2.1013 => 2.1909, std. dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 4.14% (5.5417 => 5.7709, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.12% (0.2691 => 0.2802, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (1.9966 => 2.0787, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.04% (0.3890 => 0.4047, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.98% (0.9909 => 1.0303, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.97% (0.3903 => 0.4058, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.97% (0.2875 => 0.2989, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3195 => 0.3321, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.92% (4.4195 => 4.5926, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (2.1653 => 2.2499, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.3271 => 0.3398, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.4139 => 0.4299, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.80% (1.8794 => 1.9508, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 3.78% (4.6177 => 4.7921, std. dev.: 0.0083) MultiSource/Applications/siod/siod: 3.75% (0.6634 => 0.6883, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.70% (0.7875 => 0.8166, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2792 => 0.2894, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.58% (0.9697 => 1.0044, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (2.0673 => 2.1408, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 3.49% (0.3267 => 0.3381, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.43% (0.3060 => 0.3165, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.33% (0.3096 => 0.3199, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.30% (1.4269 => 1.4740, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3317 => 0.3421, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.13% (0.3258 => 0.3360, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.3845 => 0.3965, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.05% (0.3477 => 0.3583, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3726 => 0.3838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 2.99% (0.3348 => 0.3448, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.98% (0.5546 => 0.5711, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3690 => 0.3798, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (0.3625 => 0.3731, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.73% (23.5202 => 24.1618, std. dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.56% (0.3981 => 0.4083, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.5012 => 0.5120, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.6435 => 0.6568, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.98% (2.0346 => 2.0748, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.55% (0.2122 => 0.2261, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8979, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6648, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6714, std. dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1993, std. dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.91% (41.7953 => 42.5949, std. dev.: 0.0310) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5040, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.45% (2.0820 => 2.1122, std. dev.: 0.0115) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.07% (6.9842 => 7.0592, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.49% (2.4764 => 2.4395, std. dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: -1.19% (11.9555 => 11.8130, std. dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.07% (25.4195 => 16.5059, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -8.14% (17.2379 => 15.8355, std. dev.: 0.1472) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8026, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7970, std. dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/dry: -3.58% (14.0481 => 13.5446, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9580, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: -1.42% (5.5810 => 5.5019, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 09:48:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 11:48:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120804164810.A04072A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2654?compare_to=2651&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2654, Order: 161302, Start Time: 2012-08-04 15:34:50, End Time: 2012-08-04 16:48:43 To: 2651, Order: 161299, Start Time: 2012-08-04 13:52:48, End Time: 2012-08-04 15:06:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.01% (0.5435 => 0.5326, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.42% (2.0176 => 2.3085, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.78% (0.5818 => 0.6387, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5748 => 0.6301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3578 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.75% (0.3601 => 0.3916, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.72% (0.7061 => 0.7677, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3663 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3646 => 0.3963, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.58% (0.3789 => 0.4114, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.04% (1.3693 => 1.4794, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.35% (0.4328 => 0.4646, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.12% (0.7710 => 0.8259, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.76% (3.9660 => 4.2341, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.74% (0.2655 => 0.2834, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.64% (0.2966 => 0.3163, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.59% (0.2760 => 0.2942, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.51% (0.7038 => 0.7496, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.3022 => 0.3217, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.41% (1.9828 => 2.1098, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.39% (0.3899 => 0.4148, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.38% (0.2726 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.37% (0.3485 => 0.3707, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.08% (0.3489 => 0.3701, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.05% (0.3453 => 0.3662, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.02% (0.2988 => 0.3168, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3192 => 0.3381, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.75% (0.4379 => 0.4631, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5577 => 0.5895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.59% (0.3293 => 0.3477, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2874, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.53% (0.4016 => 0.4238, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.48% (0.3868 => 0.4080, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.42% (0.4390 => 0.4628, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.40% (0.6959 => 0.7335, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.27% (0.9199 => 0.9684, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 5.06% (13.8202 => 14.5190, std. dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 5.03% (16.6129 => 17.4479, std. dev.: 0.0260) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5263, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.77% (7.2180 => 7.5623, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.66% (1.2292 => 1.2865, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5637 => 0.5898, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.2925 => 0.3060, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8941, std. dev.: 0.0174) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.56% (1.1364 => 1.1882, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2243 => 0.2344, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.39% (0.8310 => 0.8675, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.32% (1.3813 => 1.4410, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.25% (0.3246 => 0.3384, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.25% (1.0594 => 1.1044, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.20% (1.1061 => 1.1526, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.20% (3.8646 => 4.0268, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (1.3245 => 1.3800, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3755 => 0.3912, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.07% (1.3819 => 1.4381, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.04% (1.9270 => 2.0049, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (3.6692 => 3.8148, std. dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6147, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.3801 => 4.5488, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.49% (4.9865 => 5.1607, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.49% (0.4791 => 0.4958, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.41% (0.8698 => 0.8995, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.32% (1.1333 => 1.1709, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 3.22% (2.1791 => 2.2493, std. dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.19% (0.6135 => 0.6331, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.13% (8.4961 => 8.7619, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 3.04% (3.1889 => 3.2859, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (6.5754 => 6.7711, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.85% (16.2614 => 16.7250, std. dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.5298 => 14.9302, std. dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.8535 => 15.2512, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1550, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (3.2742 => 3.3579, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.30% (1.5188 => 1.5538, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.14% (4.6629 => 4.7628, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.6250 => 0.6373, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.9108 => 0.9265, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.28% (1.0313 => 1.0445, std. dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 1.18% (33.2944 => 33.6886, std. dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (6.2785 => 6.3526, std. dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5131, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2708, std. dev.: 0.0402) SingleSource/Benchmarks/Misc/mandel-2: 7.38% (1.2998 => 1.3957, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.40% (0.9996 => 1.0536, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: 4.49% (7.4271 => 7.7604, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8146, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5089 => 1.5338, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5078, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1966, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1915, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2308 => 1.1107, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.96% (20.3410 => 18.5177, std. dev.: 0.0509) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0114) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.28% (6.2497 => 5.9825, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9198, std. dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5821, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9542, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.26% (0.5449 => 0.5326, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2231, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.83% (6.6320 => 6.5105, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2074, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2474, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8692, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 10:02:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 12:02:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804170244.B7A622A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2655?compare_to=2652&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2655, Order: 161302, Start Time: 2012-08-04 15:44:57, End Time: 2012-08-04 17:03:17 To: 2652, Order: 161300, Start Time: 2012-08-04 13:58:40, End Time: 2012-08-04 15:16:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (82 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.86% (13.4635 => 13.7136, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.28% (10.3673 => 13.7136, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.46% (1.1194 => 1.2589, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3473 => 0.3903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.19% (0.3543 => 0.3975, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.18% (0.3497 => 0.3923, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.05% (0.3561 => 0.3990, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.80% (0.3694 => 0.4130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.49% (0.3828 => 0.4268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (1.7609 => 1.9073, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.12% (2.2022 => 2.3811, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 5.99% (0.5925 => 0.6280, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.94% (0.6030 => 0.6388, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.45% (0.3817 => 0.4025, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.25% (0.4879 => 0.5135, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.98% (7.0540 => 7.4054, std. dev.: 0.0103) SingleSource/UnitTests/ObjC++/property-reference: 4.86% (0.7326 => 0.7682, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.81% (10.4361 => 10.9383, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.29% (9.4845 => 9.8915, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.8172 => 0.8519, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (0.7433 => 0.7743, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (5.0018 => 5.2042, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1444, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (4.2646 => 4.4263, std. dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.63% (0.3109 => 0.3222, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.56% (0.3423 => 0.3545, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.56% (8.1363 => 8.4261, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.43% (0.7835 => 0.8104, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.27% (1.3050 => 1.3477, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.1861 => 1.2249, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (14.3668 => 14.8081, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 2.96% (1.1642 => 1.1987, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.95% (5.7591 => 5.9289, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.8067 => 0.8300, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.78% (2.0273 => 2.0837, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 2.73% (3.3354 => 3.4263, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5415 => 1.5829, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.67% (1.5603 => 1.6019, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.5105 => 0.5236, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.42% (3.8723 => 3.9659, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9765 => 1.0000, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.2024 => 2.2539, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.6675 => 0.6825, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.19% (0.6450 => 0.6591, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.6456 => 0.6590, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.02% (0.8921 => 0.9101, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4468, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.89% (2.0665 => 2.1056, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.66% (17.1811 => 17.4663, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.61% (1.1840 => 1.2031, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.50% (0.7115 => 0.7222, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 1.46% (1.2842 => 1.3029, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.43% (2.2969 => 2.3298, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.12% (1.0722 => 1.0842, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.16% (4.2280 => 4.4039, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2149, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5086 => 1.5347, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8331, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.49% (9.1159 => 9.2513, std. dev.: 0.0233) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2041, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0313 => 1.0439, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.98% (5.2763 => 3.1670, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.87% (5.3855 => 3.7232, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.50% (5.3526 => 3.7198, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2303, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.11% (2.9384 => 2.5531, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -11.79% (22.1758 => 19.5613, std. dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1067, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -8.53% (1.5373 => 1.4062, std. dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.12% (19.9488 => 18.5291, std. dev.: 0.0818) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -4.69% (1.9577 => 1.8659, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8979, std. dev.: 0.0110) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4817, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.6802 => 8.4348, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0041, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2016, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.70% (12.5348 => 12.3216, std. dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4176, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8080, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 11:50:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 13:50:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120804185030.0261D2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2656?compare_to=2654&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2656, Order: 161303, Start Time: 2012-08-04 17:36:49, End Time: 2012-08-04 18:51:02 To: 2654, Order: 161302, Start Time: 2012-08-04 15:34:50, End Time: 2012-08-04 16:48:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (141 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.95% (0.5326 => 0.5430, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.72% (79.6402 => 81.0080, std. dev.: 0.2681) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.51% (2.0176 => 2.3103, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5818 => 0.6380, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.57% (0.5748 => 0.6298, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.06% (0.3578 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.89% (0.3601 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3646 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3663 => 0.3985, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.74% (0.3650 => 0.3969, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 8.72% (0.3623 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.68% (0.7061 => 0.7674, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.30% (0.3940 => 0.4267, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 7.97% (1.3693 => 1.4785, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.50% (0.7710 => 0.8288, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2781 => 0.2980, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4062 => 0.4344, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.94% (0.2782 => 0.2975, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4328 => 0.4628, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (3.9660 => 4.2357, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.64% (0.7038 => 0.7505, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 6.62% (0.2690 => 0.2868, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.37% (0.2966 => 0.3155, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2628 => 0.2795, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2760 => 0.2934, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4379 => 0.4653, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.26% (0.3485 => 0.3703, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.3022 => 0.3211, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.23% (0.2761 => 0.2933, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.23% (1.9828 => 2.1063, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.02% (0.3107 => 0.3294, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3149 => 0.3336, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.85% (0.3489 => 0.3693, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.82% (0.2988 => 0.3162, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.81% (0.3580 => 0.3788, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.70% (0.3192 => 0.3374, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.58% (1.2193 => 1.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.57% (0.3534 => 0.3731, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.46% (0.6959 => 0.7339, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.28% (0.4390 => 0.4622, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.16% (0.5577 => 0.5865, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5330, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.15% (0.4016 => 0.4223, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (0.3756 => 0.3949, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.12% (0.3868 => 0.4066, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.04% (1.4563 => 1.5297, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.04% (16.6129 => 17.4498, std. dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.72% (7.2180 => 7.5586, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.61% (1.1364 => 1.1888, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.2292 => 1.2851, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5637 => 0.5891, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.50% (1.0594 => 1.1071, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (1.3813 => 1.4424, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (13.2842 => 13.8714, std. dev.: 0.0165) MultiSource/Applications/Burg/burg: 4.34% (1.1061 => 1.1541, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.31% (0.3246 => 0.3386, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.30% (0.8310 => 0.8667, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.28% (3.8646 => 4.0301, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3810, std. dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.7460 => 0.7776, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.23% (1.3819 => 1.4404, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.12% (1.9270 => 2.0064, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6242, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (3.6692 => 3.8171, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.3801 => 4.5516, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3755 => 0.3900, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.52% (4.9865 => 5.1618, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.4791 => 0.4959, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.48% (1.1333 => 1.1727, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.28% (2.1791 => 2.2506, std. dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.8698 => 0.8983, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.6283 => 0.6484, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.10% (0.6135 => 0.6325, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (8.4961 => 8.7559, std. dev.: 0.0104) MultiSource/Applications/d/make_dparser: 3.02% (3.1889 => 3.2853, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 2.88% (6.5754 => 6.7651, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 2.77% (16.2614 => 16.7112, std. dev.: 0.0268) MultiSource/Applications/JM/lencod/lencod: 2.66% (14.8535 => 15.2489, std. dev.: 0.0131) MultiSource/Applications/ClamAV/clamscan: 2.65% (14.5298 => 14.9148, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.55% (3.2742 => 3.3577, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1007 => 2.1517, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5524, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.11% (4.6629 => 4.7611, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.6250 => 0.6369, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.22% (1.0313 => 1.0439, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.13% (33.2944 => 33.6711, std. dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (6.2785 => 6.3459, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: 7.84% (1.2998 => 1.4017, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (0.9996 => 1.0505, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 4.48% (7.4271 => 7.7595, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7030, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8147, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5089 => 1.5356, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (22.5627 => 21.1817, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2308 => 1.1018, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.05% (20.3410 => 18.5011, std. dev.: 0.0917) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.94% (1.9762 => 1.9181, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6008, std. dev.: 0.0102) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9527, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2257, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5094, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2071, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8573, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2375, std. dev.: 0.0122) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 11:54:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 13:54:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120804185434.AE84A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2657?compare_to=2655&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2657, Order: 161303, Start Time: 2012-08-04 17:36:50, End Time: 2012-08-04 18:55:06 To: 2655, Order: 161302, Start Time: 2012-08-04 15:44:57, End Time: 2012-08-04 17:03:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (81 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.17% (10.3673 => 13.7027, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.62% (1.1194 => 1.2607, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3497 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.66% (0.3516 => 0.3926, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.78% (1.7609 => 1.9155, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.36% (2.2022 => 2.3864, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.92% (0.5925 => 0.6276, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.80% (0.6030 => 0.6380, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.18% (7.0540 => 7.4192, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3282 => 0.3446, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.93% (10.4361 => 10.9509, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference: 4.72% (0.7326 => 0.7672, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (9.4845 => 9.8967, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.10% (0.8172 => 0.8507, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.08% (4.9449 => 5.1468, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 3.98% (0.7433 => 0.7729, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (5.0018 => 5.1980, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.70% (0.3109 => 0.3224, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (4.2646 => 4.4213, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.5860 => 0.6074, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.1363 => 8.4150, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.29% (0.7835 => 0.8093, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4299 => 0.4432, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9370, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.1861 => 1.2225, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.3050 => 1.3446, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (14.3668 => 14.7836, std. dev.: 0.0152) MultiSource/Applications/Burg/burg: 2.83% (1.1642 => 1.1971, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.70% (1.5603 => 1.6025, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.69% (2.0273 => 2.0819, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.5415 => 1.5823, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 2.63% (3.3354 => 3.4230, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.5105 => 0.5238, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.55% (0.8067 => 0.8273, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9765 => 0.9995, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9598, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.2024 => 2.2509, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (0.6675 => 0.6821, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.18% (0.4636 => 0.4737, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8921 => 0.9105, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6456 => 0.6584, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6450 => 0.6575, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.89% (1.4186 => 1.4454, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.75% (2.0665 => 2.1026, std. dev.: 0.0102) MultiSource/Benchmarks/nbench/nbench: 1.64% (1.1840 => 1.2034, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4609, std. dev.: 0.0195) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3011, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.07% (1.0722 => 1.0837, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.14% (4.2280 => 4.4029, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7476, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2135, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5340, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8324, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2040, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2424, std. dev.: 0.0322) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0313 => 1.0442, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3707, std. dev.: 0.0263) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.84% (5.2763 => 3.1742, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.76% (5.3855 => 3.7290, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.39% (5.3526 => 3.7259, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1730, std. dev.: 0.0537) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5530, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -11.93% (22.1758 => 19.5306, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2373 => 1.1018, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.07% (19.9488 => 18.5392, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/mandel-2: -6.95% (1.5373 => 1.4305, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4890, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.52% (1.9577 => 1.8693, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4710, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4099, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9073, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0026, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2001, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3297, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4185, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 12:32:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 14:32:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120804193206.A46812A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2658?compare_to=2653&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2658, Order: 161302, Start Time: 2012-08-04 16:49:01, End Time: 2012-08-04 19:32:40 To: 2653, Order: 161298, Start Time: 2012-08-04 13:36:54, End Time: 2012-08-04 16:20:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (783 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.50% (0.3496 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.49% (0.3442 => 0.3872, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.42% (0.3469 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.95% (0.3650 => 0.4086, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.60% (0.3724 => 0.4156, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5826 => 0.6200, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.5889 => 0.6262, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (1.6211 => 1.7193, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 5.91% (1.5932 => 1.6873, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.63% (0.5900 => 0.6232, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.55% (0.7171 => 0.7569, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (3.5627 => 3.7587, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (1.3152 => 1.3870, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (0.5000 => 0.5269, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.31% (0.4994 => 0.5259, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 4.67% (4.2109 => 4.4074, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 4.61% (1.0781 => 1.1278, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.31% (0.2736 => 0.2854, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.27% (0.2738 => 0.2855, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.05% (2.7292 => 2.8398, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (1.9694 => 2.0489, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 4.02% (5.5417 => 5.7643, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.00% (0.2875 => 0.2990, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3362 => 0.3488, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (0.3195 => 0.3313, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (0.4658 => 0.4830, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (1.9966 => 2.0702, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.64% (0.9909 => 1.0270, std. dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (2.1013 => 2.1764, std. dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 3.56% (0.3004 => 0.3111, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.56% (0.7875 => 0.8155, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2911 => 0.3014, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (2.0673 => 2.1399, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.3903 => 0.4032, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 3.28% (2.1653 => 2.2364, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3267 => 0.3374, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (4.4195 => 4.5623, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 3.23% (0.3096 => 0.3196, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3282 => 0.3388, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.21% (4.6177 => 4.7660, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.20% (0.3124 => 0.3224, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.13% (23.5202 => 24.2575, std. dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/ary: 3.10% (0.3258 => 0.3359, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3678 => 0.3790, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (1.8794 => 1.9361, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 2.99% (0.9697 => 0.9987, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.97% (0.6634 => 0.6831, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (0.3726 => 0.3836, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.4139 => 0.4258, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.84% (1.4269 => 1.4674, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (0.3625 => 0.3726, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4146 => 0.4260, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3690 => 0.3791, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.67% (0.5546 => 0.5694, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.59% (0.4251 => 0.4361, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.3981 => 0.4081, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.19% (0.5012 => 0.5122, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.6435 => 0.6574, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.68% (2.0346 => 2.0688, std. dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (11.6398 => 11.8010, std. dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9635, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6125, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6678, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 5.12% (1.8057 => 1.8981, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1627, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6569, std. dev.: 0.0444) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2012, std. dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4989, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5922, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.68% (41.7953 => 42.4977, std. dev.: 0.0613) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.50% (3.1722 => 3.2197, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.06% (6.9842 => 7.0583, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.22% (11.9555 => 11.8100, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5284, std. dev.: 0.0155) SingleSource/Benchmarks/Dhrystone/fldry: -8.71% (17.2379 => 15.7362, std. dev.: 0.2519) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8014, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: -7.12% (0.2402 => 0.2231, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7951, std. dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5465, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.82% (10.7630 => 10.5670, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9693, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 15:43:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 17:43:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120804224345.100282A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2659?compare_to=2658&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2659, Order: 161303, Start Time: 2012-08-04 20:00:38, End Time: 2012-08-04 22:44:18 To: 2658, Order: 161302, Start Time: 2012-08-04 16:49:01, End Time: 2012-08-04 19:32:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (84 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (795 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 17.17% (0.3792 => 0.4443, std. dev.: 0.0181) SingleSource/UnitTests/ObjC/exceptions-4: 12.70% (0.3465 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.57% (0.3446 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.52% (0.3442 => 0.3873, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.44% (0.3488 => 0.3922, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.42% (0.3469 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.41% (0.3496 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.11% (0.3643 => 0.4084, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.65% (0.3724 => 0.4158, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.54% (0.5826 => 0.6207, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.42% (0.5889 => 0.6267, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (1.6211 => 1.7138, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.70% (3.5627 => 3.7657, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 5.36% (0.4029 => 0.4245, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 5.32% (1.5932 => 1.6780, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.31% (1.3152 => 1.3850, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (0.4361 => 0.4590, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (0.3930 => 0.4136, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (0.4994 => 0.5249, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 4.96% (0.7171 => 0.7527, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.2866 => 0.3005, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.82% (4.2109 => 4.4139, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.76% (0.5900 => 0.6181, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (0.5000 => 0.5238, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 4.41% (1.0781 => 1.1256, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (0.4658 => 0.4851, std. dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.94% (0.2566 => 0.2667, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (1.9966 => 2.0746, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.90% (5.5417 => 5.7578, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.90% (2.7292 => 2.8356, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (1.9694 => 2.0448, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.82% (0.3903 => 0.4052, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.80% (0.3890 => 0.4038, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 3.60% (2.1013 => 2.1769, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.4139 => 0.4287, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.3271 => 0.3384, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.45% (0.7875 => 0.8147, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (1.8794 => 1.9430, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 3.38% (0.6634 => 0.6858, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.35% (2.1653 => 2.2379, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (4.4195 => 4.5663, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 3.32% (0.9909 => 1.0238, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.30% (4.6177 => 4.7701, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.30% (0.5546 => 0.5729, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.16% (0.3195 => 0.3296, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.08% (1.4269 => 1.4708, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.00% (23.5202 => 24.2268, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4146 => 0.4266, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.84% (2.0673 => 2.1260, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.79% (0.9697 => 0.9968, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4251 => 0.4355, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.6435 => 0.6564, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.78% (2.0346 => 2.0708, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (11.6398 => 11.7831, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.99% (1.8057 => 1.8958, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1643, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (105.3826 => 107.6183, std. dev.: 0.0549) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2076, std. dev.: 0.0381) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (41.7953 => 42.6355, std. dev.: 0.0119) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.4993, std. dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.79% (3.1722 => 3.2291, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.05% (6.9842 => 7.0575, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.09% (11.9555 => 11.8250, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.04% (25.4195 => 16.5126, std. dev.: 0.0134) SingleSource/Benchmarks/Dhrystone/fldry: -7.85% (17.2379 => 15.8854, std. dev.: 0.1067) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7840, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.25% (0.2402 => 0.2276, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8002, std. dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -3.62% (14.0481 => 13.5399, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5782, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9678, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 19:06:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 21:06:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120805020610.358952A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2660?compare_to=2656&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2660, Order: 161305, Start Time: 2012-08-05 00:52:49, End Time: 2012-08-05 02:06:42 To: 2656, Order: 161303, Start Time: 2012-08-04 17:36:49, End Time: 2012-08-04 18:51:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.24% (54.6632 => 56.4324, std. dev.: 0.0533) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.44% (2.0176 => 2.3089, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.68% (0.5818 => 0.6381, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.46% (0.5748 => 0.6292, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.23% (0.7061 => 0.7713, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.03% (0.3578 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.91% (0.3646 => 0.3971, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.68% (0.3789 => 0.4118, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3650 => 0.3966, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 8.53% (0.3914 => 0.4248, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 8.11% (1.3693 => 1.4804, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (0.4328 => 0.4636, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 7.01% (0.2781 => 0.2976, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2375, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 6.61% (0.7038 => 0.7503, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.57% (0.5265 => 0.5611, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.3899 => 0.4147, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2628 => 0.2795, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.33% (0.2765 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.31% (0.3485 => 0.3705, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.22% (1.9828 => 2.1061, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3580 => 0.3799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.01% (0.2696 => 0.2858, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3149 => 0.3337, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.90% (0.3489 => 0.3695, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.89% (0.2988 => 0.3164, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.79% (0.3453 => 0.3653, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.70% (0.3192 => 0.3374, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.58% (1.2193 => 1.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.57% (0.3534 => 0.3731, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 5.34% (0.3293 => 0.3469, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.25% (0.4016 => 0.4227, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (0.3756 => 0.3951, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.14% (13.8202 => 14.5305, std. dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 5.10% (16.6129 => 17.4600, std. dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/moments: 5.04% (0.3868 => 0.4063, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.90% (1.4563 => 1.5277, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5604, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.61% (0.7506 => 0.7852, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.58% (1.2292 => 1.2855, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.57% (1.1364 => 1.1883, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (13.2842 => 13.8765, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/football/football: 4.39% (0.8310 => 0.8675, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.37% (1.3245 => 1.3824, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3813 => 1.4415, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (3.8646 => 4.0314, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.28% (0.3246 => 0.3385, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.25% (1.1061 => 1.1531, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 4.25% (1.0594 => 1.1044, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.17% (1.9270 => 2.0073, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.07% (1.3819 => 1.4382, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (3.6692 => 3.8157, std. dev.: 0.0143) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6207, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.97% (0.3755 => 0.3904, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (4.3801 => 4.5498, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (0.4791 => 0.4968, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.55% (4.9865 => 5.1636, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1333 => 1.1713, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.8698 => 0.8986, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.31% (0.4113 => 0.4249, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.26% (2.1791 => 2.2501, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.6135 => 0.6327, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7588, std. dev.: 0.0151) MultiSource/Applications/d/make_dparser: 3.04% (3.1889 => 3.2858, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (6.5754 => 6.7736, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.86% (16.2614 => 16.7272, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.74% (3.2742 => 3.3638, std. dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9258, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 2.70% (14.8535 => 15.2540, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.1007 => 2.1542, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.43% (1.5188 => 1.5557, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.10% (4.6629 => 4.7609, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6250 => 0.6367, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.25% (3.7467 => 3.7937, std. dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 1.19% (33.2944 => 33.6893, std. dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.13% (6.2785 => 6.3492, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 25.22% (1.8175 => 2.2758, std. dev.: 0.0459) SingleSource/Benchmarks/Misc/mandel-2: 7.98% (1.2998 => 1.4035, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.05% (0.9996 => 1.0501, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 4.34% (7.4271 => 7.7493, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7062, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5939, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0412, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9290 => 1.9509, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1406, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1682, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1805, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.96% (1.2308 => 1.1082, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.16% (20.3410 => 18.4770, std. dev.: 0.0814) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0116) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.8259 => 8.5649, std. dev.: 0.0122) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9196, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: -2.37% (3.0263 => 2.9546, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2291, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5051, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2127, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8497, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 19:10:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 21:10:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120805021023.54F5C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2661?compare_to=2657&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2661, Order: 161305, Start Time: 2012-08-05 00:52:36, End Time: 2012-08-05 02:10:56 To: 2657, Order: 161303, Start Time: 2012-08-04 17:36:50, End Time: 2012-08-04 18:55:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (81 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.10% (55.4433 => 56.6100, std. dev.: 0.0589) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.81% (41.7959 => 42.5543, std. dev.: 0.1098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.63% (78.8636 => 80.1473, std. dev.: 0.3308) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.15% (10.3673 => 13.7009, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.70% (1.1194 => 1.2616, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 11.89% (0.3473 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.77% (1.7609 => 1.9153, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.39% (2.2022 => 2.3870, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.80% (0.6030 => 0.6380, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5925 => 0.6265, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.4879 => 0.5148, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.13% (7.0540 => 7.4162, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/oourafft: 4.91% (0.3282 => 0.3443, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.89% (10.4361 => 10.9463, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.74% (0.7326 => 0.7673, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 4.34% (9.4845 => 9.8965, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1381, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1947, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 3.63% (0.3109 => 0.3222, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (4.2646 => 4.4158, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.43% (0.5860 => 0.6061, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (8.1363 => 8.4100, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.3050 => 1.3457, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9368, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (14.3668 => 14.7968, std. dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: 2.98% (0.4299 => 0.4427, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.5415 => 1.5834, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.66% (1.1642 => 1.1952, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.62% (1.5603 => 1.6012, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.59% (2.0273 => 2.0798, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.56% (3.3354 => 3.4209, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.8067 => 0.8270, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.29% (0.9765 => 0.9989, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (1.5859 => 1.6211, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.21% (3.8723 => 3.9580, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.2024 => 2.2509, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6675 => 0.6816, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.6456 => 0.6588, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8921 => 0.9094, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.4186 => 1.4448, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.68% (17.1811 => 17.4704, std. dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.66% (2.0665 => 2.1008, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.66% (1.1840 => 1.2036, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2842 => 1.3010, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 1.30% (2.2969 => 2.3268, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (4.2280 => 4.4005, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7502, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2138, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8328, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2033, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0313 => 1.0438, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2225, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 1.15% (2.2771 => 2.3033, std. dev.: 0.0098) MultiSource/Applications/lua/lua: 1.09% (26.0924 => 26.3762, std. dev.: 0.0139) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.85% (5.2763 => 3.1735, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.78% (5.3855 => 3.7280, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7244, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1989, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.99% (2.9384 => 2.5567, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -11.97% (22.1758 => 19.5212, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2373 => 1.1109, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -7.49% (1.5373 => 1.4221, std. dev.: 0.0172) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.83% (19.9488 => 18.5866, std. dev.: 0.0685) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5539, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -4.90% (1.9577 => 1.8618, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5958, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4758, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9049, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4202, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0027, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2014, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3230, std. dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4180, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.32% (1.8329 => 1.8087, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 20:35:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 22:35:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120805033534.5DE462A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2662?compare_to=2659&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2662, Order: 161305, Start Time: 2012-08-05 00:52:45, End Time: 2012-08-05 03:36:08 To: 2659, Order: 161303, Start Time: 2012-08-04 20:00:38, End Time: 2012-08-04 22:44:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (77 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (801 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.17% (2.2901 => 2.3168, std. dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.80% (0.3446 => 0.3887, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3465 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.49% (0.3442 => 0.3872, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3460 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.40% (0.3469 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.39% (0.3496 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.00% (0.3643 => 0.4080, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.89% (0.3650 => 0.4084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.60% (0.3724 => 0.4156, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5826 => 0.6208, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 6.44% (0.5889 => 0.6268, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (0.5026 => 0.5322, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (0.4994 => 0.5276, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.62% (1.3152 => 1.3891, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60% (3.5627 => 3.7621, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (1.6211 => 1.7110, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.28% (1.5932 => 1.6774, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (0.4361 => 0.4589, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.5900 => 0.6193, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 4.94% (0.7171 => 0.7525, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (0.5000 => 0.5233, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.52% (4.2109 => 4.4014, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 4.29% (1.0781 => 1.1244, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (0.3890 => 0.4055, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.96% (5.5417 => 5.7610, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (2.7292 => 2.8353, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (0.4658 => 0.4837, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.73% (1.9694 => 2.0429, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.68% (1.9966 => 2.0701, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.66% (0.3060 => 0.3172, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (2.1013 => 2.1763, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.37% (0.7875 => 0.8140, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 3.27% (0.9909 => 1.0233, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.26% (0.3195 => 0.3299, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 3.25% (4.6177 => 4.7678, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 3.24% (2.1653 => 2.2354, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (4.4195 => 4.5598, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.3903 => 0.4025, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 3.08% (0.6634 => 0.6838, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (0.4139 => 0.4265, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (1.8794 => 1.9360, std. dev.: 0.0064) MultiSource/Applications/lua/lua: 2.96% (1.4269 => 1.4692, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 2.93% (23.5202 => 24.2103, std. dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (2.0673 => 2.1279, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.67% (0.5546 => 0.5694, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 2.51% (0.9697 => 0.9940, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.64% (2.0346 => 2.0679, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.18% (11.6398 => 11.7777, std. dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9640, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.58% (3.3903 => 3.6133, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6704, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 5.14% (1.8057 => 1.8985, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (105.3826 => 107.6980, std. dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2001, std. dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (41.7953 => 42.6417, std. dev.: 0.0113) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4963, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5915, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.03% (6.9842 => 7.0559, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.31% (11.9555 => 11.7988, std. dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -1.21% (2.4764 => 2.4464, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.01% (25.4195 => 16.5213, std. dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/fldry: -10.42% (17.2379 => 15.4418, std. dev.: 0.2655) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7991, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8019, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5471, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5807, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9622, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 20:47:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 22:47:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120805034754.8A7F42A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2663?compare_to=2660&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2663, Order: 161306, Start Time: 2012-08-05 02:34:39, End Time: 2012-08-05 03:48:27 To: 2660, Order: 161305, Start Time: 2012-08-05 00:52:49, End Time: 2012-08-05 02:06:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.18% (28.6658 => 29.5773, std. dev.: 0.0626) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.65% (2.0176 => 2.3132, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.50% (0.5818 => 0.6371, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 9.46% (0.7061 => 0.7729, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.26% (0.5748 => 0.6280, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3650 => 0.3960, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3789 => 0.4108, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3623 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3914 => 0.4238, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 7.72% (1.3693 => 1.4750, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.20% (0.7710 => 0.8265, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4328 => 0.4628, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (3.9660 => 4.2402, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.79% (0.7038 => 0.7516, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.69% (0.2781 => 0.2967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.14% (0.2966 => 0.3148, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.13% (0.2690 => 0.2855, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2628 => 0.2788, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.08% (0.3899 => 0.4136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (0.2765 => 0.2931, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.88% (0.3485 => 0.3690, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.84% (1.9828 => 2.0986, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.78% (0.3580 => 0.3787, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.73% (0.3489 => 0.3689, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 5.69% (0.2988 => 0.3158, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.68% (1.2193 => 1.2885, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.51% (0.3192 => 0.3368, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.5577 => 0.5875, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9199 => 0.9687, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.3534 => 0.3720, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.17% (16.6129 => 17.4724, std. dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4390 => 0.4616, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5259, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.4563 => 1.5275, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.67% (0.5637 => 0.5900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.64% (7.2180 => 7.5531, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.64% (1.1364 => 1.1891, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.57% (13.2842 => 13.8917, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 4.54% (0.8310 => 0.8687, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.51% (1.1061 => 1.1560, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.49% (1.3813 => 1.4433, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 4.44% (3.8646 => 4.0361, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.39% (1.3245 => 1.3826, std. dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: 4.37% (1.2292 => 1.2829, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 4.30% (1.0594 => 1.1050, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.25% (1.9270 => 2.0089, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.15% (1.3819 => 1.4392, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (4.4433 => 4.6216, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5534, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (3.6692 => 3.8143, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.69% (2.1791 => 2.2594, std. dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.68% (0.3755 => 0.3893, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.49% (4.9865 => 5.1604, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.8698 => 0.8988, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.18% (0.6135 => 0.6330, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (8.4961 => 8.7642, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2883, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.88% (6.5754 => 6.7645, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.85% (16.2614 => 16.7241, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.83% (3.2742 => 3.3668, std. dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 2.77% (14.8535 => 15.2642, std. dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.73% (2.1007 => 2.1580, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5188 => 1.5590, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9133, std. dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 2.34% (4.6629 => 4.7722, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.91% (0.9108 => 0.9282, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6250 => 0.6367, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.54% (1.0313 => 1.0472, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.14% (3.7467 => 3.7894, std. dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.13% (6.2785 => 6.3496, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.01% (33.2944 => 33.6302, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5129, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2688, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: 7.73% (1.2998 => 1.4003, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.92% (1.5824 => 1.6761, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.32% (0.9996 => 1.0528, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 4.46% (7.4271 => 7.7580, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7080, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.7688 => 1.8143, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (1.9290 => 1.9509, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1680, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2308 => 1.1097, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.03% (20.3410 => 18.5038, std. dev.: 0.0893) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3188, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -2.85% (1.9762 => 1.9199, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5894, std. dev.: 0.0241) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9524, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5072, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2401, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2126, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4927, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2225, std. dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2536, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 20:56:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 4 Aug 2012 22:56:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120805035633.73C2A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2664?compare_to=2661&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2664, Order: 161306, Start Time: 2012-08-05 02:38:54, End Time: 2012-08-05 03:57:06 To: 2661, Order: 161305, Start Time: 2012-08-05 00:52:36, End Time: 2012-08-05 02:10:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (82 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.88% (1.4221 => 1.4488, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.86% (13.7009 => 13.3087, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.16% (56.6100 => 54.8192, std. dev.: 0.1943) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.37% (10.3673 => 13.3087, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.28% (1.1194 => 1.2569, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.22% (2.2022 => 2.3832, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.91% (1.7609 => 1.9002, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 7.26% (0.1432 => 0.1536, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.38% (0.6030 => 0.6415, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.31% (0.4879 => 0.5138, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.25% (7.0540 => 7.4246, std. dev.: 0.0103) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7326 => 0.7706, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 4.81% (0.3282 => 0.3440, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (10.4361 => 10.9283, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (0.7433 => 0.7751, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8727, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.05% (0.8172 => 0.8503, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.9449 => 5.1354, std. dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (5.0018 => 5.1910, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.5569 => 0.5779, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.42% (4.2646 => 4.4103, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (8.1363 => 8.4018, std. dev.: 0.0083) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.19% (0.7835 => 0.8085, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.3050 => 1.3439, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.94% (1.5603 => 1.6061, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 2.82% (5.7591 => 5.9213, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.73% (14.3668 => 14.7586, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 2.72% (1.1642 => 1.1959, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4299 => 0.4416, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.5415 => 1.5827, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 2.55% (3.3354 => 3.4205, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.54% (2.0273 => 2.0787, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.39% (0.8067 => 0.8260, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.37% (2.0665 => 2.1154, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.35% (0.4636 => 0.4745, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5105 => 0.5223, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (1.5859 => 1.6222, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9765 => 0.9985, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.21% (3.8723 => 3.9580, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6456 => 0.6595, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (2.2024 => 2.2493, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6450 => 0.6579, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5981 => 0.6100, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8921 => 0.9085, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.4186 => 1.4445, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2842 => 1.3066, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.56% (17.1811 => 17.4499, std. dev.: 0.0162) MultiSource/Applications/siod/siod: 1.47% (2.2969 => 2.3306, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 1.34% (1.1840 => 1.1999, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (4.2280 => 4.4036, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7586, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2138, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5086 => 1.5330, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8319, std. dev.: 0.0013) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.27% (1.0313 => 1.0444, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2311, std. dev.: 0.0396) MultiSource/Applications/lua/lua: 1.06% (26.0924 => 26.3695, std. dev.: 0.0127) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.13% (5.2763 => 3.1589, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7174, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7126, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.2007, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.14% (2.9384 => 2.5523, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -12.08% (22.1758 => 19.4980, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4194, std. dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2373 => 1.1143, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.01% (19.9488 => 18.5507, std. dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.76% (1.5373 => 1.4488, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: -5.04% (1.5835 => 1.5037, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.71% (1.9577 => 1.8655, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8976, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4816, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4261, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9997, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2010, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3190, std. dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7068, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 4 23:47:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 01:47:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120805064701.EC5CC2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2665?compare_to=2662&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2665, Order: 161306, Start Time: 2012-08-05 04:04:09, End Time: 2012-08-05 06:47:34 To: 2662, Order: 161305, Start Time: 2012-08-05 00:52:45, End Time: 2012-08-05 03:36:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (74 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (804 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.39% (2.0279 => 2.1170, std. dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.60% (124.1638 => 128.6277, std. dev.: 1.0853) SingleSource/Benchmarks/Dhrystone/fldry: 2.79% (15.4418 => 15.8727, std. dev.: 0.1426) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.45% (0.3446 => 0.3875, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.29% (0.3465 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.26% (0.3442 => 0.3864, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3496 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.21% (0.3488 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3469 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.67% (0.3650 => 0.4076, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3724 => 0.4147, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.89% (0.3792 => 0.4091, std. dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.87% (0.5826 => 0.6226, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.66% (0.5889 => 0.6281, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.46% (3.5627 => 3.7572, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.37% (1.6211 => 1.7082, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 5.34% (1.5932 => 1.6782, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.22% (1.3152 => 1.3839, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7171 => 0.7543, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (0.5026 => 0.5266, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.5900 => 0.6180, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (0.4994 => 0.5230, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (0.5000 => 0.5229, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 4.43% (4.2109 => 4.3976, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 4.21% (1.0781 => 1.1235, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.76% (2.7292 => 2.8318, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (0.4658 => 0.4830, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.39% (0.3890 => 0.4022, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.38% (1.9694 => 2.0359, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (1.9966 => 2.0640, std. dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (2.1013 => 2.1713, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.26% (0.9909 => 1.0232, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.25% (5.5417 => 5.7217, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (4.4195 => 4.5607, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.3903 => 0.4025, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (2.1653 => 2.2326, std. dev.: 0.0063) MultiSource/Applications/treecc/treecc: 3.09% (0.7875 => 0.8118, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.01% (4.6177 => 4.7568, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.86% (2.0673 => 2.1265, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (1.8794 => 1.9326, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (0.4139 => 0.4242, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.44% (0.9697 => 0.9934, std. dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 2.37% (23.5202 => 24.0774, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 2.37% (1.4269 => 1.4607, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.33% (0.5546 => 0.5675, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.20% (0.6634 => 0.6780, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.19% (2.0346 => 2.0589, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6718, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8966, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1698, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6798, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2134, std. dev.: 0.0414) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5016, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.84% (41.7953 => 42.5660, std. dev.: 0.0328) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.68% (2.0820 => 2.1170, std. dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.07% (6.9842 => 7.0591, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.76% (11.9555 => 11.7446, std. dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -1.27% (2.4764 => 2.4450, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5250, std. dev.: 0.0152) SingleSource/Benchmarks/Dhrystone/fldry: -7.92% (17.2379 => 15.8727, std. dev.: 0.1426) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7983, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -3.68% (14.0481 => 13.5307, std. dev.: 0.0113) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8117, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9574, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 03:56:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 05:56:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120805105625.CE5DB2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2666?compare_to=2663&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2666, Order: 161307, Start Time: 2012-08-05 09:43:08, End Time: 2012-08-05 10:57:00 To: 2663, Order: 161306, Start Time: 2012-08-05 02:34:39, End Time: 2012-08-05 03:48:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.66% (2.0176 => 2.3134, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.45% (0.5818 => 0.6368, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.12% (0.5748 => 0.6272, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7061 => 0.7664, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.02% (0.3940 => 0.4256, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.78% (1.3693 => 1.4758, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.90% (3.9660 => 4.2398, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5265 => 0.5625, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.82% (0.7038 => 0.7518, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.77% (0.7710 => 0.8232, std. dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 6.69% (0.2781 => 0.2967, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4328 => 0.4617, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2782 => 0.2966, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.16% (0.3899 => 0.4139, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2628 => 0.2788, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.98% (0.2760 => 0.2925, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.87% (1.9828 => 2.0991, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.76% (0.3107 => 0.3286, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.6959 => 0.7359, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3489 => 0.3688, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.2193 => 1.2880, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 5.59% (0.3149 => 0.3325, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.2988 => 0.3155, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.51% (0.3192 => 0.3368, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9199 => 0.9700, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.26% (16.6129 => 17.4873, std. dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.21% (13.8202 => 14.5398, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.4016 => 0.4216, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.91% (0.3868 => 0.4058, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.3756 => 0.3937, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (1.4563 => 1.5254, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5552, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.61% (0.7506 => 0.7852, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (3.8646 => 4.0422, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.59% (1.1364 => 1.1886, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3246 => 0.3394, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.56% (1.1061 => 1.1565, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8757, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.38% (1.3813 => 1.4418, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2292 => 1.2823, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1048, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.27% (1.9270 => 2.0093, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.26% (1.3245 => 1.3809, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 4.16% (0.3220 => 0.3354, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.10% (1.3819 => 1.4386, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (3.6692 => 3.8149, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6180, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.3801 => 4.5502, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3755 => 0.3897, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.70% (2.1791 => 2.2598, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (4.9865 => 5.1653, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.45% (1.1333 => 1.1724, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.36% (0.8698 => 0.8990, std. dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: 3.33% (0.4113 => 0.4250, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.16% (0.6135 => 0.6329, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (8.4961 => 8.7641, std. dev.: 0.0078) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2879, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7622, std. dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 2.82% (16.2614 => 16.7205, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.80% (2.1007 => 2.1596, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3643, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2578, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9104, std. dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.5188 => 1.5558, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.23% (4.6629 => 4.7671, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6250 => 0.6358, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.52% (1.0313 => 1.0470, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.20% (6.2785 => 6.3536, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 1.16% (3.7467 => 3.7903, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0395) SingleSource/Benchmarks/Misc/mandel-2: 7.18% (1.2998 => 1.3931, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.80% (0.9996 => 1.0576, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 4.35% (7.4271 => 7.7501, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7073, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.58% (1.7688 => 1.8144, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5349, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5077, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1940, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1786, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -9.64% (1.2308 => 1.1121, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (20.3410 => 18.6083, std. dev.: 0.0414) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std. dev.: 0.0080) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.90% (1.9762 => 1.9188, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6074, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: -2.36% (3.0263 => 2.9550, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2296, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5049, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2146, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2542, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2351, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.02% (3.8887 => 3.8490, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 04:01:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 06:01:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120805110136.0864F2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2667?compare_to=2664&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2667, Order: 161307, Start Time: 2012-08-05 09:43:10, End Time: 2012-08-05 11:02:10 To: 2664, Order: 161306, Start Time: 2012-08-05 02:38:54, End Time: 2012-08-05 03:57:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (85 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.45% (10.3673 => 13.3165, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.32% (1.1194 => 1.2573, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.95% (0.3497 => 0.3915, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.07% (0.3886 => 0.4316, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.28% (2.2022 => 2.3846, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.90% (1.7609 => 1.9000, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.46% (0.5925 => 0.6308, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 6.40% (0.6030 => 0.6416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.28% (0.7326 => 0.7713, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.24% (7.0540 => 7.4238, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.19% (0.4879 => 0.5132, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 4.85% (10.4361 => 10.9422, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.8172 => 0.8528, std. dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.7433 => 0.7750, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (9.4845 => 9.8716, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1434, std. dev.: 0.0116) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (5.0018 => 5.1941, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.67% (0.5860 => 0.6075, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (4.2646 => 4.4195, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.30% (8.1363 => 8.4052, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.27% (0.7835 => 0.8091, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 3.03% (1.5603 => 1.6075, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.3050 => 1.3439, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1979, std. dev.: 0.0089) MultiSource/Applications/oggenc/oggenc: 2.89% (5.7591 => 5.9253, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 2.83% (2.0273 => 2.0847, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7658, std. dev.: 0.0120) MultiSource/Benchmarks/McCat/05-eks/eks: 2.74% (0.4299 => 0.4417, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 2.59% (0.4289 => 0.4400, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (2.0665 => 2.1184, std. dev.: 0.0112) MultiSource/Applications/d/make_dparser: 2.51% (3.3354 => 3.4191, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.49% (0.5105 => 0.5232, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.46% (0.4636 => 0.4750, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.38% (0.4203 => 0.4303, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.5415 => 1.5781, std. dev.: 0.0049) MultiSource/Applications/lua/lua: 2.36% (3.8723 => 3.9638, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6225, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8921 => 0.9122, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.20% (0.6456 => 0.6598, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.2024 => 2.2505, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6675 => 0.6814, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.01% (1.2842 => 1.3100, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.4186 => 1.4455, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.54% (17.1811 => 17.4462, std. dev.: 0.0184) MultiSource/Applications/minisat/minisat: 1.45% (0.7115 => 0.7218, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 1.40% (2.2969 => 2.3290, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 1.27% (1.1840 => 1.1990, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (4.2280 => 4.3899, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8323, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5086 => 1.5330, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 1.62% (3.1578 => 3.2088, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2437, std. dev.: 0.0166) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3722, std. dev.: 0.0195) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.13% (5.2763 => 3.1587, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7178, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.60% (5.3526 => 3.7146, std. dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1938, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.01% (2.9384 => 2.5560, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.07% (22.1758 => 19.4988, std. dev.: 0.0507) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.80% (1.2373 => 1.1037, std. dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.36% (19.9488 => 18.4814, std. dev.: 0.0616) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -6.36% (1.5373 => 1.4396, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.51% (1.9577 => 1.8694, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4744, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9003, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4140, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0030, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -2.17% (12.4730 => 12.2018, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3236, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4184, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 05:26:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 07:26:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120805122602.0679F2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2668?compare_to=2665&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2668, Order: 161307, Start Time: 2012-08-05 09:43:09, End Time: 2012-08-05 12:26:35 To: 2665, Order: 161306, Start Time: 2012-08-05 04:04:09, End Time: 2012-08-05 06:47:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (73 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (806 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.75% (0.6280 => 0.6390, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.13% (1.3514 => 1.3667, std. dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.42% (0.3446 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.35% (0.3465 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3496 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3442 => 0.3865, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.24% (0.3488 => 0.3915, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3460 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.80% (0.3643 => 0.4073, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.78% (0.3650 => 0.4080, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.97% (0.5826 => 0.6232, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.72% (0.5889 => 0.6285, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.67% (1.5932 => 1.6835, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.64% (1.6211 => 1.7126, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.57% (3.5627 => 3.7612, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.34% (1.3152 => 1.3854, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.27% (0.4361 => 0.4591, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.21% (0.4994 => 0.5254, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (0.5000 => 0.5260, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7171 => 0.7543, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.5900 => 0.6197, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.97% (0.2014 => 0.2114, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.91% (0.5026 => 0.5273, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.62% (0.4029 => 0.4215, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.51% (4.2109 => 4.4008, std. dev.: 0.0083) MultiSource/Applications/d/make_dparser: 4.23% (1.0781 => 1.1237, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.76% (2.7292 => 2.8318, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 3.66% (2.1013 => 2.1783, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.48% (1.9966 => 2.0660, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.47% (1.9694 => 2.0378, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (0.3890 => 0.4024, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.44% (5.5417 => 5.7321, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (0.4658 => 0.4813, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (4.4195 => 4.5617, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.3903 => 0.4028, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 3.18% (4.6177 => 4.7647, std. dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 3.14% (0.9909 => 1.0220, std. dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (2.1653 => 2.2332, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 2.96% (1.8794 => 1.9350, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.83% (2.0673 => 2.1259, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.76% (0.5546 => 0.5699, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.72% (0.7875 => 0.8089, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 2.62% (0.9697 => 0.9951, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.54% (1.4269 => 1.4631, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 2.49% (0.6634 => 0.6799, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 2.46% (23.5202 => 24.0992, std. dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: 1.34% (2.0346 => 2.0619, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.03% (2.5769 => 2.9641, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6739, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8953, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1670, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6352, std. dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (41.7953 => 42.6440, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1915, std. dev.: 0.0147) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4976, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.08% (6.9842 => 7.0596, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.68% (11.9555 => 11.7547, std. dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5150, std. dev.: 0.0179) SingleSource/Benchmarks/Dhrystone/fldry: -9.19% (17.2379 => 15.6544, std. dev.: 0.2301) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7868, std. dev.: 0.0180) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -3.51% (14.0481 => 13.5548, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9684, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 16:50:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 18:50:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120805235001.ED0172A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2669?compare_to=2666&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2669, Order: 161310, Start Time: 2012-08-05 22:36:53, End Time: 2012-08-05 23:50:36 To: 2666, Order: 161307, Start Time: 2012-08-05 09:43:08, End Time: 2012-08-05 10:57:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (145 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.5006 => 56.3586, std. dev.: 0.1037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.01% (1.3072 => 1.3204, std. dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.58% (2.0176 => 2.3118, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5818 => 0.6353, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5748 => 0.6269, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3578 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3646 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.24% (0.7061 => 0.7643, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3789 => 0.4100, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.17% (0.3623 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.82% (0.3940 => 0.4248, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.70% (1.3693 => 1.4748, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.08% (0.2782 => 0.2979, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.82% (3.9660 => 4.2365, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4328 => 0.4623, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.77% (0.7710 => 0.8232, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.69% (0.5265 => 0.5617, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.62% (0.2781 => 0.2965, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7038 => 0.7502, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2760 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.18% (0.3899 => 0.4140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4062 => 0.4312, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2696 => 0.2861, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.97% (0.2765 => 0.2930, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.94% (0.2726 => 0.2888, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.90% (0.3489 => 0.3695, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.89% (0.3580 => 0.3791, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.85% (1.9828 => 2.0988, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.78% (0.3149 => 0.3331, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.6959 => 0.7356, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.3107 => 0.3284, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.2988 => 0.3155, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.56% (1.2193 => 1.2871, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3192 => 0.3366, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.33% (0.3453 => 0.3637, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.22% (0.9199 => 0.9679, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 5.13% (0.3293 => 0.3462, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.10% (16.6129 => 17.4598, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.04% (13.8202 => 14.5174, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.4016 => 0.4216, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5602, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (1.4563 => 1.5247, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.5637 => 0.5901, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.56% (3.8646 => 4.0409, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (1.1364 => 1.1881, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (13.2842 => 13.8878, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: 4.49% (0.7506 => 0.7843, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.39% (1.3245 => 1.3826, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8310 => 0.8674, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.38% (1.1061 => 1.1545, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2825, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 4.24% (1.0594 => 1.1043, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.19% (1.3813 => 1.4392, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.3819 => 1.4396, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 4.17% (1.9270 => 2.0073, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (3.6692 => 3.8125, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.4433 => 4.6152, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5473, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.47% (2.1791 => 2.2548, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.46% (4.9865 => 5.1591, std. dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.1333 => 1.1716, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.31% (0.4113 => 0.4249, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.22% (0.8698 => 0.8978, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2877, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7466, std. dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 2.77% (16.2614 => 16.7114, std. dev.: 0.0179) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7572, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3641, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2578, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9141, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (1.5188 => 1.5535, std. dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 2.22% (4.6629 => 4.7665, std. dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6250 => 0.6358, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.66% (0.9108 => 0.9259, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.2944 => 33.6935, std. dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (6.2785 => 6.3457, std. dev.: 0.0110) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7868, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 25.32% (1.8175 => 2.2777, std. dev.: 0.0481) SingleSource/Benchmarks/Misc/mandel-2: 7.75% (1.2998 => 1.4005, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.97% (1.5824 => 1.6769, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.24% (0.9996 => 1.0520, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 4.45% (7.4271 => 7.7576, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7077, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9774, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5089 => 1.5364, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5952, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9573, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.19% (1.0310 => 1.0433, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6870, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.71% (0.4657 => 0.3972, std. dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1588, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2308 => 1.1009, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (20.3410 => 18.6237, std. dev.: 0.0733) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.18% (1.3780 => 1.3204, std. dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5727, std. dev.: 0.0224) MultiSource/Applications/spiff/spiff: -2.37% (3.0263 => 2.9547, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2313, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5046, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.65% (7.3305 => 7.2092, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2203, std. dev.: 0.0330) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 16:54:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 18:54:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120805235441.DBDBF2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2670?compare_to=2667&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2670, Order: 161310, Start Time: 2012-08-05 22:36:51, End Time: 2012-08-05 23:55:16 To: 2667, Order: 161307, Start Time: 2012-08-05 09:43:10, End Time: 2012-08-05 11:02:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (86 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (752 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.41% (13.3165 => 13.6372, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.22% (1.1037 => 1.1172, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -3.54% (1.4396 => 1.3886, std. dev.: 0.0182) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.54% (10.3673 => 13.6372, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 12.76% (0.3473 => 0.3916, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.59% (1.1194 => 1.2603, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.45% (0.3543 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3516 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.36% (0.3561 => 0.4001, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3828 => 0.4279, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.45% (0.3886 => 0.4331, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.52% (1.7609 => 1.9110, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.40% (2.2022 => 2.3872, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.50% (0.5925 => 0.6310, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.6030 => 0.6418, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.45% (0.7326 => 0.7725, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.33% (7.0540 => 7.4303, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.4879 => 0.5139, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 4.91% (0.3282 => 0.3443, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.90% (10.4361 => 10.9473, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 4.37% (9.4845 => 9.8993, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (0.7433 => 0.7754, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.28% (0.8172 => 0.8522, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 4.23% (0.2554 => 0.2662, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (5.0018 => 5.2072, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1442, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.88% (0.3121 => 0.3242, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.73% (4.2646 => 4.4238, std. dev.: 0.0114) MultiSource/Applications/sgefa/sgefa: 3.67% (0.3109 => 0.3223, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 3.59% (0.3423 => 0.3546, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.57% (8.1363 => 8.4264, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: 3.48% (0.7835 => 0.8108, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1861 => 1.2246, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.22% (1.3050 => 1.3470, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 3.05% (0.4299 => 0.4430, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.5415 => 1.5884, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 2.97% (5.7591 => 5.9302, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7912, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 2.82% (1.1642 => 1.1970, std. dev.: 0.0097) MultiSource/Applications/treecc/treecc: 2.78% (2.0273 => 2.0837, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6036, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.68% (0.4103 => 0.4213, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.67% (3.3354 => 3.4246, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.63% (0.9765 => 1.0022, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.8067 => 0.8271, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6240, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.2024 => 2.2541, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.31% (3.8723 => 3.9619, std. dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6456 => 0.6604, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8921 => 0.9123, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6450 => 0.6590, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (2.0665 => 2.1102, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6675 => 0.6814, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.4186 => 1.4477, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2842 => 1.3053, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4537, std. dev.: 0.0131) MultiSource/Benchmarks/nbench/nbench: 1.58% (1.1840 => 1.2027, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.08% (1.0722 => 1.0838, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (4.2280 => 4.4069, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7481, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2120, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8328, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5086 => 1.5328, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.55% (9.1159 => 9.2569, std. dev.: 0.0262) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2043, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.31% (1.3045 => 1.3216, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.20% (1.0313 => 1.0437, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.03% (5.2763 => 3.1640, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.78% (5.3855 => 3.7276, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7245, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2349, std. dev.: 0.0492) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.09% (2.9384 => 2.5537, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -11.82% (22.1758 => 19.5554, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -9.71% (1.2373 => 1.1172, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -9.67% (1.5373 => 1.3886, std. dev.: 0.0182) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.85% (19.9488 => 18.5828, std. dev.: 0.0486) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -4.70% (1.9577 => 1.8657, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.17% (8.6802 => 8.4049, std. dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4809, std. dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (8.1563 => 7.9012, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9998, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2015, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3269, std. dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8092, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 18:19:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 20:19:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120806011953.BFF162A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2671?compare_to=2668&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2671, Order: 161310, Start Time: 2012-08-05 22:36:52, End Time: 2012-08-06 01:20:28 To: 2668, Order: 161307, Start Time: 2012-08-05 09:43:09, End Time: 2012-08-05 12:26:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (85 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (794 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.07% (124.5258 => 129.5908, std. dev.: 0.9775) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3460 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3465 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3442 => 0.3883, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3488 => 0.3934, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3643 => 0.4094, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.36% (0.3650 => 0.4101, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.95% (0.3724 => 0.4169, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 6.90% (0.5826 => 0.6228, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.1619 => 0.1730, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.61% (0.5889 => 0.6278, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60% (3.5627 => 3.7622, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.59% (1.3152 => 1.3887, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (0.5026 => 0.5301, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.47% (1.6211 => 1.7097, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.46% (0.5900 => 0.6222, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 5.39% (0.4029 => 0.4246, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.35% (1.5932 => 1.6785, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (0.5000 => 0.5264, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (0.4994 => 0.5256, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (0.4361 => 0.4584, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7171 => 0.7533, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.95% (0.2866 => 0.3008, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.73% (4.2109 => 4.4100, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.42% (0.2736 => 0.2857, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.34% (1.0781 => 1.1249, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (2.7292 => 2.8440, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.13% (0.2566 => 0.2672, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (1.9694 => 2.0505, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (0.4658 => 0.4844, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.94% (0.9909 => 1.0299, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.85% (5.5417 => 5.7552, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.79% (0.4139 => 0.4296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.78% (0.3890 => 0.4037, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.76% (0.2875 => 0.2983, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (1.9966 => 2.0699, std. dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 3.67% (2.1013 => 2.1784, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3195 => 0.3307, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (1.8794 => 1.9448, std. dev.: 0.0070) MultiSource/Applications/hbd/hbd: 3.38% (0.9697 => 1.0025, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 3.33% (0.3004 => 0.3104, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.32% (2.0673 => 2.1359, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 3.32% (2.1653 => 2.2371, std. dev.: 0.0093) MultiSource/Applications/treecc/treecc: 3.28% (0.7875 => 0.8133, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.25% (4.6177 => 4.7676, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/wc: 3.23% (0.3096 => 0.3196, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.3903 => 0.4024, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (4.4195 => 4.5564, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.94% (1.4269 => 1.4688, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.92% (0.6634 => 0.6828, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.3625 => 0.3727, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.78% (23.5202 => 24.1742, std. dev.: 0.0135) MultiSource/Applications/Burg/burg: 2.78% (0.5546 => 0.5700, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.71% (0.3726 => 0.3827, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.4146 => 0.4248, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (0.4251 => 0.4351, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.5012 => 0.5115, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.6435 => 0.6554, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.46% (2.0346 => 2.0643, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.54% (0.2122 => 0.2282, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8951, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7124, std. dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2060, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (41.7953 => 42.6361, std. dev.: 0.0089) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4983, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.56% (11.9555 => 11.7686, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.02% (25.4195 => 16.5184, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/fldry: -9.02% (17.2379 => 15.6826, std. dev.: 0.1450) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7936, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -5.95% (0.2402 => 0.2259, std. dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7910, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.55% (14.0481 => 13.5489, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5792, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9569, std. dev.: 0.0141) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4966, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 21:13:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 23:13:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120806041358.4AF1F2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2672?compare_to=2669&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2672, Order: 161315, Start Time: 2012-08-06 03:00:50, End Time: 2012-08-06 04:14:32 To: 2669, Order: 161310, Start Time: 2012-08-05 22:36:53, End Time: 2012-08-05 23:50:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.58% (2.0176 => 2.3117, std. dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3578 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.50% (0.3601 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.29% (0.3789 => 0.4103, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7061 => 0.7644, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.64% (1.3693 => 1.4739, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (3.9660 => 4.2356, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.79% (0.2782 => 0.2971, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7038 => 0.7513, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.63% (0.7710 => 0.8221, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.54% (0.2690 => 0.2866, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.20% (0.2937 => 0.3119, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.2966 => 0.3142, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3489 => 0.3690, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.73% (0.3580 => 0.3785, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.72% (1.9828 => 2.0963, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.6959 => 0.7347, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.2988 => 0.3152, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (1.2193 => 1.2859, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.22% (0.5577 => 0.5868, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.14% (0.9199 => 0.9672, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3534 => 0.3715, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.12% (16.6129 => 17.4637, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.04% (13.8202 => 14.5170, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3868 => 0.4051, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5554, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.59% (1.4563 => 1.5231, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (1.1364 => 1.1884, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.54% (0.5637 => 0.5893, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (13.2842 => 13.8704, std. dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.35% (3.8646 => 4.0326, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8310 => 0.8671, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.29% (1.1061 => 1.1536, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.7460 => 0.7778, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2814, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3803, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.20% (1.3813 => 1.4393, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.17% (1.9270 => 2.0073, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.15% (1.0594 => 1.1034, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.07% (1.3819 => 1.4381, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.97% (0.3755 => 0.3904, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (3.6692 => 3.8141, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6143, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.3801 => 4.5461, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 3.53% (2.1791 => 2.2561, std. dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.1333 => 1.1728, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.43% (4.9865 => 5.1576, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 3.40% (0.4113 => 0.4253, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.40% (0.4791 => 0.4954, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6135 => 0.6334, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.08% (3.1889 => 3.2872, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7468, std. dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.5754 => 6.7614, std. dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 2.77% (16.2614 => 16.7120, std. dev.: 0.0203) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2604, std. dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 2.66% (14.5298 => 14.9158, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.59% (2.1007 => 2.1552, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.2742 => 3.3583, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5188 => 1.5533, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.18% (4.6629 => 4.7647, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6250 => 0.6352, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.38% (1.0313 => 1.0455, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (6.2785 => 6.3486, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7868, std. dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.40% (5.7573 => 7.5073, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/mandel-2: 8.72% (1.2998 => 1.4131, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.31% (7.4271 => 7.7470, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7058, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9664, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.54% (1.7688 => 1.8137, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.82% (1.5089 => 1.5363, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.05% (1.0310 => 1.0418, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.73% (0.4657 => 0.3971, std. dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.5627 => 21.1322, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.2308 => 1.1058, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.92% (20.3410 => 18.5270, std. dev.: 0.0112) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3739, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3174, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5982, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9538, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2291, std. dev.: 0.0088) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.88% (6.6320 => 6.5070, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2140, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (5.3167 => 5.2450, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.5254 => 2.4920, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8454, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 21:18:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 5 Aug 2012 23:18:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120806041849.98EB72A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2673?compare_to=2670&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2673, Order: 161315, Start Time: 2012-08-06 03:00:56, End Time: 2012-08-06 04:19:25 To: 2670, Order: 161310, Start Time: 2012-08-05 22:36:51, End Time: 2012-08-05 23:55:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (85 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.20% (7.9477 => 8.0433, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.47% (10.3673 => 13.6303, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 12.47% (0.3473 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.17% (1.1194 => 1.2556, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.86% (0.3694 => 0.4132, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.41% (2.2022 => 2.3875, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (1.7609 => 1.9021, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.96% (0.3817 => 0.4121, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.41% (0.5925 => 0.6305, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.37% (0.6030 => 0.6414, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.32% (7.0540 => 7.4293, std. dev.: 0.0140) SingleSource/UnitTests/ObjC++/property-reference: 5.26% (0.7326 => 0.7711, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.4879 => 0.5128, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 4.88% (0.3282 => 0.3442, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.83% (10.4361 => 10.9400, std. dev.: 0.0097) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.2554 => 0.2667, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.38% (9.4845 => 9.8999, std. dev.: 0.0133) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.8172 => 0.8527, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.7433 => 0.7752, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (5.0018 => 5.2035, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1443, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.97% (0.5569 => 0.5790, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (4.2646 => 4.4291, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.79% (0.5860 => 0.6082, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.69% (0.3092 => 0.3206, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.63% (0.3109 => 0.3222, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.57% (8.1363 => 8.4264, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 3.52% (0.7835 => 0.8111, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1861 => 1.2241, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4299 => 0.4435, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.3050 => 1.3460, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.08% (2.0273 => 2.0897, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7995, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.01% (1.1642 => 1.1992, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.99% (5.7591 => 5.9314, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.93% (1.5415 => 1.5867, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.91% (0.8067 => 0.8302, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.74% (0.5105 => 0.5245, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.69% (3.3354 => 3.4250, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.67% (0.4636 => 0.4760, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.66% (1.5603 => 1.6018, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.65% (0.9765 => 1.0024, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.48% (3.8723 => 3.9682, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5859 => 1.6234, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.2024 => 2.2534, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.4186 => 1.4486, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.09% (0.6456 => 0.6591, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.07% (0.6675 => 0.6813, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.01% (0.8921 => 0.9100, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (2.0665 => 2.1057, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.65% (2.2969 => 2.3349, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.65% (1.1840 => 1.2035, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.62% (17.1811 => 17.4601, std. dev.: 0.0077) MultiSource/Applications/minisat/minisat: 1.50% (0.7115 => 0.7222, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.19% (1.0722 => 1.0850, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (4.2280 => 4.3993, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7596, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2112, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.60% (11.6436 => 11.8304, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5312, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2507, std. dev.: 0.0327) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.00% (2.8904 => 2.9194, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.99% (5.2763 => 3.1665, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.01% (5.3855 => 3.7152, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7118, std. dev.: 0.0085) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1711, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.39% (2.9384 => 2.5450, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -11.84% (22.1758 => 19.5509, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2373 => 1.1107, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -8.68% (1.5373 => 1.4038, std. dev.: 0.0196) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.42% (19.9488 => 18.4688, std. dev.: 0.0570) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -4.69% (1.9577 => 1.8659, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4761, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9050, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4160, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0019, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.33% (0.4808 => 0.4696, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2001, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3194, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.06% (1.7254 => 1.7071, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 22:44:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 00:44:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120806054408.2F93A2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2674?compare_to=2671&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2674, Order: 161315, Start Time: 2012-08-06 03:01:05, End Time: 2012-08-06 05:44:42 To: 2671, Order: 161310, Start Time: 2012-08-05 22:36:52, End Time: 2012-08-06 01:20:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (81 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (797 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 26.27% (0.3792 => 0.4788, std. dev.: 0.0219) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3442 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.91% (0.3446 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3465 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3460 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.79% (0.3496 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3488 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3643 => 0.4094, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 12.25% (0.3650 => 0.4097, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.95% (0.3724 => 0.4169, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5826 => 0.6231, std. dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 6.67% (0.5889 => 0.6282, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.75% (3.5627 => 3.7675, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (1.6211 => 1.7122, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (0.5026 => 0.5308, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.49% (1.3152 => 1.3874, std. dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 5.37% (1.5932 => 1.6787, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.35% (0.4994 => 0.5261, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.12% (0.7171 => 0.7538, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (0.3930 => 0.4129, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.04% (0.4361 => 0.4581, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.02% (0.5000 => 0.5251, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.01% (0.4029 => 0.4231, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.2866 => 0.3007, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.64% (4.2109 => 4.4061, std. dev.: 0.0090) MultiSource/Applications/d/make_dparser: 4.42% (1.0781 => 1.1258, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (2.7292 => 2.8473, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (1.9694 => 2.0485, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (1.9966 => 2.0733, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.72% (0.2875 => 0.2982, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.67% (2.1013 => 2.1785, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 3.63% (5.5417 => 5.7426, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (0.4658 => 0.4825, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (0.3890 => 0.4029, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.56% (0.9909 => 1.0262, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3195 => 0.3307, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.43% (0.3004 => 0.3107, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.41% (4.6177 => 4.7753, std. dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (2.1653 => 2.2374, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 3.26% (0.3096 => 0.3197, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.24% (0.4139 => 0.4273, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.21% (2.0673 => 2.1337, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 3.21% (1.8794 => 1.9397, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 3.21% (0.9697 => 1.0008, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.3903 => 0.4026, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.12% (0.7875 => 0.8121, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (4.4195 => 4.5562, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.95% (1.4269 => 1.4690, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.83% (0.3678 => 0.3782, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.3625 => 0.3725, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 2.68% (0.3726 => 0.3826, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.65% (23.5202 => 24.1437, std. dev.: 0.0126) MultiSource/Applications/siod/siod: 2.59% (0.6634 => 0.6806, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.52% (0.5546 => 0.5686, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.6435 => 0.6568, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.37% (2.0346 => 2.0625, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6738, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1646, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6877, std. dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2091, std. dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (41.7953 => 42.6431, std. dev.: 0.0111) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4930, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2225, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5148, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.07% (6.9842 => 7.0591, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.59% (11.9555 => 11.7657, std. dev.: 0.0089) SingleSource/UnitTests/Vector/constpool: -1.30% (2.4764 => 2.4442, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.08% (25.4195 => 16.5033, std. dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -8.37% (17.2379 => 15.7948, std. dev.: 0.0303) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7940, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7942, std. dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/dry: -3.62% (14.0481 => 13.5391, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9584, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 22:55:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 00:55:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120806055537.9B4D92A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2675?compare_to=2672&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2675, Order: 161317, Start Time: 2012-08-06 04:42:29, End Time: 2012-08-06 05:56:11 To: 2672, Order: 161315, Start Time: 2012-08-06 03:00:50, End Time: 2012-08-06 04:14:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5818 => 0.6373, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.43% (0.5748 => 0.6290, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.03% (0.3578 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.89% (0.3646 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3623 => 0.3937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.66% (0.3650 => 0.3966, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3789 => 0.4113, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.53% (0.7061 => 0.7663, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions: 8.46% (0.3914 => 0.4245, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.20% (0.3940 => 0.4263, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.70% (0.1819 => 0.1959, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 7.27% (1.3693 => 1.4689, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2782 => 0.2966, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (3.9660 => 4.2269, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.45% (0.7710 => 0.8207, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.40% (0.5265 => 0.5602, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.31% (0.7038 => 0.7482, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2760 => 0.2934, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.26% (0.2765 => 0.2938, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4062 => 0.4313, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2655 => 0.2814, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.83% (1.9828 => 2.0983, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2696 => 0.2852, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.3107 => 0.3284, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.68% (0.3485 => 0.3683, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.65% (0.3149 => 0.3327, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.31% (1.2193 => 1.2841, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.30% (0.6959 => 0.7328, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.17% (0.9199 => 0.9675, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.07% (0.3293 => 0.3460, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.02% (0.5577 => 0.5857, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.87% (13.8202 => 14.4935, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 4.87% (16.6129 => 17.4220, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.3756 => 0.3937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.76% (0.3868 => 0.4052, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.60% (0.2914 => 0.3048, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.50% (1.4563 => 1.5218, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.42% (7.2180 => 7.5373, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3246 => 0.3389, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.37% (1.1364 => 1.1861, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.35% (13.2842 => 13.8617, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.33% (0.7460 => 0.7783, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.25% (0.8310 => 0.8663, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 4.20% (0.7506 => 0.7821, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 4.19% (1.2292 => 1.2807, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.16% (1.3819 => 1.4394, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.3813 => 1.4385, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.12% (3.8646 => 4.0240, std. dev.: 0.0102) MultiSource/Applications/Burg/burg: 4.10% (1.1061 => 1.1515, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.06% (1.9270 => 2.0052, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.03% (1.3245 => 1.3779, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.99% (1.0594 => 1.1017, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8085, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.76% (4.4433 => 4.6105, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.75% (0.3755 => 0.3896, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.66% (4.3801 => 4.5404, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (4.9865 => 5.1568, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4791 => 0.4949, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1333 => 1.1706, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 3.20% (2.1791 => 2.2489, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.02% (0.6283 => 0.6473, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.01% (3.1889 => 3.2850, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.95% (0.8698 => 0.8955, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.87% (8.4961 => 8.7402, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.82% (0.6135 => 0.6308, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4113 => 0.4228, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.73% (4.6629 => 4.7901, std. dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.5754 => 6.7463, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.56% (16.2614 => 16.6775, std. dev.: 0.0115) MultiSource/Applications/ClamAV/clamscan: 2.49% (14.5298 => 14.8913, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.48% (3.2742 => 3.3554, std. dev.: 0.0140) MultiSource/Applications/JM/lencod/lencod: 2.47% (14.8535 => 15.2200, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1525, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (1.5188 => 1.5500, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 1.79% (0.6250 => 0.6362, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (0.9108 => 0.9238, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.17% (1.0313 => 1.0434, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.41% (5.7573 => 7.5082, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 25.46% (1.8175 => 2.2802, std. dev.: 0.0335) SingleSource/Benchmarks/Misc/mandel-2: 6.99% (1.2998 => 1.3907, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.41% (0.9996 => 1.0537, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7532, std. dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7083, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (2.8606 => 2.9656, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.70% (1.5089 => 1.5345, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5076, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0407, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.19% (1.0310 => 1.0433, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.08% (10.7476 => 10.8636, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1390, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1398, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8630, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2308 => 1.0913, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.88% (20.3410 => 18.5346, std. dev.: 0.0675) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3071, std. dev.: 0.0096) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.94% (1.9762 => 1.9181, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5878, std. dev.: 0.0218) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9555, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2193, std. dev.: 0.0173) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5048, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2124, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4923, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8693, std. dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2530, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8473, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 5 23:05:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 01:05:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120806060518.D12EF2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2676?compare_to=2673&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2676, Order: 161317, Start Time: 2012-08-06 04:47:29, End Time: 2012-08-06 06:05:54 To: 2673, Order: 161315, Start Time: 2012-08-06 03:00:56, End Time: 2012-08-06 04:19:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (80 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.97% (1.4038 => 1.4455, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.66% (55.5878 => 56.5079, std. dev.: 0.0944) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.37% (13.6303 => 13.4435, std. dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.67% (10.3673 => 13.4435, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3497 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.02% (0.3543 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3561 => 0.3989, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.98% (1.1194 => 1.2535, std. dev.: 0.0090) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.78% (1.7609 => 1.8979, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.76% (2.2022 => 2.3731, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.35% (0.6030 => 0.6413, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.99% (0.5925 => 0.6280, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 5.04% (10.4361 => 10.9617, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference: 4.98% (0.7326 => 0.7691, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.85% (7.0540 => 7.3963, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.30% (0.8172 => 0.8523, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.97% (9.4845 => 9.8613, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.9449 => 5.1355, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.7433 => 0.7718, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (5.0018 => 5.1909, std. dev.: 0.0117) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (0.3121 => 0.3235, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5860 => 0.6070, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (4.2646 => 4.4151, std. dev.: 0.0103) MultiSource/Applications/spiff/spiff: 3.43% (0.7835 => 0.8104, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.1363 => 8.4107, std. dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9371, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7997, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1861 => 1.2218, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (1.3050 => 1.3436, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 2.81% (0.4299 => 0.4420, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.61% (2.0273 => 2.0802, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5803, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.49% (3.3354 => 3.4185, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.45% (1.5603 => 1.5985, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.40% (0.8067 => 0.8261, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9765 => 0.9985, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.23% (3.8723 => 3.9586, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.14% (0.5105 => 0.5214, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (1.5859 => 1.6184, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.99% (2.0665 => 2.1076, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.2024 => 2.2448, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.8921 => 0.9077, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.74% (0.6450 => 0.6562, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.4186 => 1.4432, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.45% (1.2842 => 1.3028, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.44% (17.1811 => 17.4287, std. dev.: 0.0208) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1840 => 1.1983, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.21% (2.2969 => 2.3246, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.87% (4.2280 => 4.3916, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 1.78% (3.1578 => 3.2140, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.66% (11.6436 => 11.8365, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (1.5086 => 1.5326, std. dev.: 0.0016) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2383, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1603, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7072, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7040, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0480, std. dev.: 0.0863) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5432, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: -12.16% (22.1758 => 19.4801, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -10.50% (1.2373 => 1.1074, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.38% (19.9488 => 18.4773, std. dev.: 0.0747) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -5.97% (1.5373 => 1.4455, std. dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/fldry: -5.05% (1.9577 => 1.8588, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4774, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9017, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4277, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0005, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.29% (0.4808 => 0.4698, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2016, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3142, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4180, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8080, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 01:14:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 03:14:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120806081400.2DD292A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2677?compare_to=2675&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2677, Order: 161318, Start Time: 2012-08-06 06:58:47, End Time: 2012-08-06 08:14:33 To: 2675, Order: 161317, Start Time: 2012-08-06 04:42:29, End Time: 2012-08-06 05:56:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (112 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.42% (1.0913 => 1.1068, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.96% (2.0176 => 2.3195, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.83% (0.3578 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3601 => 0.3913, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3646 => 0.3960, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.57% (0.3663 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3789 => 0.4113, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.50% (0.3623 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.29% (0.4003 => 0.4335, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 8.10% (0.3940 => 0.4259, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7061 => 0.7631, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.51% (1.3693 => 1.4721, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.28% (0.7710 => 0.8271, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (3.9660 => 4.2351, std. dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 6.65% (0.7038 => 0.7506, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.62% (0.2781 => 0.2965, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.53% (1.9828 => 2.0925, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.50% (0.3580 => 0.3777, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (1.2193 => 1.2850, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.2988 => 0.3149, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.24% (0.9199 => 0.9681, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.22% (16.6129 => 17.4802, std. dev.: 0.1862) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 5.02% (13.8202 => 14.5135, std. dev.: 0.0107) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.65% (7.2180 => 7.5538, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.64% (1.4563 => 1.5238, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.54% (1.1364 => 1.1880, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.49% (0.7506 => 0.7843, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.48% (1.3245 => 1.3839, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (3.8646 => 4.0370, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.7460 => 0.7788, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.39% (1.1061 => 1.1547, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8659, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/football/football: 4.33% (0.8310 => 0.8670, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.3819 => 1.4413, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0087, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.3813 => 1.4383, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.11% (1.0594 => 1.1029, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (3.6692 => 3.8168, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 3.98% (1.2292 => 1.2781, std. dev.: 0.0125) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (4.4433 => 4.6125, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (4.3801 => 4.5438, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 3.60% (2.1791 => 2.2576, std. dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.45% (1.1333 => 1.1724, std. dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.11% (3.1889 => 3.2882, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (6.5754 => 6.7694, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7464, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6135 => 0.6313, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.88% (4.6629 => 4.7972, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 2.69% (14.8535 => 15.2535, std. dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: 2.66% (16.2614 => 16.6938, std. dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9112, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (0.9108 => 0.9238, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.28% (1.0313 => 1.0445, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.02% (3.7467 => 3.7850, std. dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.02% (6.2785 => 6.3424, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5108, std. dev.: 0.0688) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2648, std. dev.: 0.0461) SingleSource/Benchmarks/Misc/mandel-2: 7.74% (1.2998 => 1.4004, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7509, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 3.97% (11.2619 => 11.7093, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.90% (1.4298 => 1.4569, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9580, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5085, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.10% (10.7476 => 10.8656, std. dev.: 0.0186) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1390, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1234, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1068, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.18% (20.3410 => 18.4745, std. dev.: 0.0821) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.12% (0.3139 => 0.2947, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.50% (1.3780 => 1.3160, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6021, std. dev.: 0.0189) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9532, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2233, std. dev.: 0.0184) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5081, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2159, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.44% (9.3358 => 9.2016, std. dev.: 0.0460) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4917, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2480, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 01:19:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 03:19:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120806081912.EBE7D2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2678?compare_to=2676&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2678, Order: 161318, Start Time: 2012-08-06 06:58:53, End Time: 2012-08-06 08:19:48 To: 2676, Order: 161317, Start Time: 2012-08-06 04:47:29, End Time: 2012-08-06 06:05:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (79 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1983 => 1.2149, std. dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (13.4435 => 13.6180, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.96% (56.5079 => 54.8332, std. dev.: 0.1201) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.36% (10.3673 => 13.6180, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std. dev.: 0.0113) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.05% (0.3543 => 0.3970, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3497 => 0.3918, std. dev.: 0.0088) SingleSource/UnitTests/ObjC/for-in: 11.97% (0.3694 => 0.4136, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3561 => 0.3987, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.49% (0.3828 => 0.4268, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.67% (2.2022 => 2.3932, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.48% (1.7609 => 1.9103, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1584 => 0.1700, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.03% (0.5925 => 0.6282, std. dev.: 0.0086) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference: 5.95% (0.7326 => 0.7762, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.49% (0.4879 => 0.5147, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (7.0540 => 7.4277, std. dev.: 0.0176) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (10.4361 => 10.9829, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.12% (0.5569 => 0.5854, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.8172 => 0.8568, std. dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7433 => 0.7772, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2554 => 0.2669, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.39% (0.3121 => 0.3258, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 4.27% (9.4845 => 9.8891, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.16% (0.5860 => 0.6104, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (4.9449 => 5.1498, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (5.0018 => 5.2001, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/bh/bh: 3.91% (0.3092 => 0.3213, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.84% (4.2646 => 4.4284, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.73% (0.4103 => 0.4256, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.67% (5.7591 => 5.9702, std. dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 3.63% (0.3109 => 0.3222, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1861 => 1.2283, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (8.1363 => 8.4231, std. dev.: 0.0133) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 3.47% (0.4299 => 0.4448, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.34% (2.0273 => 2.0951, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.8067 => 0.8328, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.18% (1.3050 => 1.3465, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 3.06% (3.3354 => 3.4375, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.06% (1.5603 => 1.6080, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.04% (14.3668 => 14.8038, std. dev.: 0.0249) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.89% (1.5415 => 1.5860, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 2.84% (1.1642 => 1.1973, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.84% (1.4186 => 1.4589, std. dev.: 0.0063) MultiSource/Applications/lua/lua: 2.74% (3.8723 => 3.9784, std. dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 2.61% (1.1840 => 1.2149, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.28% (0.6450 => 0.6597, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9765 => 0.9985, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.19% (2.0665 => 2.1118, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.09% (17.1811 => 17.5398, std. dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5981 => 0.6104, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.88% (1.2842 => 1.3083, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 1.82% (0.8921 => 0.9083, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 1.73% (2.2969 => 2.3366, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: 1.70% (0.7115 => 0.7236, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.23% (1.0722 => 1.0854, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0287) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.18% (4.2280 => 4.4046, std. dev.: 0.0243) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7461, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0093) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5086 => 1.5336, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8340, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2275, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.90% (5.2763 => 3.1709, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.95% (5.3855 => 3.7186, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.63% (5.3526 => 3.7131, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1405, std. dev.: 0.0362) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.07% (2.9384 => 2.5543, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -11.85% (22.1758 => 19.5487, std. dev.: 0.0342) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: -9.63% (1.5373 => 1.3892, std. dev.: 0.0250) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.44% (19.9488 => 18.4644, std. dev.: 0.0841) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.78% (1.9577 => 1.8641, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4858, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9024, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4163, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.75% (1.3677 => 1.3301, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0047, std. dev.: 0.0156) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4808 => 0.4702, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.16% (12.4730 => 12.2030, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6780, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3251, std. dev.: 0.0349) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4180, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 01:57:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 03:57:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120806085735.D3D682A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2679?compare_to=2674&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2679, Order: 161317, Start Time: 2012-08-06 06:12:43, End Time: 2012-08-06 08:58:09 To: 2674, Order: 161315, Start Time: 2012-08-06 03:01:05, End Time: 2012-08-06 05:44:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (73 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (807 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.42% (1.6787 => 1.7025, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.62% (2.0432 => 2.0967, std. dev.: 0.0166) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.19% (0.3488 => 0.3948, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3442 => 0.3882, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3465 => 0.3906, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 12.59% (0.3446 => 0.3880, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 12.48% (0.3469 => 0.3902, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3643 => 0.4087, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 12.05% (0.3650 => 0.4090, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.86% (1.5932 => 1.7025, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 6.85% (0.5826 => 0.6225, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 6.55% (0.5889 => 0.6275, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (0.5900 => 0.6257, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (3.5627 => 3.7692, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.69% (1.6211 => 1.7133, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.57% (0.4361 => 0.4604, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (0.4994 => 0.5271, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.48% (0.5000 => 0.5274, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (1.3152 => 1.3867, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.27% (0.2866 => 0.3017, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.11% (4.2109 => 4.4262, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (0.5026 => 0.5279, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.82% (0.4029 => 0.4223, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 4.59% (1.0781 => 1.1276, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.31% (0.2736 => 0.2854, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (2.7292 => 2.8441, std. dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (0.3890 => 0.4042, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (1.9966 => 2.0745, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.79% (0.2875 => 0.2984, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (1.9694 => 2.0433, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.61% (0.4658 => 0.4826, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (4.4195 => 4.5759, std. dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 3.49% (5.5417 => 5.7353, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 3.40% (2.1653 => 2.2389, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 3.39% (4.6177 => 4.7742, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (2.0673 => 2.1353, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (1.8794 => 1.9408, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.22% (0.3195 => 0.3298, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.18% (0.3903 => 0.4027, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.17% (0.4139 => 0.4270, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.11% (0.7875 => 0.8120, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.04% (0.4146 => 0.4272, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.87% (1.4269 => 1.4678, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.78% (0.5546 => 0.5700, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 2.74% (0.6634 => 0.6816, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.73% (2.0346 => 2.0697, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (0.6435 => 0.6537, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6715, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1738, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6869, std. dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (41.7953 => 42.6541, std. dev.: 0.3306) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std. dev.: 0.0055) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4969, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5912, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.27% (1.0927 => 1.1066, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.08% (6.9842 => 7.0598, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.51% (11.9555 => 11.7749, std. dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.04% (25.4195 => 16.5115, std. dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/ary2: -10.16% (0.2402 => 0.2158, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -8.71% (17.2379 => 15.7364, std. dev.: 0.0537) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8106, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5426, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5775, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9648, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 02:56:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 04:56:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120806095659.01C602A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2680?compare_to=2677&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2680, Order: 161319, Start Time: 2012-08-06 08:42:50, End Time: 2012-08-06 09:56:53 To: 2677, Order: 161318, Start Time: 2012-08-06 06:58:47, End Time: 2012-08-06 08:14:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.07% (55.4167 => 56.5664, std. dev.: 0.0833) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.03% (2.0176 => 2.3208, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.5818 => 0.6356, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7061 => 0.7710, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.94% (0.3578 => 0.3898, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.72% (0.3646 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.71% (0.3650 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.60% (0.3663 => 0.3978, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 8.58% (0.3789 => 0.4114, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3623 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3914 => 0.4246, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.34% (0.4003 => 0.4337, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.69% (0.7710 => 0.8303, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.42% (0.1819 => 0.1954, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5265 => 0.5645, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.07% (1.3693 => 1.4661, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.03% (3.9660 => 4.2449, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.58% (0.7038 => 0.7501, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.14% (0.4379 => 0.4648, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.14% (0.6959 => 0.7386, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.07% (0.2782 => 0.2951, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.76% (0.5577 => 0.5898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.61% (1.2193 => 1.2877, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.39% (0.9199 => 0.9695, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.39% (0.2765 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.31% (1.9828 => 2.0880, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.28% (0.4390 => 0.4622, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.3580 => 0.3768, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.17% (16.6129 => 17.4725, std. dev.: 0.0104) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.17% (13.8202 => 14.5348, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 5.12% (0.3107 => 0.3266, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3149 => 0.3308, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 5.02% (0.2988 => 0.3138, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.4563 => 1.5266, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.79% (1.1061 => 1.1591, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (7.2180 => 7.5608, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.74% (0.5637 => 0.5904, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.73% (0.7506 => 0.7861, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.59% (1.1364 => 1.1886, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.57% (3.8646 => 4.0414, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.56% (0.4016 => 0.4199, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.53% (1.3813 => 1.4439, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3246 => 0.3393, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.3756 => 0.3926, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.44% (0.7460 => 0.7791, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.44% (1.3819 => 1.4432, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (13.2842 => 13.8693, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.35% (1.3245 => 1.3821, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.33% (1.0594 => 1.1053, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.27% (1.9270 => 2.0093, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.21% (3.6692 => 3.8235, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2945 => 0.3062, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (4.4433 => 4.6198, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.3801 => 4.5538, std. dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.88% (2.1791 => 2.2636, std. dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 3.87% (1.2292 => 1.2768, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (0.4791 => 0.4965, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (4.9865 => 5.1664, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.59% (1.1333 => 1.1740, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 3.48% (0.4113 => 0.4256, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.31% (0.6135 => 0.6338, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.25% (0.6283 => 0.6487, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.22% (8.4961 => 8.7694, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.04% (3.1889 => 3.2857, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 2.97% (6.5754 => 6.7705, std. dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.95% (0.8698 => 0.8955, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.94% (3.2742 => 3.3705, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.90% (14.8535 => 15.2845, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.80% (2.1007 => 2.1595, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.65% (14.5298 => 14.9154, std. dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 2.64% (16.2614 => 16.6913, std. dev.: 0.0137) MultiSource/Applications/oggenc/oggenc: 2.60% (4.6629 => 4.7842, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (1.5188 => 1.5570, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.9108 => 0.9265, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.42% (1.0313 => 1.0459, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.27% (6.2785 => 6.3582, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 1.18% (3.7467 => 3.7910, std. dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 1.08% (33.2944 => 33.6553, std. dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5158, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/mandel-2: 7.48% (1.2998 => 1.3970, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7554, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7034, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (2.8606 => 2.9657, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.58% (1.7688 => 1.8144, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5943, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0310 => 1.0439, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.25% (10.7476 => 10.8816, std. dev.: 0.0339) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1404, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.5627 => 21.1374, std. dev.: 0.0288) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.11% (1.2308 => 1.1064, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.97% (20.3410 => 18.5170, std. dev.: 0.0156) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9194, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5734, std. dev.: 0.0157) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9522, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2304, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2138, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2201, std. dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2539, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 03:06:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 05:06:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120806100620.1EDAD2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2681?compare_to=2678&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2681, Order: 161319, Start Time: 2012-08-06 08:48:11, End Time: 2012-08-06 10:06:55 To: 2678, Order: 161318, Start Time: 2012-08-06 06:58:53, End Time: 2012-08-06 08:19:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (84 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.78% (78.9659 => 80.3687, std. dev.: 0.1997) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.38% (13.6180 => 13.4301, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: -1.23% (1.2149 => 1.2000, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.54% (10.3673 => 13.4301, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3473 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.31% (0.3543 => 0.3979, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.91% (1.1194 => 1.2527, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.18% (0.3927 => 0.4366, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.36% (2.2022 => 2.3863, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.97% (1.7609 => 1.9012, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.82% (0.5925 => 0.6329, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.72% (0.6030 => 0.6435, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 6.20% (0.7326 => 0.7780, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.53% (0.8172 => 0.8624, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.08% (0.4879 => 0.5127, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.03% (7.0540 => 7.4089, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.00% (10.4361 => 10.9583, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (0.7433 => 0.7751, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (9.4845 => 9.8845, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3121 => 0.3250, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (5.0018 => 5.2016, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1381, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 3.84% (0.7835 => 0.8136, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.65% (1.5603 => 1.6172, std. dev.: 0.0115) MultiSource/Benchmarks/McCat/18-imp/imp: 3.59% (0.3423 => 0.3546, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (4.2646 => 4.4150, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.50% (8.1363 => 8.4212, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.28% (5.7591 => 5.9482, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4636 => 0.4785, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1861 => 1.2234, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.08% (0.3826 => 0.3944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.3050 => 1.3443, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7955, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.88% (1.5415 => 1.5859, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.88% (0.4103 => 0.4221, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.83% (3.3354 => 3.4299, std. dev.: 0.0126) MultiSource/Applications/lua/lua: 2.77% (3.8723 => 3.9797, std. dev.: 0.0072) MultiSource/Applications/treecc/treecc: 2.68% (2.0273 => 2.0817, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.62% (2.0665 => 2.1207, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.55% (1.1642 => 1.1939, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 2.47% (0.4299 => 0.4405, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.40% (0.8067 => 0.8261, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 2.40% (0.4289 => 0.4392, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6456 => 0.6604, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.2024 => 2.2519, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9765 => 0.9979, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.14% (0.5105 => 0.5214, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.05% (1.2842 => 1.3105, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.97% (17.1811 => 17.5198, std. dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6675 => 0.6801, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4452, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.80% (0.6450 => 0.6566, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.60% (0.8921 => 0.9064, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.35% (1.1840 => 1.2000, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 1.31% (2.2969 => 2.3269, std. dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.4002, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7562, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (1.5086 => 1.5344, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2111, std. dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8306, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2274, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.95% (5.2763 => 3.1686, std. dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7126, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.73% (5.3526 => 3.7076, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1606, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5520, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -12.00% (22.1758 => 19.5141, std. dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -9.72% (1.2373 => 1.1170, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -7.80% (1.5373 => 1.4174, std. dev.: 0.0184) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5543, std. dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.64% (1.9577 => 1.8669, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.46% (1.5835 => 1.5128, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4909, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (8.1563 => 7.9014, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9992, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.6802 => 8.4411, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.35% (0.4808 => 0.4695, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2008, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3239, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4176, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 05:09:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 07:09:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120806120914.3954E2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2682?compare_to=2679&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2682, Order: 161319, Start Time: 2012-08-06 09:26:20, End Time: 2012-08-06 12:09:50 To: 2679, Order: 161317, Start Time: 2012-08-06 06:12:43, End Time: 2012-08-06 08:58:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (87 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (792 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.38% (0.2086 => 0.2240, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.42% (126.2530 => 129.3092, std. dev.: 0.8947) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3446 => 0.3899, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.02% (0.3488 => 0.3942, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3442 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3465 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3460 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.77% (0.3469 => 0.3912, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.46% (0.3643 => 0.4097, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.24% (0.3724 => 0.4180, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.21% (0.5826 => 0.6246, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.15% (1.5932 => 1.7071, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5889 => 0.6300, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.26% (3.5627 => 3.7856, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.20% (1.3152 => 1.3967, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (1.6211 => 1.7204, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.05% (0.5900 => 0.6257, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (0.4361 => 0.4622, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (0.5026 => 0.5323, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.81% (0.4994 => 0.5284, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (0.5000 => 0.5285, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.49% (0.7171 => 0.7565, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 5.36% (0.4029 => 0.4245, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.33% (4.2109 => 4.4353, std. dev.: 0.0076) MultiSource/Applications/d/make_dparser: 5.26% (1.0781 => 1.1348, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.81% (2.7292 => 2.8604, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.2736 => 0.2867, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.50% (5.5417 => 5.7910, std. dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 4.46% (2.1013 => 2.1951, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.44% (1.9694 => 2.0568, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (0.3890 => 0.4059, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.29% (1.9966 => 2.0823, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.23% (0.4658 => 0.4855, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.07% (4.6177 => 4.8056, std. dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 4.02% (2.1653 => 2.2524, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.93% (4.4195 => 4.5933, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 3.85% (1.8794 => 1.9517, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.82% (0.3903 => 0.4052, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.71% (0.7875 => 0.8167, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.4139 => 0.4289, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.61% (0.9909 => 1.0267, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.45% (23.5202 => 24.3314, std. dev.: 0.0122) MultiSource/Applications/siod/siod: 3.44% (0.6634 => 0.6862, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3195 => 0.3304, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.29% (1.4269 => 1.4739, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (2.0673 => 2.1343, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.21% (0.3271 => 0.3376, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.17% (0.5546 => 0.5722, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.15% (0.3362 => 0.3468, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3625 => 0.3738, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.3678 => 0.3786, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.92% (0.9697 => 0.9980, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 2.87% (0.3726 => 0.3833, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4146 => 0.4259, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4251 => 0.4364, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.28% (2.0346 => 2.0810, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.6435 => 0.6572, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (0.4847 => 0.4949, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.5012 => 0.5116, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.40% (11.6398 => 11.8027, std. dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.91% (2.5769 => 2.9610, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6769, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6542, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2107, std. dev.: 0.0551) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4950, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2250, std. dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4658, std. dev.: 0.0847) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.04% (6.9842 => 7.0566, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.05% (11.9555 => 11.8304, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.06% (25.4195 => 16.5081, std. dev.: 0.0230) SingleSource/Benchmarks/Dhrystone/fldry: -8.70% (17.2379 => 15.7378, std. dev.: 0.2131) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7933, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary2: -7.41% (0.2402 => 0.2224, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7958, std. dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -3.55% (14.0481 => 13.5495, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9547, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: -1.42% (5.5810 => 5.5017, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 11:20:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 13:20:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120806182017.86C352A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2683?compare_to=2680&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2683, Order: 161324, Start Time: 2012-08-06 17:06:53, End Time: 2012-08-06 18:20:52 To: 2680, Order: 161319, Start Time: 2012-08-06 08:42:50, End Time: 2012-08-06 09:56:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.73% (28.2509 => 29.5863, std. dev.: 0.1598) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.06% (2.0176 => 2.3215, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7061 => 0.7730, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.46% (0.5748 => 0.6292, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3646 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3914 => 0.4261, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.81% (0.3789 => 0.4123, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.77% (0.7710 => 0.8309, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.64% (0.1819 => 0.1958, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.19% (1.3693 => 1.4677, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (3.9660 => 4.2481, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.76% (0.7038 => 0.7514, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2782 => 0.2966, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0056) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.14% (0.4379 => 0.4648, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.86% (0.2765 => 0.2927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.3899 => 0.4125, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2696 => 0.2851, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.55% (1.2193 => 1.2870, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3485 => 0.3677, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.9828 => 2.0902, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.9199 => 0.9689, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.26% (13.8202 => 14.5472, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.22% (0.5577 => 0.5868, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 5.22% (0.2243 => 0.2360, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.19% (16.6129 => 17.4752, std. dev.: 0.0185) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.3192 => 0.3355, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.08% (0.2127 => 0.2235, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.84% (7.2180 => 7.5670, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.79% (1.4563 => 1.5261, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.67% (1.1364 => 1.1895, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.65% (0.7506 => 0.7855, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.60% (1.1061 => 1.1570, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (3.8646 => 4.0417, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3246 => 0.3394, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.3868 => 0.4042, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.50% (13.2842 => 13.8817, std. dev.: 0.0127) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7460 => 0.7793, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.45% (0.8310 => 0.8680, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (1.3245 => 1.3831, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.3813 => 1.4420, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.0594 => 1.1052, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.31% (1.9270 => 2.0100, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.19% (1.3819 => 1.4398, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6243, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.07% (1.2292 => 1.2792, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.06% (0.8698 => 0.9051, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.06% (3.6692 => 3.8180, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5512, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 3.87% (2.1791 => 2.2634, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1333 => 1.1750, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.67% (0.4113 => 0.4264, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.61% (0.4791 => 0.4964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.52% (4.9865 => 5.1622, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (8.4961 => 8.7815, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.21% (0.6135 => 0.6332, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.15% (3.1889 => 3.2893, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.08% (6.5754 => 6.7781, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.05% (3.2742 => 3.3741, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (2.1007 => 2.1613, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2763, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 2.74% (16.2614 => 16.7068, std. dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 2.55% (4.6629 => 4.7817, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.5298 => 14.8999, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5567, std. dev.: 0.0070) MultiSource/Applications/lua/lua: 1.44% (3.7467 => 3.8005, std. dev.: 0.0092) MultiSource/Applications/lemon/lemon: 1.42% (1.0313 => 1.0459, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (6.2785 => 6.3626, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5211, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0456) SingleSource/Benchmarks/Misc/mandel-2: 7.86% (1.2998 => 1.4020, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (0.9996 => 1.0505, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7556, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7070, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.56% (1.7688 => 1.8140, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9573, std. dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.08% (10.7476 => 10.8636, std. dev.: 0.0441) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1392, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.45% (0.4657 => 0.4124, std. dev.: 0.0163) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1597, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.6576 => 0.6473, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.2308 => 1.1039, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.96% (20.3410 => 18.5188, std. dev.: 0.0519) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5803, std. dev.: 0.0155) MultiSource/Applications/spiff/spiff: -2.35% (3.0263 => 2.9553, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.19% (6.3560 => 6.2167, std. dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.6320 => 6.5122, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3305 => 7.2079, std. dev.: 0.0218) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4924, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2489, std. dev.: 0.0055) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2215, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.00% (3.8887 => 3.8498, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 11:24:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 13:24:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120806182449.D1C9C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2684?compare_to=2681&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2684, Order: 161324, Start Time: 2012-08-06 17:06:52, End Time: 2012-08-06 18:25:26 To: 2681, Order: 161319, Start Time: 2012-08-06 08:48:11, End Time: 2012-08-06 10:06:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (90 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.57% (7.9596 => 8.0849, std. dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.41% (10.3673 => 13.4161, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 13.01% (0.3473 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.52% (0.3561 => 0.4007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3516 => 0.3956, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.44% (1.1194 => 1.2586, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 12.29% (0.3694 => 0.4148, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3828 => 0.4284, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.66% (0.3927 => 0.4385, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 11.50% (0.3886 => 0.4333, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.64% (1.7609 => 1.9130, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.41% (2.2022 => 2.3875, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5925 => 0.6351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.15% (0.6030 => 0.6461, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3177 => 0.3389, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.61% (0.7326 => 0.7810, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.55% (0.1892 => 0.2016, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.43% (0.4879 => 0.5144, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (7.0540 => 7.4122, std. dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (10.4361 => 10.9613, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.97% (0.3282 => 0.3445, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.7433 => 0.7752, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5569 => 0.5808, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.28% (0.8172 => 0.8522, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8795, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.9449 => 5.1508, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (5.0018 => 5.1987, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.72% (0.5860 => 0.6078, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (4.2646 => 4.4220, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4290, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.46% (0.7835 => 0.8106, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.40% (1.5603 => 1.6133, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.31% (5.7591 => 5.9496, std. dev.: 0.0129) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4636 => 0.4789, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2252, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (1.3050 => 1.3459, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7996, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.85% (1.1642 => 1.1974, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.4289 => 0.4410, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.79% (2.0665 => 2.1242, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.78% (3.3354 => 3.4282, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.5415 => 1.5834, std. dev.: 0.0060) MultiSource/Applications/treecc/treecc: 2.72% (2.0273 => 2.0824, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.52% (3.8723 => 3.9698, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.48% (0.8067 => 0.8267, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9765 => 0.9987, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.18% (2.2024 => 2.2505, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.17% (0.5105 => 0.5216, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5859 => 1.6202, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 2.11% (1.2842 => 1.3113, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (0.6675 => 0.6815, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5981 => 0.6106, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.94% (17.1811 => 17.5142, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.91% (1.4186 => 1.4457, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.77% (0.6450 => 0.6564, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.40% (2.2969 => 2.3291, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 1.34% (1.1840 => 1.1999, std. dev.: 0.0050) MultiSource/Applications/lemon/lemon: 1.02% (1.0722 => 1.0831, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.04% (4.2280 => 4.3989, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5339, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 1.60% (3.1578 => 3.2082, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 1.59% (11.6436 => 11.8287, std. dev.: 0.0022) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2034, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2324, std. dev.: 0.0078) MultiSource/Applications/lua/lua: 1.05% (26.0924 => 26.3662, std. dev.: 0.0327) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.81% (5.2763 => 3.1760, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7250, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.48% (5.3526 => 3.7213, std. dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1803, std. dev.: 0.0407) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.90% (2.9384 => 2.5593, std. dev.: 0.0165) MultiSource/Applications/ClamAV/clamscan: -11.84% (22.1758 => 19.5509, std. dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -9.54% (1.2373 => 1.1192, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -7.40% (1.5373 => 1.4236, std. dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5725, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.02% (1.9577 => 1.8595, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4799, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9082, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4229, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0058, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2009, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.77% (12.5348 => 12.3130, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4187, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 12:49:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 14:49:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120806194922.A52022A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2685?compare_to=2682&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2685, Order: 161324, Start Time: 2012-08-06 17:06:37, End Time: 2012-08-06 19:49:56 To: 2682, Order: 161319, Start Time: 2012-08-06 09:26:20, End Time: 2012-08-06 12:09:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (95 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (785 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.20% (0.3446 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.19% (0.3465 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3496 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.09% (0.3460 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.04% (0.3488 => 0.3943, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.00% (0.3469 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.74% (0.3643 => 0.4107, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3724 => 0.4184, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 7.35% (0.5826 => 0.6254, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.24% (1.5932 => 1.7086, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.13% (0.5889 => 0.6309, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.59% (1.6211 => 1.7279, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.20% (3.5627 => 3.7835, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.17% (1.3152 => 1.3963, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (0.4361 => 0.4618, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (0.4994 => 0.5279, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.68% (0.5900 => 0.6235, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7171 => 0.7577, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.63% (0.5026 => 0.5309, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.48% (0.5000 => 0.5274, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.42% (0.3930 => 0.4143, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 5.24% (4.2109 => 4.4315, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: 5.24% (0.4029 => 0.4240, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.16% (1.0781 => 1.1337, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.2866 => 0.3003, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (2.7292 => 2.8590, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 4.75% (0.2566 => 0.2688, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.71% (0.2736 => 0.2865, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 4.28% (5.5417 => 5.7791, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.28% (1.9694 => 2.0536, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (0.3890 => 0.4053, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.18% (1.9966 => 2.0800, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (2.1013 => 2.1887, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (0.4658 => 0.4851, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.01% (2.1653 => 2.2522, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 3.96% (4.6177 => 4.8005, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (4.4195 => 4.5891, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.79% (0.2875 => 0.2984, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3060 => 0.3175, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.72% (0.3362 => 0.3487, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.3903 => 0.4047, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.68% (0.7875 => 0.8165, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.65% (0.9909 => 1.0271, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 3.56% (23.5202 => 24.3574, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.53% (0.4139 => 0.4285, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.52% (1.8794 => 1.9456, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3195 => 0.3307, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.46% (0.3004 => 0.3108, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.41% (2.0673 => 2.1377, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.39% (1.4269 => 1.4753, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.39% (0.5546 => 0.5734, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.3271 => 0.3380, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.26% (0.6634 => 0.6850, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.07% (0.3678 => 0.3791, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (0.3625 => 0.3736, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.99% (0.9697 => 0.9987, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 2.87% (0.3726 => 0.3833, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3690 => 0.3795, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4251 => 0.4368, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4146 => 0.4258, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.3981 => 0.4087, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.37% (2.0346 => 2.0828, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.5012 => 0.5125, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.6435 => 0.6577, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (0.4847 => 0.4949, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (11.6398 => 11.8178, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (0.7426 => 0.7538, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (4.6926 => 4.7405, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6137, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6769, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1659, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.34% (1.8057 => 1.8840, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6718, std. dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1967, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (41.7953 => 42.6402, std. dev.: 0.0095) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4965, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.03% (6.9842 => 7.0562, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.08% (25.4195 => 16.5035, std. dev.: 0.0208) SingleSource/Benchmarks/Dhrystone/fldry: -8.56% (17.2379 => 15.7625, std. dev.: 0.1983) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7981, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -7.12% (0.2402 => 0.2231, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7878, std. dev.: 0.0163) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5469, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9551, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 13:02:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 15:02:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120806200229.DD9962A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2686?compare_to=2683&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2686, Order: 161328, Start Time: 2012-08-06 18:48:56, End Time: 2012-08-06 20:03:02 To: 2683, Order: 161324, Start Time: 2012-08-06 17:06:53, End Time: 2012-08-06 18:20:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (143 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.13% (7.9536 => 8.0433, std. dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.10% (0.9051 => 0.8951, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.75% (2.0176 => 2.3152, std. dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.42% (0.1072 => 0.1173, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7061 => 0.7666, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.5818 => 0.6312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5748 => 0.6226, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.97% (0.3578 => 0.3863, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.84% (0.3663 => 0.3950, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.73% (0.3623 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3650 => 0.3932, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.66% (0.3914 => 0.4214, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.65% (0.3789 => 0.4079, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.4003 => 0.4305, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.23% (1.3693 => 1.4683, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.09% (0.7710 => 0.8257, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.82% (0.7038 => 0.7518, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (3.9660 => 4.2354, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.74% (0.5265 => 0.5620, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4328 => 0.4592, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.6959 => 0.7377, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4062 => 0.4298, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.72% (0.2781 => 0.2940, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.68% (1.2193 => 1.2885, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2607 => 0.2750, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.37% (0.2628 => 0.2769, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9199 => 0.9692, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.2937 => 0.3091, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3022 => 0.3179, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.3489 => 0.3668, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 5.10% (16.6129 => 17.4603, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.05% (0.3107 => 0.3264, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (1.4563 => 1.5296, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.98% (1.9828 => 2.0815, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 4.97% (13.8202 => 14.5064, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3485 => 0.3656, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 4.86% (0.3149 => 0.3302, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.63% (1.0594 => 1.1085, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.60% (0.7460 => 0.7803, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.51% (1.1061 => 1.1560, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.51% (7.2180 => 7.5433, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.47% (0.3246 => 0.3391, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 4.41% (0.3534 => 0.3690, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 4.36% (3.8646 => 4.0332, std. dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.34% (0.3756 => 0.3919, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.31% (1.9270 => 2.0101, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (1.3813 => 1.4408, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.28% (0.8310 => 0.8666, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3810, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (13.2842 => 13.8486, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.21% (1.3819 => 1.4401, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.3868 => 0.4026, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.90% (2.1791 => 2.2641, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5490, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8086, std. dev.: 0.0093) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (4.4433 => 4.6093, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.64% (1.2292 => 1.2739, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.64% (1.1333 => 1.1745, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.46% (0.4791 => 0.4957, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1466, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3755 => 0.3875, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.19% (0.6135 => 0.6331, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 3.00% (3.1889 => 3.2846, std. dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 2.94% (8.4961 => 8.7456, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.91% (0.8698 => 0.8951, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.84% (3.2742 => 3.3673, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.80% (2.1007 => 2.1596, std. dev.: 0.0199) MultiSource/Applications/JM/lencod/lencod: 2.73% (14.8535 => 15.2596, std. dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (6.5754 => 6.7513, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.58% (1.5188 => 1.5580, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6733, std. dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.5298 => 14.8895, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 2.29% (4.6629 => 4.7697, std. dev.: 0.0151) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.70% (0.9108 => 0.9263, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.50% (1.0313 => 1.0468, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7868, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5136, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2667, std. dev.: 0.0319) SingleSource/Benchmarks/Misc/mandel-2: 8.26% (1.2998 => 1.4072, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.21% (0.9996 => 1.0517, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: 4.50% (7.4271 => 7.7614, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7059, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (1.5089 => 1.5348, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.50% (1.9290 => 1.9580, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5940, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0407, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.25% (1.0310 => 1.0439, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6859, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1399, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.5627 => 21.1100, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.81% (0.6576 => 0.6457, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.05% (1.2308 => 1.1071, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.66% (20.3410 => 18.5801, std. dev.: 0.0359) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std. dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9184, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6036, std. dev.: 0.0114) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9554, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4974, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2324, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3305 => 7.2107, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4927, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2151, std. dev.: 0.0373) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2490, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 13:11:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 15:11:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120806201140.621F32A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2687?compare_to=2684&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2687, Order: 161328, Start Time: 2012-08-06 18:53:33, End Time: 2012-08-06 20:12:15 To: 2684, Order: 161324, Start Time: 2012-08-06 17:06:52, End Time: 2012-08-06 18:25:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (85 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.05% (10.3673 => 13.3791, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3473 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.75% (0.3497 => 0.3943, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 12.74% (0.3516 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3543 => 0.3992, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.61% (0.3561 => 0.4010, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.32% (0.3694 => 0.4149, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.99% (0.3828 => 0.4287, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3927 => 0.4389, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.70% (1.1194 => 1.2504, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.02% (2.2022 => 2.3788, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.89% (1.7609 => 1.8999, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.27% (0.1622 => 0.1740, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1892 => 0.2017, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.48% (0.5925 => 0.6309, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference-object: 6.27% (0.6030 => 0.6408, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7326 => 0.7712, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 5.07% (10.4361 => 10.9649, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.4879 => 0.5123, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.88% (7.0540 => 7.3982, std. dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: 4.71% (0.7433 => 0.7783, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.56% (9.4845 => 9.9168, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.09% (0.8172 => 0.8506, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (4.9449 => 5.1449, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.02% (0.5569 => 0.5793, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (5.0018 => 5.1992, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 3.77% (0.3423 => 0.3552, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.75% (0.5860 => 0.6080, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (4.2646 => 4.4215, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (0.3121 => 0.3235, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 3.55% (0.7835 => 0.8113, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.54% (8.1363 => 8.4242, std. dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.47% (5.7591 => 5.9589, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.4636 => 0.4788, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.1861 => 1.2249, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.24% (1.5603 => 1.6108, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.3050 => 1.3472, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (14.3668 => 14.8097, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.5415 => 1.5884, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4299 => 0.4429, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.98% (1.1642 => 1.1989, std. dev.: 0.0077) MultiSource/Applications/d/make_dparser: 2.97% (3.3354 => 3.4343, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.76% (2.0273 => 2.0832, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.71% (3.8723 => 3.9771, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.5105 => 0.5238, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 2.59% (0.4289 => 0.4400, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.55% (0.8067 => 0.8273, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.53% (2.0665 => 2.1187, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.50% (0.9765 => 1.0009, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.2024 => 2.2568, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5859 => 1.6243, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (0.6675 => 0.6823, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.16% (1.4186 => 1.4492, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.06% (17.1811 => 17.5352, std. dev.: 0.0536) MultiSource/Applications/hexxagon/hexxagon: 1.93% (1.2842 => 1.3090, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 1.91% (0.8921 => 0.9091, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.81% (2.2969 => 2.3384, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: 1.62% (0.7115 => 0.7230, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.58% (1.1840 => 1.2027, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.29% (1.0722 => 1.0860, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9734, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (4.2280 => 4.3819, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7590, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2147, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8314, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0017) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.11% (5.2763 => 3.1598, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7015, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6958, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1140, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.39% (2.9384 => 2.5450, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -11.86% (22.1758 => 19.5464, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.2373 => 1.1135, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -8.46% (1.5373 => 1.4072, std. dev.: 0.0201) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.22% (19.9488 => 18.5078, std. dev.: 0.0829) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5028, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4890, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -4.70% (1.9577 => 1.8657, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4814, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9030, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4166, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0017, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4808 => 0.4690, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.71% (12.5348 => 12.3207, std. dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4180, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.35% (1.8329 => 1.8082, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 14:44:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 16:44:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120806214445.6454A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2688?compare_to=2686&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2688, Order: 161333, Start Time: 2012-08-06 20:31:12, End Time: 2012-08-06 21:45:20 To: 2686, Order: 161328, Start Time: 2012-08-06 18:48:56, End Time: 2012-08-06 20:03:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (150 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.23% (0.5326 => 0.5445, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.72% (79.5734 => 80.9446, std. dev.: 0.3008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.83% (2.0176 => 2.3169, std. dev.: 0.0165) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.59% (0.7061 => 0.7738, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.46% (0.5748 => 0.6292, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 9.03% (0.3601 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3646 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.89% (0.3623 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.82% (0.3650 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.81% (0.3789 => 0.4123, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.76% (0.3914 => 0.4257, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.64% (0.4003 => 0.4349, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.55% (0.3940 => 0.4277, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.78% (0.2596 => 0.2798, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.65% (1.3693 => 1.4741, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.14% (0.5265 => 0.5641, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 7.12% (0.7038 => 0.7539, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.08% (0.7710 => 0.8256, std. dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.94% (3.9660 => 4.2411, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2782 => 0.2966, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2781 => 0.2963, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.43% (0.4062 => 0.4323, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.32% (0.6959 => 0.7399, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.18% (0.3899 => 0.4140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2655 => 0.2818, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.13% (0.2690 => 0.2855, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.08% (0.3489 => 0.3701, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2760 => 0.2924, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.88% (1.9828 => 2.0993, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.82% (0.2696 => 0.2853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.76% (0.3022 => 0.3196, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.73% (0.3580 => 0.3785, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.69% (0.4390 => 0.4640, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2761 => 0.2917, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.62% (0.3149 => 0.3326, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9199 => 0.9707, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.52% (0.2988 => 0.3153, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3485 => 0.3677, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.47% (1.2193 => 1.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3192 => 0.3366, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.35% (16.6129 => 17.5023, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.3453 => 0.3636, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.27% (0.5577 => 0.5871, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 5.13% (0.3293 => 0.3462, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.12% (13.8202 => 14.5283, std. dev.: 0.0140) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.98% (0.3534 => 0.3710, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (0.3756 => 0.3943, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.88% (1.4563 => 1.5274, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.79% (1.1364 => 1.1908, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 4.77% (0.7506 => 0.7864, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.75% (0.5637 => 0.5905, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.73% (0.3868 => 0.4051, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.71% (3.8646 => 4.0466, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.68% (7.2180 => 7.5556, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.67% (1.1061 => 1.1577, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3856, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3246 => 0.3394, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (1.3819 => 1.4427, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (13.2842 => 13.8632, std. dev.: 0.0154) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3813 => 1.4415, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.35% (1.9270 => 2.0108, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8310 => 0.8668, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.7460 => 0.7778, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2814, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.0594 => 1.1042, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (3.6692 => 3.8157, std. dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.94% (0.3755 => 0.3903, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6180, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5515, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.86% (2.1791 => 2.2633, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.65% (0.6135 => 0.6359, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 3.64% (0.2859 => 0.2963, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.61% (0.4791 => 0.4964, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.58% (1.1333 => 1.1739, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.9865 => 5.1529, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.8698 => 0.8988, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.17% (0.6283 => 0.6482, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.01% (8.4961 => 8.7517, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.92% (3.2742 => 3.3699, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.88% (3.1889 => 3.2807, std. dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7623, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.80% (2.1007 => 2.1596, std. dev.: 0.0141) MultiSource/Applications/JM/lencod/lencod: 2.76% (14.8535 => 15.2636, std. dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.5298 => 14.8989, std. dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 2.52% (16.2614 => 16.6714, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5188 => 1.5560, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.28% (4.6629 => 4.7694, std. dev.: 0.0167) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.78% (0.9108 => 0.9270, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.6250 => 0.6359, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.41% (1.0313 => 1.0458, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.30% (3.7467 => 3.7954, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.2944 => 33.6951, std. dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3506, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: 6.69% (1.2998 => 1.3868, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.75% (0.9996 => 1.0571, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7544, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7028, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (2.8606 => 2.9657, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8166, std. dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.35% (0.9692 => 0.9920, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5089 => 1.5338, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 1.09% (10.7476 => 10.8644, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1399, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.5627 => 21.1252, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.6576 => 0.6469, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.87% (1.2308 => 1.1093, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.85% (20.3410 => 18.5399, std. dev.: 0.0702) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.40% (0.3139 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5919, std. dev.: 0.0068) MultiSource/Applications/spiff/spiff: -2.36% (3.0263 => 2.9548, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2231, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5037, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2143, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2516, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2326, std. dev.: 0.0252) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 14:58:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 16:58:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120806215826.4B97B2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2689?compare_to=2687&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2689, Order: 161342, Start Time: 2012-08-06 20:40:26, End Time: 2012-08-06 21:59:01 To: 2687, Order: 161328, Start Time: 2012-08-06 18:53:33, End Time: 2012-08-06 20:12:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (84 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.43% (13.3791 => 13.5699, std. dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.16% (55.2104 => 56.4009, std. dev.: 0.1103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.89% (10.3673 => 13.5699, std. dev.: 0.0095) SingleSource/UnitTests/ObjC/trivial-interface: 12.90% (0.3473 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3543 => 0.3987, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.53% (0.3497 => 0.3935, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3516 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.36% (0.3561 => 0.4001, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.05% (0.3694 => 0.4139, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.81% (0.3828 => 0.4280, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.73% (1.1194 => 1.2507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.18% (2.2022 => 2.3824, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.75% (1.7609 => 1.8973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.6030 => 0.6406, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.19% (0.5925 => 0.6292, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.20% (10.4361 => 10.9788, std. dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference: 5.17% (0.7326 => 0.7705, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.4879 => 0.5119, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.81% (0.4615 => 0.4837, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.72% (7.0540 => 7.3867, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/oourafft: 4.66% (0.3282 => 0.3435, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (0.7433 => 0.7770, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.32% (9.4845 => 9.8938, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.8172 => 0.8510, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (5.0018 => 5.2027, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1383, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.80% (0.3109 => 0.3227, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 3.72% (1.5603 => 1.6183, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (4.2646 => 4.4140, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.37% (5.7591 => 5.9531, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.32% (8.1363 => 8.4062, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.20% (0.7835 => 0.8086, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1861 => 1.2232, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.13% (0.4636 => 0.4781, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7996, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.4103 => 0.4225, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3437, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.86% (3.3354 => 3.4308, std. dev.: 0.0095) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1958, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.5415 => 1.5832, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.70% (2.0273 => 2.0820, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (2.0665 => 2.1200, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5859 => 1.6254, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9681, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.2024 => 2.2565, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.39% (0.5105 => 0.5227, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6456 => 0.6609, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.37% (0.8067 => 0.8258, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.6675 => 0.6825, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9765 => 0.9979, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8921 => 0.9106, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.04% (17.1811 => 17.5320, std. dev.: 0.0176) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3101, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4468, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.97% (0.6450 => 0.6577, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.63% (2.2969 => 2.3344, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.50% (1.1840 => 1.2018, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.43% (0.7115 => 0.7217, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.16% (1.0722 => 1.0846, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.20% (4.2280 => 4.4054, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7496, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2144, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8339, std. dev.: 0.0012) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2032, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.20% (2.2771 => 2.3045, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1594, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6991, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6959, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0714, std. dev.: 0.0341) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5463, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: -12.10% (22.1758 => 19.4931, std. dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2373 => 1.1100, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -8.37% (1.5373 => 1.4087, std. dev.: 0.0207) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.14% (19.9488 => 18.5251, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.92% (1.9577 => 1.8613, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4774, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9041, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4252, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9998, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2010, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.74% (12.5348 => 12.3167, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4173, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.40% (1.8329 => 1.8073, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 16:00:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 18:00:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120806230047.339D12A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2690?compare_to=2685&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2690, Order: 161331, Start Time: 2012-08-06 20:18:01, End Time: 2012-08-06 23:01:23 To: 2685, Order: 161324, Start Time: 2012-08-06 17:06:37, End Time: 2012-08-06 19:49:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3446 => 0.3919, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 13.66% (0.3469 => 0.3943, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.59% (0.3496 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.20% (0.3643 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.04% (0.3650 => 0.4126, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.67% (0.3724 => 0.4196, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.55% (0.5826 => 0.6266, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.35% (0.5889 => 0.6322, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.12% (0.3792 => 0.4062, std. dev.: 0.0093) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.38% (1.5932 => 1.6949, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.26% (1.6211 => 1.7226, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (3.5627 => 3.7849, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.82% (0.7171 => 0.7588, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.80% (1.3152 => 1.3915, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (0.4361 => 0.4611, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.2014 => 0.2128, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (0.4994 => 0.5276, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.5900 => 0.6233, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (0.5000 => 0.5267, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (0.3930 => 0.4138, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (0.5026 => 0.5292, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.17% (4.2109 => 4.4284, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.04% (0.4029 => 0.4232, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.01% (1.0781 => 1.1321, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (0.3890 => 0.4084, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.95% (0.2866 => 0.3008, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.88% (2.7292 => 2.8624, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.2736 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2738 => 0.2864, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.49% (1.9694 => 2.0579, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.37% (2.1013 => 2.1932, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.37% (0.9909 => 1.0342, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3195 => 0.3334, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2792 => 0.2912, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 4.29% (0.3004 => 0.3133, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2750 => 0.2866, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.19% (1.9966 => 2.0803, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.15% (2.0673 => 2.1531, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 4.11% (5.5417 => 5.7695, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (0.4658 => 0.4849, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2811 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.09% (0.2813 => 0.2928, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2823 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.2780 => 0.2892, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.96% (2.1653 => 2.2510, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4146 => 0.4310, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.94% (0.3678 => 0.3823, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.94% (0.3096 => 0.3218, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3060 => 0.3180, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 3.90% (4.6177 => 4.7980, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2911 => 0.3024, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3258 => 0.3384, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3124 => 0.3244, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3362 => 0.3491, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.83% (0.3267 => 0.3392, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.78% (23.5202 => 24.4084, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: 3.74% (0.3317 => 0.3441, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.73% (1.8794 => 1.9495, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3625 => 0.3759, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (4.4195 => 4.5817, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 3.65% (0.3726 => 0.3862, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.62% (0.3477 => 0.3603, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3348 => 0.3469, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.3903 => 0.4043, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.58% (0.9697 => 1.0044, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.48% (0.4139 => 0.4283, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.47% (0.7875 => 0.8148, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 3.34% (0.4251 => 0.4393, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.3271 => 0.3378, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3690 => 0.3810, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 3.20% (1.4269 => 1.4726, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.3981 => 0.4108, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 3.10% (0.5546 => 0.5718, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.01% (0.6634 => 0.6834, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.75% (0.5012 => 0.5150, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.6435 => 0.6604, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.16% (2.0346 => 2.0785, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (11.6398 => 11.7993, std. dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9638, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 8.25% (0.2122 => 0.2297, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6689, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.66% (1.8057 => 1.8898, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6330, std. dev.: 0.0391) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2004, std. dev.: 0.0583) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (41.7953 => 42.6484, std. dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4957, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2269, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.07% (6.9842 => 7.0586, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.04% (2.4764 => 2.4260, std. dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5307, std. dev.: 0.0155) SingleSource/Benchmarks/Dhrystone/fldry: -9.35% (17.2379 => 15.6263, std. dev.: 0.2371) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9779, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7820, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7959, std. dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5405, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5731, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9590, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 16:27:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 18:27:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120806232707.E6F1D2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2691?compare_to=2688&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2691, Order: 161353, Start Time: 2012-08-06 22:13:35, End Time: 2012-08-06 23:27:43 To: 2688, Order: 161333, Start Time: 2012-08-06 20:31:12, End Time: 2012-08-06 21:45:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (152 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.7085 => 56.6131, std. dev.: 0.0356) MultiSource/Benchmarks/llubenchmark/llu: 1.96% (3.7662 => 3.8401, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/mandel-2: 1.28% (1.3868 => 1.4045, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.41% (2.0176 => 2.3286, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.75% (0.3578 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3646 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.53% (0.3601 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.45% (0.5818 => 0.6368, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.42% (0.3650 => 0.3994, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.42% (0.3663 => 0.4008, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3623 => 0.3962, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.35% (0.7061 => 0.7721, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3789 => 0.4143, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.20% (0.3914 => 0.4274, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.17% (0.4003 => 0.4370, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5748 => 0.6274, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/property: 8.93% (0.3940 => 0.4292, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 8.33% (1.3693 => 1.4834, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.44% (0.4328 => 0.4650, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.41% (0.2781 => 0.2987, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (3.9660 => 4.2569, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.7710 => 0.8266, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.13% (0.7038 => 0.7540, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.13% (0.2596 => 0.2781, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.89% (0.4062 => 0.4342, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.68% (0.2966 => 0.3164, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.63% (0.2655 => 0.2831, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.56% (0.2760 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.54% (0.2628 => 0.2800, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.48% (0.3489 => 0.3715, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2765 => 0.2943, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3022 => 0.3215, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.39% (0.3899 => 0.4148, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.38% (0.2726 => 0.2900, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2696 => 0.2867, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3580 => 0.3807, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.27% (0.2761 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.23% (1.9828 => 2.1063, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 6.22% (0.2988 => 0.3174, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3485 => 0.3701, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 6.14% (0.3192 => 0.3388, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4390 => 0.4657, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4379 => 0.4645, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5577 => 0.5912, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.6959 => 0.7373, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3453 => 0.3658, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (1.2193 => 1.2898, std. dev.: 0.0100) MultiSource/Applications/SPASS/SPASS: 5.65% (13.8202 => 14.6017, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/lists: 5.65% (0.3293 => 0.3479, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.53% (0.9199 => 0.9708, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.43% (0.4016 => 0.4234, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3756 => 0.3958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.38% (0.3534 => 0.3724, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1865 => 0.1965, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (1.4563 => 1.5339, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 5.30% (0.7506 => 0.7904, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 5.30% (0.3868 => 0.4073, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.26% (16.6129 => 17.4864, std. dev.: 0.0159) MultiSource/Benchmarks/McCat/08-main/main: 5.22% (0.2243 => 0.2360, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.2925 => 0.3075, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.01% (7.2180 => 7.5797, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (13.2842 => 13.9393, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.90% (0.5637 => 0.5913, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (1.1364 => 1.1920, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.78% (1.1061 => 1.1590, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 4.74% (1.2292 => 1.2875, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.69% (1.9270 => 2.0174, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3246 => 0.3398, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.67% (1.3813 => 1.4458, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 4.65% (3.8646 => 4.0444, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.3245 => 1.3858, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.63% (1.0594 => 1.1084, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 4.62% (0.8310 => 0.8694, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.3819 => 1.4447, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.50% (0.7460 => 0.7796, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3755 => 0.3918, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.33% (3.6692 => 3.8280, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.31% (4.4433 => 4.6349, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.3801 => 4.5608, std. dev.: 0.0113) MultiSource/Applications/siod/siod: 4.09% (2.1791 => 2.2682, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.03% (0.4791 => 0.4984, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1744, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (1.1333 => 1.1757, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.71% (0.8698 => 0.9021, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.6283 => 0.6505, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.4961 => 8.7789, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.33% (0.6135 => 0.6339, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 3.31% (3.1889 => 3.2945, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (6.5754 => 6.7872, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 3.17% (14.8535 => 15.3237, std. dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.05% (3.2742 => 3.3741, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.04% (2.1007 => 2.1645, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 3.00% (16.2614 => 16.7494, std. dev.: 0.0237) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9423, std. dev.: 0.0115) MultiSource/Applications/oggenc/oggenc: 2.56% (4.6629 => 4.7824, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5188 => 1.5573, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.24% (0.6250 => 0.6390, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.86% (0.9108 => 0.9277, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.68% (1.0313 => 1.0486, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.52% (3.7467 => 3.8037, std. dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.41% (6.2785 => 6.3673, std. dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7624, std. dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.19% (1.8175 => 2.2753, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 8.06% (1.2998 => 1.4045, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.30% (0.9996 => 1.0526, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 4.46% (7.4271 => 7.7584, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7050, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std. dev.: 0.0014) MultiSource/Benchmarks/llubenchmark/llu: 1.78% (3.7731 => 3.8401, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.15% (1.0310 => 1.0429, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1404, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.95% (22.5627 => 21.2191, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2308 => 1.1011, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.62% (20.3410 => 18.5871, std. dev.: 0.0411) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0080) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.84% (1.9762 => 1.9200, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5937, std. dev.: 0.0106) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9524, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2256, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.92% (6.6320 => 6.5044, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2139, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8600, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.31% (2.5254 => 2.4923, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2185, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.04% (3.8887 => 3.8481, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 16:44:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 18:44:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120806234459.28D862A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2692?compare_to=2689&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2692, Order: 161353, Start Time: 2012-08-06 22:27:09, End Time: 2012-08-06 23:45:35 To: 2689, Order: 161342, Start Time: 2012-08-06 20:40:26, End Time: 2012-08-06 21:59:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (83 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (13.5699 => 13.4056, std. dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.31% (10.3673 => 13.4056, std. dev.: 0.0085) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.18% (0.3927 => 0.4366, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.06% (2.2022 => 2.3797, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.51% (1.7609 => 1.8931, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5925 => 0.6265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.72% (0.6030 => 0.6375, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.08% (0.2758 => 0.2898, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.05% (7.0540 => 7.4103, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.78% (0.8172 => 0.8563, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 4.63% (0.7326 => 0.7665, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.4879 => 0.5103, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 4.35% (10.4361 => 10.8898, std. dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (0.7433 => 0.7751, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (9.4845 => 9.8635, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5860 => 0.6093, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.9449 => 5.1332, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (5.0018 => 5.1856, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (4.2646 => 4.4133, std. dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.32% (0.7835 => 0.8095, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (8.1363 => 8.4017, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9399, std. dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.12% (1.1861 => 1.2231, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.08% (1.3050 => 1.3452, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1978, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 2.87% (1.5603 => 1.6051, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (14.3668 => 14.7755, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.78% (0.5981 => 0.6147, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.8067 => 0.8288, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4636 => 0.4758, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.60% (3.3354 => 3.4222, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.59% (2.0273 => 2.0799, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.5415 => 1.5813, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.56% (0.4103 => 0.4208, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9710, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (2.2024 => 2.2555, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.31% (0.9765 => 0.9991, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5859 => 1.6219, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.5105 => 0.5217, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.6456 => 0.6594, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4463, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6675 => 0.6799, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8921 => 0.9085, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0665 => 2.1030, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.68% (2.2969 => 2.3355, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.61% (17.1811 => 17.4573, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 1.56% (1.2842 => 1.3042, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.35% (1.1840 => 1.2000, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.22% (4.2280 => 4.4065, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 1.84% (2.2771 => 2.3189, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 1.68% (3.1578 => 3.2109, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8317, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0031) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2367, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1473, std. dev.: 0.0123) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7008, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6984, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0848, std. dev.: 0.0215) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5414, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -12.22% (22.1758 => 19.4652, std. dev.: 0.0369) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2373 => 1.1133, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -7.70% (1.5373 => 1.4190, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.52% (19.9488 => 18.6478, std. dev.: 0.0283) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.98% (1.9577 => 1.8603, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4799, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9051, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4200, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0009, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.1997, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.77% (12.5348 => 12.3128, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std. dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.30% (1.8329 => 1.8090, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 18:09:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 20:09:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807010901.BD2502A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2693?compare_to=2691&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2693, Order: 161356, Start Time: 2012-08-06 23:55:47, End Time: 2012-08-07 01:09:37 To: 2691, Order: 161353, Start Time: 2012-08-06 22:13:35, End Time: 2012-08-06 23:27:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 2 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.22% (1.4834 => 1.4653, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.02% (2.1063 => 2.0849, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.82% (2.0176 => 2.3166, std. dev.: 0.0160) SingleSource/UnitTests/ObjC/trivial-interface: 9.81% (0.3578 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3601 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.52% (0.3646 => 0.3993, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.51% (0.3650 => 0.3997, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.37% (0.3789 => 0.4144, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3623 => 0.3962, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3663 => 0.4005, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 9.24% (0.4003 => 0.4373, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3914 => 0.4275, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.09% (0.7061 => 0.7703, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 8.93% (0.3940 => 0.4292, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (3.9660 => 4.2474, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.7710 => 0.8255, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.01% (1.3693 => 1.4653, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.91% (0.5265 => 0.5629, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.48% (0.7038 => 0.7494, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0106) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.6959 => 0.7377, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.66% (1.2193 => 1.2883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.61% (0.2690 => 0.2841, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.54% (0.2655 => 0.2802, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2765 => 0.2917, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.46% (0.3022 => 0.3187, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.5577 => 0.5880, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.39% (0.3580 => 0.3773, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.36% (0.9199 => 0.9692, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.28% (0.4390 => 0.4622, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5499, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.15% (1.9828 => 2.0849, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (1.4563 => 1.5298, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.89% (16.6129 => 17.4255, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.81% (7.2180 => 7.5655, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3192 => 0.3345, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.78% (0.7506 => 0.7865, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (13.2842 => 13.9059, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.66% (1.1364 => 1.1893, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 4.61% (0.3534 => 0.3697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.61% (0.4016 => 0.4201, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3246 => 0.3394, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 4.55% (3.8646 => 4.0405, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.49% (1.1061 => 1.1558, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4436, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 4.45% (0.8310 => 0.8680, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (1.3245 => 1.3831, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.7460 => 0.7790, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (1.3813 => 1.4422, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.40% (1.9270 => 2.0117, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.37% (0.3756 => 0.3920, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.36% (1.0594 => 1.1056, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.3868 => 0.4033, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.06% (3.6692 => 3.8182, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (4.4433 => 4.6232, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3220 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (4.3801 => 4.5510, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.88% (1.2292 => 1.2769, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.77% (2.1791 => 2.2612, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (1.1333 => 1.1748, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3755 => 0.3878, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.25% (4.9865 => 5.1486, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4113 => 0.4246, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (8.4961 => 8.7708, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (0.6135 => 0.6324, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.08% (3.1889 => 3.2871, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.02% (0.6283 => 0.6473, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.8698 => 0.8960, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.94% (6.5754 => 6.7685, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.87% (14.8535 => 15.2802, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.85% (3.2742 => 3.3676, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.71% (2.1007 => 2.1577, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 2.71% (14.5298 => 14.9237, std. dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 2.70% (16.2614 => 16.7008, std. dev.: 0.0296) MultiSource/Applications/oggenc/oggenc: 2.56% (4.6629 => 4.7822, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5567, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.40% (1.0313 => 1.0457, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (6.2785 => 6.3629, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 1.23% (3.7467 => 3.7929, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.10% (33.2944 => 33.6620, std. dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 27.34% (1.8175 => 2.3144, std. dev.: 0.0259) SingleSource/Benchmarks/Misc/mandel-2: 7.91% (1.2998 => 1.4026, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.11% (0.9996 => 1.0507, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7555, std. dev.: 0.0166) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7074, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9745, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.90% (1.4298 => 1.4569, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.81% (1.5089 => 1.5362, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.17% (1.9290 => 1.9515, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 1.03% (10.7476 => 10.8586, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/richards_benchmark: 1.00% (1.1560 => 1.1676, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.45% (22.5627 => 21.1081, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2308 => 1.1096, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.88% (20.3410 => 18.5350, std. dev.: 0.0840) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5975, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9536, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2189, std. dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5084, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2176, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2541, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2335, std. dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8468, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 18:31:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 20:31:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807013129.537952A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2694?compare_to=2692&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2694, Order: 161359, Start Time: 2012-08-07 00:13:42, End Time: 2012-08-07 01:32:05 To: 2692, Order: 161353, Start Time: 2012-08-06 22:27:09, End Time: 2012-08-06 23:45:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (99 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.12% (13.4056 => 13.6895, std. dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference: 1.46% (0.7665 => 0.7777, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.91% (1.4190 => 1.4461, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.13% (79.9511 => 79.0486, std. dev.: 0.3035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.04% (10.3673 => 13.6895, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3473 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.87% (0.3497 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3516 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.79% (0.3543 => 0.3996, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3543 => 0.3996, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.48% (0.3694 => 0.4155, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.11% (1.1194 => 1.2550, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 12.10% (0.3828 => 0.4291, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.73% (0.3886 => 0.4342, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.69% (0.3927 => 0.4386, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.02% (2.2022 => 2.3789, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.65% (1.7609 => 1.8956, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.33% (0.6030 => 0.6472, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7326 => 0.7777, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.78% (7.0540 => 7.3915, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.57% (0.4879 => 0.5102, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.53% (10.4361 => 10.9084, std. dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (0.7433 => 0.7769, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.8172 => 0.8532, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.04% (0.5569 => 0.5794, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (9.4845 => 9.8589, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.9449 => 5.1389, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.5860 => 0.6089, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (5.0018 => 5.1923, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (4.2646 => 4.4219, std. dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 3.65% (0.3423 => 0.3548, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.58% (0.4103 => 0.4250, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.4636 => 0.4800, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.50% (0.7835 => 0.8109, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.48% (0.3136 => 0.3245, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.46% (8.1363 => 8.4178, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.4289 => 0.4427, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.19% (0.3232 => 0.3335, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.18% (0.3865 => 0.3988, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3283 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.10% (1.1861 => 1.2229, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0665 => 2.1305, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8068, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.06% (0.3826 => 0.3943, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.04% (1.1642 => 1.1996, std. dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 2.89% (5.7591 => 5.9256, std. dev.: 0.0068) MultiSource/Applications/hbd/hbd: 2.88% (1.5603 => 1.6052, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3935 => 0.4048, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.82% (2.0273 => 2.0845, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.77% (3.3354 => 3.4277, std. dev.: 0.0152) MultiSource/Applications/lua/lua: 2.73% (3.8723 => 3.9779, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists1: 2.71% (0.3684 => 0.3784, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.8067 => 0.8280, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.64% (1.5415 => 1.5822, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2842 => 1.3170, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.2024 => 2.2584, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.47% (0.4048 => 0.4148, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.44% (0.4299 => 0.4404, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9765 => 1.0000, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.37% (0.5105 => 0.5226, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.26% (0.6675 => 0.6826, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (1.4186 => 1.4505, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5981 => 0.6115, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.93% (17.1811 => 17.5131, std. dev.: 0.0108) MultiSource/Applications/siod/siod: 1.85% (2.2969 => 2.3395, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/football/football: 1.79% (0.8921 => 0.9081, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: 1.67% (0.7115 => 0.7234, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.35% (1.1840 => 1.2000, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.20% (1.0722 => 1.0851, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3126, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.32% (4.2280 => 4.4106, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7545, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5358, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8347, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 1.58% (3.1578 => 3.2077, std. dev.: 0.0056) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2268, std. dev.: 0.0305) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1511, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7116, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7063, std. dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1982, std. dev.: 0.0343) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.21% (2.9384 => 2.5503, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -11.94% (22.1758 => 19.5275, std. dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -9.96% (1.2373 => 1.1141, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.94% (19.9488 => 18.5635, std. dev.: 0.0600) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.93% (1.5373 => 1.4461, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -5.04% (1.9577 => 1.8591, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5112, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4915, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9074, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4247, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0025, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.79% (12.5348 => 12.3107, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4188, std. dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.37% (1.8329 => 1.8078, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 19:12:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 21:12:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120807021220.019A82A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2695?compare_to=2690&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2695, Order: 161356, Start Time: 2012-08-06 23:29:27, End Time: 2012-08-07 02:12:56 To: 2690, Order: 161331, Start Time: 2012-08-06 20:18:01, End Time: 2012-08-06 23:01:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (111 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (768 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.53% (2.4260 => 2.4631, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.01% (2.0408 => 2.1022, std. dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.62% (54.0771 => 54.9539, std. dev.: 0.0368) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.60% (0.3465 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.60% (0.3446 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.45% (0.3496 => 0.4001, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.44% (0.3442 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.39% (0.3460 => 0.3958, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 14.36% (0.3469 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.33% (0.3488 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.92% (0.3643 => 0.4150, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.75% (0.3650 => 0.4152, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.53% (0.3724 => 0.4228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.02% (0.3792 => 0.4172, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 7.84% (0.5826 => 0.6283, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.44% (0.5889 => 0.6327, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.1619 => 0.1737, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (1.6211 => 1.7272, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (3.5627 => 3.7917, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 6.21% (1.5932 => 1.6922, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.19% (1.3152 => 1.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7171 => 0.7605, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.5900 => 0.6242, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (0.4361 => 0.4612, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.71% (0.5026 => 0.5313, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.2014 => 0.2128, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.61% (0.4994 => 0.5274, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.53% (0.4029 => 0.4252, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.47% (0.3930 => 0.4145, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (0.5000 => 0.5272, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 5.44% (4.2109 => 4.4399, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.36% (2.7292 => 2.8755, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 5.19% (1.0781 => 1.1341, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2792 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.83% (0.2875 => 0.3014, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2729 => 0.2860, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.76% (0.9909 => 1.0381, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2738 => 0.2868, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2714 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.62% (0.2750 => 0.2877, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.62% (1.9694 => 2.0603, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.2736 => 0.2862, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 4.59% (0.3004 => 0.3142, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.57% (0.3195 => 0.3341, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.57% (0.2780 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.56% (1.9966 => 2.0877, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 4.54% (2.1013 => 2.1967, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.2823 => 0.2950, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.44% (2.0673 => 2.1591, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.44% (0.3267 => 0.3412, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.42% (4.6177 => 4.8218, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.3096 => 0.3232, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2803 => 0.2926, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.35% (0.9697 => 1.0119, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.32% (0.3890 => 0.4058, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.28% (0.3317 => 0.3459, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3258 => 0.3396, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.23% (0.2911 => 0.3034, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (4.4195 => 4.6051, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (0.4658 => 0.4853, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 4.16% (5.5417 => 5.7721, std. dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 4.16% (2.1653 => 2.2553, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.13% (0.3678 => 0.3830, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.13% (0.2566 => 0.2672, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.3362 => 0.3500, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3348 => 0.3485, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.08% (0.3060 => 0.3185, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3124 => 0.3250, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.00% (0.3477 => 0.3616, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.97% (0.3726 => 0.3874, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3282 => 0.3410, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.87% (0.3903 => 0.4054, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.75% (0.3625 => 0.3761, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.70% (1.8794 => 1.9490, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 3.64% (0.4146 => 0.4297, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.63% (0.7875 => 0.8161, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.58% (0.3690 => 0.3822, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.50% (0.4139 => 0.4284, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.49% (0.3981 => 0.4120, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.46% (23.5202 => 24.3351, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.3845 => 0.3978, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.3271 => 0.3383, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 3.28% (1.4269 => 1.4737, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 3.19% (0.5546 => 0.5723, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.09% (0.6634 => 0.6839, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.87% (0.5012 => 0.5156, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.6435 => 0.6606, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.01% (2.0346 => 2.0755, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6795, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.2122 => 0.2228, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8923, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2086, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (105.3826 => 107.5997, std. dev.: 0.0398) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4961, std. dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.79% (41.7953 => 42.5416, std. dev.: 0.0523) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5910, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2210, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.13% (6.9842 => 7.0630, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.12% (11.9555 => 11.8219, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5325, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary2: -10.03% (0.2402 => 0.2161, std. dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: -8.55% (17.2379 => 15.7644, std. dev.: 0.1321) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8006, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7976, std. dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -3.58% (14.0481 => 13.5457, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5816, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4961, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.46% (16.2163 => 15.9797, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 19:51:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 21:51:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807025111.EC6262A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2696?compare_to=2693&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2696, Order: 161379, Start Time: 2012-08-07 01:37:49, End Time: 2012-08-07 02:51:47 To: 2693, Order: 161356, Start Time: 2012-08-06 23:55:47, End Time: 2012-08-07 01:09:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (147 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (2.0849 => 2.1083, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.11% (77.7265 => 80.1458, std. dev.: 0.7461) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.53% (2.0176 => 2.3107, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.09% (0.3578 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.86% (0.3601 => 0.3956, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.85% (0.3646 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.83% (0.3663 => 0.4023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.73% (0.7061 => 0.7748, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.70% (0.3650 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.69% (0.3623 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.63% (0.3789 => 0.4154, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.63% (0.5818 => 0.6378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.45% (0.3914 => 0.4284, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.34% (0.5748 => 0.6285, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.27% (0.4003 => 0.4374, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.14% (0.3940 => 0.4300, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 7.57% (1.3693 => 1.4729, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4062 => 0.4368, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.4328 => 0.4643, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.22% (0.7710 => 0.8267, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2781 => 0.2980, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (3.9660 => 4.2490, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.95% (0.2690 => 0.2877, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.75% (0.3022 => 0.3226, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.72% (0.7038 => 0.7511, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2765 => 0.2950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.63% (0.2760 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.57% (0.2937 => 0.3130, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2726 => 0.2905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.44% (0.3899 => 0.4150, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.37% (0.2761 => 0.2937, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.37% (0.2966 => 0.3155, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.33% (1.9828 => 2.1083, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 6.32% (0.3149 => 0.3348, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.28% (0.3485 => 0.3704, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.28% (0.3489 => 0.3708, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.22% (0.2988 => 0.3174, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 6.17% (0.3192 => 0.3389, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.15% (0.3580 => 0.3800, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3453 => 0.3659, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.88% (0.6959 => 0.7368, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.4390 => 0.4641, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.72% (1.2193 => 1.2890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.60% (0.3534 => 0.3732, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.50% (0.4016 => 0.4237, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.44% (0.9199 => 0.9699, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (0.3756 => 0.3960, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.43% (0.3868 => 0.4078, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.42% (13.8202 => 14.5697, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.36% (0.5577 => 0.5876, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.20% (16.6129 => 17.4774, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.09% (1.3819 => 1.4522, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (1.3813 => 1.4509, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.90% (1.4563 => 1.5277, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.90% (0.5637 => 0.5913, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.90% (7.2180 => 7.5714, std. dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (13.2842 => 13.9151, std. dev.: 0.0230) MultiSource/Applications/hexxagon/hexxagon: 4.72% (1.2292 => 1.2872, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.71% (1.1364 => 1.1899, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8310 => 0.8701, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.64% (1.1061 => 1.1574, std. dev.: 0.0063) MultiSource/Applications/spiff/spiff: 4.60% (0.7506 => 0.7851, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (3.8646 => 4.0397, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.0594 => 1.1069, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.46% (1.3245 => 1.3836, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.7460 => 0.7790, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.31% (3.6692 => 3.8274, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0095, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3755 => 0.3914, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (4.4433 => 4.6230, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (4.3801 => 4.5572, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.75% (2.1791 => 2.2609, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.75% (0.8698 => 0.9024, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1333 => 1.1747, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (4.9865 => 5.1681, std. dev.: 0.0210) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.50% (0.6283 => 0.6503, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (8.4961 => 8.7713, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.21% (0.6135 => 0.6332, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2886, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (6.5754 => 6.7703, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.91% (3.2742 => 3.3694, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.87% (14.8535 => 15.2793, std. dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 2.82% (14.5298 => 14.9394, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.81% (2.1007 => 2.1597, std. dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7088, std. dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 2.49% (4.6629 => 4.7792, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5188 => 1.5565, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.10% (0.6250 => 0.6381, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.75% (0.9108 => 0.9267, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.47% (1.0313 => 1.0465, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (6.2785 => 6.3609, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.26% (33.2944 => 33.7134, std. dev.: 0.0176) MultiSource/Applications/lua/lua: 1.17% (3.7467 => 3.7906, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5202, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2614, std. dev.: 0.0324) SingleSource/Benchmarks/Misc/mandel-2: 7.21% (1.2998 => 1.3935, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7539, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7076, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9664, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9751, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.19% (1.0310 => 1.0433, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1860, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2308 => 1.1063, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.09% (20.3410 => 18.4925, std. dev.: 0.0902) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3136, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.87% (1.9762 => 1.9195, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5950, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: -2.33% (3.0263 => 2.9557, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2231, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5111, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2139, std. dev.: 0.0243) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8580, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2163, std. dev.: 0.0217) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2520, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 20:18:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 22:18:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807031817.954282A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2697?compare_to=2694&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2697, Order: 161380, Start Time: 2012-08-07 02:00:15, End Time: 2012-08-07 03:18:54 To: 2694, Order: 161359, Start Time: 2012-08-07 00:13:42, End Time: 2012-08-07 01:32:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (106 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (733 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.05% (10.9084 => 11.0232, std. dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.80% (13.6895 => 13.4429, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.67% (10.3673 => 13.4429, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 13.01% (0.3473 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.75% (0.3497 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3543 => 0.3992, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3543 => 0.3992, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 12.64% (0.3561 => 0.4011, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.53% (1.1194 => 1.2597, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 12.45% (0.3694 => 0.4154, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.79% (0.3886 => 0.4344, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.74% (0.3927 => 0.4388, std. dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.67% (2.2022 => 2.3931, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (1.7609 => 1.9100, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.58% (0.3177 => 0.3386, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.89% (0.6030 => 0.6385, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (10.4361 => 11.0232, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.55% (0.2107 => 0.2224, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4615 => 0.4868, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.4879 => 0.5146, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.34% (7.0540 => 7.4310, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/oourafft: 5.24% (0.3282 => 0.3454, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.11% (0.7326 => 0.7700, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (0.7433 => 0.7794, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.76% (9.4845 => 9.9363, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 4.74% (0.2554 => 0.2675, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.8172 => 0.8550, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.45% (0.5860 => 0.6121, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.41% (4.9449 => 5.1629, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (5.0018 => 5.2195, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5569 => 0.5808, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.03% (4.2646 => 4.4366, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.94% (0.3121 => 0.3244, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3423 => 0.3557, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.86% (0.3109 => 0.3229, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.85% (0.7835 => 0.8137, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 3.84% (0.3180 => 0.3302, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.78% (0.2700 => 0.2802, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.77% (0.2758 => 0.2862, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (8.1363 => 8.4412, std. dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 3.68% (5.7591 => 5.9711, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.59% (1.1861 => 1.2287, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.4636 => 0.4800, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.53% (0.4103 => 0.4248, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.48% (1.3050 => 1.3504, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.38% (1.1642 => 1.2035, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (14.3668 => 14.8412, std. dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/hash: 3.29% (0.4289 => 0.4430, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 3.26% (1.5603 => 1.6112, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.25% (0.3136 => 0.3238, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.25% (0.5105 => 0.5271, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.23% (2.2024 => 2.2736, std. dev.: 0.0129) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.19% (2.0273 => 2.0920, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.14% (3.3354 => 3.4400, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.13% (0.3865 => 0.3986, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4299 => 0.4432, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.07% (0.6456 => 0.6654, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.06% (0.3826 => 0.3943, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.04% (0.8067 => 0.8312, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.03% (1.5415 => 1.5882, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (0.4064 => 0.4187, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.00% (3.8723 => 3.9885, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.92% (2.0665 => 2.1269, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (1.5859 => 1.6317, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 2.89% (0.3603 => 0.3707, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.79% (0.9765 => 1.0037, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.73% (0.6675 => 0.6857, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (0.3935 => 0.4042, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.54% (1.4186 => 1.4547, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.53% (0.6450 => 0.6613, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8921 => 0.9137, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5981 => 0.6125, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.5020 => 0.5135, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.28% (2.2969 => 2.3492, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.23% (1.2842 => 1.3129, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.20% (17.1811 => 17.5586, std. dev.: 0.0129) MultiSource/Applications/minisat/minisat: 2.19% (0.7115 => 0.7271, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.87% (1.1840 => 1.2061, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.63% (1.0722 => 1.0897, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.36% (4.2280 => 4.4122, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7591, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.80% (1.5086 => 1.5357, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 1.63% (3.1578 => 3.2092, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8318, std. dev.: 0.0023) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2284, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.02% (26.0924 => 26.3581, std. dev.: 0.0289) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.79% (5.2763 => 3.1767, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.72% (5.3855 => 3.7312, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.38% (5.3526 => 3.7264, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1979, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.99% (2.9384 => 2.5568, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -11.81% (22.1758 => 19.5572, std. dev.: 0.0286) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2373 => 1.1162, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -8.28% (1.5373 => 1.4100, std. dev.: 0.0198) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.34% (19.9488 => 18.4854, std. dev.: 0.0563) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.08% (1.5835 => 1.5030, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.59% (1.9577 => 1.8679, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5952, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4848, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9033, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4157, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0001, std. dev.: 0.0096) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2006, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3155, std. dev.: 0.0055) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4191, std. dev.: 0.0094) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 21:33:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 6 Aug 2012 23:33:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807043303.25FD12A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2698?compare_to=2696&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2698, Order: 161380, Start Time: 2012-08-07 03:19:45, End Time: 2012-08-07 04:33:39 To: 2696, Order: 161379, Start Time: 2012-08-07 01:37:49, End Time: 2012-08-07 02:51:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.88% (0.5373 => 0.5474, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.56% (2.0176 => 2.3113, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 9.98% (0.3578 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.86% (0.3601 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3646 => 0.4003, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.74% (0.3623 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.72% (0.3663 => 0.4019, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.71% (0.5818 => 0.6383, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.70% (0.3650 => 0.4004, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3789 => 0.4153, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.53% (0.3914 => 0.4287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.46% (0.5748 => 0.6292, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.43% (0.7061 => 0.7727, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.27% (0.4003 => 0.4374, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.16% (0.3940 => 0.4301, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 7.60% (1.3693 => 1.4733, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.41% (0.7710 => 0.8281, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4328 => 0.4648, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.21% (3.9660 => 4.2521, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.84% (0.4062 => 0.4340, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7038 => 0.7513, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.2937 => 0.3135, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.69% (0.3485 => 0.3718, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2726 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.55% (0.3022 => 0.3220, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.48% (0.3149 => 0.3353, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2761 => 0.2939, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3107 => 0.3307, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.42% (1.9828 => 2.1101, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3489 => 0.3710, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.31% (0.3899 => 0.4145, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2988 => 0.3176, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.4379 => 0.4654, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.26% (0.3580 => 0.3804, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.05% (0.3453 => 0.3662, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.89% (0.3293 => 0.3487, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.88% (0.6959 => 0.7368, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.83% (1.2193 => 1.2904, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.74% (0.4390 => 0.4642, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.66% (0.3534 => 0.3734, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.57% (0.9199 => 0.9711, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.50% (0.5577 => 0.5884, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.48% (0.4016 => 0.4236, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.43% (13.8202 => 14.5708, std. dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/moments: 5.43% (0.3868 => 0.4078, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (0.3756 => 0.3959, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 5.35% (16.6129 => 17.5010, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.15% (1.3819 => 1.4530, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.07% (1.3813 => 1.4514, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.99% (1.4563 => 1.5289, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.5637 => 0.5912, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (13.2842 => 13.9315, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (7.2180 => 7.5697, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.84% (0.3246 => 0.3403, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.78% (0.7506 => 0.7865, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.77% (1.2292 => 1.2878, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.76% (3.8646 => 4.0484, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 4.72% (0.8310 => 0.8702, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.72% (1.1364 => 1.1900, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.71% (1.1061 => 1.1582, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.55% (1.0594 => 1.1076, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.53% (0.7460 => 0.7798, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.52% (1.3245 => 1.3844, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.48% (1.9270 => 2.0133, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.37% (0.3755 => 0.3919, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.33% (3.6692 => 3.8281, std. dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.08% (4.3801 => 4.5589, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (4.4433 => 4.6236, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3220 => 0.3349, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.86% (0.4791 => 0.4976, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.81% (2.1791 => 2.2621, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.79% (0.8698 => 0.9028, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.72% (0.6135 => 0.6363, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.9865 => 5.1718, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1333 => 1.1750, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.6283 => 0.6507, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.40% (0.4113 => 0.4253, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.32% (3.2742 => 3.3829, std. dev.: 0.0141) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (8.4961 => 8.7748, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 3.18% (3.1889 => 3.2904, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (6.5754 => 6.7714, std. dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 2.89% (14.8535 => 15.2830, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (2.1007 => 2.1612, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.82% (16.2614 => 16.7205, std. dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 2.78% (14.5298 => 14.9337, std. dev.: 0.0148) MultiSource/Applications/oggenc/oggenc: 2.57% (4.6629 => 4.7829, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (1.5188 => 1.5570, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.19% (0.6250 => 0.6387, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (0.9108 => 0.9273, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.61% (1.0313 => 1.0479, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.38% (6.2785 => 6.3653, std. dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7351, std. dev.: 0.0192) MultiSource/Applications/lua/lua: 1.29% (3.7467 => 3.7949, std. dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5122, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 24.88% (1.8175 => 2.2697, std. dev.: 0.0211) SingleSource/Benchmarks/Misc/mandel-2: 8.02% (1.2998 => 1.4040, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.45% (0.9996 => 1.0541, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7548, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7071, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8147, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1399, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1913, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1100, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.92% (20.3410 => 18.5264, std. dev.: 0.0628) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3089, std. dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.8259 => 8.5688, std. dev.: 0.0297) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0092) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9540, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2237, std. dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.03% (6.6320 => 6.4973, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2136, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0046, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2452, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8651, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 22:24:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 00:24:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120807052405.A9E9A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2699?compare_to=2695&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2699, Order: 161380, Start Time: 2012-08-07 02:41:07, End Time: 2012-08-07 05:24:42 To: 2695, Order: 161356, Start Time: 2012-08-06 23:29:27, End Time: 2012-08-07 02:12:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (109 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (771 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.30% (0.3465 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.29% (0.3446 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.27% (0.3496 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3442 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.20% (0.3469 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.18% (0.3460 => 0.3916, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.76% (0.3643 => 0.4108, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3724 => 0.4185, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.04% (0.3792 => 0.4059, std. dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 6.94% (1.5932 => 1.7037, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.61% (0.5826 => 0.6211, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.5889 => 0.6262, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.79% (3.5627 => 3.7691, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (1.6211 => 1.7146, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.55% (1.3152 => 1.3882, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (0.4361 => 0.4596, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (0.5026 => 0.5294, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.31% (0.5900 => 0.6213, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.22% (0.5000 => 0.5261, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7171 => 0.7533, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.85% (4.2109 => 4.4151, std. dev.: 0.0082) MultiSource/Applications/d/make_dparser: 4.72% (1.0781 => 1.1290, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.64% (0.2738 => 0.2865, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (2.7292 => 2.8528, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.26% (0.3004 => 0.3132, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.11% (0.9909 => 1.0316, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (1.9694 => 2.0500, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2750 => 0.2862, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.05% (5.5417 => 5.7663, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.05% (2.0673 => 2.1510, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3195 => 0.3324, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2792 => 0.2903, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 3.94% (2.1013 => 2.1840, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.92% (0.2729 => 0.2836, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.92% (0.2911 => 0.3025, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2714 => 0.2820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.84% (0.3096 => 0.3215, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (1.9966 => 2.0731, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.2823 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.80% (0.2813 => 0.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2803 => 0.2909, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.3362 => 0.3489, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.76% (0.3267 => 0.3390, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.74% (0.4139 => 0.4294, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.2780 => 0.2884, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3258 => 0.3379, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.69% (0.3060 => 0.3173, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.68% (0.3317 => 0.3439, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.3124 => 0.3238, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.63% (0.4658 => 0.4827, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.56% (2.1653 => 2.2423, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.3678 => 0.3808, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.52% (0.7875 => 0.8152, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (1.8794 => 1.9454, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.51% (0.9697 => 1.0037, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.49% (0.3726 => 0.3856, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (4.4195 => 4.5736, std. dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 3.49% (23.5202 => 24.3400, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.3903 => 0.4039, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3348 => 0.3464, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.45% (4.6177 => 4.7769, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3477 => 0.3596, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.32% (0.4251 => 0.4392, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3690 => 0.3810, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4146 => 0.4280, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 3.07% (1.4269 => 1.4707, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.06% (0.3981 => 0.4103, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.00% (0.6634 => 0.6833, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.86% (0.3845 => 0.3955, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.6435 => 0.6619, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.83% (0.5546 => 0.5703, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.5012 => 0.5153, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.95% (2.0346 => 2.0742, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6645, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8909, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std. dev.: 0.0244) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6868, std. dev.: 0.0478) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1998, std. dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (41.7953 => 42.6434, std. dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4953, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2280, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5899, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.07% (6.9842 => 7.0589, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5261, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary2: -10.70% (0.2402 => 0.2145, std. dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: -8.20% (17.2379 => 15.8239, std. dev.: 0.1929) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7846, std. dev.: 0.0177) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8000, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -3.57% (14.0481 => 13.5462, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9679, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 23:08:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 01:08:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807060847.82A9D2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2700?compare_to=2697&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2700, Order: 161388, Start Time: 2012-08-07 04:50:53, End Time: 2012-08-07 06:09:24 To: 2697, Order: 161380, Start Time: 2012-08-07 02:00:15, End Time: 2012-08-07 03:18:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (111 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (729 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (13.4429 => 13.6508, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 1.31% (0.7700 => 0.7801, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.69% (54.9410 => 56.4205, std. dev.: 0.1629) SingleSource/Benchmarks/Misc/mandel-2: 1.45% (1.4100 => 1.4304, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.42% (3.8191 => 3.7649, std. dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.67% (10.3673 => 13.6508, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 13.27% (0.3473 => 0.3934, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 13.01% (0.3497 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.91% (0.3516 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3543 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3543 => 0.3998, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.81% (0.3561 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3694 => 0.4157, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3828 => 0.4299, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.04% (0.3886 => 0.4354, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2512, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.24% (2.2022 => 2.3837, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.73% (1.7609 => 1.8971, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.52% (0.1622 => 0.1744, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.05% (0.5925 => 0.6343, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 6.48% (0.7326 => 0.7801, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4615 => 0.4871, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.18% (10.4361 => 10.9769, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (7.0540 => 7.4134, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.3282 => 0.3447, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.94% (0.7433 => 0.7800, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.89% (0.8172 => 0.8572, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.76% (9.4845 => 9.9358, std. dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.71% (0.3121 => 0.3268, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.66% (0.2554 => 0.2673, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.40% (4.9449 => 5.1623, std. dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.38% (5.0018 => 5.2211, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.27% (0.5860 => 0.6110, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5569 => 0.5802, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.13% (4.2646 => 4.4409, std. dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/strcat: 4.03% (0.2831 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3232 => 0.3361, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.87% (8.1363 => 8.4508, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.86% (0.3423 => 0.3555, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.84% (0.2758 => 0.2864, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 3.84% (0.7835 => 0.8136, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.84% (0.3180 => 0.3302, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.2700 => 0.2803, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.2905 => 0.3015, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.77% (0.4636 => 0.4811, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.4103 => 0.4257, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.73% (0.3109 => 0.3225, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 3.73% (1.5603 => 1.6185, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3283 => 0.3402, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.60% (0.3387 => 0.3509, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1861 => 1.2283, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.51% (0.3650 => 0.3778, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3865 => 0.4000, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.48% (5.7591 => 5.9593, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.47% (1.3050 => 1.3503, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3826 => 0.3958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.42% (0.3098 => 0.3204, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.41% (0.3052 => 0.3156, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.38% (0.4289 => 0.4434, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 3.36% (0.3422 => 0.3537, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.36% (1.1642 => 1.2033, std. dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3935 => 0.4067, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.35% (0.3136 => 0.3241, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (14.3668 => 14.8478, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.33% (2.0665 => 2.1354, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.26% (0.3162 => 0.3265, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (1.5415 => 1.5902, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.14% (0.6456 => 0.6659, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.14% (0.8067 => 0.8320, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.13% (2.0273 => 2.0908, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.4064 => 0.4191, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.08% (3.3354 => 3.4381, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.04% (0.3684 => 0.3796, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.02% (2.2024 => 2.2690, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4299 => 0.4429, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.97% (3.8723 => 3.9874, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 2.86% (0.4620 => 0.4752, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (1.5859 => 1.6306, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.78% (0.4203 => 0.4320, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.5105 => 0.5247, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.4048 => 0.4160, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.73% (0.9765 => 1.0032, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.63% (1.2842 => 1.3180, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.50% (0.6450 => 0.6611, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.43% (0.6675 => 0.6837, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.41% (1.4186 => 1.4528, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5981 => 0.6125, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8921 => 0.9120, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.22% (2.2969 => 2.3478, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.98% (17.1811 => 17.5207, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: 1.91% (0.7115 => 0.7251, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.80% (1.1840 => 1.2053, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.57% (1.0722 => 1.0890, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.82% (4.2280 => 4.3896, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5339, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8330, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2492, std. dev.: 0.0078) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2038, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.13% (26.0924 => 26.3863, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1652, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.15% (5.3855 => 3.7078, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7033, std. dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1424, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.31% (2.9384 => 2.5472, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -11.92% (22.1758 => 19.5318, std. dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2373 => 1.1137, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.27% (19.9488 => 18.4980, std. dev.: 0.0901) SingleSource/Benchmarks/Misc/mandel-2: -6.95% (1.5373 => 1.4304, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.16% (1.9577 => 1.8763, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4788, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9105, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0037, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.6802 => 8.4445, std. dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3241, std. dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4183, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 6 23:15:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 01:15:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807061506.992142A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2701?compare_to=2698&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2701, Order: 161388, Start Time: 2012-08-07 05:01:47, End Time: 2012-08-07 06:15:42 To: 2698, Order: 161380, Start Time: 2012-08-07 03:19:45, End Time: 2012-08-07 04:33:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.48% (1.0541 => 0.9963, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.53% (2.0176 => 2.3107, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 9.52% (0.7061 => 0.7733, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5818 => 0.6370, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.29% (0.5748 => 0.6282, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.11% (0.3646 => 0.3978, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.05% (0.3623 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.60% (0.3940 => 0.4279, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.73% (1.3693 => 1.4751, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (3.9660 => 4.2473, std. dev.: 0.0070) SingleSource/Regression/C++/ofstream_ctor: 7.01% (0.2781 => 0.2976, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5265 => 0.5625, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.79% (0.7038 => 0.7516, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2726 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.28% (0.2721 => 0.2892, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.27% (0.2966 => 0.3152, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (0.3149 => 0.3345, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.18% (0.3899 => 0.4140, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.10% (0.3489 => 0.3702, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.05% (1.9828 => 2.1028, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.4379 => 0.4642, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.89% (0.2988 => 0.3164, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.6959 => 0.7366, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.83% (0.4390 => 0.4646, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3192 => 0.3375, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.71% (1.2193 => 1.2889, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 5.59% (0.3453 => 0.3646, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.53% (0.2243 => 0.2367, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.44% (0.9199 => 0.9699, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 5.34% (0.3293 => 0.3469, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 5.29% (13.8202 => 14.5518, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.18% (0.4016 => 0.4224, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3534 => 0.3717, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.2925 => 0.3075, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 5.02% (16.6129 => 17.4476, std. dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/moments: 5.02% (0.3868 => 0.4062, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.88% (7.2180 => 7.5704, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.88% (1.4563 => 1.5273, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.69% (1.1364 => 1.1897, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.3819 => 1.4461, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (1.3813 => 1.4448, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.56% (0.8310 => 0.8689, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.56% (1.1061 => 1.1565, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 4.56% (1.9270 => 2.0148, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (13.2842 => 13.8891, std. dev.: 0.0193) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2292 => 1.2847, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 4.48% (3.8646 => 4.0376, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (1.3245 => 1.3831, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.7460 => 0.7788, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.37% (1.0594 => 1.1057, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (3.6692 => 3.8200, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (4.4433 => 4.6234, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.99% (0.3755 => 0.3905, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5543, std. dev.: 0.0100) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.93% (2.1791 => 2.2648, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1333 => 1.1750, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.4791 => 0.4961, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.38% (0.8698 => 0.8992, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.9865 => 5.1528, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.29% (0.6135 => 0.6337, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.24% (8.4961 => 8.7715, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.05% (3.1889 => 3.2862, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (6.5754 => 6.7695, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.86% (3.2742 => 3.3678, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2764, std. dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 2.83% (4.6629 => 4.7950, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7214, std. dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (2.1007 => 2.1593, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.66% (14.5298 => 14.9162, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5188 => 1.5572, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.02% (0.9108 => 0.9292, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6250 => 0.6374, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.27% (3.7467 => 3.7944, std. dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.20% (6.2785 => 6.3537, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.15% (33.2944 => 33.6776, std. dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.45% (5.7573 => 7.5104, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2645, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/mandel-2: 8.41% (1.2998 => 1.4091, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7557, std. dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7049, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4565, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.60% (1.9290 => 1.9598, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.46% (5.5130 => 5.5937, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0310 => 1.0435, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6865, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1404, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1504, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.75% (1.2308 => 1.1108, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.83% (20.3410 => 18.5448, std. dev.: 0.0245) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.50% (0.3139 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.91% (1.9762 => 1.9186, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6013, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9556, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2284, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3305 => 7.2140, std. dev.: 0.0260) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0198) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2485, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.16% (3.8887 => 3.8435, std. dev.: 0.0079) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2326, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 00:58:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 02:58:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807075842.0151E2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2702?compare_to=2700&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2702, Order: 161394, Start Time: 2012-08-07 06:37:33, End Time: 2012-08-07 07:59:17 To: 2700, Order: 161388, Start Time: 2012-08-07 04:50:53, End Time: 2012-08-07 06:09:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 2 (32 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 26.89% (0.4209 => 0.5341, std. dev.: 0.0340) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.39% (2.1354 => 2.1058, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -1.04% (1.3180 => 1.3043, std. dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 39.93% (0.3817 => 0.5341, std. dev.: 0.0340) MultiSource/Benchmarks/PAQ8p/paq8p: 30.70% (10.3673 => 13.5499, std. dev.: 0.0389) SingleSource/UnitTests/ObjC/trivial-interface: 11.95% (0.3473 => 0.3888, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 11.63% (0.3561 => 0.3975, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.28% (2.2022 => 2.3846, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.60% (1.7609 => 1.8947, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.2065 => 0.2211, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.62% (0.5925 => 0.6258, std. dev.: 0.0119) SingleSource/UnitTests/ObjC++/property-reference-object: 5.56% (0.6030 => 0.6365, std. dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.8172 => 0.8596, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.4615 => 0.4853, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.95% (7.0540 => 7.4031, std. dev.: 0.0101) MultiSource/Applications/lambda-0_1_3/lambda: 4.84% (0.7433 => 0.7793, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 4.81% (0.3282 => 0.3440, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2700 => 0.2828, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 4.69% (10.4361 => 10.9257, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.49% (0.5860 => 0.6123, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.5569 => 0.5818, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.16% (0.7835 => 0.8161, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (5.0018 => 5.2098, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1432, std. dev.: 0.0130) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.97% (4.2646 => 4.4338, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 3.80% (0.3423 => 0.3553, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 3.67% (0.3109 => 0.3223, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.65% (0.3180 => 0.3296, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1861 => 1.2283, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.55% (1.3050 => 1.3513, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.44% (8.1363 => 8.4163, std. dev.: 0.0097) MultiSource/Applications/oggenc/oggenc: 3.38% (5.7591 => 5.9536, std. dev.: 0.0033) MultiSource/Applications/Burg/burg: 3.38% (1.1642 => 1.2035, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.8067 => 0.8338, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.25% (2.0273 => 2.0931, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (14.3668 => 14.8177, std. dev.: 0.0190) MultiSource/Applications/d/make_dparser: 3.12% (3.3354 => 3.4394, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.07% (0.4299 => 0.4431, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.03% (1.5603 => 1.6076, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.4103 => 0.4224, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (1.5859 => 1.6320, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.89% (3.8723 => 3.9844, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.83% (2.2024 => 2.2647, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.83% (0.5020 => 0.5162, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.5415 => 1.5851, std. dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.6450 => 0.6621, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4289 => 0.4401, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.54% (0.9765 => 1.0013, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (1.4186 => 1.4534, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 2.40% (2.2969 => 2.3520, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8921 => 0.9127, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.29% (0.6675 => 0.6828, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 2.06% (17.1811 => 17.5346, std. dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (2.0665 => 2.1058, std. dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 1.80% (1.1840 => 1.2053, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: 1.62% (0.7115 => 0.7230, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3043, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.49% (1.0722 => 1.0882, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.46% (4.2280 => 4.4167, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7592, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.73% (1.5086 => 1.5347, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2124, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8332, std. dev.: 0.0005) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2048, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2272, std. dev.: 0.0127) MultiSource/Applications/lua/lua: 1.19% (26.0924 => 26.4027, std. dev.: 0.0417) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1498, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.99% (5.3855 => 3.7163, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7113, std. dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1371, std. dev.: 1.1593) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5534, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -11.76% (22.1758 => 19.5680, std. dev.: 0.0298) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.78% (1.2373 => 1.1163, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -8.78% (1.5373 => 1.4023, std. dev.: 0.0166) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.56% (19.9488 => 18.4414, std. dev.: 0.1177) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.02% (1.5835 => 1.5040, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4833, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (8.1563 => 7.9007, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4330, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0003, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2000, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3238, std. dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0146) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.34% (1.8329 => 1.8083, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 01:00:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 03:00:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807080023.234B92A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2703?compare_to=2701&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2703, Order: 161394, Start Time: 2012-08-07 06:43:48, End Time: 2012-08-07 08:00:57 To: 2701, Order: 161388, Start Time: 2012-08-07 05:01:47, End Time: 2012-08-07 06:15:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (101 on baseline) Performance Improvements: 1 (27 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.13% (1.1108 => 1.0983, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.06% (2.0176 => 2.3215, std. dev.: 0.0535) SingleSource/UnitTests/ObjC++/property-reference-object: 9.21% (0.5818 => 0.6354, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.11% (0.3130 => 0.3415, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 8.96% (0.7061 => 0.7694, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5748 => 0.6259, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.55% (0.3578 => 0.3884, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.37% (1.3693 => 1.4839, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.92% (0.4003 => 0.4320, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.92% (0.3940 => 0.4252, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.91% (0.2655 => 0.2865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (0.4328 => 0.4657, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2966 => 0.3184, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2696 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.05% (0.2937 => 0.3144, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (3.9660 => 4.2455, std. dev.: 0.1052) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3489 => 0.3732, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.83% (0.4390 => 0.4690, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.80% (0.3149 => 0.3363, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3192 => 0.3405, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.54% (0.3580 => 0.3814, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sieve: 6.23% (0.3453 => 0.3668, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.16% (0.3293 => 0.3496, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.3756 => 0.3977, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3534 => 0.3741, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.66% (0.3868 => 0.4087, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.39% (13.8202 => 14.5645, std. dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 5.26% (16.6129 => 17.4861, std. dev.: 0.2436) MultiSource/Applications/hexxagon/hexxagon: 5.14% (1.2292 => 1.2924, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.76% (1.1061 => 1.1587, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.44% (1.9270 => 2.0126, std. dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.15% (0.4791 => 0.4990, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.86% (2.1791 => 2.2633, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.84% (0.8698 => 0.9032, std. dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.60% (4.9865 => 5.1659, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.49% (0.6283 => 0.6502, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (8.4961 => 8.7855, std. dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 3.06% (14.8535 => 15.3080, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.05% (3.1889 => 3.2862, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.04% (3.2742 => 3.3737, std. dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (6.5754 => 6.7736, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.98% (2.1007 => 2.1632, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.87% (16.2614 => 16.7283, std. dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 2.71% (14.5298 => 14.9240, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5188 => 1.5584, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.60% (4.6629 => 4.7842, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.17% (3.7467 => 3.7907, std. dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 1.11% (33.2944 => 33.6653, std. dev.: 0.0188) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/mandel-2: 7.78% (1.2998 => 1.4009, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6757, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 4.28% (7.4271 => 7.7449, std. dev.: 0.0196) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7059, std. dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: 1.23% (1.9290 => 1.9527, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.20% (1.0310 => 1.0434, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6878, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1399, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1977, std. dev.: 0.0448) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0131) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0983, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (20.3410 => 18.5947, std. dev.: 0.0180) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.35% (0.4366 => 0.4176, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6051, std. dev.: 0.0795) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9561, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2213, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2144, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.5254 => 2.4920, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2209, std. dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2532, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 01:37:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 03:37:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120807083724.DEE102A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2704?compare_to=2699&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2704, Order: 161393, Start Time: 2012-08-07 05:52:36, End Time: 2012-08-07 08:37:59 To: 2699, Order: 161380, Start Time: 2012-08-07 02:41:07, End Time: 2012-08-07 05:24:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (774 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.65% (0.2093 => 0.2274, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.05% (2.4779 => 2.4519, std. dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.12% (0.3460 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3469 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.04% (0.3488 => 0.3943, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.58% (0.3650 => 0.4109, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3724 => 0.4182, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5826 => 0.6240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5889 => 0.6300, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (1.6211 => 1.7197, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 6.06% (1.5932 => 1.6898, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.89% (0.4994 => 0.5288, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.86% (3.5627 => 3.7716, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.74% (1.3152 => 1.3907, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (0.4361 => 0.4607, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.55% (0.5026 => 0.5305, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 5.41% (0.7171 => 0.7559, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (0.3930 => 0.4138, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (0.5000 => 0.5260, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.5900 => 0.6206, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 5.04% (4.2109 => 4.4230, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 5.01% (0.4029 => 0.4231, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.88% (2.7292 => 2.8623, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.79% (0.2566 => 0.2689, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 4.73% (0.2725 => 0.2854, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.73% (0.2875 => 0.3011, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 4.53% (0.3004 => 0.3140, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.51% (0.2750 => 0.2874, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.50% (0.9909 => 1.0355, std. dev.: 0.0072) MultiSource/Applications/d/make_dparser: 4.45% (1.0781 => 1.1261, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.42% (0.2738 => 0.2859, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.34% (2.0673 => 2.1571, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2780 => 0.2899, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3258 => 0.3397, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.25% (0.2803 => 0.2922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (1.9694 => 2.0520, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2823 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.16% (0.3267 => 0.3403, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.16% (0.2813 => 0.2930, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (1.9966 => 2.0795, std. dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (2.1013 => 2.1881, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.12% (0.2911 => 0.3031, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3096 => 0.3223, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.07% (0.3362 => 0.3499, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3317 => 0.3452, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.99% (0.3060 => 0.3182, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.92% (5.5417 => 5.7591, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.3124 => 0.3245, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.86% (0.3890 => 0.4040, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (0.4658 => 0.4837, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3348 => 0.3472, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.67% (4.6177 => 4.7872, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.3678 => 0.3812, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.62% (2.1653 => 2.2437, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 3.60% (0.3726 => 0.3860, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.56% (1.8794 => 1.9464, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.56% (0.6634 => 0.6870, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4146 => 0.4291, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.3903 => 0.4039, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.48% (0.3477 => 0.3598, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (4.4195 => 4.5727, std. dev.: 0.0049) MultiSource/Applications/hbd/hbd: 3.44% (0.9697 => 1.0031, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.36% (0.4139 => 0.4278, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.34% (0.4251 => 0.4393, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.30% (0.7875 => 0.8135, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3690 => 0.3809, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.22% (0.3981 => 0.4109, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 3.19% (23.5202 => 24.2698, std. dev.: 0.0278) MultiSource/Applications/lua/lua: 3.17% (1.4269 => 1.4722, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.3845 => 0.3965, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.76% (0.5546 => 0.5699, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.72% (2.0346 => 2.0695, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9640, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.16% (0.2122 => 0.2274, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6725, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8905, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6384, std. dev.: 0.0719) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1930, std. dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (41.7953 => 42.6202, std. dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4977, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.10% (6.9842 => 7.0607, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.18% (11.9555 => 11.8148, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5439, std. dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/fldry: -8.98% (17.2379 => 15.6906, std. dev.: 0.1578) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std. dev.: 0.0324) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7956, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -3.66% (14.0481 => 13.5339, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5834, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9618, std. dev.: 0.0555) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 03:00:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 05:00:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807100027.822DD2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2705?compare_to=2703&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2705, Order: 161403, Start Time: 2012-08-07 08:47:10, End Time: 2012-08-07 10:00:57 To: 2703, Order: 161394, Start Time: 2012-08-07 06:43:48, End Time: 2012-08-07 08:00:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (142 on baseline) Performance Improvements: 4 (28 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 946 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.91% (0.2942 => 0.3057, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.30% (3.2743 => 3.3495, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 1.30% (10.8311 => 10.9721, std. dev.: 0.0312) MultiSource/Applications/lambda-0_1_3/lambda: 1.26% (5.2532 => 5.3192, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (2.1175 => 2.0944, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: -1.06% (1.4839 => 1.4681, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.61% (1.6757 => 1.6488, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.09% (1.4556 => 1.4398, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.37% (2.0176 => 2.3075, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7061 => 0.7678, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.70% (0.5818 => 0.6324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.40% (0.5748 => 0.6231, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.97% (0.3578 => 0.3863, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.67% (0.3650 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.64% (0.3914 => 0.4213, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.63% (0.3789 => 0.4078, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.59% (0.3623 => 0.3898, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.22% (1.3693 => 1.4681, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7038 => 0.7534, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.7710 => 0.8245, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.92% (3.9660 => 4.2406, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.69% (0.2781 => 0.2967, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.61% (0.5265 => 0.5613, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2782 => 0.2964, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4062 => 0.4312, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 6.13% (0.2690 => 0.2855, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2655 => 0.2815, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.97% (0.2966 => 0.3143, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.95% (0.3899 => 0.4131, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2760 => 0.2923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.82% (0.2696 => 0.2853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2761 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.63% (1.9828 => 2.0944, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.61% (0.3580 => 0.3781, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.59% (0.4379 => 0.4624, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.6959 => 0.7344, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.53% (1.2193 => 1.2867, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.2988 => 0.3152, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.33% (0.9199 => 0.9689, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.22% (0.4390 => 0.4619, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5328, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.01% (1.4563 => 1.5293, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.83% (16.6129 => 17.4161, std. dev.: 0.0183) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.66% (1.1364 => 1.1893, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.52% (0.3868 => 0.4043, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.49% (3.8646 => 4.0381, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.47% (7.2180 => 7.5410, std. dev.: 0.0065) MultiSource/Applications/spiff/spiff: 4.46% (0.7506 => 0.7841, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.39% (0.8310 => 0.8675, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5637 => 0.5883, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.33% (1.1061 => 1.1540, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.30% (1.2292 => 1.2821, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.26% (1.9270 => 2.0091, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (13.2842 => 13.8499, std. dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3803, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 4.21% (2.1791 => 2.2708, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 4.15% (1.0594 => 1.1034, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.08% (1.3819 => 1.4383, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.04% (1.3813 => 1.4371, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.89% (0.3755 => 0.3901, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8083, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 3.78% (16.2614 => 16.8757, std. dev.: 0.0151) MultiSource/Applications/sgefa/sgefa: 3.74% (0.2995 => 0.3107, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (4.4433 => 4.6059, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.57% (4.3801 => 4.5366, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.38% (0.4791 => 0.4953, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.1333 => 1.1708, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1508, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.22% (0.8698 => 0.8978, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (8.4961 => 8.7454, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6135 => 0.6313, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2796, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.75% (0.4113 => 0.4226, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (6.5754 => 6.7543, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.70% (1.5188 => 1.5598, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.2742 => 3.3601, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 2.59% (14.8535 => 15.2389, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.5298 => 14.9020, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.1007 => 2.1540, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.29% (4.6629 => 4.7696, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 1.71% (0.6250 => 0.6357, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.44% (1.0313 => 1.0462, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5204, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4024, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7549, std. dev.: 0.0174) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.20% (1.5824 => 1.6488, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.16% (11.2619 => 11.7299, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.65% (2.8606 => 2.9650, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8182, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.34% (3.2729 => 3.3495, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.09% (10.7476 => 10.9721, std. dev.: 0.0312) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.03% (1.5089 => 1.5395, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5092, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0310 => 1.0440, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.5928 => 4.6465, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.02% (2.2986 => 2.3220, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.52% (22.5627 => 21.0923, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.70% (1.0460 => 0.8609, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2308 => 1.1001, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.88% (20.3410 => 18.5347, std. dev.: 0.0231) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.89% (0.8342 => 0.8101, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5904, std. dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9306, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.03% (3.0263 => 2.9650, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2277, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.95% (6.6320 => 6.5029, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3305 => 7.2114, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.50% (7.1097 => 7.0030, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.41% (28.2225 => 27.8235, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2246, std. dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 03:05:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 05:05:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807100517.4F38E2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2706?compare_to=2702&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2706, Order: 161403, Start Time: 2012-08-07 08:47:09, End Time: 2012-08-07 10:05:53 To: 2702, Order: 161394, Start Time: 2012-08-07 06:37:33, End Time: 2012-08-07 07:59:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (87 on baseline) Performance Improvements: 4 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 924 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.25% (17.5346 => 17.7540, std. dev.: 0.0203) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.81% (0.2943 => 0.3055, std. dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.34% (55.2472 => 56.5394, std. dev.: 0.0823) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (1.5347 => 1.5562, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 1.27% (5.2548 => 5.3215, std. dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 1.26% (3.7741 => 3.8216, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.71% (1.6786 => 1.6499, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.52% (0.8600 => 0.8469, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.39% (2.3376 => 2.3051, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.27% (1.4536 => 1.4352, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.80% (10.3673 => 13.6644, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2540, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.06% (0.3473 => 0.3857, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.70% (0.3543 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.01% (0.3886 => 0.4275, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.96% (2.2022 => 2.3996, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.68% (1.7609 => 1.8962, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.80% (0.6030 => 0.6380, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.71% (10.4361 => 11.0317, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 5.69% (0.5925 => 0.6262, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.42% (0.7326 => 0.7723, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.32% (7.0540 => 7.4294, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: 5.15% (0.3282 => 0.3451, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.4615 => 0.4851, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.06% (0.4879 => 0.5126, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (0.7433 => 0.7770, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.20% (0.8172 => 0.8515, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 4.20% (9.4845 => 9.8825, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (5.0018 => 5.2084, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1433, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.75% (0.5860 => 0.6080, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (4.2646 => 4.4229, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.61% (5.7591 => 5.9672, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.38% (8.1363 => 8.4117, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 3.33% (17.1811 => 17.7540, std. dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.3050 => 1.3464, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.5415 => 1.5873, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (14.3668 => 14.7868, std. dev.: 0.0143) MultiSource/Applications/d/make_dparser: 2.91% (3.3354 => 3.4326, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 2.90% (2.0273 => 2.0860, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.86% (1.1642 => 1.1975, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.8067 => 0.8297, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.75% (3.8723 => 3.9788, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.74% (2.2024 => 2.2628, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.72% (1.5603 => 1.6027, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.61% (0.4636 => 0.4757, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5859 => 1.6264, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9765 => 1.0012, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8921 => 0.9129, std. dev.: 0.0065) MultiSource/Applications/siod/siod: 2.27% (2.2969 => 2.3490, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.22% (0.6450 => 0.6593, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6456 => 0.6597, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5020 => 0.5128, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6675 => 0.6816, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.4186 => 1.4482, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.93% (2.0665 => 2.1064, std. dev.: 0.0117) MultiSource/Applications/minisat/minisat: 1.73% (0.7115 => 0.7238, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.73% (1.2842 => 1.3064, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 1.43% (1.1840 => 1.2009, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.42% (1.0722 => 1.0874, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.03% (2.6778 => 2.9732, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.15% (4.2280 => 4.4035, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7569, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.16% (1.5086 => 1.5562, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2163, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2451, std. dev.: 0.0057) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.38% (11.6436 => 11.8046, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.37% (26.0924 => 26.4495, std. dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.15% (3.7781 => 3.8216, std. dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: 1.10% (5.2636 => 5.3215, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1605, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.75% (5.3855 => 3.7293, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7218, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0819, std. dev.: 0.0258) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.88% (2.9384 => 2.5598, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: -11.77% (22.1758 => 19.5650, std. dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.76% (19.9488 => 18.4011, std. dev.: 0.0558) SingleSource/Benchmarks/Misc/mandel-2: -7.56% (1.5373 => 1.4211, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.37% (1.5835 => 1.4984, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.91% (1.9577 => 1.8615, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.91% (1.5660 => 1.4891, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4888, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9072, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0924, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4197, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0003, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.82% (1.6805 => 1.6499, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6776, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3154, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.68% (0.8614 => 0.8469, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4193, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8129, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 04:42:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 06:42:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807114248.C31622A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2707?compare_to=2705&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2707, Order: 161409, Start Time: 2012-08-07 10:29:23, End Time: 2012-08-07 11:43:24 To: 2705, Order: 161403, Start Time: 2012-08-07 08:47:10, End Time: 2012-08-07 10:00:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 11 (150 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 942 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.48% (1.0968 => 1.1788, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 6.08% (18.5347 => 19.6622, std. dev.: 0.0502) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.90% (78.1430 => 81.1870, std. dev.: 0.4858) SingleSource/Benchmarks/Misc/richards_benchmark: 3.05% (1.1679 => 1.2035, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 2.93% (3.1190 => 3.2103, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.90% (12.0866 => 12.4367, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.69% (3.3495 => 3.4060, std. dev.: 0.0201) MultiSource/Benchmarks/Bullet/bullet: 1.42% (7.2114 => 7.3139, std. dev.: 0.0299) MultiSource/Applications/lemon/lemon: 1.37% (1.4398 => 1.4595, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.32% (1.3101 => 1.3274, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5029 => 6.5757, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.56% (0.0996 => 0.0851, std. dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.31% (2.0176 => 2.3064, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7061 => 0.7692, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5818 => 0.6330, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5748 => 0.6239, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.22% (0.3578 => 0.3872, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.09% (0.3646 => 0.3941, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.06% (1.3693 => 1.4797, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 8.05% (0.3601 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3663 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.94% (0.3789 => 0.4090, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-3: 7.87% (0.3623 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2781 => 0.2984, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.23% (0.7038 => 0.7547, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (3.9660 => 4.2509, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (0.4328 => 0.4635, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.05% (0.2782 => 0.2978, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.91% (0.7710 => 0.8243, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.5265 => 0.5618, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.69% (0.2690 => 0.2870, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.47% (0.2937 => 0.3127, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2696 => 0.2867, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.33% (0.3899 => 0.4146, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3489 => 0.3707, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.18% (0.3107 => 0.3299, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.13% (1.9828 => 2.1044, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.13% (0.3149 => 0.3342, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.2988 => 0.3166, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3192 => 0.3381, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.83% (0.5577 => 0.5902, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.6959 => 0.7363, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (1.2193 => 1.2895, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.71% (0.3453 => 0.3650, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.3293 => 0.3476, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9199 => 0.9703, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.43% (13.8202 => 14.5703, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3534 => 0.3725, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.33% (0.4390 => 0.4624, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.33% (0.4016 => 0.4230, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3756 => 0.3955, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.4563 => 1.5314, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.99% (16.6129 => 17.4413, std. dev.: 0.0133) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.90% (1.1364 => 1.1921, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.85% (1.2292 => 1.2888, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.84% (1.1061 => 1.1596, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.84% (0.3246 => 0.3403, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.79% (7.2180 => 7.5636, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.73% (0.8310 => 0.8703, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.71% (3.8646 => 4.0468, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (13.2842 => 13.8991, std. dev.: 0.0071) MultiSource/Applications/treecc/treecc: 4.58% (1.9270 => 2.0153, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.3245 => 1.3849, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.43% (1.3819 => 1.4431, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.41% (1.0594 => 1.1061, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5637 => 0.5885, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.39% (2.1791 => 2.2748, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.35% (1.3813 => 1.4414, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3755 => 0.3912, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.15% (16.2614 => 16.9367, std. dev.: 0.0148) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8163, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6208, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5475, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (0.4791 => 0.4971, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.8698 => 0.9018, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.57% (1.1333 => 1.1738, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (4.9865 => 5.1614, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.41% (0.6283 => 0.6497, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.39% (0.6135 => 0.6343, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.18% (3.1889 => 3.2903, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.17% (8.4961 => 8.7654, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (6.5754 => 6.7759, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.03% (1.5188 => 1.5648, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.99% (2.1007 => 2.1635, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.92% (3.2742 => 3.3699, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.86% (14.5298 => 14.9455, std. dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.8535 => 15.2750, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 2.45% (4.6629 => 4.7773, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.6250 => 0.6379, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.97% (0.9108 => 0.9287, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.68% (1.0313 => 1.0486, std. dev.: 0.0043) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.21% (3.7467 => 3.7921, std. dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2643, std. dev.: 0.0486) SingleSource/Benchmarks/Misc/mandel-2: 9.44% (1.2998 => 1.4225, std. dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.41% (1.5824 => 1.6522, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.32% (7.4271 => 7.7483, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/richards_benchmark: 4.11% (1.1560 => 1.2035, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.07% (3.2729 => 3.4060, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7010, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4367, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8182, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.19% (10.7476 => 10.9831, std. dev.: 0.0457) MultiSource/Applications/lemon/lemon: 2.08% (1.4298 => 1.4595, std. dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 1.99% (3.1476 => 3.2103, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.36% (4.5928 => 4.6552, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.19% (1.9290 => 1.9519, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6858, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.5627 => 21.1516, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1068, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.45% (6.2497 => 5.9713, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.67% (1.3780 => 1.3274, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.34% (20.3410 => 19.6622, std. dev.: 0.0502) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9248, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6038, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (0.8342 => 0.8142, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9573, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2300, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.53% (0.6615 => 0.6514, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8034, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.38% (9.3358 => 9.2071, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7929, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0149) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (84.4286 => 83.5247, std. dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 04:49:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 06:49:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120807114902.36A7B2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2708?compare_to=2704&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2708, Order: 161403, Start Time: 2012-08-07 09:06:16, End Time: 2012-08-07 11:49:39 To: 2704, Order: 161393, Start Time: 2012-08-07 05:52:36, End Time: 2012-08-07 08:37:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (107 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (772 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.58% (0.3465 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.57% (0.3446 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3460 => 0.3891, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.44% (0.3496 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.43% (0.3442 => 0.3870, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3488 => 0.3921, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.31% (0.3469 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.13% (0.3643 => 0.4085, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.60% (0.3724 => 0.4156, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5826 => 0.6236, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.83% (0.5889 => 0.6291, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.28% (1.5932 => 1.6933, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.76% (3.5627 => 3.7678, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (1.6211 => 1.7141, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (1.3152 => 1.3870, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 5.41% (0.7171 => 0.7559, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.30% (0.4361 => 0.4592, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.25% (0.5026 => 0.5290, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.96% (4.2109 => 4.4196, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 4.93% (1.0781 => 1.1312, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.89% (0.3930 => 0.4122, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.5900 => 0.6187, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.74% (0.4029 => 0.4220, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (2.7292 => 2.8554, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.46% (0.2738 => 0.2860, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.2736 => 0.2853, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.07% (0.2875 => 0.2992, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.06% (5.5417 => 5.7669, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (2.1013 => 2.1850, std. dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 3.98% (0.2566 => 0.2668, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (1.9694 => 2.0476, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.91% (0.3195 => 0.3320, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (1.9966 => 2.0747, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (0.3890 => 0.4042, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.89% (0.9909 => 1.0294, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.82% (4.6177 => 4.7940, std. dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2792 => 0.2897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (2.0673 => 2.1449, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2780 => 0.2883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.70% (0.2729 => 0.2830, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.69% (2.1653 => 2.2452, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 3.65% (0.3096 => 0.3209, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2803 => 0.2905, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.62% (0.9697 => 1.0048, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.3845 => 0.3984, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.2823 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.56% (0.2811 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.53% (0.3060 => 0.3168, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.53% (0.3317 => 0.3434, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.3903 => 0.4040, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.45% (0.3362 => 0.3478, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.43% (4.4195 => 4.5711, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.39% (0.7875 => 0.8142, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.35% (0.3348 => 0.3460, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.28% (0.3625 => 0.3744, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.28% (0.4146 => 0.4282, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.22% (1.8794 => 1.9399, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3678 => 0.3796, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.20% (0.3282 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.10% (23.5202 => 24.2493, std. dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.09% (0.4139 => 0.4267, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.09% (0.6634 => 0.6839, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 2.99% (0.3477 => 0.3581, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.99% (1.4269 => 1.4695, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.87% (0.3690 => 0.3796, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 2.87% (0.4251 => 0.4373, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3981 => 0.4091, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.76% (0.5546 => 0.5699, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.5012 => 0.5135, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.6435 => 0.6592, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.97% (2.0346 => 2.0747, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9635, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 8.58% (0.2122 => 0.2304, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8968, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std. dev.: 0.0836) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (105.3826 => 107.6968, std. dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std. dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (41.7953 => 42.6092, std. dev.: 0.0201) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4947, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.06% (6.9842 => 7.0584, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.02% (11.9555 => 11.8341, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5261, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary2: -9.58% (0.2402 => 0.2172, std. dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: -8.11% (17.2379 => 15.8404, std. dev.: 0.1922) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8105, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7932, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -3.63% (14.0481 => 13.5378, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5705, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9563, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 04:52:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 06:52:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807115252.29E562A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2709?compare_to=2706&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2709, Order: 161409, Start Time: 2012-08-07 10:34:28, End Time: 2012-08-07 11:53:29 To: 2706, Order: 161403, Start Time: 2012-08-07 08:47:09, End Time: 2012-08-07 10:05:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (108 on baseline) Performance Improvements: 3 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 921 (729 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.89% (1.1194 => 1.1965, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 5.83% (18.4011 => 19.4735, std. dev.: 0.1015) MultiSource/Applications/siod/siod: 3.26% (3.2996 => 3.4071, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.91% (78.9512 => 81.2464, std. dev.: 0.1309) MultiSource/Applications/hexxagon/hexxagon: 2.90% (12.0924 => 12.4425, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 1.84% (1.1315 => 1.1523, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (1.3058 => 1.3275, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.20% (0.8469 => 0.8571, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 1.19% (3.2039 => 3.2419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5078 => 6.5813, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.61% (0.0999 => 0.0853, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.72% (1.5562 => 1.5294, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3215 => 5.2664, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.38% (10.3673 => 13.7241, std. dev.: 0.0200) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3516 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3561 => 0.3994, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.80% (1.1194 => 1.2515, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.40% (2.2022 => 2.4093, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.15% (1.7609 => 1.9044, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.50% (0.1584 => 0.1687, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 6.37% (0.3282 => 0.3491, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 6.29% (10.4361 => 11.0923, std. dev.: 0.0139) SingleSource/UnitTests/ObjC++/Hello: 6.23% (0.5925 => 0.6294, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.94% (7.0540 => 7.4729, std. dev.: 0.0198) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.7433 => 0.7860, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4615 => 0.4871, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.4879 => 0.5139, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 5.11% (0.7326 => 0.7700, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.79% (0.2107 => 0.2208, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.77% (0.8172 => 0.8562, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 4.70% (0.2554 => 0.2674, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.53% (9.4845 => 9.9146, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.43% (4.9449 => 5.1642, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.38% (5.0018 => 5.2207, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.35% (0.5569 => 0.5811, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.23% (0.5860 => 0.6108, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.18% (4.2646 => 4.4427, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: 4.17% (0.7835 => 0.8162, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.11% (0.2700 => 0.2811, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3121 => 0.3248, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.88% (0.2758 => 0.2865, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 3.83% (0.3423 => 0.3554, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.79% (8.1363 => 8.4445, std. dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 3.76% (0.3109 => 0.3226, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4636 => 0.4808, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.68% (0.3180 => 0.3297, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.65% (1.3050 => 1.3526, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.60% (5.7591 => 5.9665, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 3.56% (0.3092 => 0.3202, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.49% (1.5603 => 1.6148, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.1861 => 1.2269, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.42% (0.3826 => 0.3957, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.42% (17.1811 => 17.7686, std. dev.: 0.0212) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.40% (1.5415 => 1.5939, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.4103 => 0.4239, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.28% (14.3668 => 14.8382, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 3.23% (1.1642 => 1.2018, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.21% (2.0273 => 2.0923, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 3.09% (0.3232 => 0.3332, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.09% (3.3354 => 3.4384, std. dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (2.2024 => 2.2698, std. dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.02% (0.3441 => 0.3545, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.01% (0.3650 => 0.3760, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.8067 => 0.8305, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.9765 => 1.0053, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.90% (0.5105 => 0.5253, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.87% (1.5859 => 1.6314, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 2.81% (0.4299 => 0.4420, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4289 => 0.4409, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3865 => 0.3973, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.78% (3.8723 => 3.9800, std. dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/bigfib: 2.77% (0.6456 => 0.6635, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.74% (2.0665 => 2.1231, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.72% (2.2969 => 2.3594, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.61% (0.4064 => 0.4170, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (0.6675 => 0.6849, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.4186 => 1.4540, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.48% (0.6450 => 0.6610, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (0.4620 => 0.4729, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5981 => 0.6122, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.34% (1.2842 => 1.3143, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.5020 => 0.5137, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8921 => 0.9128, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.93% (0.7115 => 0.7252, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.85% (1.0722 => 1.0920, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.79% (1.1840 => 1.2052, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.36% (1.1145 => 1.1965, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (4.2280 => 4.3890, std. dev.: 0.0128) MultiSource/Applications/siod/siod: 3.79% (3.2827 => 3.4071, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7503, std. dev.: 0.0059) MultiSource/Applications/aha/aha: 2.61% (3.1595 => 3.2419, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2193, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5748, std. dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.76% (1.3045 => 1.3275, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.38% (1.5086 => 1.5294, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7854, std. dev.: 0.0085) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2195, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: 1.11% (1.1396 => 1.1523, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5813, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1585, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.55% (5.3855 => 3.7401, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.20% (5.3526 => 3.7359, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1222, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5447, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -11.55% (22.1758 => 19.6134, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.09% (1.2373 => 1.1001, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel-2: -7.19% (1.5373 => 1.4267, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4890, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: -4.71% (1.9577 => 1.8654, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4959, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4178, std. dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9134, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.89% (0.4808 => 0.4669, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0028, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.38% (19.9488 => 19.4735, std. dev.: 0.1015) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6778, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3395, std. dev.: 0.0074) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4170, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.46% (1.6805 => 1.6560, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8132, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 06:24:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 08:24:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807132446.389942A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2710?compare_to=2707&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2710, Order: 161413, Start Time: 2012-08-07 12:11:26, End Time: 2012-08-07 13:25:22 To: 2707, Order: 161409, Start Time: 2012-08-07 10:29:23, End Time: 2012-08-07 11:43:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (152 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.31% (3.7673 => 3.8166, std. dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.91% (81.1870 => 79.6396, std. dev.: 0.3868) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.33% (2.0176 => 2.3067, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.5818 => 0.6334, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3578 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.83% (0.3601 => 0.3919, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.60% (0.3663 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3623 => 0.3933, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.52% (0.3650 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.50% (0.7061 => 0.7661, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3914 => 0.4246, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.45% (1.3693 => 1.4850, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.45% (0.7038 => 0.7562, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.44% (0.4328 => 0.4650, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (3.9660 => 4.2567, std. dev.: 0.0167) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.7710 => 0.8272, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.09% (0.2596 => 0.2780, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.5265 => 0.5635, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3489 => 0.3722, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.66% (1.9828 => 2.1149, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.62% (0.3899 => 0.4157, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.59% (0.2761 => 0.2943, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.59% (0.3022 => 0.3221, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.47% (0.4390 => 0.4674, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.45% (0.3580 => 0.3811, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3192 => 0.3397, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.37% (0.3485 => 0.3707, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.35% (0.6959 => 0.7401, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2988 => 0.3176, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.4379 => 0.4654, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.07% (1.2193 => 1.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3453 => 0.3659, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.68% (0.5577 => 0.5894, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.66% (0.9199 => 0.9720, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.3756 => 0.3965, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.44% (13.8202 => 14.5723, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.37% (1.4563 => 1.5345, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.28% (0.2914 => 0.3068, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.22% (1.1364 => 1.1957, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 5.22% (0.2243 => 0.2360, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.20% (1.2292 => 1.2931, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.18% (0.3246 => 0.3414, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.16% (0.7506 => 0.7893, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 5.13% (16.6129 => 17.4652, std. dev.: 0.0132) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.5637 => 0.5925, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.98% (7.2180 => 7.5771, std. dev.: 0.0090) MultiSource/Applications/Burg/burg: 4.97% (1.1061 => 1.1611, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.87% (3.8646 => 4.0527, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 4.85% (0.8310 => 0.8713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.72% (1.3819 => 1.4471, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.71% (1.9270 => 2.0178, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (1.3245 => 1.3867, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 4.64% (2.1791 => 2.2803, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (1.3813 => 1.4454, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (13.2842 => 13.8951, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.58% (1.0594 => 1.1079, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 4.41% (0.2995 => 0.3127, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.37% (0.3755 => 0.3919, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.27% (3.6692 => 3.8260, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 4.22% (0.3220 => 0.3356, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (4.4433 => 4.6275, std. dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 4.08% (16.2614 => 16.9250, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.3801 => 4.5575, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.83% (0.8698 => 0.9031, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.67% (1.1333 => 1.1749, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.52% (4.9865 => 5.1621, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 3.50% (0.4113 => 0.4257, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.46% (0.6135 => 0.6347, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.29% (1.5188 => 1.5687, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (8.4961 => 8.7745, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 3.26% (3.1889 => 3.2927, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (2.1007 => 2.1672, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.13% (3.2742 => 3.3768, std. dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 3.09% (14.8535 => 15.3129, std. dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (6.5754 => 6.7757, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.93% (14.5298 => 14.9560, std. dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 2.49% (4.6629 => 4.7792, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.24% (0.6250 => 0.6390, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.97% (0.9108 => 0.9287, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.32% (3.7467 => 3.7962, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (6.2785 => 6.3565, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 26.65% (1.8175 => 2.3018, std. dev.: 0.0346) SingleSource/Benchmarks/Misc/mandel-2: 10.86% (1.2998 => 1.4410, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.41% (1.5824 => 1.6522, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 4.40% (7.4271 => 7.7537, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 4.18% (1.1560 => 1.2043, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.13% (3.2729 => 3.4080, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7007, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9885, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9570, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.90% (1.7688 => 1.8201, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4370, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.23% (10.7476 => 10.9870, std. dev.: 0.0594) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2105, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.99% (1.4298 => 1.4582, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (0.5184 => 0.5285, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9572, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.42% (4.5928 => 4.6580, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5076, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1946, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2143, std. dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 1.15% (3.7731 => 3.8166, std. dev.: 0.0155) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1624, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.34% (0.0997 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.2308 => 1.1039, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.55% (1.3780 => 1.3153, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.37% (20.3410 => 19.6565, std. dev.: 0.0141) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4867 => 0.4712, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5876, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -2.65% (1.9762 => 1.9239, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (0.8342 => 0.8142, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9562, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.31% (0.6589 => 0.6437, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2300, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8040, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2119, std. dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.27% (9.9194 => 9.7937, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (84.4286 => 83.5242, std. dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 06:41:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 08:41:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807134109.5EFA22A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2711?compare_to=2709&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2711, Order: 161414, Start Time: 2012-08-07 12:22:55, End Time: 2012-08-07 13:41:46 To: 2709, Order: 161409, Start Time: 2012-08-07 10:34:28, End Time: 2012-08-07 11:53:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (734 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.27% (10.3673 => 13.8161, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.73% (0.3473 => 0.3915, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.35% (0.3497 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.32% (0.3516 => 0.3949, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.76% (1.1194 => 1.2510, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.35% (2.2022 => 2.3860, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.92% (1.7609 => 1.9004, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.09% (0.5925 => 0.6286, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.33% (7.0540 => 7.4302, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (10.4361 => 10.9828, std. dev.: 0.0107) MultiSource/Applications/lambda-0_1_3/lambda: 5.22% (0.7433 => 0.7821, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.21% (0.1940 => 0.2041, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 5.13% (0.7326 => 0.7702, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.4879 => 0.5119, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 4.62% (0.2554 => 0.2672, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.8172 => 0.8547, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.46% (9.4845 => 9.9076, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.36% (4.9449 => 5.1605, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (5.0018 => 5.2191, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 4.22% (0.7835 => 0.8166, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.5569 => 0.5804, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 4.15% (0.3109 => 0.3238, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.13% (4.2646 => 4.4407, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.01% (0.5860 => 0.6095, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.00% (0.2700 => 0.2808, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.97% (0.3121 => 0.3245, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.86% (0.3423 => 0.3555, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.80% (0.4103 => 0.4259, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.77% (0.2758 => 0.2862, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (8.1363 => 8.4413, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/09-vor/vor: 3.65% (0.3180 => 0.3296, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.57% (17.1811 => 17.7951, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.56% (1.3050 => 1.3514, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 3.54% (2.0273 => 2.0990, std. dev.: 0.0066) MultiSource/Applications/hbd/hbd: 3.52% (1.5603 => 1.6153, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.48% (0.3162 => 0.3272, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (0.4636 => 0.4796, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (1.1861 => 1.2256, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.32% (1.5415 => 1.5927, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.30% (5.7591 => 5.9491, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.20% (1.1642 => 1.2015, std. dev.: 0.0087) MultiSource/Applications/d/make_dparser: 3.18% (3.3354 => 3.4413, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (14.3668 => 14.8204, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.07% (0.3650 => 0.3762, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (2.2024 => 2.2699, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 3.06% (3.8723 => 3.9909, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 3.04% (0.3422 => 0.3526, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.04% (0.5105 => 0.5260, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.03% (0.3826 => 0.3942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4289 => 0.4419, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4299 => 0.4429, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.00% (0.3865 => 0.3981, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.00% (0.8067 => 0.8309, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.93% (1.5859 => 1.6324, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.86% (0.9765 => 1.0044, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.80% (0.6456 => 0.6637, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (2.0665 => 2.1239, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (0.4064 => 0.4175, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.6675 => 0.6853, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6450 => 0.6619, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3174, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.50% (2.2969 => 2.3543, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.4186 => 1.4540, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.49% (0.5020 => 0.5145, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5981 => 0.6125, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.28% (0.8921 => 0.9124, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 2.01% (0.7115 => 0.7258, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.82% (1.1840 => 1.2056, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.73% (1.0722 => 1.0908, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.17% (1.1145 => 1.1944, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.52% (4.2280 => 4.4191, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 3.80% (3.2827 => 3.4076, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7575, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 2.60% (3.1595 => 3.2417, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2194, std. dev.: 0.0045) MultiSource/Applications/lua/lua: 1.94% (26.0924 => 26.5996, std. dev.: 0.0162) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7952, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5086 => 1.5275, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 1.15% (1.1396 => 1.1527, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5804, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.17% (5.2763 => 3.1569, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.07% (5.3855 => 3.7124, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7094, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1015, std. dev.: 0.0226) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5470, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -11.66% (22.1758 => 19.5911, std. dev.: 0.0301) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.19% (1.6925 => 1.4184, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2373 => 1.1055, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -8.36% (1.5373 => 1.4088, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.91% (1.5660 => 1.4891, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.84% (1.9577 => 1.8629, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (4.8142 => 4.6141, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9001, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4942, std. dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.93% (0.4808 => 0.4667, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4258, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0005, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (19.9488 => 19.5458, std. dev.: 0.0489) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4186, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3460, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.46% (1.6805 => 1.6560, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 08:00:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 10:00:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120807150041.BD6E82A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2712?compare_to=2708&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2712, Order: 161413, Start Time: 2012-08-07 12:17:48, End Time: 2012-08-07 15:01:18 To: 2708, Order: 161403, Start Time: 2012-08-07 09:06:16, End Time: 2012-08-07 11:49:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3465 => 0.3903, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.62% (0.3446 => 0.3881, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3496 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3488 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.52% (0.3442 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3643 => 0.4094, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.08% (0.3650 => 0.4091, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3724 => 0.4164, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 7.00% (0.5826 => 0.6234, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.1619 => 0.1730, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.09% (1.6211 => 1.7198, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (3.5627 => 3.7755, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 5.93% (1.5932 => 1.6877, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.56% (1.3152 => 1.3883, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.41% (0.4994 => 0.5264, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (0.3930 => 0.4141, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (0.5026 => 0.5294, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.29% (0.7171 => 0.7550, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 4.98% (4.2109 => 4.4206, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (0.5000 => 0.5245, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.2736 => 0.2861, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.52% (1.0781 => 1.1268, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.40% (2.7292 => 2.8494, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (1.9694 => 2.0528, std. dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (2.1013 => 2.1901, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.20% (0.2738 => 0.2853, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.17% (0.9909 => 1.0322, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.06% (0.3890 => 0.4048, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2875 => 0.2991, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.02% (5.5417 => 5.7645, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (1.9966 => 2.0750, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (0.4658 => 0.4838, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 3.69% (2.1653 => 2.2452, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: 3.67% (0.2803 => 0.2906, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (4.4195 => 4.5817, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 3.67% (4.6177 => 4.7871, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.62% (2.0673 => 2.1422, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/wc: 3.62% (0.3096 => 0.3208, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (0.3625 => 0.3755, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.48% (0.5546 => 0.5739, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.43% (1.8794 => 1.9438, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.3678 => 0.3804, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3267 => 0.3378, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.3903 => 0.4035, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3317 => 0.3428, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.33% (0.6634 => 0.6855, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4146 => 0.4284, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.31% (0.7875 => 0.8136, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 3.31% (0.9697 => 1.0018, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.30% (0.3362 => 0.3473, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3124 => 0.3227, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.3845 => 0.3971, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.24% (0.4139 => 0.4273, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.17% (0.3282 => 0.3386, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.14% (0.3348 => 0.3453, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.3271 => 0.3371, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.98% (1.4269 => 1.4694, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 2.86% (23.5202 => 24.1929, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4251 => 0.4368, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.3981 => 0.4087, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.5012 => 0.5127, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.6435 => 0.6572, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.12% (2.0346 => 2.0778, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.91% (2.5769 => 2.9611, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6126, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6689, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1655, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6345, std. dev.: 0.0420) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1987, std. dev.: 0.0068) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4977, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.75% (41.7953 => 42.5280, std. dev.: 0.0537) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2203, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.08% (6.9842 => 7.0596, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.41% (11.9555 => 11.7872, std. dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5264, std. dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/fldry: -7.92% (17.2379 => 15.8729, std. dev.: 0.0938) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7994, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.68% (14.0481 => 13.5311, std. dev.: 0.0054) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7995, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5807, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9586, std. dev.: 0.0143) MultiSource/Benchmarks/Olden/bh/bh: -1.38% (5.5810 => 5.5039, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 08:06:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 10:06:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807150652.02AC82A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2713?compare_to=2710&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2713, Order: 161414, Start Time: 2012-08-07 13:53:31, End Time: 2012-08-07 15:07:28 To: 2710, Order: 161413, Start Time: 2012-08-07 12:11:26, End Time: 2012-08-07 13:25:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (151 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.22% (2.0176 => 2.3045, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7061 => 0.7698, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.5818 => 0.6340, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3646 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5748 => 0.6247, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3601 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.49% (0.3663 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.47% (0.3650 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.36% (1.3693 => 1.4838, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 8.33% (0.3914 => 0.4240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 8.15% (0.3940 => 0.4261, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.37% (0.4328 => 0.4647, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.29% (3.9660 => 4.2552, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.27% (0.7038 => 0.7550, std. dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.7710 => 0.8261, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.88% (0.5265 => 0.5627, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.80% (0.2765 => 0.2953, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.64% (0.3899 => 0.4158, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.63% (0.3485 => 0.3716, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 6.59% (0.2761 => 0.2943, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.59% (0.3022 => 0.3221, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.55% (1.9828 => 2.1126, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.54% (0.3580 => 0.3814, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.48% (0.3489 => 0.3715, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.2988 => 0.3179, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.04% (0.6959 => 0.7379, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.2193 => 1.2924, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3453 => 0.3659, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.86% (0.3293 => 0.3486, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.9199 => 0.9727, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (0.3756 => 0.3968, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.5577 => 0.5889, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.55% (0.3534 => 0.3730, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.53% (0.4016 => 0.4238, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.51% (0.3868 => 0.4081, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.46% (13.8202 => 14.5748, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 5.31% (0.2243 => 0.2362, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.24% (0.3246 => 0.3416, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.18% (1.4563 => 1.5318, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.10% (0.7506 => 0.7889, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 5.09% (16.6129 => 17.4580, std. dev.: 0.0276) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.02% (1.1364 => 1.1935, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.01% (1.2292 => 1.2908, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.99% (7.2180 => 7.5780, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5637 => 0.5915, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.80% (0.8310 => 0.8709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.77% (1.3819 => 1.4478, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.75% (3.8646 => 4.0480, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (13.2842 => 13.9034, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.65% (1.3245 => 1.3861, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.64% (1.9270 => 2.0164, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.63% (1.1061 => 1.1573, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.63% (1.3813 => 1.4452, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 4.58% (1.0594 => 1.1079, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 4.50% (2.1791 => 2.2771, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.7460 => 0.7792, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.44% (0.2995 => 0.3128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3755 => 0.3920, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (3.6692 => 3.8288, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 4.29% (0.3220 => 0.3358, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.14% (16.2614 => 16.9341, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (4.4433 => 4.6264, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.3801 => 4.5575, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.90% (0.4791 => 0.4978, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.76% (0.8698 => 0.9025, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.62% (1.1333 => 1.1743, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (4.9865 => 5.1616, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.46% (0.6135 => 0.6347, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 3.45% (0.4113 => 0.4255, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.4961 => 8.7787, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 3.15% (3.1889 => 3.2895, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 3.13% (6.5754 => 6.7809, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.12% (1.5188 => 1.5662, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.99% (2.1007 => 2.1636, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.99% (3.2742 => 3.3722, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.95% (14.8535 => 15.2916, std. dev.: 0.0147) MultiSource/Applications/ClamAV/clamscan: 2.82% (14.5298 => 14.9396, std. dev.: 0.0187) MultiSource/Applications/oggenc/oggenc: 2.48% (4.6629 => 4.7785, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.19% (0.6250 => 0.6387, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.01% (0.9108 => 0.9291, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.76% (0.6744 => 0.6863, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.76% (1.0313 => 1.0494, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.36% (3.7467 => 3.7976, std. dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (6.2785 => 6.3564, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2616, std. dev.: 0.0498) SingleSource/Benchmarks/Misc/mandel-2: 9.66% (1.2998 => 1.4253, std. dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.18% (1.0895 => 1.1786, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.50% (7.4271 => 7.7614, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.38% (1.5824 => 1.6517, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.11% (3.2729 => 3.4075, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/richards_benchmark: 4.10% (1.1560 => 1.2034, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7019, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.36% (2.8606 => 2.9568, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4378, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.84% (1.7688 => 1.8190, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.08% (10.7476 => 10.9712, std. dev.: 0.0512) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.01% (1.4298 => 1.4586, std. dev.: 0.0012) MultiSource/Applications/aha/aha: 1.99% (3.1476 => 3.2102, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5944, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.5928 => 4.6560, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5062, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (1.5089 => 1.5287, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1932, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.15% (1.9290 => 1.9512, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1624, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2308 => 1.0960, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.77% (1.3780 => 1.3123, std. dev.: 0.0103) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9710, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.13% (20.3410 => 19.7045, std. dev.: 0.0551) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5866, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: -2.71% (1.9762 => 1.9227, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (0.8342 => 0.8142, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.35% (0.6589 => 0.6434, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.35% (3.0263 => 2.9552, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2292, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8037, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.41% (9.3358 => 9.2044, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.27% (9.9194 => 9.7936, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (84.4286 => 83.5269, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 11:12:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 13:12:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120807181227.0727F2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2714?compare_to=2712&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2714, Order: 161414, Start Time: 2012-08-07 15:29:28, End Time: 2012-08-07 18:13:03 To: 2712, Order: 161413, Start Time: 2012-08-07 12:17:48, End Time: 2012-08-07 15:01:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (775 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.42% (125.3607 => 129.6476, std. dev.: 0.8162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.60% (15.8729 => 15.4598, std. dev.: 0.0482) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.73% (0.3496 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.68% (0.3469 => 0.3909, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 12.68% (0.3446 => 0.3883, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3442 => 0.3876, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3460 => 0.3894, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3488 => 0.3924, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 12.22% (0.3643 => 0.4088, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.11% (0.3650 => 0.4092, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.84% (0.3724 => 0.4165, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.55% (0.3792 => 0.4230, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.1619 => 0.1738, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5826 => 0.6236, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.5889 => 0.6298, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.09% (1.6211 => 1.7199, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.01% (3.5627 => 3.7767, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.97% (0.7171 => 0.7599, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 5.85% (1.5932 => 1.6864, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.80% (1.3152 => 1.3915, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.53% (0.4361 => 0.4602, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.2014 => 0.2123, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.5900 => 0.6219, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (0.5000 => 0.5260, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (0.4994 => 0.5249, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 5.00% (4.2109 => 4.4213, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (0.5026 => 0.5268, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 4.46% (1.0781 => 1.1262, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.42% (0.2736 => 0.2857, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.42% (0.2738 => 0.2859, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.2866 => 0.2992, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.31% (2.7292 => 2.8467, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.21% (0.2566 => 0.2674, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.14% (2.1013 => 2.1883, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2875 => 0.2991, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.99% (1.9694 => 2.0480, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (1.9966 => 2.0761, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.96% (0.9909 => 1.0301, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 3.92% (5.5417 => 5.7590, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.91% (0.4658 => 0.4840, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.86% (0.3890 => 0.4040, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.81% (2.1653 => 2.2479, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3195 => 0.3316, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.76% (0.3004 => 0.3117, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 3.71% (0.2803 => 0.2907, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 3.69% (4.6177 => 4.7882, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3625 => 0.3758, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.65% (2.0673 => 2.1428, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (4.4195 => 4.5800, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 3.59% (0.2813 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.3903 => 0.4043, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.54% (0.2823 => 0.2923, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.53% (0.7875 => 0.8153, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.3678 => 0.3806, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (1.8794 => 1.9446, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4146 => 0.4289, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.43% (0.9697 => 1.0030, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 3.42% (0.6634 => 0.6861, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.3845 => 0.3976, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.40% (0.3060 => 0.3164, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.36% (0.3124 => 0.3229, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.32% (0.3317 => 0.3427, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (0.4139 => 0.4274, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.20% (0.3282 => 0.3387, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3726 => 0.3843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.08% (0.3348 => 0.3451, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.96% (1.4269 => 1.4691, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.87% (23.5202 => 24.1954, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.69% (0.5546 => 0.5695, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.61% (0.3981 => 0.4085, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.97% (2.0346 => 2.0747, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9640, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.2122 => 0.2251, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6735, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 5.15% (1.8057 => 1.8987, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1710, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (105.3826 => 107.6963, std. dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.1999, std. dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4985, std. dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.84% (41.7953 => 42.5658, std. dev.: 0.0261) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2268, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.04% (6.9842 => 7.0567, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.42% (11.9555 => 11.7858, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5422, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -10.32% (17.2379 => 15.4598, std. dev.: 0.0482) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8019, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -7.08% (0.2402 => 0.2232, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7939, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5433, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9582, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4967, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 11:24:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 13:24:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807182428.CACDE2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2715?compare_to=2713&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2715, Order: 161426, Start Time: 2012-08-07 17:11:05, End Time: 2012-08-07 18:25:05 To: 2713, Order: 161414, Start Time: 2012-08-07 13:53:31, End Time: 2012-08-07 15:07:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (155 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (704 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (55.0056 => 56.5360, std. dev.: 0.1046) SingleSource/Benchmarks/Misc/lowercase: 1.53% (7.9527 => 8.0747, std. dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.26% (0.5818 => 0.6357, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.08% (0.3578 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.97% (0.3646 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5748 => 0.6262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.79% (0.3650 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.76% (0.3789 => 0.4121, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7061 => 0.7679, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.66% (0.3914 => 0.4253, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.52% (0.4003 => 0.4344, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.40% (0.3940 => 0.4271, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 8.33% (1.3693 => 1.4834, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.69% (0.2782 => 0.2996, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (0.4328 => 0.4660, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.47% (0.2690 => 0.2891, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.35% (3.9660 => 4.2576, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7038 => 0.7554, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.26% (0.7710 => 0.8270, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 7.25% (0.2937 => 0.3150, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2966 => 0.3178, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.13% (0.2721 => 0.2915, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.10% (0.5265 => 0.5639, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3107 => 0.3326, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.01% (0.2696 => 0.2885, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.95% (0.3899 => 0.4170, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.94% (1.9828 => 2.1204, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.82% (0.3489 => 0.3727, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.78% (0.3022 => 0.3227, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.73% (0.3580 => 0.3821, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3192 => 0.3405, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.21% (0.4379 => 0.4651, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.19% (0.3293 => 0.3497, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4390 => 0.4660, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.04% (0.3756 => 0.3983, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.6959 => 0.7377, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.2193 => 1.2918, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.89% (0.3868 => 0.4096, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.88% (0.4016 => 0.4252, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.9199 => 0.9727, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.63% (13.8202 => 14.5976, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5577 => 0.5890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.2914 => 0.3072, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.42% (0.1865 => 0.1966, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.32% (16.6129 => 17.4964, std. dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.2292 => 1.2943, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.29% (0.2023 => 0.2130, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (1.4563 => 1.5324, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.16% (1.1364 => 1.1950, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.08% (0.3246 => 0.3411, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.08% (0.2127 => 0.2235, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.03% (7.2180 => 7.5813, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.88% (1.3819 => 1.4494, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.5637 => 0.5911, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.85% (0.7506 => 0.7870, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.84% (3.8646 => 4.0515, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.77% (1.3813 => 1.4472, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.8310 => 0.8704, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.73% (1.1061 => 1.1584, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.71% (1.9270 => 2.0178, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3755 => 0.3931, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.64% (13.2842 => 13.9011, std. dev.: 0.0220) MultiSource/Benchmarks/nbench/nbench: 4.63% (1.0594 => 1.1085, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.3245 => 1.3858, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.62% (0.7460 => 0.7805, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 4.48% (2.1791 => 2.2767, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.20% (3.6692 => 3.8234, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.19% (4.4433 => 4.6296, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (4.3801 => 4.5615, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 4.13% (16.2614 => 16.9335, std. dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.98% (0.8698 => 0.9044, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.97% (0.4791 => 0.4981, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.76% (4.9865 => 5.1742, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (1.1333 => 1.1751, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.59% (0.6135 => 0.6355, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.55% (0.6283 => 0.6506, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.4113 => 0.4254, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.31% (3.1889 => 3.2946, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.25% (1.5188 => 1.5682, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (8.4961 => 8.7709, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.22% (2.1007 => 2.1683, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.07% (3.2742 => 3.3746, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.99% (14.8535 => 15.2970, std. dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (6.5754 => 6.7715, std. dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 2.88% (14.5298 => 14.9488, std. dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 2.76% (4.6629 => 4.7915, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6250 => 0.6410, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (0.9108 => 0.9273, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.65% (0.6744 => 0.6855, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.44% (3.7467 => 3.8007, std. dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (6.2785 => 6.3530, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 1.00% (33.2944 => 33.6278, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2571, std. dev.: 0.0537) SingleSource/Benchmarks/Misc/mandel-2: 8.93% (1.2998 => 1.4159, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.40% (1.5824 => 1.6521, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7531, std. dev.: 0.0055) MultiSource/Applications/siod/siod: 4.16% (3.2729 => 3.4089, std. dev.: 0.0240) SingleSource/Benchmarks/Misc/richards_benchmark: 4.13% (1.1560 => 1.2038, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7009, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9569, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.00% (1.9199 => 1.9775, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.88% (1.7688 => 1.8197, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4380, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.30% (10.7476 => 10.9947, std. dev.: 0.0479) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 2.05% (1.4298 => 1.4591, std. dev.: 0.0056) MultiSource/Applications/aha/aha: 1.99% (3.1476 => 3.2101, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5073, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.36% (4.5928 => 4.6551, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1963, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.28% (1.5089 => 1.5282, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.22% (1.9290 => 1.9525, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.5627 => 21.1772, std. dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2308 => 1.1006, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.31% (1.3780 => 1.3186, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.56% (20.3410 => 19.6165, std. dev.: 0.0193) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.8259 => 8.5754, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: -2.63% (1.9762 => 1.9243, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (0.8342 => 0.8142, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9577, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2293, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8038, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.41% (9.3358 => 9.2044, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7925, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (84.4286 => 83.5290, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 11:29:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 13:29:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807182901.1A28C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2716?compare_to=2711&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2716, Order: 161426, Start Time: 2012-08-07 17:11:01, End Time: 2012-08-07 18:29:38 To: 2711, Order: 161414, Start Time: 2012-08-07 12:22:55, End Time: 2012-08-07 13:41:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (93 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (745 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.53% (13.8161 => 13.4664, std. dev.: 0.0190) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.89% (10.3673 => 13.4664, std. dev.: 0.0190) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3473 => 0.3913, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3497 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.24% (0.3561 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 12.05% (0.3694 => 0.4139, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.70% (0.3828 => 0.4276, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3927 => 0.4372, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.97% (2.2022 => 2.3778, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.66% (1.7609 => 1.8957, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.97% (0.2065 => 0.2209, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.19% (0.6030 => 0.6403, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5925 => 0.6289, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.4615 => 0.4860, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7326 => 0.7706, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.05% (0.8172 => 0.8585, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 4.98% (0.7433 => 0.7803, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3933, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.65% (0.4879 => 0.5106, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.61% (10.4361 => 10.9168, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.60% (0.5569 => 0.5825, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 4.35% (0.2554 => 0.2665, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.20% (9.4845 => 9.8832, std. dev.: 0.0145) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.0018 => 5.2091, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.13% (0.2758 => 0.2872, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.9449 => 5.1485, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5860 => 0.6088, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.89% (4.2646 => 4.4305, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.89% (0.2700 => 0.2805, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.88% (0.3121 => 0.3242, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.74% (0.3423 => 0.3551, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.71% (0.3180 => 0.3298, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.70% (0.7835 => 0.8125, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.54% (8.1363 => 8.4245, std. dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (1.3050 => 1.3492, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.32% (17.1811 => 17.7515, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.25% (5.7591 => 5.9460, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.19% (0.4103 => 0.4234, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1861 => 1.2239, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4636 => 0.4783, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.09% (2.0273 => 2.0899, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 3.08% (1.1642 => 1.2001, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.5415 => 1.5889, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 3.05% (0.4299 => 0.4430, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.05% (3.3354 => 3.4370, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (14.3668 => 14.7929, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.8067 => 0.8297, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.2024 => 2.2651, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5105 => 0.5244, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.72% (0.3826 => 0.3930, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4289 => 0.4405, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9765 => 1.0028, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.67% (1.5603 => 1.6020, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 2.65% (3.8723 => 3.9749, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.59% (1.5859 => 1.6269, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (2.0665 => 2.1184, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.31% (0.5020 => 0.5136, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.28% (0.6675 => 0.6827, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.28% (2.2969 => 2.3492, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6450 => 0.6596, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.4186 => 1.4504, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.19% (0.5981 => 0.6112, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.11% (1.2842 => 1.3113, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8921 => 0.9109, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: 1.78% (0.7115 => 0.7242, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.67% (1.1840 => 1.2038, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.44% (1.0722 => 1.0876, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.32% (1.1145 => 1.1961, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.12% (4.2280 => 4.4021, std. dev.: 0.0078) MultiSource/Applications/siod/siod: 3.77% (3.2827 => 3.4066, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7459, std. dev.: 0.0045) MultiSource/Applications/aha/aha: 2.60% (3.1595 => 3.2415, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2193, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 1.92% (26.0924 => 26.5938, std. dev.: 0.0285) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5086 => 1.5292, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7860, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 1.11% (1.1396 => 1.1523, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.29% (5.2763 => 3.1503, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7046, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6995, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0964, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5475, std. dev.: 0.0152) MultiSource/Applications/ClamAV/clamscan: -11.76% (22.1758 => 19.5680, std. dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4196, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2373 => 1.1022, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -7.82% (1.5373 => 1.4171, std. dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.01% (1.9577 => 1.8597, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4892, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4090, std. dev.: 0.0228) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9095, std. dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.77% (0.4808 => 0.4675, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0012, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.28% (19.9488 => 19.4931, std. dev.: 0.0596) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3454, std. dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4196, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.46% (1.6805 => 1.6559, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 13:06:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 15:06:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807200632.2B18A2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2717?compare_to=2715&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2717, Order: 161435, Start Time: 2012-08-07 18:53:12, End Time: 2012-08-07 20:07:08 To: 2715, Order: 161426, Start Time: 2012-08-07 17:11:05, End Time: 2012-08-07 18:25:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (150 on baseline) Performance Improvements: 2 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.63% (2.1204 => 2.0858, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: -1.15% (1.4834 => 1.4663, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.89% (2.0176 => 2.3180, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 8.89% (0.5818 => 0.6335, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 8.88% (0.7061 => 0.7688, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.63% (0.5748 => 0.6244, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3789 => 0.4108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.36% (0.3623 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.36% (0.3650 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.27% (3.9660 => 4.2543, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.12% (0.7038 => 0.7539, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.08% (1.3693 => 1.4663, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.91% (0.7710 => 0.8243, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.33% (0.4328 => 0.4602, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.07% (0.2782 => 0.2951, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.96% (0.6959 => 0.7374, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.2193 => 1.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.70% (0.9199 => 0.9723, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.66% (0.4062 => 0.4292, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3899 => 0.4117, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.54% (0.2690 => 0.2839, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.51% (13.8202 => 14.5816, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.50% (0.3580 => 0.3777, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.30% (0.3489 => 0.3674, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.25% (1.1364 => 1.1961, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2761 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.9828 => 2.0858, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.18% (1.4563 => 1.5317, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.03% (1.1061 => 1.1617, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 5.02% (0.2988 => 0.3138, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.96% (0.3246 => 0.3407, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.91% (3.8646 => 4.0543, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.88% (7.2180 => 7.5704, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 4.87% (16.6129 => 17.4222, std. dev.: 0.0121) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.81% (0.5637 => 0.5908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (13.2842 => 13.9112, std. dev.: 0.0255) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.67% (0.4390 => 0.4595, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.65% (0.8310 => 0.8696, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 4.63% (1.9270 => 2.0163, std. dev.: 0.0132) MultiSource/Benchmarks/nbench/nbench: 4.59% (1.0594 => 1.1080, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (1.3245 => 1.3845, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.7460 => 0.7795, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.47% (1.3819 => 1.4437, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.3868 => 0.4039, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.36% (2.1791 => 2.2740, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.27% (1.3813 => 1.4403, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.21% (16.2614 => 16.9452, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.15% (3.6692 => 3.8213, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.00% (1.2292 => 1.2784, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6205, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (4.3801 => 4.5511, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (0.4791 => 0.4969, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1333 => 1.1747, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (4.9865 => 5.1624, std. dev.: 0.0133) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.36% (3.1889 => 3.2961, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (8.4961 => 8.7776, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.29% (0.6283 => 0.6490, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (0.8698 => 0.8976, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.04% (6.5754 => 6.7756, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.00% (2.1007 => 2.1638, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.00% (1.5188 => 1.5643, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.99% (14.5298 => 14.9639, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.93% (3.2742 => 3.3702, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.92% (14.8535 => 15.2874, std. dev.: 0.0110) MultiSource/Applications/oggenc/oggenc: 2.67% (4.6629 => 4.7875, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.72% (1.0313 => 1.0490, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.27% (3.7467 => 3.7941, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (6.2785 => 6.3460, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5148, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2692, std. dev.: 0.0237) SingleSource/Benchmarks/Misc/mandel-2: 9.46% (1.2998 => 1.4227, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.41% (1.5824 => 1.6522, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7525, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/richards_benchmark: 4.17% (1.1560 => 1.2042, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.06% (3.2729 => 3.4058, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7012, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.87% (1.9199 => 1.9750, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4378, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.86% (1.7688 => 1.8193, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.16% (10.7476 => 10.9795, std. dev.: 0.0100) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2105, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.99% (1.4298 => 1.4583, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (0.5184 => 0.5285, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5115, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.38% (1.5089 => 1.5297, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.5928 => 4.6547, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.18% (1.0310 => 1.0432, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (1.9433 => 1.9653, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1493, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.19% (20.3410 => 19.6924, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5814, std. dev.: 0.0142) MultiSource/Benchmarks/Olden/bh/bh: -2.64% (1.9762 => 1.9240, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (0.8342 => 0.8142, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9574, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2282, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8029, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7927, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2172, std. dev.: 0.0322) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.08% (84.4286 => 83.5194, std. dev.: 0.0152) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 13:16:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 15:16:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807201608.EC41C2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2718?compare_to=2716&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2718, Order: 161436, Start Time: 2012-08-07 18:57:54, End Time: 2012-08-07 20:16:46 To: 2716, Order: 161426, Start Time: 2012-08-07 17:11:01, End Time: 2012-08-07 18:29:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (119 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.81% (13.4664 => 13.9794, std. dev.: 0.0127) MultiSource/Applications/hbd/hbd: 1.09% (1.6020 => 1.6195, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.09% (0.5370 => 0.5482, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.28% (42.0053 => 42.5425, std. dev.: 0.1471) MultiSource/Benchmarks/llubenchmark/llu: 1.07% (3.7733 => 3.8138, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.84% (10.3673 => 13.9794, std. dev.: 0.0127) SingleSource/UnitTests/ObjC/block-byref-aggr: 20.57% (0.3817 => 0.4602, std. dev.: 0.0295) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3473 => 0.3932, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.04% (0.3543 => 0.4005, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 13.04% (0.3497 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.94% (0.3516 => 0.3971, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3543 => 0.4000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.81% (0.3561 => 0.4017, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3694 => 0.4157, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.20% (0.3828 => 0.4295, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.04% (1.1194 => 1.2542, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.94% (0.3886 => 0.4350, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3926, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.14% (1.7609 => 1.9042, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5925 => 0.6346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.6030 => 0.6457, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.2065 => 0.2211, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.50% (0.1584 => 0.1687, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.48% (0.7326 => 0.7801, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.42% (0.3177 => 0.3381, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.39% (7.0540 => 7.4342, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (10.4361 => 10.9829, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.3282 => 0.3453, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.21% (0.4879 => 0.5133, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (0.7433 => 0.7805, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 4.75% (0.2905 => 0.3043, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 4.66% (0.2554 => 0.2673, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.56% (0.8172 => 0.8545, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.33% (5.0018 => 5.2185, std. dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 4.29% (9.4845 => 9.8910, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.29% (4.9449 => 5.1568, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.11% (4.2646 => 4.4397, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5569 => 0.5796, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.4636 => 0.4824, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5860 => 0.6091, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.91% (0.2891 => 0.3004, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.89% (0.2700 => 0.2805, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2831 => 0.2941, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.88% (0.2758 => 0.2865, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.85% (0.7835 => 0.8137, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.84% (0.3121 => 0.3241, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3232 => 0.3355, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.79% (1.5603 => 1.6195, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.79% (8.1363 => 8.4446, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.70% (0.4103 => 0.4255, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.65% (0.3423 => 0.3548, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3283 => 0.3402, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.60% (0.3109 => 0.3221, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3180 => 0.3294, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.56% (0.3092 => 0.3202, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.53% (0.3650 => 0.3779, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.50% (2.0665 => 2.1388, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.49% (5.7591 => 5.9602, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 3.48% (0.3422 => 0.3541, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.47% (0.3052 => 0.3158, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.3050 => 1.3497, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.38% (0.3136 => 0.3242, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3826 => 0.3955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4289 => 0.4432, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3603 => 0.3723, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.32% (1.1861 => 1.2255, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 3.30% (17.1811 => 17.7478, std. dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.4064 => 0.4195, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.22% (1.1642 => 1.2017, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.5415 => 1.5907, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.17% (3.3354 => 3.4412, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.10% (0.5105 => 0.5263, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (14.3668 => 14.8079, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/moments: 3.04% (0.4048 => 0.4171, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.04% (0.6456 => 0.6652, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4299 => 0.4429, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.02% (2.0273 => 2.0885, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 3.01% (0.3684 => 0.3795, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.97% (0.4203 => 0.4328, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.91% (1.2842 => 1.3216, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.90% (0.4620 => 0.4754, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.85% (0.8067 => 0.8297, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.83% (0.9765 => 1.0041, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.69% (3.8723 => 3.9764, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.64% (0.6675 => 0.6851, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5859 => 1.6276, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.56% (0.5981 => 0.6134, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.2024 => 2.2585, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.48% (0.6450 => 0.6610, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.5020 => 0.5134, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.26% (1.4186 => 1.4507, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.16% (2.2969 => 2.3465, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8921 => 0.9102, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.93% (0.7115 => 0.7252, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.86% (1.1840 => 1.2060, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.53% (1.0722 => 1.0886, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.33% (1.1145 => 1.1962, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.27% (4.2280 => 4.4085, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 3.80% (3.2827 => 3.4076, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std. dev.: 0.0055) MultiSource/Applications/aha/aha: 2.59% (3.1595 => 3.2413, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2194, std. dev.: 0.0045) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5759, std. dev.: 0.0242) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5086 => 1.5275, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 1.23% (2.2771 => 2.3052, std. dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 1.23% (11.6436 => 11.7872, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: 1.14% (1.1396 => 1.1526, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.10% (1.0313 => 1.0426, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2108, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.04% (5.2763 => 3.1635, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.87% (5.3855 => 3.7232, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7175, std. dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0765, std. dev.: 0.0198) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5529, std. dev.: 0.0111) MultiSource/Applications/ClamAV/clamscan: -11.64% (22.1758 => 19.5939, std. dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.28% (1.2373 => 1.0977, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel-2: -8.52% (1.5373 => 1.4063, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4892, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -4.71% (1.9577 => 1.8654, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.26% (8.1563 => 7.8906, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.20% (8.6802 => 8.4023, std. dev.: 0.0184) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4976, std. dev.: 0.0476) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.89% (0.4808 => 0.4669, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0004, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.08% (19.9488 => 19.5329, std. dev.: 0.0577) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4193, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3469, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.43% (1.6805 => 1.6564, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.8329 => 1.8144, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 14:25:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 16:25:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120807212545.009A72A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2719?compare_to=2714&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2719, Order: 161434, Start Time: 2012-08-07 18:43:00, End Time: 2012-08-07 21:26:21 To: 2714, Order: 161414, Start Time: 2012-08-07 15:29:28, End Time: 2012-08-07 18:13:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (112 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.42% (1.6864 => 1.7104, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 1.07% (1.0030 => 1.0137, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.20% (2.0269 => 2.0918, std. dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.30% (54.1321 => 54.8359, std. dev.: 0.0946) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.17% (0.3446 => 0.3900, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.16% (0.3465 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.12% (0.3460 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3469 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.58% (0.3650 => 0.4109, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.24% (0.3724 => 0.4180, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.23% (0.3792 => 0.4142, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.89% (0.1620 => 0.1764, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 7.36% (1.5932 => 1.7104, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5826 => 0.6206, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.40% (0.5889 => 0.6266, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.34% (3.5627 => 3.7885, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.16% (1.6211 => 1.7209, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.04% (1.3152 => 1.3946, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.95% (0.5026 => 0.5325, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (0.4361 => 0.4618, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.81% (0.4029 => 0.4263, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.2014 => 0.2129, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.63% (0.4994 => 0.5275, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (0.5000 => 0.5280, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2738 => 0.2888, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (0.3930 => 0.4142, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.37% (0.5900 => 0.6217, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.28% (4.2109 => 4.4334, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 5.19% (1.0781 => 1.1341, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 5.17% (0.9909 => 1.0421, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference: 5.03% (0.7171 => 0.7532, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.97% (0.2875 => 0.3018, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.91% (0.2729 => 0.2863, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.91% (0.2750 => 0.2885, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.86% (0.2714 => 0.2846, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.86% (0.3004 => 0.3150, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.2866 => 0.3005, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.81% (0.2725 => 0.2856, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (2.7292 => 2.8600, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 4.78% (0.3267 => 0.3423, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.69% (0.2792 => 0.2923, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.2736 => 0.2864, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.66% (0.3195 => 0.3344, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.63% (2.0673 => 2.1631, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.60% (0.2780 => 0.2908, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.60% (0.2803 => 0.2932, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/except: 4.55% (0.2811 => 0.2939, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.55% (0.2813 => 0.2941, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (0.3890 => 0.4067, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 4.54% (0.9697 => 1.0137, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.52% (0.3625 => 0.3789, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.52% (2.1013 => 2.1963, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3258 => 0.3405, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.2911 => 0.3042, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.49% (0.3096 => 0.3235, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.46% (0.2823 => 0.2949, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 4.46% (0.3317 => 0.3465, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.44% (1.9694 => 2.0568, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.35% (0.3124 => 0.3260, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3678 => 0.3837, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.31% (5.5417 => 5.7803, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.28% (0.3060 => 0.3191, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.25% (0.3362 => 0.3505, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (1.9966 => 2.0811, std. dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 4.17% (0.2566 => 0.2673, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (0.4658 => 0.4852, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3348 => 0.3485, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (2.1653 => 2.2534, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.02% (4.6177 => 4.8035, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3726 => 0.3875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.00% (0.3477 => 0.3616, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.3282 => 0.3411, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.91% (0.7875 => 0.8183, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (4.4195 => 4.5912, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.87% (0.3903 => 0.4054, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4251 => 0.4413, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 3.74% (0.4146 => 0.4301, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.65% (0.4139 => 0.4290, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.63% (0.3690 => 0.3824, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.63% (1.8794 => 1.9476, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.3981 => 0.4125, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.3271 => 0.3388, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.3845 => 0.3978, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 3.22% (1.4269 => 1.4728, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 3.21% (0.6634 => 0.6847, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 3.12% (0.5546 => 0.5719, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.99% (23.5202 => 24.2240, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/bigfib: 2.97% (0.5012 => 0.5161, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.6435 => 0.6620, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.14% (2.0346 => 2.0781, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 7.26% (0.2122 => 0.2276, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6130, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 5.21% (1.8057 => 1.8998, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std. dev.: 0.0649) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (105.3826 => 107.7204, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2012, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.98% (41.7953 => 42.6214, std. dev.: 0.0142) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4957, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.01% (6.9842 => 7.0548, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.20% (2.4764 => 2.4466, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: -1.11% (11.9555 => 11.8223, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5488, std. dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: -9.68% (17.2379 => 15.5691, std. dev.: 0.2062) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7913, std. dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7945, std. dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: -3.53% (14.0481 => 13.5523, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9597, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 14:48:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 16:48:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807214843.AD0FB2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2720?compare_to=2717&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2720, Order: 161444, Start Time: 2012-08-07 20:35:25, End Time: 2012-08-07 21:49:19 To: 2717, Order: 161435, Start Time: 2012-08-07 18:53:12, End Time: 2012-08-07 20:07:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.86% (54.8162 => 56.3845, std. dev.: 0.2688) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.57% (2.0176 => 2.3115, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7061 => 0.7682, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.75% (0.5818 => 0.6327, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5748 => 0.6240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.56% (0.3646 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3789 => 0.4108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.09% (0.4003 => 0.4327, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (3.9660 => 4.2456, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.03% (1.3693 => 1.4655, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.77% (0.7710 => 0.8232, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7038 => 0.7509, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.43% (0.4062 => 0.4323, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.00% (0.2782 => 0.2949, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.69% (1.2193 => 1.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.61% (0.2690 => 0.2841, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.54% (0.2655 => 0.2802, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.6959 => 0.7343, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.39% (0.3580 => 0.3773, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.36% (0.5577 => 0.5876, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.35% (0.9199 => 0.9691, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.34% (13.8202 => 14.5585, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 5.34% (0.3149 => 0.3317, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.24% (1.9828 => 2.0867, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2761 => 0.2904, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (1.4563 => 1.5298, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.95% (0.3192 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (1.1364 => 1.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.87% (0.3453 => 0.3621, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.78% (7.2180 => 7.5627, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.67% (16.6129 => 17.3886, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.60% (0.7506 => 0.7851, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.58% (0.4016 => 0.4200, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.54% (0.8310 => 0.8687, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (13.2842 => 13.8836, std. dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 4.50% (3.8646 => 4.0385, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 4.48% (1.1061 => 1.1556, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (0.3756 => 0.3922, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.39% (1.0594 => 1.1059, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.30% (1.3245 => 1.3815, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0087, std. dev.: 0.0113) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 4.11% (2.1791 => 2.2687, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.10% (1.3813 => 1.4380, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (3.6692 => 3.8166, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 4.01% (16.2614 => 16.9133, std. dev.: 0.0201) MultiSource/Applications/hexxagon/hexxagon: 3.98% (1.2292 => 1.2781, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (4.4433 => 4.6130, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.3801 => 4.5455, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.4791 => 0.4959, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.9865 => 5.1474, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.17% (3.1889 => 3.2900, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.16% (0.6135 => 0.6329, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.99% (0.4113 => 0.4236, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7496, std. dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (6.5754 => 6.7630, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.83% (2.1007 => 2.1601, std. dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: 2.75% (14.5298 => 14.9288, std. dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2562, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5188 => 1.5593, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (3.2742 => 3.3606, std. dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 2.50% (4.6629 => 4.7793, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 1.62% (0.6250 => 0.6351, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.44% (0.9108 => 0.9239, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.40% (5.7573 => 7.5077, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 25.44% (1.8175 => 2.2798, std. dev.: 0.0362) SingleSource/Benchmarks/Misc/mandel-2: 10.08% (1.2998 => 1.4308, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.21% (1.0895 => 1.1790, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.39% (1.5824 => 1.6519, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7526, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 4.16% (1.1560 => 1.2041, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.13% (3.2729 => 3.4082, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.89% (11.2619 => 11.7000, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9570, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4371, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8179, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.09% (10.7476 => 10.9721, std. dev.: 0.0406) MultiSource/Applications/lemon/lemon: 2.01% (1.4298 => 1.4585, std. dev.: 0.0006) MultiSource/Applications/aha/aha: 1.98% (3.1476 => 3.2100, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (0.5184 => 0.5286, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5079, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.36% (4.5928 => 4.6552, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1943, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5283, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.47% (22.5627 => 21.1038, std. dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.10% (0.2670 => 0.2507, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.2308 => 1.1076, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.83% (1.3780 => 1.3252, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.83% (20.3410 => 19.5627, std. dev.: 0.0678) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5850, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/bh/bh: -2.68% (1.9762 => 1.9232, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.39% (0.8342 => 0.8143, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2311, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8030, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0081, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.38% (9.3358 => 9.2074, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.26% (9.9194 => 9.7940, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8707, std. dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (84.4286 => 83.5243, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 15:03:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 17:03:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807220306.652A32A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2721?compare_to=2718&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2721, Order: 161444, Start Time: 2012-08-07 20:45:02, End Time: 2012-08-07 22:03:42 To: 2718, Order: 161436, Start Time: 2012-08-07 18:57:54, End Time: 2012-08-07 20:16:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (104 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (734 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.91% (54.8656 => 55.9149, std. dev.: 0.3405) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.16% (13.9794 => 13.8175, std. dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.28% (10.3673 => 13.8175, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.87% (0.3497 => 0.3947, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3543 => 0.3998, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3543 => 0.3998, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.72% (0.3561 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.48% (0.3694 => 0.4155, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.12% (0.3828 => 0.4292, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.08% (1.1194 => 1.2546, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.31% (2.2022 => 2.3851, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.00% (1.7609 => 1.9017, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.78% (0.5925 => 0.6327, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.68% (0.6030 => 0.6433, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.56% (0.7326 => 0.7733, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4615 => 0.4868, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.33% (0.4879 => 0.5139, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 5.18% (10.4361 => 10.9764, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.10% (7.0540 => 7.4140, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.3282 => 0.3447, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.88% (0.7433 => 0.7796, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2554 => 0.2669, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (0.8172 => 0.8539, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.38% (4.9449 => 5.1615, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (9.4845 => 9.8975, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.25% (5.0018 => 5.2142, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.06% (0.5569 => 0.5795, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.02% (4.2646 => 4.4362, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.96% (0.5860 => 0.6092, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.83% (0.7835 => 0.8135, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.70% (8.1363 => 8.4374, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.65% (0.3423 => 0.3548, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (0.4636 => 0.4805, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.58% (1.5603 => 1.6161, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.50% (1.3050 => 1.3507, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.48% (1.1642 => 1.2047, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.44% (0.4103 => 0.4244, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.30% (5.7591 => 5.9494, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2252, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 3.27% (17.1811 => 17.7427, std. dev.: 0.0236) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4299 => 0.4438, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.20% (0.3283 => 0.3388, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.19% (3.3354 => 3.4419, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (14.3668 => 14.8079, std. dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.04% (0.3650 => 0.3761, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9765 => 1.0057, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.98% (2.0665 => 2.1281, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.98% (0.3826 => 0.3940, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.98% (2.0273 => 2.0877, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (1.5415 => 1.5874, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3865 => 0.3980, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.96% (0.4289 => 0.4416, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.94% (0.8067 => 0.8304, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 2.92% (0.3422 => 0.3522, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.91% (2.2024 => 2.2664, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (0.5105 => 0.5250, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.4064 => 0.4178, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.77% (0.6456 => 0.6635, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4620 => 0.4745, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.68% (0.6675 => 0.6854, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.66% (1.5859 => 1.6281, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.60% (3.8723 => 3.9729, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2842 => 1.3170, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.52% (0.4048 => 0.4150, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.50% (0.4203 => 0.4308, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.44% (0.5981 => 0.6127, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.41% (1.4186 => 1.4528, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.36% (0.6450 => 0.6602, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.5020 => 0.5138, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8921 => 0.9105, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.05% (2.2969 => 2.3439, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.93% (0.7115 => 0.7252, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.79% (1.1840 => 1.2052, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.41% (1.0722 => 1.0873, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.15% (1.1145 => 1.1942, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.85% (4.2280 => 4.3907, std. dev.: 0.0085) MultiSource/Applications/siod/siod: 3.77% (3.2827 => 3.4064, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (3.6395 => 3.7600, std. dev.: 0.0025) MultiSource/Applications/aha/aha: 2.60% (3.1595 => 3.2418, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.01% (26.0924 => 26.6173, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1578 => 3.2176, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7971, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5086 => 1.5275, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2276, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0313 => 1.0439, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.17% (1.1396 => 1.1529, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.02% (5.2763 => 3.1649, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.04% (5.3855 => 3.7136, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7094, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2017, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.05% (2.9384 => 2.5550, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: -11.69% (22.1758 => 19.5828, std. dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.2373 => 1.1050, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: -8.89% (1.5373 => 1.4006, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4890, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.86% (1.9577 => 1.8626, std. dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4889, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9002, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4182, std. dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.79% (0.4808 => 0.4674, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.78% (1.3677 => 1.3297, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0023, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (19.9488 => 19.5449, std. dev.: 0.0295) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4195, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.45% (12.5348 => 12.3526, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.45% (1.6805 => 1.6562, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 16:30:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 18:30:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120807233055.D57AF2A6C072@llvm.org> http://llvm.org/perf/db_default/v4/nts/2722?compare_to=2720&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2722, Order: 161449, Start Time: 2012-08-07 22:17:26, End Time: 2012-08-07 23:31:30 To: 2720, Order: 161444, Start Time: 2012-08-07 20:35:25, End Time: 2012-08-07 21:49:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (151 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.73% (0.5379 => 0.5526, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.27% (2.0176 => 2.3056, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3578 => 0.3919, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.43% (0.3646 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.36% (0.3601 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3789 => 0.4138, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3623 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.18% (0.3650 => 0.3985, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.10% (0.3914 => 0.4270, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.81% (0.3940 => 0.4287, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.79% (0.4003 => 0.4355, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7061 => 0.7678, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.70% (0.2596 => 0.2796, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.58% (1.3693 => 1.4731, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (3.9660 => 4.2534, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.20% (0.5265 => 0.5644, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.12% (0.7710 => 0.8259, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7038 => 0.7534, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.62% (0.2781 => 0.2965, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.6959 => 0.7383, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.00% (0.3899 => 0.4133, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.86% (0.2628 => 0.2782, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.81% (1.2193 => 1.2902, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.80% (1.9828 => 2.0978, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.65% (0.3489 => 0.3686, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.3149 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.54% (0.9199 => 0.9709, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.48% (0.3485 => 0.3676, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.47% (0.5577 => 0.5882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2988 => 0.3151, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.41% (13.8202 => 14.5677, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.39% (1.1364 => 1.1976, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.34% (1.4563 => 1.5340, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.00% (7.2180 => 7.5787, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.97% (1.1061 => 1.1611, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.92% (0.4390 => 0.4606, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.92% (16.6129 => 17.4301, std. dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.87% (0.3246 => 0.3404, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.85% (0.7506 => 0.7870, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.82% (3.8646 => 4.0509, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.67% (1.3245 => 1.3863, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3868 => 0.4048, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (13.2842 => 13.8983, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.59% (1.3819 => 1.4453, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 4.55% (1.0594 => 1.1076, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.54% (0.8310 => 0.8687, std. dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.47% (1.3813 => 1.4430, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.35% (1.9270 => 2.0109, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.32% (0.7460 => 0.7782, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.29% (1.2292 => 1.2819, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.24% (2.1791 => 2.2714, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.17% (3.6692 => 3.8221, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 4.09% (16.2614 => 16.9258, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.08% (4.4433 => 4.6245, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.3801 => 4.5542, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.57% (1.1333 => 1.1738, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9865 => 5.1557, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.35% (0.8698 => 0.8989, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.30% (3.1889 => 3.2941, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.26% (0.6283 => 0.6488, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (8.4961 => 8.7570, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (6.5754 => 6.7655, std. dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.5298 => 14.9446, std. dev.: 0.0141) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.8535 => 15.2752, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.1007 => 2.1600, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.78% (1.5188 => 1.5610, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.70% (3.2742 => 3.3627, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.45% (0.9108 => 0.9331, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.40% (4.6629 => 4.7749, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.62% (0.6250 => 0.6351, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.51% (1.0313 => 1.0469, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.48% (0.6744 => 0.6844, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.27% (3.7467 => 3.7943, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (6.2785 => 6.3532, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std. dev.: 0.0519) SingleSource/Benchmarks/Misc/mandel-2: 8.29% (1.2998 => 1.4075, std. dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7557, std. dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.42% (1.5824 => 1.6523, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.15% (3.2729 => 3.4086, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 4.09% (1.1560 => 1.2033, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.89% (11.2619 => 11.7005, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4373, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.09% (10.7476 => 10.9723, std. dev.: 0.0309) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (0.5184 => 0.5288, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.99% (1.4298 => 1.4583, std. dev.: 0.0016) MultiSource/Applications/aha/aha: 1.99% (3.1476 => 3.2101, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 1.39% (4.5928 => 4.6566, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1966, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.33% (1.5089 => 1.5289, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1237, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1069, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.57% (20.3410 => 19.6140, std. dev.: 0.0680) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.66% (1.9762 => 1.9237, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5967, std. dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (0.8342 => 0.8142, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.35% (3.0263 => 2.9551, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2322, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8030, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0083, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.40% (9.3358 => 9.2049, std. dev.: 0.0450) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.27% (9.9194 => 9.7931, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.08% (84.4286 => 83.5191, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 16:50:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 18:50:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120807235005.285173524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2723?compare_to=2721&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2723, Order: 161449, Start Time: 2012-08-07 22:32:03, End Time: 2012-08-07 23:50:41 To: 2721, Order: 161444, Start Time: 2012-08-07 20:45:02, End Time: 2012-08-07 22:03:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (101 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (736 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.87% (78.2097 => 80.4561, std. dev.: 0.4559) SingleSource/Benchmarks/Misc/mandel-2: 2.23% (1.4006 => 1.4318, std. dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.72% (10.3673 => 13.7591, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3473 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.13% (0.3497 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.00% (0.3516 => 0.3973, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.98% (0.3543 => 0.4003, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.93% (0.3543 => 0.4001, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.92% (0.3561 => 0.4021, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3694 => 0.4159, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 12.25% (0.3828 => 0.4297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.53% (1.1194 => 1.2485, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (2.2022 => 2.3725, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (1.7609 => 1.8950, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference-object: 6.12% (0.6030 => 0.6399, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.53% (0.4615 => 0.4870, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 5.17% (0.7433 => 0.7817, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (10.4361 => 10.9607, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 4.82% (0.2554 => 0.2677, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.4879 => 0.5112, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.64% (7.0540 => 7.3814, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.59% (0.5860 => 0.6129, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 4.43% (9.4845 => 9.9048, std. dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.43% (0.8172 => 0.8534, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.28% (4.9449 => 5.1564, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.28% (0.7835 => 0.8170, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.5569 => 0.5806, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.25% (5.0018 => 5.2142, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.14% (4.2646 => 4.4412, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.01% (0.3121 => 0.3246, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.92% (0.2758 => 0.2866, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.83% (0.3423 => 0.3554, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.80% (1.3050 => 1.3546, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.69% (8.1363 => 8.4368, std. dev.: 0.0091) MultiSource/Applications/hbd/hbd: 3.68% (1.5603 => 1.6177, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.65% (0.3180 => 0.3296, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.54% (17.1811 => 17.7890, std. dev.: 0.0305) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (0.4636 => 0.4797, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.37% (5.7591 => 5.9534, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.4103 => 0.4241, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1861 => 1.2258, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 3.30% (3.3354 => 3.4454, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.19% (1.1642 => 1.2013, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.19% (2.0273 => 2.0919, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash: 3.17% (0.4289 => 0.4425, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.16% (0.3422 => 0.3530, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.12% (1.5415 => 1.5896, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (14.3668 => 14.8092, std. dev.: 0.0138) MultiSource/Benchmarks/McCat/05-eks/eks: 3.07% (0.4299 => 0.4431, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.06% (0.3826 => 0.3943, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.06% (0.5105 => 0.5261, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.94% (0.6456 => 0.6646, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 2.94% (3.8723 => 3.9860, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.93% (0.4064 => 0.4183, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.8067 => 0.8303, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3865 => 0.3977, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.85% (0.3650 => 0.3754, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.83% (2.2024 => 2.2647, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (2.0665 => 2.1239, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9765 => 1.0035, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.58% (0.4620 => 0.4739, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.5859 => 1.6267, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.52% (0.6675 => 0.6843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.50% (0.4203 => 0.4308, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.49% (0.5020 => 0.5145, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.48% (0.6450 => 0.6610, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (1.4186 => 1.4533, std. dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: 2.44% (1.2842 => 1.3155, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.31% (0.5981 => 0.6119, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.24% (2.2969 => 2.3483, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.17% (0.8921 => 0.9115, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.95% (0.7115 => 0.7254, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.93% (1.1840 => 1.2069, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.51% (1.0722 => 1.0884, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.12% (1.1145 => 1.1938, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (4.2280 => 4.4132, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 3.77% (3.2827 => 3.4064, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0054) MultiSource/Applications/aha/aha: 2.59% (3.1595 => 3.2413, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.87% (3.1578 => 3.2170, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5759, std. dev.: 0.0277) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.38% (1.5086 => 1.5294, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.26% (11.6436 => 11.7908, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0313 => 1.0440, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.16% (1.1396 => 1.1528, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1594, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7025, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7005, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0960, std. dev.: 0.0237) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.24% (2.9384 => 2.5494, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -11.87% (22.1758 => 19.5446, std. dev.: 0.0272) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2373 => 1.1133, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -6.86% (1.5373 => 1.4318, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4890, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -4.57% (1.9577 => 1.8682, std. dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4933, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9015, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4153, std. dev.: 0.0144) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.83% (0.4808 => 0.4672, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0004, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (19.9488 => 19.5696, std. dev.: 0.0282) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4169, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3495, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.46% (1.6805 => 1.6559, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 17:37:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 19:37:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120808003722.255B63524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2724?compare_to=2719&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2724, Order: 161446, Start Time: 2012-08-07 21:54:37, End Time: 2012-08-08 00:37:57 To: 2719, Order: 161434, Start Time: 2012-08-07 18:43:00, End Time: 2012-08-07 21:26:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 3 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.37% (1.0421 => 1.0278, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: -1.25% (1.0137 => 1.0010, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.74% (2.0918 => 2.0555, std. dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3465 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3488 => 0.3940, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3442 => 0.3888, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 12.88% (0.3446 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3460 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3643 => 0.4100, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.41% (0.3650 => 0.4103, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 12.11% (0.3724 => 0.4175, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.07% (1.5932 => 1.7059, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5826 => 0.6193, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.29% (3.5627 => 3.7868, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 6.21% (0.5889 => 0.6255, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.18% (1.6211 => 1.7213, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.99% (1.3152 => 1.3940, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.96% (0.4361 => 0.4621, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (0.4994 => 0.5285, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.78% (0.4029 => 0.4262, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.59% (0.5026 => 0.5307, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (0.5000 => 0.5272, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.42% (0.5900 => 0.6220, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (0.3930 => 0.4142, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 5.33% (4.2109 => 4.4352, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 5.21% (1.0781 => 1.1343, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.08% (0.1968 => 0.2068, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (2.7292 => 2.8621, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 4.78% (0.7171 => 0.7514, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.52% (2.1013 => 2.1962, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.46% (1.9694 => 2.0573, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.38% (1.9966 => 2.0840, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 4.34% (5.5417 => 5.7823, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (0.3890 => 0.4056, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (0.4658 => 0.4854, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.17% (0.2566 => 0.2673, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.06% (0.7875 => 0.8195, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.01% (4.6177 => 4.8029, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 3.93% (2.1653 => 2.2505, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.87% (0.2738 => 0.2844, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (4.4195 => 4.5891, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 3.80% (0.5546 => 0.5757, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.79% (0.2875 => 0.2984, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.3903 => 0.4049, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 3.74% (0.6634 => 0.6882, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.72% (0.9909 => 1.0278, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (0.3195 => 0.3313, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.65% (0.4139 => 0.4290, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.62% (0.2792 => 0.2893, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0673 => 2.1416, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (1.8794 => 1.9469, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 3.53% (0.3004 => 0.3110, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 3.36% (1.4269 => 1.4748, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 3.33% (0.3096 => 0.3199, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3267 => 0.3374, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.3271 => 0.3378, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.3362 => 0.3471, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.23% (0.9697 => 1.0010, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3317 => 0.3424, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.22% (0.3845 => 0.3969, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.19% (0.3258 => 0.3362, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.3678 => 0.3795, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.14% (0.3348 => 0.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3726 => 0.3842, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.08% (0.3282 => 0.3383, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (0.3625 => 0.3735, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.02% (0.3477 => 0.3582, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.93% (0.3690 => 0.3798, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 2.90% (23.5202 => 24.2013, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4146 => 0.4262, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4251 => 0.4367, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.30% (2.0346 => 2.0814, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.6435 => 0.6579, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.5012 => 0.5123, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.00% (2.5769 => 2.9635, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.43% (3.3903 => 3.6084, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1651, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6788, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2130, std. dev.: 0.0080) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (41.7953 => 42.5823, std. dev.: 0.0281) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4980, std. dev.: 0.0266) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5919, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.04% (6.9842 => 7.0565, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.12% (11.9555 => 11.8215, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.06% (25.4195 => 16.5071, std. dev.: 0.0195) SingleSource/Benchmarks/Dhrystone/fldry: -9.74% (17.2379 => 15.5586, std. dev.: 0.3196) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8039, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.79% (11.2080 => 10.7827, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5431, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5803, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9603, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 18:13:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 20:13:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808011325.28CE13524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2725?compare_to=2722&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2725, Order: 161455, Start Time: 2012-08-07 23:59:56, End Time: 2012-08-08 01:14:00 To: 2722, Order: 161449, Start Time: 2012-08-07 22:17:26, End Time: 2012-08-07 23:31:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.41% (2.0176 => 2.3083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.65% (0.5818 => 0.6321, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.56% (0.3646 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.50% (0.7061 => 0.7661, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5748 => 0.6233, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.44% (0.3663 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.43% (0.3914 => 0.4244, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3623 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.27% (0.7038 => 0.7620, std. dev.: 0.0075) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 8.15% (0.3940 => 0.4261, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.56% (1.3693 => 1.4728, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (3.9660 => 4.2508, std. dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.96% (0.7710 => 0.8247, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.72% (0.4062 => 0.4335, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4328 => 0.4616, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.40% (0.2782 => 0.2960, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.3899 => 0.4147, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.10% (0.2607 => 0.2766, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2655 => 0.2814, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2628 => 0.2784, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.92% (0.6959 => 0.7371, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2726 => 0.2885, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.68% (0.3149 => 0.3328, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.67% (1.2193 => 1.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.65% (0.4390 => 0.4638, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.52% (1.9828 => 2.0923, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.9199 => 0.9701, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 5.44% (13.8202 => 14.5723, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3192 => 0.3365, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.40% (0.5577 => 0.5878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.2988 => 0.3149, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 5.07% (0.3293 => 0.3460, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.96% (1.4563 => 1.5285, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.1364 => 1.1924, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.88% (0.7506 => 0.7872, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.76% (7.2180 => 7.5615, std. dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 4.71% (16.6129 => 17.3959, std. dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/moments: 4.71% (0.3868 => 0.4050, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.70% (3.8646 => 4.0463, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.68% (0.3246 => 0.3398, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.57% (1.9270 => 2.0150, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.55% (0.8310 => 0.8688, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.52% (1.3819 => 1.4444, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.49% (1.0594 => 1.1070, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.49% (1.3245 => 1.3840, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.46% (1.2292 => 1.2840, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (13.2842 => 13.8739, std. dev.: 0.0115) MultiSource/Applications/Burg/burg: 4.42% (1.1061 => 1.1550, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.3813 => 1.4420, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.2945 => 0.3072, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.25% (2.1791 => 2.2717, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (0.7460 => 0.7774, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (3.6692 => 3.8167, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6208, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 3.98% (16.2614 => 16.9080, std. dev.: 0.0160) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (4.3801 => 4.5497, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.48% (4.9865 => 5.1600, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.47% (1.1333 => 1.1726, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.46% (0.8698 => 0.8999, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.6283 => 0.6484, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (8.4961 => 8.7673, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.08% (3.1889 => 3.2870, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (6.5754 => 6.7716, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.5298 => 14.9414, std. dev.: 0.0214) MultiSource/Applications/JM/lencod/lencod: 2.82% (14.8535 => 15.2731, std. dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.2742 => 3.3655, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.77% (1.5188 => 1.5609, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.1007 => 2.1585, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.26% (4.6629 => 4.7683, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.68% (0.9108 => 0.9261, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.44% (1.0313 => 1.0462, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.17% (6.2785 => 6.3521, std. dev.: 0.0150) MultiSource/Applications/lua/lua: 1.08% (3.7467 => 3.7871, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5158, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0446) SingleSource/Benchmarks/Misc/mandel-2: 9.95% (1.2998 => 1.4291, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7562, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.40% (1.5824 => 1.6521, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.34% (3.2729 => 3.4149, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 4.13% (1.1560 => 1.2038, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7012, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9574, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.90% (1.7688 => 1.8201, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.87% (12.0921 => 12.4389, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.23% (0.9692 => 0.9908, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5184 => 0.5291, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.99% (10.7476 => 10.9618, std. dev.: 0.0219) MultiSource/Applications/aha/aha: 1.99% (3.1476 => 3.2101, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.97% (1.4298 => 1.4579, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5070, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.5928 => 4.6564, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5281, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1406, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2308 => 1.1074, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9710, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.36% (20.3410 => 19.6573, std. dev.: 0.0258) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5833, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: -2.65% (1.9762 => 1.9238, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.41% (0.8342 => 0.8141, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.26% (3.0263 => 2.9580, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2264, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8024, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0081, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7928, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2199, std. dev.: 0.0423) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5302, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 18:37:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 20:37:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808013709.923623524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2726?compare_to=2723&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2726, Order: 161455, Start Time: 2012-08-08 00:19:00, End Time: 2012-08-08 01:37:46 To: 2723, Order: 161449, Start Time: 2012-08-07 22:32:03, End Time: 2012-08-07 23:50:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.98% (13.7591 => 14.0310, std. dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.34% (10.3673 => 14.0310, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3473 => 0.3914, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3497 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3516 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.36% (0.3543 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 12.27% (0.3561 => 0.3998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2455, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.08% (1.7609 => 1.9032, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.97% (2.2022 => 2.3778, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.35% (0.1892 => 0.2031, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.69% (0.1584 => 0.1690, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.88% (10.4361 => 11.0498, std. dev.: 0.0208) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5925 => 0.6257, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 5.59% (0.6030 => 0.6367, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.22% (7.0540 => 7.4225, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 5.09% (0.3282 => 0.3449, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 4.91% (0.7433 => 0.7798, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.78% (9.4845 => 9.9376, std. dev.: 0.0099) SingleSource/UnitTests/ObjC++/property-reference: 4.76% (0.7326 => 0.7675, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.8172 => 0.8547, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (5.0018 => 5.2294, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.48% (4.9449 => 5.1663, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.5860 => 0.6115, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.5569 => 0.5806, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.24% (4.2646 => 4.4456, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.10% (0.3121 => 0.3249, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.99% (0.2758 => 0.2868, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 3.94% (0.7835 => 0.8144, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 3.86% (0.3423 => 0.3555, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.83% (0.3109 => 0.3228, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.70% (8.1363 => 8.4371, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.62% (1.3050 => 1.3523, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.54% (17.1811 => 17.7896, std. dev.: 0.0258) MultiSource/Applications/hbd/hbd: 3.51% (1.5603 => 1.6150, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.43% (5.7591 => 5.9567, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1861 => 1.2266, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.33% (1.5415 => 1.5928, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4299 => 0.4439, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.22% (3.3354 => 3.4428, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.19% (1.1642 => 1.2013, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (14.3668 => 14.8145, std. dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.06% (0.4636 => 0.4778, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.06% (2.0273 => 2.0893, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.4103 => 0.4228, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.02% (0.5105 => 0.5259, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.01% (0.3387 => 0.3489, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.94% (0.8067 => 0.8304, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.94% (2.2024 => 2.2671, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.93% (0.9765 => 1.0051, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.87% (3.8723 => 3.9835, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.85% (0.6450 => 0.6634, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.80% (0.6675 => 0.6862, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5859 => 1.6301, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.69% (0.3826 => 0.3929, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.6456 => 0.6614, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.43% (1.4186 => 1.4531, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 2.42% (0.4289 => 0.4393, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5981 => 0.6124, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8921 => 0.9134, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.31% (2.0665 => 2.1142, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.5020 => 0.5134, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 2.15% (2.2969 => 2.3462, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 2.05% (1.1840 => 1.2083, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.96% (1.2842 => 1.3094, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.94% (0.7115 => 0.7253, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.66% (1.0722 => 1.0900, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.32% (1.1145 => 1.1961, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.81% (3.2827 => 3.4078, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.74% (4.2280 => 4.3860, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7495, std. dev.: 0.0062) MultiSource/Applications/aha/aha: 2.61% (3.1595 => 3.2421, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.10% (26.0924 => 26.6403, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2133, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.21% (11.6436 => 11.7850, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: 1.17% (1.1396 => 1.1529, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5775, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1610, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7014, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.84% (5.3526 => 3.7017, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0900, std. dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.62% (2.9384 => 2.5381, std. dev.: 0.0206) MultiSource/Applications/ClamAV/clamscan: -11.86% (22.1758 => 19.5467, std. dev.: 0.0655) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.21% (1.6925 => 1.4182, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2373 => 1.1159, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -8.23% (1.5373 => 1.4108, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4890, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8653, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4922, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9037, std. dev.: 0.0073) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4808 => 0.4663, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4267, std. dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.78% (1.3677 => 1.3297, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0032, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (19.9488 => 19.5686, std. dev.: 0.0433) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.56% (9.5636 => 9.4140, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3430, std. dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.45% (1.6805 => 1.6562, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 19:55:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 21:55:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808025536.46F6E3524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2727?compare_to=2725&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2727, Order: 161462, Start Time: 2012-08-08 01:42:08, End Time: 2012-08-08 02:56:11 To: 2725, Order: 161455, Start Time: 2012-08-07 23:59:56, End Time: 2012-08-08 01:14:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 2 (2 on baseline) Performance Regressions: 1 (146 on baseline) Performance Improvements: 2 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/queens: 2.40% (2.1861 => 2.2385, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -1.78% (7.7562 => 7.6181, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: -1.53% (1.4579 => 1.4356, std. dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.64% (2.0176 => 2.3130, std. dev.: 0.0161) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7061 => 0.7679, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.65% (0.5818 => 0.6321, std. dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: 8.58% (0.5748 => 0.6241, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.13% (0.3578 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.95% (0.3650 => 0.3940, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.94% (0.3601 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.82% (0.3914 => 0.4220, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.78% (0.3663 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.52% (0.4003 => 0.4304, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.46% (0.3940 => 0.4234, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.32% (1.3693 => 1.4695, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.06% (0.7710 => 0.8254, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.03% (3.9660 => 4.2450, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.93% (0.5265 => 0.5630, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4328 => 0.4604, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.6959 => 0.7377, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.2193 => 1.2907, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.60% (0.9199 => 0.9714, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.5577 => 0.5885, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.48% (0.3246 => 0.3424, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.45% (13.8202 => 14.5739, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.33% (0.3022 => 0.3183, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.28% (0.3580 => 0.3769, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.25% (0.2760 => 0.2905, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.10% (0.8310 => 0.8734, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.06% (1.4563 => 1.5300, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.02% (1.1364 => 1.1934, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.00% (1.9828 => 2.0819, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.90% (0.4390 => 0.4605, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 4.86% (0.3192 => 0.3347, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.84% (3.8646 => 4.0518, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.82% (0.7506 => 0.7868, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.72% (7.2180 => 7.5588, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.68% (16.6129 => 17.3902, std. dev.: 0.0114) MultiSource/Applications/Burg/burg: 4.63% (1.1061 => 1.1573, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3856, std. dev.: 0.0071) MultiSource/Applications/treecc/treecc: 4.57% (1.9270 => 2.0151, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.56% (1.0594 => 1.1077, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.50% (1.3819 => 1.4441, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.39% (16.2614 => 16.9748, std. dev.: 0.0233) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.7460 => 0.7785, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2814, std. dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3868 => 0.4032, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.23% (2.1791 => 2.2713, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (3.6692 => 3.8225, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.13% (0.4791 => 0.4989, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6207, std. dev.: 0.0084) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.3801 => 4.5523, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.67% (0.3131 => 0.3246, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.6283 => 0.6507, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.43% (4.9865 => 5.1573, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1719, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.33% (0.6135 => 0.6339, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (8.4961 => 8.7679, std. dev.: 0.0183) MultiSource/Applications/d/make_dparser: 3.18% (3.1889 => 3.2903, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8698 => 0.8974, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.13% (3.2742 => 3.3768, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (6.5754 => 6.7770, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.97% (0.4113 => 0.4235, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.96% (14.5298 => 14.9599, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 2.94% (14.8535 => 15.2897, std. dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5188 => 1.5612, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.69% (2.1007 => 2.1572, std. dev.: 0.0155) MultiSource/Applications/oggenc/oggenc: 2.61% (4.6629 => 4.7845, std. dev.: 0.0155) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.93% (0.9108 => 0.9284, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.76% (1.0313 => 1.0494, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.56% (0.6744 => 0.6849, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.48% (3.7467 => 3.8023, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std. dev.: 0.0495) SingleSource/Benchmarks/Misc/mandel-2: 10.80% (1.2998 => 1.4402, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.18% (1.0895 => 1.1786, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.13% (1.5824 => 1.6635, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 4.15% (1.1560 => 1.2040, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.88% (3.2729 => 3.4000, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6844, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9570, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.94% (1.7688 => 1.8208, std. dev.: 0.0190) SingleSource/Benchmarks/McGill/queens: 2.91% (2.1753 => 2.2385, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4368, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4271 => 7.6181, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.26% (10.7476 => 10.9902, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.01% (3.1476 => 3.2110, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9585, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (1.5089 => 1.5308, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0492, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.14% (0.2670 => 0.2506, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.04% (22.5627 => 21.2002, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2308 => 1.1003, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3163, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.25% (20.3410 => 19.6807, std. dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.8259 => 8.5682, std. dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: -2.64% (1.9762 => 1.9240, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.63% (0.8342 => 0.8123, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9600, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2340, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.53% (0.6615 => 0.6514, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8021, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: -1.45% (9.3358 => 9.2006, std. dev.: 0.0298) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4341, std. dev.: 0.0091) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 20:24:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 22:24:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808032417.5CEE73524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2728?compare_to=2726&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2728, Order: 161463, Start Time: 2012-08-08 02:06:02, End Time: 2012-08-08 03:24:53 To: 2726, Order: 161455, Start Time: 2012-08-08 00:19:00, End Time: 2012-08-08 01:37:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (97 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.21% (2.3778 => 2.4303, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.19% (3.7014 => 3.7824, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.07% (3.7017 => 3.7785, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (55.0449 => 56.5766, std. dev.: 0.0477) SingleSource/Benchmarks/McGill/queens: 2.44% (2.1850 => 2.2384, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.52% (14.0310 => 13.5373, std. dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.58% (10.3673 => 13.5373, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3543 => 0.3962, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 11.77% (0.3561 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.36% (2.2022 => 2.4303, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.23% (1.7609 => 1.9059, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.47% (0.1432 => 0.1539, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.57% (0.1584 => 0.1688, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1892 => 0.2014, std. dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.25% (0.3121 => 0.3316, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.88% (7.0540 => 7.4691, std. dev.: 0.0107) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.6030 => 0.6366, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.57% (0.5925 => 0.6255, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 5.42% (0.3282 => 0.3460, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.40% (0.4615 => 0.4864, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.39% (10.4361 => 10.9988, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.23% (0.4879 => 0.5134, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.5569 => 0.5841, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (0.7433 => 0.7792, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.64% (0.2758 => 0.2886, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (9.4845 => 9.9205, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.47% (0.8172 => 0.8537, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.41% (0.7326 => 0.7649, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.41% (4.9449 => 5.1629, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.33% (5.0018 => 5.2182, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.04% (0.5860 => 0.6097, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 4.03% (0.3423 => 0.3561, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.98% (0.8067 => 0.8388, std. dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 3.93% (5.7591 => 5.9857, std. dev.: 0.0169) MultiSource/Applications/spiff/spiff: 3.88% (0.7835 => 0.8139, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (4.2646 => 4.4298, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 3.85% (17.1811 => 17.8418, std. dev.: 0.0155) MultiSource/Benchmarks/McCat/09-vor/vor: 3.74% (0.3180 => 0.3299, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.57% (0.3109 => 0.3220, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.55% (1.3050 => 1.3513, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.51% (8.1363 => 8.4216, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.35% (1.5415 => 1.5931, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1861 => 1.2246, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 3.23% (3.3354 => 3.4430, std. dev.: 0.0085) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.18% (1.1642 => 1.2012, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.16% (2.0273 => 2.0914, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (0.5105 => 0.5264, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7987, std. dev.: 0.0112) MultiSource/Applications/hbd/hbd: 2.96% (1.5603 => 1.6065, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.92% (3.8723 => 3.9853, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.91% (0.3441 => 0.3541, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.85% (0.9765 => 1.0043, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.80% (0.4636 => 0.4766, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (1.5859 => 1.6296, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.73% (0.4103 => 0.4215, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6450 => 0.6625, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4299 => 0.4415, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.2024 => 2.2615, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8921 => 0.9158, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.5020 => 0.5153, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (0.6675 => 0.6849, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.54% (0.6456 => 0.6620, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.51% (2.2969 => 2.3546, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.43% (1.4186 => 1.4531, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.98% (1.1840 => 1.2075, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: 1.94% (0.7115 => 0.7253, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.92% (2.0665 => 2.1062, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3075, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.58% (1.0722 => 1.0891, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.33% (1.1145 => 1.1962, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (4.2280 => 4.4099, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.58% (3.2827 => 3.4002, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7549, std. dev.: 0.0043) MultiSource/Applications/aha/aha: 2.77% (3.1595 => 3.2469, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 2.56% (2.1825 => 2.2384, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.75% (26.0924 => 26.5503, std. dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/hash2: 1.61% (3.1578 => 3.2086, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5086 => 1.5307, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7945, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 1.15% (1.1396 => 1.1527, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1297, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1631, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.77% (5.3855 => 3.7824, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.41% (5.3526 => 3.7785, std. dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -15.02% (54.1659 => 46.0298, std. dev.: 0.0254) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.13% (2.9384 => 2.5527, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -11.64% (22.1758 => 19.5947, std. dev.: 0.0282) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2373 => 1.1020, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel-2: -7.84% (1.5373 => 1.4168, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.34% (2.7294 => 2.5564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5044, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.89% (1.5660 => 1.4894, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.58% (1.9577 => 1.8681, std. dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4917, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4153, std. dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9126, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.85% (0.4808 => 0.4671, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9919, std. dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3414, std. dev.: 0.0075) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4182, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.36% (1.6805 => 1.6577, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (19.9488 => 19.6813, std. dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 20:48:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 22:48:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120808034851.1445C3524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2729?compare_to=2724&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2729, Order: 161460, Start Time: 2012-08-08 01:06:09, End Time: 2012-08-08 03:49:28 To: 2724, Order: 161446, Start Time: 2012-08-07 21:54:37, End Time: 2012-08-08 00:37:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (107 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (772 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.26% (0.3446 => 0.3903, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3442 => 0.3898, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.22% (0.3465 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.15% (0.3460 => 0.3915, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3469 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.71% (0.3643 => 0.4106, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.60% (0.3650 => 0.4110, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5826 => 0.6239, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.01% (0.3792 => 0.4058, std. dev.: 0.0095) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.5889 => 0.6297, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.58% (1.5932 => 1.6981, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.20% (1.6211 => 1.7216, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 6.11% (0.7171 => 0.7609, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.08% (0.4361 => 0.4626, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.95% (3.5627 => 3.7748, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.91% (1.3152 => 1.3929, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.2014 => 0.2129, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.67% (0.3930 => 0.4153, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (0.4994 => 0.5273, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 5.36% (4.2109 => 4.4368, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (0.5026 => 0.5292, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (0.5000 => 0.5263, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 5.11% (0.4029 => 0.4235, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.05% (1.0781 => 1.1325, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.92% (2.7292 => 2.8636, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (0.4658 => 0.4880, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.71% (0.2866 => 0.3001, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.2736 => 0.2862, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (2.1013 => 2.1978, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (0.3890 => 0.4067, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.54% (1.9694 => 2.0588, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 4.41% (5.5417 => 5.7860, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.33% (0.2566 => 0.2677, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 4.12% (4.6177 => 4.8080, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (1.9966 => 2.0779, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 4.05% (0.9909 => 1.0310, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.02% (0.6634 => 0.6901, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.01% (4.4195 => 4.5969, std. dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (2.1653 => 2.2509, std. dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 3.90% (1.8794 => 1.9527, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.3903 => 0.4055, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.83% (0.7875 => 0.8177, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.83% (0.2875 => 0.2985, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.71% (0.9697 => 1.0057, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.69% (0.2738 => 0.2839, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.63% (0.3004 => 0.3113, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.61% (0.3271 => 0.3389, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.58% (0.3267 => 0.3384, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.57% (2.0673 => 2.1411, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.54% (0.3362 => 0.3481, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3258 => 0.3373, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.53% (0.3060 => 0.3168, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.49% (0.3726 => 0.3856, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.48% (0.4139 => 0.4283, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (0.3625 => 0.3751, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 3.43% (1.4269 => 1.4759, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3317 => 0.3430, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.36% (0.3096 => 0.3200, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.35% (0.3348 => 0.3460, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.32% (0.3678 => 0.3800, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.25% (0.5546 => 0.5726, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 3.14% (0.4146 => 0.4276, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.11% (0.3282 => 0.3384, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.3845 => 0.3961, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.99% (23.5202 => 24.2232, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 2.96% (0.4251 => 0.4377, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3477 => 0.3580, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.86% (0.3981 => 0.4095, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.66% (2.0346 => 2.0888, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.6435 => 0.6604, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.60% (0.7426 => 0.7545, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.2122 => 0.2271, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6085, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6754, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1693, std. dev.: 0.1188) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6638, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1939, std. dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4953, std. dev.: 0.0240) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.65% (41.7953 => 42.4848, std. dev.: 0.0769) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5387, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.04% (6.9842 => 7.0567, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.20% (2.4764 => 2.4468, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.09% (25.4195 => 16.5008, std. dev.: 0.0194) SingleSource/Benchmarks/Dhrystone/fldry: -9.56% (17.2379 => 15.5902, std. dev.: 0.2472) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9737, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8101, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7879, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -3.55% (14.0481 => 13.5500, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.66% (10.7630 => 10.5839, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9632, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4967, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7152, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 21:37:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 7 Aug 2012 23:37:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808043743.93E253524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2730?compare_to=2727&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2730, Order: 161471, Start Time: 2012-08-08 03:24:21, End Time: 2012-08-08 04:38:20 To: 2727, Order: 161462, Start Time: 2012-08-08 01:42:08, End Time: 2012-08-08 02:56:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 2 (0 on baseline) Performance Regressions: 2 (149 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset New Passes - Execution Time --------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.74% (78.7997 => 80.9556, std. dev.: 0.1564) SingleSource/Regression/C/uint64_to_float: 2.01% (0.5325 => 0.5432, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.14% (3.7316 => 3.6892, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.51% (2.0176 => 2.3103, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5818 => 0.6330, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.61% (0.5748 => 0.6243, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.22% (0.3578 => 0.3872, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.14% (0.3601 => 0.3894, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3914 => 0.4228, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.00% (0.3650 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.97% (0.3663 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.89% (0.3789 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.4003 => 0.4315, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.64% (0.3940 => 0.4241, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.61% (0.7710 => 0.8297, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.27% (1.3693 => 1.4688, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.20% (3.9660 => 4.2517, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.95% (0.7038 => 0.7527, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.93% (0.5265 => 0.5630, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4328 => 0.4605, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.18% (1.2193 => 1.2946, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.6959 => 0.7383, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.07% (0.2782 => 0.2951, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4379 => 0.4645, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.04% (0.2781 => 0.2949, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.73% (0.9199 => 0.9726, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5577 => 0.5893, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.44% (13.8202 => 14.5723, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.39% (0.3485 => 0.3673, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.39% (0.3246 => 0.3421, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.28% (0.2765 => 0.2911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (1.4563 => 1.5324, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.16% (1.1364 => 1.1950, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.3192 => 0.3355, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 5.04% (0.8310 => 0.8729, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.02% (1.9828 => 2.0823, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.92% (0.4390 => 0.4606, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.88% (1.0594 => 1.1111, std. dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 4.87% (16.6129 => 17.4222, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (7.2180 => 7.5694, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.85% (1.3819 => 1.4489, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.78% (3.8646 => 4.0493, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.76% (0.7506 => 0.7863, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3453 => 0.3616, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.71% (1.1061 => 1.1582, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.68% (1.3813 => 1.4459, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.67% (1.3245 => 1.3864, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 4.62% (16.2614 => 17.0123, std. dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/lists1: 4.61% (0.3534 => 0.3697, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.57% (0.2995 => 0.3132, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.54% (0.7460 => 0.7799, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.53% (13.2842 => 13.8855, std. dev.: 0.0121) MultiSource/Applications/treecc/treecc: 4.48% (1.9270 => 2.0134, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.48% (0.4016 => 0.4196, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.28% (0.4791 => 0.4996, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.24% (4.4433 => 4.6315, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (3.6692 => 3.8244, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.19% (2.1791 => 2.2703, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.3801 => 4.5612, std. dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: 4.13% (1.2292 => 1.2800, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.80% (0.3131 => 0.3250, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.69% (0.6283 => 0.6515, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.64% (1.1333 => 1.1745, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6135 => 0.6358, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.55% (4.9865 => 5.1635, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (8.4961 => 8.7866, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.34% (3.1889 => 3.2953, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.28% (3.2742 => 3.3815, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.22% (0.8698 => 0.8978, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (6.5754 => 6.7773, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 3.05% (14.8535 => 15.3072, std. dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: 2.99% (14.5298 => 14.9637, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.88% (2.1007 => 2.1612, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.86% (1.5188 => 1.5622, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.74% (4.6629 => 4.7907, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.12% (0.9108 => 0.9301, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.80% (1.0313 => 1.0499, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.31% (3.7467 => 3.7957, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2785 => 6.3485, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/mandel-2: 9.89% (1.2998 => 1.4283, std. dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.16% (1.5824 => 1.6640, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 4.16% (1.1560 => 1.2041, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.02% (3.2729 => 3.4046, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.2619 => 11.6850, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9570, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 2.92% (2.1753 => 2.2389, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4379, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.82% (1.7688 => 1.8187, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4271 => 7.6081, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.40% (10.7476 => 11.0053, std. dev.: 0.0276) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2105, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5284, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1899, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2308 => 1.0991, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0146) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.45% (6.2497 => 5.9713, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.59% (20.3410 => 19.6101, std. dev.: 0.0706) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.23% (0.4867 => 0.4710, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.64% (1.9762 => 1.9240, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.61% (0.8342 => 0.8124, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5977, std. dev.: 0.0134) MultiSource/Applications/spiff/spiff: -2.29% (3.0263 => 2.9571, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2307, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8034, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0083, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.38% (9.3358 => 9.2066, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8710, std. dev.: 0.0157) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4391, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 7 22:11:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 00:11:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808051120.1ECCE3524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2731?compare_to=2728&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2731, Order: 161471, Start Time: 2012-08-08 03:53:09, End Time: 2012-08-08 05:11:57 To: 2728, Order: 161463, Start Time: 2012-08-08 02:06:02, End Time: 2012-08-08 03:24:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (104 on baseline) Performance Improvements: 4 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 926 (735 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.07% (13.5373 => 14.2236, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 2.04% (2.3203 => 2.3677, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel-2: 1.63% (1.4168 => 1.4399, std. dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 1.16% (1.1020 => 1.1148, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.64% (2.4303 => 2.3905, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.55% (3.7824 => 3.7239, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.45% (3.7785 => 3.7238, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (19.6813 => 19.4825, std. dev.: 0.0718) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.20% (10.3673 => 14.2236, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 12.50% (0.3473 => 0.3907, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.19% (0.3543 => 0.3975, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.11% (0.3543 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.70% (0.3828 => 0.4276, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 11.45% (0.3886 => 0.4331, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.73% (1.7609 => 1.9146, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.55% (2.2022 => 2.3905, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 8.51% (0.1622 => 0.1760, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.63% (0.1584 => 0.1689, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.26% (0.5925 => 0.6296, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.6030 => 0.6407, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.61% (0.3282 => 0.3466, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.52% (7.0540 => 7.4434, std. dev.: 0.0150) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4615 => 0.4867, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (10.4361 => 10.9941, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.31% (0.4879 => 0.5138, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.14% (0.7433 => 0.7815, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.12% (0.7326 => 0.7701, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.82% (9.4845 => 9.9417, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 4.70% (0.2554 => 0.2674, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.39% (5.0018 => 5.2216, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.38% (4.9449 => 5.1613, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.36% (0.5569 => 0.5812, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.31% (0.8172 => 0.8524, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.16% (4.2646 => 4.4421, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.5860 => 0.6102, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3121 => 0.3247, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.02% (0.2758 => 0.2869, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 3.88% (0.7835 => 0.8139, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.85% (0.2700 => 0.2804, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.85% (17.1811 => 17.8426, std. dev.: 0.0475) MultiSource/Benchmarks/McCat/18-imp/imp: 3.83% (0.3423 => 0.3554, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.76% (5.7591 => 5.9754, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (8.1363 => 8.4418, std. dev.: 0.0065) MultiSource/Benchmarks/McCat/09-vor/vor: 3.74% (0.3180 => 0.3299, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.67% (0.3109 => 0.3223, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.3092 => 0.3205, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.65% (1.3050 => 1.3526, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.53% (3.3354 => 3.4530, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.52% (1.5603 => 1.6152, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.48% (1.1861 => 1.2274, std. dev.: 0.0091) MultiSource/Applications/Burg/burg: 3.36% (1.1642 => 1.2033, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.31% (14.3668 => 14.8429, std. dev.: 0.0183) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.30% (1.5415 => 1.5924, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.30% (0.8067 => 0.8333, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.21% (0.4636 => 0.4785, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.20% (2.0273 => 2.0921, std. dev.: 0.0105) MultiSource/Applications/lua/lua: 3.09% (3.8723 => 3.9919, std. dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.04% (0.5105 => 0.5260, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.99% (0.3441 => 0.3544, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.4103 => 0.4225, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.94% (0.9765 => 1.0052, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 2.93% (0.4299 => 0.4425, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (1.5859 => 1.6318, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.88% (0.3650 => 0.3755, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.87% (2.2024 => 2.2657, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.83% (0.6456 => 0.6639, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.4289 => 0.4410, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.6675 => 0.6853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.61% (0.3826 => 0.3926, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.60% (0.6450 => 0.6618, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (0.4064 => 0.4169, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.58% (2.2969 => 2.3561, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.54% (1.4186 => 1.4547, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.47% (2.0665 => 2.1176, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.44% (0.5981 => 0.6127, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8921 => 0.9134, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.37% (0.5020 => 0.5139, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.23% (1.2842 => 1.3129, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 2.13% (1.1840 => 1.2092, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: 2.08% (0.7115 => 0.7263, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.74% (1.0722 => 1.0909, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.1145 => 1.1964, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.59% (4.2280 => 4.4219, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 3.98% (2.2771 => 2.3677, std. dev.: 0.0172) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.59% (3.2827 => 3.4004, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7588, std. dev.: 0.0033) MultiSource/Applications/aha/aha: 2.76% (3.1595 => 3.2466, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 2.58% (2.1825 => 2.2389, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.11% (3.1578 => 3.2244, std. dev.: 0.0049) MultiSource/Applications/lua/lua: 1.83% (26.0924 => 26.5710, std. dev.: 0.0155) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.41% (1.5086 => 1.5298, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.34% (1.0313 => 1.0451, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7951, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 1.15% (1.1396 => 1.1527, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5786, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1631, std. dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.85% (5.3855 => 3.7239, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.43% (5.3526 => 3.7238, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -15.10% (54.1659 => 45.9843, std. dev.: 0.0370) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.46% (2.9384 => 2.5429, std. dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: -11.67% (22.1758 => 19.5888, std. dev.: 0.0299) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2373 => 1.1148, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -6.34% (1.5373 => 1.4399, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4893, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.74% (1.9577 => 1.8650, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: -4.59% (1.5835 => 1.5108, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4913, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4094, std. dev.: 0.0181) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9036, std. dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.95% (0.4808 => 0.4666, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0118, std. dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.34% (19.9488 => 19.4825, std. dev.: 0.0718) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.57% (9.5636 => 9.4136, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3474, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.37% (1.6805 => 1.6574, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 00:24:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 02:24:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808072438.3A1503524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2732?compare_to=2730&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2732, Order: 161475, Start Time: 2012-08-08 06:08:27, End Time: 2012-08-08 07:25:14 To: 2730, Order: 161471, Start Time: 2012-08-08 03:24:21, End Time: 2012-08-08 04:38:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 1 (27 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -3.72% (1.4283 => 1.3752, std. dev.: 0.0199) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.59% (2.0176 => 2.3119, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.82% (0.5748 => 0.6255, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7061 => 0.7631, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 8.05% (0.3578 => 0.3866, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3601 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.87% (0.3646 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.70% (0.3650 => 0.3931, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 7.69% (0.3914 => 0.4215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.59% (0.3623 => 0.3898, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.24% (1.3693 => 1.4685, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7038 => 0.7542, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (3.9660 => 4.2459, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5265 => 0.5625, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.77% (0.7710 => 0.8232, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (1.2193 => 1.2922, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.98% (0.3899 => 0.4132, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.6959 => 0.7363, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.65% (0.3489 => 0.3686, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.62% (0.3149 => 0.3326, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.60% (0.9199 => 0.9714, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.48% (0.3246 => 0.3424, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.46% (13.8202 => 14.5750, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.5577 => 0.5880, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.37% (1.9828 => 2.0893, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2988 => 0.3146, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.04% (1.1364 => 1.1937, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.96% (0.8310 => 0.8722, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.95% (1.4563 => 1.5284, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.89% (16.6129 => 17.4258, std. dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.69% (1.3813 => 1.4461, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 4.69% (3.8646 => 4.0457, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.68% (7.2180 => 7.5555, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (13.2842 => 13.8932, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.3245 => 1.3849, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.3819 => 1.4446, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.52% (1.0594 => 1.1073, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 4.52% (0.7506 => 0.7845, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.50% (1.1061 => 1.1559, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 4.43% (16.2614 => 16.9818, std. dev.: 0.0168) MultiSource/Applications/treecc/treecc: 4.40% (1.9270 => 2.0118, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.27% (1.2292 => 1.2817, std. dev.: 0.0117) MultiSource/Benchmarks/McCat/18-imp/imp: 4.22% (0.3220 => 0.3356, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 4.16% (2.1791 => 2.2698, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (3.6692 => 3.8169, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (4.4433 => 4.6189, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.3801 => 4.5505, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.83% (0.6135 => 0.6370, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 3.67% (0.3131 => 0.3246, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.47% (1.1333 => 1.1726, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 3.29% (3.1889 => 3.2938, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (8.4961 => 8.7708, std. dev.: 0.0142) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.5754 => 6.7674, std. dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 2.88% (14.8535 => 15.2810, std. dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.5298 => 14.9438, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 2.76% (4.6629 => 4.7918, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.97% (0.9108 => 0.9287, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.74% (1.0313 => 1.0492, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.17% (3.7467 => 3.7906, std. dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.01% (33.2944 => 33.6309, std. dev.: 0.0323) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.79% (0.4846 => 0.6968, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5132, std. dev.: 0.0285) SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.21% (1.0895 => 1.1789, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 5.80% (1.2998 => 1.3752, std. dev.: 0.0199) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.17% (1.5824 => 1.6642, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 4.20% (1.1560 => 1.2045, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 3.92% (3.2729 => 3.4011, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6845, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.03% (1.9199 => 1.9780, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 2.96% (2.1753 => 2.2396, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.91% (1.7688 => 1.8202, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4381, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6021, std. dev.: 0.0241) MultiSource/Applications/SPASS/SPASS: 2.34% (10.7476 => 10.9987, std. dev.: 0.0307) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0003) MultiSource/Applications/aha/aha: 2.01% (3.1476 => 3.2109, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0072) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5073, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/bisort/bisort: 1.23% (0.8239 => 0.8340, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6388, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.07% (0.2670 => 0.2508, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1982, std. dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.69% (1.2308 => 1.1115, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.28% (20.3410 => 19.6743, std. dev.: 0.0636) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.23% (0.4867 => 0.4710, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5926, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.61% (0.8342 => 0.8124, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9249, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9597, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2345, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8039, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0084, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2183, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4430, std. dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 00:30:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 02:30:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808073043.D291D3524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2733?compare_to=2731&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2733, Order: 161475, Start Time: 2012-08-08 06:08:40, End Time: 2012-08-08 07:31:20 To: 2731, Order: 161471, Start Time: 2012-08-08 03:53:09, End Time: 2012-08-08 05:11:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (99 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.61% (14.2236 => 13.9942, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.98% (10.3673 => 13.9942, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3516 => 0.3940, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/synchronized: 12.05% (0.3561 => 0.3990, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.96% (1.1194 => 1.2533, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std. dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (0.1622 => 0.1771, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.15% (2.2022 => 2.4038, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.92% (1.7609 => 1.9004, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0161) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.88% (0.1584 => 0.1693, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.68% (0.6030 => 0.6433, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.94% (0.3282 => 0.3477, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7433 => 0.7870, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.77% (10.4361 => 11.0381, std. dev.: 0.0325) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.66% (7.0540 => 7.4533, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.60% (0.4879 => 0.5152, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.53% (0.4615 => 0.4870, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 5.09% (9.4845 => 9.9669, std. dev.: 0.1580) MultiSource/Benchmarks/McCat/08-main/main: 4.70% (0.2554 => 0.2674, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.5569 => 0.5826, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.50% (5.0018 => 5.2270, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.47% (4.9449 => 5.1659, std. dev.: 0.0123) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.39% (4.2646 => 4.4518, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.8172 => 0.8525, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.27% (0.5860 => 0.6110, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.26% (0.3121 => 0.3254, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.15% (0.2700 => 0.2812, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 4.02% (0.3109 => 0.3234, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.96% (0.3387 => 0.3521, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 3.95% (17.1811 => 17.8597, std. dev.: 0.0147) MultiSource/Applications/spiff/spiff: 3.89% (0.7835 => 0.8140, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: 3.86% (0.3423 => 0.3555, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.81% (1.3050 => 1.3547, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.80% (0.4103 => 0.4259, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.77% (1.5603 => 1.6192, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/09-vor/vor: 3.77% (0.3180 => 0.3300, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.77% (8.1363 => 8.4431, std. dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 3.76% (5.7591 => 5.9757, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.3092 => 0.3205, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 3.62% (1.1642 => 1.2064, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.57% (1.5415 => 1.5966, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.57% (1.1861 => 1.2284, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (14.3668 => 14.8786, std. dev.: 0.0090) MultiSource/Applications/d/make_dparser: 3.51% (3.3354 => 3.4526, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.8067 => 0.8348, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.46% (0.3441 => 0.3560, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.29% (2.0273 => 2.0939, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.5105 => 0.5272, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3826 => 0.3951, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.26% (2.0665 => 2.1338, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6450 => 0.6659, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.19% (0.3136 => 0.3236, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.6456 => 0.6660, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5981 => 0.6169, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.4064 => 0.4191, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.12% (2.2024 => 2.2712, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.06% (0.9765 => 1.0064, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 3.04% (3.8723 => 3.9902, std. dev.: 0.0140) MultiSource/Benchmarks/McCat/05-eks/eks: 2.98% (0.4299 => 0.4427, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.93% (1.5859 => 1.6324, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6675 => 0.6867, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.82% (1.2842 => 1.3204, std. dev.: 0.0074) MultiSource/Applications/siod/siod: 2.79% (2.2969 => 2.3609, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.69% (0.5020 => 0.5155, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.60% (1.4186 => 1.4555, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8921 => 0.9148, std. dev.: 0.0036) MultiSource/Applications/minisat/minisat: 2.32% (0.7115 => 0.7280, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 2.14% (1.1840 => 1.2093, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.88% (1.0722 => 1.0924, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9740, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.1145 => 1.1964, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (4.2280 => 4.4004, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.59% (3.2827 => 3.4007, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7614, std. dev.: 0.0109) MultiSource/Applications/aha/aha: 2.78% (3.1595 => 3.2474, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.57% (2.1825 => 2.2386, std. dev.: 0.0132) MultiSource/Applications/lua/lua: 1.76% (26.0924 => 26.5524, std. dev.: 0.0280) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.38% (1.5086 => 1.5294, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.36% (1.3045 => 1.3223, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7944, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.12% (1.1396 => 1.1524, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2149, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.89% (5.2763 => 3.1716, std. dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.87% (5.3855 => 3.7232, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7141, std. dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0692, std. dev.: 1.1628) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.06% (2.9384 => 2.5547, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -11.07% (22.1758 => 19.7215, std. dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.64% (1.6925 => 1.4278, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.04% (1.2373 => 1.1007, std. dev.: 0.0171) SingleSource/Benchmarks/Misc/mandel-2: -7.04% (1.5373 => 1.4291, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.34% (2.7294 => 2.5564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5034, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4893, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.56% (19.9488 => 19.2386, std. dev.: 0.1478) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.8999, std. dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4983, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4209, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9999, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std. dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4180, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3518, std. dev.: 0.0277) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.31% (1.6805 => 1.6585, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2320, std. dev.: 0.0243) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 01:48:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 03:48:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120808084820.684ED3524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2734?compare_to=2729&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2734, Order: 161475, Start Time: 2012-08-08 06:03:10, End Time: 2012-08-08 08:48:57 To: 2729, Order: 161460, Start Time: 2012-08-08 01:06:09, End Time: 2012-08-08 03:49:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 7 (90 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 945 (789 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 8.03% (13.5500 => 14.6374, std. dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/fldry: 7.50% (15.5902 => 16.7598, std. dev.: 0.0788) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.86% (124.2380 => 130.2739, std. dev.: 0.5659) SingleSource/Benchmarks/Misc/richards_benchmark: 2.22% (2.9636 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1847 => 7.2855, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.22% (50.2915 => 50.9062, std. dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.2429 => 1.2579, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/siod/siod: -3.99% (7.0567 => 6.7750, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.82% (0.6287 => 0.6110, std. dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.16% (0.3488 => 0.3947, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3446 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.10% (0.3465 => 0.3919, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3442 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.01% (0.3460 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3469 => 0.3916, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.68% (0.3643 => 0.4105, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 12.55% (0.3650 => 0.4108, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5826 => 0.6265, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.37% (0.5889 => 0.6323, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.67% (0.1619 => 0.1727, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.15% (1.5932 => 1.6912, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (1.6211 => 1.7205, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.99% (0.4994 => 0.5293, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.83% (0.7171 => 0.7589, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.80% (0.3930 => 0.4158, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.80% (0.4361 => 0.4614, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.73% (1.3152 => 1.3905, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.72% (3.5627 => 3.7664, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.47% (0.5900 => 0.6223, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.44% (4.2109 => 4.4400, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (0.5026 => 0.5291, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.18% (0.5000 => 0.5259, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.11% (0.2566 => 0.2697, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.00% (1.0781 => 1.1320, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.2866 => 0.3007, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.46% (2.7292 => 2.8510, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 4.35% (5.5417 => 5.7826, std. dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 4.30% (2.1013 => 2.1917, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (0.3890 => 0.4050, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 4.11% (0.9909 => 1.0316, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (0.4658 => 0.4848, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3195 => 0.3324, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (1.9966 => 2.0760, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (1.9694 => 2.0475, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.94% (4.4195 => 4.5935, std. dev.: 0.0097) SingleSource/Regression/C++/ofstream_ctor: 3.93% (0.3004 => 0.3122, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.92% (0.6634 => 0.6894, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.89% (2.0673 => 2.1477, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.88% (0.3271 => 0.3398, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.85% (4.6177 => 4.7957, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 3.75% (2.1653 => 2.2464, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 3.74% (0.9697 => 1.0060, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.3903 => 0.4048, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (1.8794 => 1.9492, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3362 => 0.3486, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.68% (0.3124 => 0.3239, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.4139 => 0.4291, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.63% (0.3060 => 0.3171, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.60% (0.3336 => 0.3456, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.2911 => 0.3015, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.47% (23.5202 => 24.3356, std. dev.: 0.0097) MultiSource/Applications/treecc/treecc: 3.43% (0.7875 => 0.8145, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.28% (1.4269 => 1.4737, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.20% (0.3845 => 0.3968, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 3.08% (0.5546 => 0.5717, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.6435 => 0.6617, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.50% (2.0346 => 2.0854, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0173) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.45% (0.2122 => 0.2280, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (12.0509 => 12.6505, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std. dev.: 0.0233) SingleSource/Benchmarks/Misc/flops-2: 4.31% (1.8057 => 1.8835, std. dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6374, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7116, std. dev.: 0.0228) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (41.7953 => 42.6532, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary3: 1.77% (15.8721 => 16.1529, std. dev.: 0.0273) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5928, std. dev.: 0.0199) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9062, std. dev.: 0.0249) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2210, std. dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3107, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.42% (1.0927 => 1.1082, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.25% (25.4195 => 16.2048, std. dev.: 0.1670) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8019, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -6.79% (0.2402 => 0.2239, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8039, std. dev.: 0.0027) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7750, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.91% (0.6293 => 0.6110, std. dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/fldry: -2.77% (17.2379 => 16.7598, std. dev.: 0.0788) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5758, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9613, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 02:07:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 04:07:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808090705.6CCB63524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2735?compare_to=2732&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2735, Order: 161478, Start Time: 2012-08-08 07:53:49, End Time: 2012-08-08 09:07:41 To: 2732, Order: 161475, Start Time: 2012-08-08 06:08:27, End Time: 2012-08-08 07:25:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (143 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 26.49% (7.2695 => 9.1952, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.52% (77.8818 => 81.4051, std. dev.: 0.0624) SingleSource/Benchmarks/Misc/mandel-2: 3.83% (1.3752 => 1.4279, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.69% (54.5814 => 56.0501, std. dev.: 0.2507) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.28% (2.0176 => 2.3057, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5748 => 0.6269, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3578 => 0.3880, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.43% (0.7061 => 0.7656, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.28% (0.3601 => 0.3899, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 8.26% (0.3646 => 0.3947, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.14% (0.3623 => 0.3918, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.14% (0.3663 => 0.3961, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.02% (0.3914 => 0.4228, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.4003 => 0.4315, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 7.69% (0.3940 => 0.4243, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.19% (1.3693 => 1.4678, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.19% (0.7710 => 0.8264, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.90% (3.9660 => 4.2396, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7038 => 0.7509, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (0.4328 => 0.4598, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (1.2193 => 1.2892, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.56% (0.6959 => 0.7346, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.54% (0.2726 => 0.2877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.2937 => 0.3099, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.48% (0.3485 => 0.3676, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9199 => 0.9700, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.42% (0.5577 => 0.5879, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.31% (1.9828 => 2.0881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.31% (0.3580 => 0.3770, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.24% (0.3246 => 0.3416, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2761 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.91% (13.8202 => 14.4994, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4390 => 0.4604, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.77% (1.4563 => 1.5258, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.66% (1.1364 => 1.1894, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 4.66% (0.8310 => 0.8697, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.64% (7.2180 => 7.5528, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.3756 => 0.3927, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.54% (16.6129 => 17.3663, std. dev.: 0.0150) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (3.8646 => 4.0393, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.38% (0.7460 => 0.7787, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.33% (0.7506 => 0.7831, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3810, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.19% (1.0594 => 1.1038, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.17% (1.1061 => 1.1522, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.16% (13.2842 => 13.8364, std. dev.: 0.0237) MultiSource/Applications/hexxagon/hexxagon: 4.14% (1.2292 => 1.2801, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.13% (1.3819 => 1.4390, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.13% (1.3813 => 1.4383, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 4.13% (16.2614 => 16.9323, std. dev.: 0.0133) MultiSource/Applications/treecc/treecc: 4.12% (1.9270 => 2.0063, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6146, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (3.6692 => 3.8104, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.79% (2.1791 => 2.2616, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (4.3801 => 4.5429, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (0.4791 => 0.4965, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.18% (1.1333 => 1.1693, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.17% (4.9865 => 5.1446, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6283 => 0.6480, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7470, std. dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.94% (0.8698 => 0.8954, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.91% (3.2742 => 3.3696, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 2.89% (3.1889 => 3.2809, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.5754 => 6.7586, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.66% (14.8535 => 15.2488, std. dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9098, std. dev.: 0.0161) MultiSource/Applications/oggenc/oggenc: 2.59% (4.6629 => 4.7837, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.56% (2.1007 => 2.1545, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5188 => 1.5555, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.32% (1.0313 => 1.0449, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 1.06% (3.7467 => 3.7864, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/mandel-2: 9.86% (1.2998 => 1.4279, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.21% (1.5824 => 1.6648, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 4.07% (1.1560 => 1.2030, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.93% (3.2729 => 3.4015, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.2619 => 11.6849, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.7688 => 1.8206, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 2.89% (2.1753 => 2.2382, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4385, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6061, std. dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: 2.38% (10.7476 => 11.0029, std. dev.: 0.0658) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2104, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9568, std. dev.: 0.0091) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1952, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (1.5089 => 1.5286, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.5627 => 21.1151, std. dev.: 0.0194) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.91% (1.0460 => 0.8587, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.37% (1.2308 => 1.1032, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.45% (6.2497 => 5.9713, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.16% (1.3780 => 1.3207, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.27% (20.3410 => 19.6757, std. dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.61% (1.9762 => 1.9247, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5967, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.59% (0.8342 => 0.8126, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9634, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2274, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8041, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0084, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.40% (9.3358 => 9.2053, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4369, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8730, std. dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 02:18:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 04:18:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808091843.E81013524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2736?compare_to=2733&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2736, Order: 161478, Start Time: 2012-08-08 08:00:36, End Time: 2012-08-08 09:19:20 To: 2733, Order: 161475, Start Time: 2012-08-08 06:08:40, End Time: 2012-08-08 07:31:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (99 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.29% (6.7653 => 8.6794, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.24% (54.8258 => 56.6005, std. dev.: 0.0385) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.63% (19.2386 => 19.5523, std. dev.: 0.0436) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.65% (10.3673 => 13.9598, std. dev.: 0.0106) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.95% (0.3497 => 0.3915, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.88% (0.3543 => 0.3964, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.80% (1.1194 => 1.2515, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3694 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.71% (1.7609 => 1.9142, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.27% (2.2022 => 2.3844, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.76% (0.1584 => 0.1691, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 6.42% (0.6030 => 0.6417, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.33% (0.3177 => 0.3378, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5925 => 0.6298, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.24% (0.4615 => 0.4857, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 5.24% (0.7326 => 0.7710, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (10.4361 => 10.9831, std. dev.: 0.0359) MultiSource/Applications/lambda-0_1_3/lambda: 5.22% (0.7433 => 0.7821, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.16% (0.4879 => 0.5131, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.3282 => 0.3447, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.02% (7.0540 => 7.4084, std. dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 4.50% (9.4845 => 9.9116, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.5569 => 0.5810, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 4.27% (0.2554 => 0.2663, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.25% (4.9449 => 5.1550, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (5.0018 => 5.2132, std. dev.: 0.0122) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.98% (0.8172 => 0.8497, std. dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.96% (4.2646 => 4.4334, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.92% (0.5860 => 0.6090, std. dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 3.78% (17.1811 => 17.8308, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/18-imp/imp: 3.77% (0.3423 => 0.3552, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 3.66% (0.7835 => 0.8122, std. dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 3.60% (0.3109 => 0.3221, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.57% (0.3387 => 0.3508, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.56% (1.5603 => 1.6158, std. dev.: 0.0116) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (8.1363 => 8.4229, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.47% (1.3050 => 1.3503, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1861 => 1.2258, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.4103 => 0.4239, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.28% (5.7591 => 5.9478, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.23% (0.5105 => 0.5270, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.16% (3.3354 => 3.4408, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (14.3668 => 14.8158, std. dev.: 0.0070) MultiSource/Applications/treecc/treecc: 3.11% (2.0273 => 2.0903, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 3.07% (1.1642 => 1.1999, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.5415 => 1.5887, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4289 => 0.4415, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (1.5859 => 1.6317, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.89% (2.2024 => 2.2660, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3826 => 0.3936, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.84% (3.8723 => 3.9824, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9765 => 1.0040, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.80% (0.4636 => 0.4766, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3865 => 0.3973, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.77% (0.6456 => 0.6635, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.73% (0.6675 => 0.6857, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4299 => 0.4415, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.65% (2.0665 => 2.1212, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (0.4064 => 0.4169, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.56% (2.2969 => 2.3557, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 2.54% (0.8921 => 0.9148, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.53% (1.4186 => 1.4545, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 2.51% (0.4620 => 0.4736, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.43% (0.5020 => 0.5142, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 2.38% (1.2842 => 1.3147, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5981 => 0.6120, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.01% (1.1840 => 1.2078, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: 1.98% (0.7115 => 0.7256, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.76% (1.0722 => 1.0911, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.33% (1.1145 => 1.1962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (4.2280 => 4.3959, std. dev.: 0.0150) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.61% (3.2827 => 3.4013, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7459, std. dev.: 0.0075) MultiSource/Applications/aha/aha: 2.78% (3.1595 => 3.2472, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 2.56% (2.1825 => 2.2383, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.90% (3.1578 => 3.2178, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.63% (26.0924 => 26.5188, std. dev.: 0.0349) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7999, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5086 => 1.5269, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5836, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 1.10% (1.1396 => 1.1521, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.02% (9.1159 => 9.2091, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.00% (5.2763 => 3.1659, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7108, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7068, std. dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0803, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5541, std. dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: -11.73% (22.1758 => 19.5747, std. dev.: 0.0616) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2373 => 1.1064, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -7.92% (1.5373 => 1.4156, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5566, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.89% (1.5660 => 1.4894, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.76% (1.9577 => 1.8646, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.8999, std. dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5012, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4808 => 0.4660, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4277, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.60% (10.2830 => 10.0153, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.99% (19.9488 => 19.5523, std. dev.: 0.0436) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std. dev.: 0.0118) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.55% (9.5636 => 9.4158, std. dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.37% (1.6805 => 1.6574, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.8329 => 1.8144, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 03:48:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 05:48:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808104858.7C0173524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2737?compare_to=2735&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2737, Order: 161481, Start Time: 2012-08-08 09:35:42, End Time: 2012-08-08 10:49:36 To: 2735, Order: 161478, Start Time: 2012-08-08 07:53:49, End Time: 2012-08-08 09:07:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.26% (2.0176 => 2.3053, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3578 => 0.3880, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.28% (0.7061 => 0.7646, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3914 => 0.4230, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.92% (0.4003 => 0.4320, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.77% (0.3940 => 0.4246, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.7710 => 0.8276, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.17% (1.3693 => 1.4675, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.87% (3.9660 => 4.2385, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 6.83% (0.7038 => 0.7519, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4328 => 0.4605, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.6959 => 0.7376, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.2193 => 1.2909, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 5.74% (0.4062 => 0.4295, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3899 => 0.4117, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5577 => 0.5887, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.55% (0.3246 => 0.3426, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9199 => 0.9707, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2761 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0860, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.01% (13.8202 => 14.5127, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.4563 => 1.5266, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.78% (0.4390 => 0.4600, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.77% (1.1364 => 1.1906, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.66% (16.6129 => 17.3867, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/football/football: 4.66% (0.8310 => 0.8697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.61% (7.2180 => 7.5511, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (3.8646 => 4.0419, std. dev.: 0.0094) MultiSource/Applications/treecc/treecc: 4.50% (1.9270 => 2.0137, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists1: 4.50% (0.3534 => 0.3693, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.3868 => 0.4042, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.48% (0.7460 => 0.7794, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.3245 => 1.3828, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.37% (1.1061 => 1.1544, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.23% (1.3813 => 1.4397, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.21% (1.0594 => 1.1040, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.16% (16.2614 => 16.9375, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (13.2842 => 13.8347, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 4.08% (1.2292 => 1.2794, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.08% (1.3819 => 1.4383, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2945 => 0.3060, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.89% (2.1791 => 2.2639, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (3.6692 => 3.8105, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (4.4433 => 4.6136, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (4.3801 => 4.5426, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.49% (4.9865 => 5.1606, std. dev.: 0.0070) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.41% (0.6135 => 0.6344, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1333 => 1.1706, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6283 => 0.6480, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7497, std. dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.98% (0.8698 => 0.8957, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.97% (0.4113 => 0.4235, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 2.96% (3.1889 => 3.2834, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.93% (3.2742 => 3.3701, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.80% (14.8535 => 15.2688, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.74% (6.5754 => 6.7556, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 2.71% (14.5298 => 14.9232, std. dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 2.62% (4.6629 => 4.7852, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (1.5188 => 1.5551, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.68% (0.9108 => 0.9261, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.40% (1.0313 => 1.0457, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.03% (3.7467 => 3.7852, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2608, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel-2: 8.86% (1.2998 => 1.4150, std. dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.20% (1.5824 => 1.6647, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 4.11% (1.1560 => 1.2035, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.92% (3.2729 => 3.4011, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.2619 => 11.6852, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.02% (1.7688 => 1.8223, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 2.91% (2.1753 => 2.2385, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4380, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4271 => 7.6138, std. dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9937, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2107, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5109, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (1.9290 => 1.9564, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (1.5089 => 1.5300, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.88% (0.4657 => 0.3964, std. dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.33% (22.5627 => 21.1340, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.54% (0.6576 => 0.6475, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2308 => 1.1098, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.45% (6.2497 => 5.9714, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.29% (1.3780 => 1.3189, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.29% (20.3410 => 19.6723, std. dev.: 0.0337) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.8259 => 8.5683, std. dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.61% (0.8342 => 0.8124, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.58% (1.9762 => 1.9252, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9630, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2315, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.53% (0.6615 => 0.6514, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8040, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4361, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2322, std. dev.: 0.0223) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 04:05:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 06:05:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808110548.487963524044@llvm.org> http://llvm.org/perf/db_default/v4/nts/2738?compare_to=2736&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2738, Order: 161481, Start Time: 2012-08-08 09:47:39, End Time: 2012-08-08 11:06:26 To: 2736, Order: 161478, Start Time: 2012-08-08 08:00:36, End Time: 2012-08-08 09:19:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (100 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (737 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.22% (0.5325 => 0.5443, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/lowercase: 1.54% (7.9382 => 8.0607, std. dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.64% (10.3673 => 13.9589, std. dev.: 0.0102) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 11.92% (0.3516 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.88% (0.3543 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.85% (1.1194 => 1.2520, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.67% (1.7609 => 1.9136, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.26% (2.2022 => 2.3840, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.69% (0.1584 => 0.1690, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.42% (0.6030 => 0.6417, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.36% (0.5925 => 0.6302, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.4615 => 0.4860, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.27% (10.4361 => 10.9863, std. dev.: 0.0234) SingleSource/UnitTests/ObjC++/property-reference: 5.21% (0.7326 => 0.7708, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.14% (0.4879 => 0.5130, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.09% (0.7433 => 0.7811, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.07% (7.0540 => 7.4114, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.3282 => 0.3447, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 4.54% (9.4845 => 9.9147, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.35% (0.5569 => 0.5811, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.8172 => 0.8527, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.23% (0.5860 => 0.6108, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (4.9449 => 5.1517, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.18% (5.0018 => 5.2109, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.03% (4.2646 => 4.4363, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.85% (17.1811 => 17.8423, std. dev.: 0.0564) MultiSource/Benchmarks/McCat/18-imp/imp: 3.71% (0.3423 => 0.3550, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.70% (0.3109 => 0.3224, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.69% (0.7835 => 0.8124, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.64% (1.3050 => 1.3525, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.63% (1.5603 => 1.6170, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4289, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.37% (0.3387 => 0.3501, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.33% (5.7591 => 5.9509, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (1.1861 => 1.2256, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.5105 => 0.5273, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.28% (1.1642 => 1.2024, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.4103 => 0.4237, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.5415 => 1.5916, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 3.22% (2.0273 => 2.0926, std. dev.: 0.0095) MultiSource/Applications/d/make_dparser: 3.15% (3.3354 => 3.4403, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.4289 => 0.4421, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (14.3668 => 14.8080, std. dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.8067 => 0.8314, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5859 => 1.6331, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.98% (2.0665 => 2.1280, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.9765 => 1.0048, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.89% (3.8723 => 3.9843, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3826 => 0.3936, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.86% (0.6675 => 0.6866, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 2.86% (0.4299 => 0.4422, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.85% (0.4636 => 0.4768, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.77% (0.6456 => 0.6635, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.67% (0.3935 => 0.4040, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (0.4064 => 0.4171, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.56% (0.6450 => 0.6615, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.53% (1.4186 => 1.4545, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.50% (2.2969 => 2.3543, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4620 => 0.4734, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8921 => 0.9138, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.39% (1.2842 => 1.3149, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.38% (0.4203 => 0.4303, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.5020 => 0.5137, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5981 => 0.6110, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.11% (0.7115 => 0.7265, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.91% (1.1840 => 1.2066, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.34% (1.1145 => 1.1963, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.04% (4.2280 => 4.3989, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.60% (3.2827 => 3.4008, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7548, std. dev.: 0.0036) MultiSource/Applications/aha/aha: 2.78% (3.1595 => 3.2474, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 2.59% (2.1825 => 2.2390, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.93% (3.1578 => 3.2189, std. dev.: 0.0049) MultiSource/Applications/lua/lua: 1.80% (26.0924 => 26.5630, std. dev.: 0.0162) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5086 => 1.5275, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2275, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5818, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1396 => 1.1516, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.02% (5.2763 => 3.1649, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7118, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.72% (5.3526 => 3.7083, std. dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0848, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5529, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -11.74% (22.1758 => 19.5720, std. dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2373 => 1.1068, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -7.90% (1.5373 => 1.4158, std. dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5566, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4892, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (1.9577 => 1.8675, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4968, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (8.1563 => 7.9112, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4204, std. dev.: 0.0197) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.89% (0.4808 => 0.4669, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0064, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.72% (19.9488 => 19.6056, std. dev.: 0.0495) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.56% (9.5636 => 9.4147, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3470, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.39% (1.6805 => 1.6572, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 04:59:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 06:59:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120808115959.584412A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2739?compare_to=2734&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2739, Order: 161481, Start Time: 2012-08-08 09:17:15, End Time: 2012-08-08 12:00:37 To: 2734, Order: 161475, Start Time: 2012-08-08 06:03:10, End Time: 2012-08-08 08:48:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (81 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (797 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 1.99% (16.2048 => 16.5279, std. dev.: 0.0271) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.14% (24.3356 => 24.0583, std. dev.: 0.0311) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.35% (0.3465 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.22% (0.3446 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3469 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3496 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.13% (0.3488 => 0.3911, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3442 => 0.3859, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.99% (0.3460 => 0.3875, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.72% (0.3643 => 0.4070, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 11.59% (0.3650 => 0.4073, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3724 => 0.4144, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.07% (0.5826 => 0.6238, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.96% (0.5889 => 0.6299, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.54% (1.5932 => 1.6974, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.58% (1.6211 => 1.7116, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.38% (3.5627 => 3.7544, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.37% (0.4361 => 0.4595, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7171 => 0.7553, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.06% (1.3152 => 1.3818, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (0.4994 => 0.5240, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.91% (0.5026 => 0.5273, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.68% (0.5000 => 0.5234, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.68% (0.5900 => 0.6176, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 4.62% (4.2109 => 4.4056, std. dev.: 0.0109) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (0.3890 => 0.4061, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 4.30% (1.0781 => 1.1245, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.06% (2.7292 => 2.8401, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.2736 => 0.2845, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.79% (2.1013 => 2.1810, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (0.4658 => 0.4831, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.64% (5.5417 => 5.7432, std. dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.46% (1.9694 => 2.0375, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.39% (1.9966 => 2.0642, std. dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 3.33% (0.3004 => 0.3104, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.32% (0.3195 => 0.3301, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.3903 => 0.4031, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.27% (0.9909 => 1.0233, std. dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 3.22% (4.6177 => 4.7666, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (4.4195 => 4.5598, std. dev.: 0.0062) MultiSource/Applications/siod/siod: 3.12% (0.6634 => 0.6841, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 3.11% (0.7875 => 0.8120, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.10% (2.1653 => 2.2325, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0673 => 2.1313, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 3.04% (0.9697 => 0.9992, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.4139 => 0.4264, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (1.8794 => 1.9359, std. dev.: 0.0085) MultiSource/Applications/lua/lua: 2.82% (1.4269 => 1.4671, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 2.76% (0.3726 => 0.3829, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.65% (0.5546 => 0.5693, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4146 => 0.4250, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4251 => 0.4355, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.6435 => 0.6583, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.29% (23.5202 => 24.0583, std. dev.: 0.0311) MultiSource/Applications/sqlite3/sqlite3: 2.03% (2.0346 => 2.0759, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 8.20% (0.2122 => 0.2296, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6639, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8907, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std. dev.: 0.0318) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6364, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6551, std. dev.: 0.0413) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2107, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.80% (41.7953 => 42.5461, std. dev.: 0.0548) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9068, std. dev.: 0.0107) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2210, std. dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3122, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.05% (11.9555 => 11.8299, std. dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5279, std. dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/ary2: -8.41% (0.2402 => 0.2200, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7928, std. dev.: 0.0133) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8013, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0049) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.02% (17.2379 => 16.8891, std. dev.: 0.0424) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9632, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 05:30:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 07:30:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808123056.BFA712A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2740?compare_to=2737&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2740, Order: 161483, Start Time: 2012-08-08 11:17:44, End Time: 2012-08-08 12:31:34 To: 2737, Order: 161481, Start Time: 2012-08-08 09:35:42, End Time: 2012-08-08 10:49:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.06% (55.9049 => 56.4953, std. dev.: 0.1783) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.28% (2.0176 => 2.3057, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5818 => 0.6360, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.20% (0.3663 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3623 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.19% (0.3646 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5748 => 0.6269, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.03% (0.3789 => 0.4131, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 8.67% (0.4003 => 0.4350, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.31% (0.1986 => 0.2151, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7061 => 0.7640, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 7.35% (1.3693 => 1.4700, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.30% (0.7710 => 0.8273, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.18% (0.5265 => 0.5643, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (3.9660 => 4.2451, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.64% (0.7038 => 0.7505, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4328 => 0.4610, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2607 => 0.2765, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.93% (1.2193 => 1.2916, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4062 => 0.4301, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.6959 => 0.7356, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3489 => 0.3688, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.65% (0.9199 => 0.9719, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.5577 => 0.5885, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.48% (1.9828 => 2.0915, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.42% (0.3246 => 0.3422, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.2988 => 0.3149, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.14% (1.4563 => 1.5312, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.14% (13.8202 => 14.5301, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.5637 => 0.5918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.92% (7.2180 => 7.5731, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.84% (1.1364 => 1.1914, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.8310 => 0.8704, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (3.8646 => 4.0449, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.63% (16.6129 => 17.3818, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3856, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (0.7460 => 0.7800, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.40% (1.9270 => 2.0118, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.38% (1.1061 => 1.1546, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2292 => 1.2823, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.30% (1.3813 => 1.4407, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.26% (1.3819 => 1.4407, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 4.22% (16.2614 => 16.9481, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (13.2842 => 13.8427, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.0594 => 1.1036, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 4.16% (0.3220 => 0.3354, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (4.4433 => 4.6266, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (4.3801 => 4.5580, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (3.6692 => 3.8167, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 3.85% (2.1791 => 2.2631, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (0.4791 => 0.4969, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.68% (0.3755 => 0.3893, std. dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 3.61% (0.3131 => 0.3244, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1720, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.37% (0.6135 => 0.6342, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8698 => 0.8974, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.11% (4.9865 => 5.1418, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.09% (3.1889 => 3.2873, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (8.4961 => 8.7569, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.99% (3.2742 => 3.3721, std. dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2732, std. dev.: 0.0151) MultiSource/Applications/ClamAV/clamscan: 2.77% (14.5298 => 14.9321, std. dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7570, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1007 => 2.1557, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.49% (4.6629 => 4.7792, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5188 => 1.5555, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.37% (1.0313 => 1.0454, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.12% (6.2785 => 6.3488, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 1.10% (3.7467 => 3.7880, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5146, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2583, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel-2: 9.92% (1.2998 => 1.4288, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.17% (1.5824 => 1.6642, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 4.13% (1.1560 => 1.2037, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.90% (3.2729 => 3.4004, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6845, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9569, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.92% (2.1753 => 2.2389, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9753, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.87% (1.7688 => 1.8195, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4370, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 2.65% (7.4271 => 7.6240, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.30% (10.7476 => 10.9946, std. dev.: 0.0573) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.02% (3.1476 => 3.2111, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5952, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (1.5089 => 1.5300, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5073, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1939, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.5627 => 21.1147, std. dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.91% (1.0460 => 0.8587, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2308 => 1.1029, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.71% (1.3780 => 1.3131, std. dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.45% (6.2497 => 5.9714, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.32% (20.3410 => 19.6648, std. dev.: 0.0626) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5910, std. dev.: 0.0154) MultiSource/Benchmarks/Olden/bh/bh: -2.58% (1.9762 => 1.9252, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.58% (0.8342 => 0.8127, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9624, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2275, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8587, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8059, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0081, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.36% (9.3358 => 9.2090, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.16% (84.4286 => 83.4461, std. dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 05:52:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 07:52:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808125251.43A2C2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2741?compare_to=2738&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2741, Order: 161483, Start Time: 2012-08-08 11:34:54, End Time: 2012-08-08 12:53:27 To: 2738, Order: 161481, Start Time: 2012-08-08 09:47:39, End Time: 2012-08-08 11:06:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (110 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (729 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.82% (56.6605 => 54.4984, std. dev.: 0.6178) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.80% (10.3673 => 13.9754, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3473 => 0.3949, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.57% (0.3516 => 0.3993, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.47% (0.3497 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.45% (0.3561 => 0.4040, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.38% (0.3543 => 0.4017, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.38% (0.3543 => 0.4017, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 12.97% (0.3694 => 0.4173, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.62% (0.3828 => 0.4311, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.51% (0.3886 => 0.4372, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3927 => 0.4410, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.90% (1.1194 => 1.2526, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.66% (1.7609 => 1.9134, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.46% (2.2022 => 2.3885, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.88% (0.1584 => 0.1693, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 6.83% (0.6030 => 0.6442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.82% (0.5925 => 0.6329, std. dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 6.56% (0.1555 => 0.1657, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.3177 => 0.3382, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (0.4615 => 0.4882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.62% (0.7326 => 0.7738, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.53% (0.7433 => 0.7844, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 5.49% (10.4361 => 11.0095, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.39% (7.0540 => 7.4340, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.4879 => 0.5137, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.02% (0.5860 => 0.6154, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 4.78% (9.4845 => 9.9380, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.64% (4.9449 => 5.1741, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.62% (0.2554 => 0.2672, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.61% (0.8172 => 0.8549, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (5.0018 => 5.2293, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: 4.47% (0.7835 => 0.8185, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.38% (0.5569 => 0.5813, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.26% (0.3121 => 0.3254, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.24% (4.2646 => 4.4453, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 4.08% (1.5603 => 1.6239, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.02% (0.2758 => 0.2869, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.96% (0.2700 => 0.2807, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.96% (8.1363 => 8.4583, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3423 => 0.3558, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.86% (0.3109 => 0.3229, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.85% (0.3092 => 0.3211, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 3.81% (0.3180 => 0.3301, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 3.78% (17.1811 => 17.8304, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.74% (1.3050 => 1.3538, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.68% (0.4103 => 0.4254, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (1.1861 => 1.2277, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (1.5415 => 1.5945, std. dev.: 0.0074) MultiSource/Applications/d/make_dparser: 3.43% (3.3354 => 3.4498, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.42% (0.3387 => 0.3503, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.42% (2.0273 => 2.0967, std. dev.: 0.0141) MultiSource/Applications/oggenc/oggenc: 3.42% (5.7591 => 5.9561, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.40% (0.8067 => 0.8341, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (0.4636 => 0.4793, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.38% (1.1642 => 1.2035, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.35% (0.5105 => 0.5276, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.19% (0.4289 => 0.4426, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (14.3668 => 14.8250, std. dev.: 0.0095) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4299 => 0.4434, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3441 => 0.3549, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.11% (0.9765 => 1.0069, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.10% (0.3422 => 0.3528, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.08% (0.3826 => 0.3944, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.05% (0.3865 => 0.3983, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.04% (0.3650 => 0.3761, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.02% (3.8723 => 3.9894, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.6456 => 0.6650, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.00% (0.3603 => 0.3711, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.96% (1.5859 => 1.6329, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.93% (2.2024 => 2.2670, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.91% (2.0665 => 2.1266, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6675 => 0.6869, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.4064 => 0.4182, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.89% (2.2969 => 2.3633, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.74% (0.6450 => 0.6627, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.68% (1.2842 => 1.3186, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.68% (1.4186 => 1.4566, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 2.64% (0.4620 => 0.4742, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.62% (0.4048 => 0.4154, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (0.8921 => 0.9151, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.44% (0.5981 => 0.6127, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.18% (0.7115 => 0.7270, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.06% (1.1840 => 1.2084, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.98% (1.0722 => 1.0934, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9733, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.1145 => 1.1957, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.79% (4.2280 => 4.3881, std. dev.: 0.0163) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.58% (3.2827 => 3.4002, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std. dev.: 0.0003) MultiSource/Applications/aha/aha: 2.78% (3.1595 => 3.2474, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 2.59% (2.1825 => 2.2390, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1578 => 3.2176, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5753, std. dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.39% (1.3045 => 1.3226, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (1.5086 => 1.5290, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.28% (11.6436 => 11.7926, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2282, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 1.17% (1.1396 => 1.1529, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.12% (1.0313 => 1.0428, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.03% (2.8904 => 2.9201, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1700, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7174, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7144, std. dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0587, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5530, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -11.51% (22.1758 => 19.6244, std. dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2373 => 1.1082, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -7.06% (1.5373 => 1.4288, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.34% (2.7294 => 2.5563, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.05% (1.5835 => 1.5036, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4892, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.60% (1.9577 => 1.8676, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5020, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9031, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4272, std. dev.: 0.0099) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.85% (0.4808 => 0.4671, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.58% (10.2830 => 10.0172, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.03% (19.9488 => 19.5437, std. dev.: 0.0651) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4183, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3522, std. dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.36% (1.6805 => 1.6577, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 07:35:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 09:35:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808143557.A899D2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2742?compare_to=2740&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2742, Order: 161487, Start Time: 2012-08-08 13:22:45, End Time: 2012-08-08 14:36:35 To: 2740, Order: 161483, Start Time: 2012-08-08 11:17:44, End Time: 2012-08-08 12:31:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (149 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.16% (2.0176 => 2.3032, std. dev.: 0.0147) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3578 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.19% (0.3601 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.19% (0.3646 => 0.3981, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.18% (0.3650 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.09% (0.3663 => 0.3996, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.08% (0.3623 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5748 => 0.6264, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.82% (0.4003 => 0.4356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.60% (0.3940 => 0.4279, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.26% (0.1986 => 0.2150, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7061 => 0.7632, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.7710 => 0.8280, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 7.39% (1.3693 => 1.4705, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (3.9660 => 4.2473, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5265 => 0.5637, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.82% (0.7038 => 0.7518, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.44% (0.2655 => 0.2826, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.35% (0.4328 => 0.4603, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.14% (0.2607 => 0.2767, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4379 => 0.4645, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.92% (1.2193 => 1.2915, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.68% (0.6959 => 0.7354, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.65% (0.3489 => 0.3686, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.61% (0.9199 => 0.9715, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3899 => 0.4117, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.58% (0.5577 => 0.5888, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.2140 => 0.2259, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.37% (1.9828 => 2.0892, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.34% (0.3149 => 0.3317, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.30% (0.3246 => 0.3418, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.4563 => 1.5314, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.12% (13.8202 => 14.5276, std. dev.: 0.0099) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.95% (0.3453 => 0.3624, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3293 => 0.3456, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.93% (7.2180 => 7.5737, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.90% (1.1364 => 1.1921, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4390 => 0.4604, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.84% (0.5637 => 0.5910, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.77% (0.7506 => 0.7864, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.67% (16.6129 => 17.3883, std. dev.: 0.0165) MultiSource/Applications/Burg/burg: 4.66% (1.1061 => 1.1576, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.65% (3.8646 => 4.0442, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 4.65% (0.8310 => 0.8696, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.64% (0.7460 => 0.7806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (1.3813 => 1.4445, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.3868 => 0.4040, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (1.3245 => 1.3833, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.44% (1.3819 => 1.4432, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.35% (1.9270 => 2.0109, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (13.2842 => 13.8485, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 4.24% (1.0594 => 1.1043, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 4.20% (16.2614 => 16.9450, std. dev.: 0.0183) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.09% (4.4433 => 4.6252, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (3.6692 => 3.8179, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (4.3801 => 4.5571, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 3.93% (2.1791 => 2.2648, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.68% (0.3755 => 0.3893, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.41% (0.6135 => 0.6344, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4113 => 0.4246, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.23% (3.1889 => 3.2919, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.12% (4.9865 => 5.1419, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7546, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.88% (14.5298 => 14.9485, std. dev.: 0.0170) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7619, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.82% (14.8535 => 15.2730, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (3.2742 => 3.3653, std. dev.: 0.0149) MultiSource/Applications/oggenc/oggenc: 2.64% (4.6629 => 4.7862, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1525, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.5188 => 1.5558, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (0.9108 => 0.9260, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.36% (1.0313 => 1.0453, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.17% (6.2785 => 6.3519, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.12% (3.7467 => 3.7886, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/mandel-2: 10.39% (1.2998 => 1.4349, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.18% (1.0895 => 1.1786, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.18% (1.5824 => 1.6643, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 4.12% (1.1560 => 1.2036, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.93% (3.2729 => 3.4014, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.2619 => 11.6850, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9774, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 2.91% (2.1753 => 2.2387, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.88% (1.7688 => 1.8198, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4372, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.53% (10.7476 => 11.0193, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std. dev.: 0.0206) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2107, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9584, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5068, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bisort/bisort: 1.35% (0.8239 => 0.8350, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.51% (0.4657 => 0.4028, std. dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.48% (22.5627 => 21.1017, std. dev.: 0.0249) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3173, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.06% (20.3410 => 19.7192, std. dev.: 0.0335) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5961, std. dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.60% (0.8342 => 0.8125, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.59% (1.9762 => 1.9250, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9628, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2350, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.50% (9.3358 => 9.1957, std. dev.: 0.0284) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8051, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4358, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 07:41:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 09:41:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808144106.D4AE22A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2743?compare_to=2741&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2743, Order: 161487, Start Time: 2012-08-08 13:23:00, End Time: 2012-08-08 14:41:45 To: 2741, Order: 161483, Start Time: 2012-08-08 11:34:54, End Time: 2012-08-08 12:53:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (112 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (726 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.05% (13.9754 => 14.1225, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.22% (10.3673 => 14.1225, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3497 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.52% (0.3543 => 0.4022, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.45% (0.3516 => 0.3989, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.34% (0.3561 => 0.4036, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.99% (0.3694 => 0.4174, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.64% (0.3828 => 0.4312, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.55% (0.3927 => 0.4420, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.40% (0.3886 => 0.4368, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.95% (1.1194 => 1.2532, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.88% (1.7609 => 1.9173, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (2.2022 => 2.3908, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.07% (0.1584 => 0.1696, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.87% (0.5925 => 0.6332, std. dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference-object: 6.80% (0.6030 => 0.6440, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.61% (0.3177 => 0.3387, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.50% (0.1892 => 0.2015, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4615 => 0.4886, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.69% (0.7326 => 0.7743, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 5.61% (10.4361 => 11.0214, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.51% (0.3282 => 0.3463, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.45% (0.7433 => 0.7838, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.42% (7.0540 => 7.4360, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 4.97% (9.4845 => 9.9563, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2554 => 0.2678, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.82% (4.9449 => 5.1831, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.79% (5.0018 => 5.2413, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.76% (0.8172 => 0.8561, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.69% (0.5569 => 0.5830, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.54% (0.5860 => 0.6126, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.54% (0.2271 => 0.2374, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.52% (4.2646 => 4.4573, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.29% (0.3121 => 0.3255, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.28% (0.2758 => 0.2876, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.24% (0.7835 => 0.8167, std. dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 4.21% (0.3109 => 0.3240, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.14% (8.1363 => 8.4731, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.11% (0.2700 => 0.2811, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.08% (1.5603 => 1.6240, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 4.06% (0.3423 => 0.3562, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 4.06% (0.3180 => 0.3309, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.01% (1.3050 => 1.3573, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.95% (17.1811 => 17.8603, std. dev.: 0.0252) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.77% (0.4636 => 0.4811, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.76% (1.1861 => 1.2307, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.76% (5.7591 => 5.9755, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.75% (1.5415 => 1.5993, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 3.70% (3.3354 => 3.4588, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 3.66% (0.3387 => 0.3511, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.66% (1.1642 => 1.2068, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.65% (2.0273 => 2.1013, std. dev.: 0.0083) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.53% (0.2891 => 0.2993, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (14.3668 => 14.8662, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.47% (0.5105 => 0.5282, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.8067 => 0.8344, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.35% (0.3136 => 0.3241, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (2.2024 => 2.2750, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.28% (1.5859 => 1.6379, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9765 => 1.0084, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.26% (3.8723 => 3.9987, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3826 => 0.3950, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.23% (0.3865 => 0.3990, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3441 => 0.3552, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.21% (0.3650 => 0.3767, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4299 => 0.4436, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.16% (0.3422 => 0.3530, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.6456 => 0.6658, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.05% (0.3307 => 0.3408, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (1.4186 => 1.4616, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.01% (2.0665 => 2.1286, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.6675 => 0.6874, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.4064 => 0.4185, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.95% (0.3935 => 0.4051, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.88% (0.4620 => 0.4753, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3684 => 0.3790, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6450 => 0.6635, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 2.86% (0.3603 => 0.3706, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.85% (2.2969 => 2.3624, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.83% (1.2842 => 1.3206, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.74% (0.5981 => 0.6145, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.74% (0.4203 => 0.4318, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.73% (0.5020 => 0.5157, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8921 => 0.9164, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.4048 => 0.4157, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.32% (0.7115 => 0.7280, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.1840 => 1.2106, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 2.14% (1.0722 => 1.0951, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.1145 => 1.1964, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (4.2280 => 4.3833, std. dev.: 0.0170) MultiSource/Applications/siod/siod: 3.61% (3.2827 => 3.4012, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7455, std. dev.: 0.0094) MultiSource/Applications/aha/aha: 2.77% (3.1595 => 3.2469, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.60% (2.1825 => 2.2392, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1578 => 3.2176, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 1.63% (26.0924 => 26.5177, std. dev.: 0.0325) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.60% (1.3045 => 1.3254, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.28% (11.6436 => 11.7931, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 1.17% (1.1396 => 1.1529, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5788, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.87% (5.2763 => 3.1727, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.91% (5.3855 => 3.7210, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.57% (5.3526 => 3.7161, std. dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0754, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5518, std. dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: -11.50% (22.1758 => 19.6256, std. dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2373 => 1.1059, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: -6.81% (1.5373 => 1.4326, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.89% (1.5660 => 1.4894, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.46% (1.9577 => 1.8703, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4938, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4808 => 0.4660, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9088, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.6802 => 8.4316, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3292, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0124, std. dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.07% (19.9488 => 19.5368, std. dev.: 0.0324) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.62% (12.5348 => 12.3313, std. dev.: 0.0095) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4182, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.36% (1.6805 => 1.6577, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 08:11:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 10:11:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120808151119.9FB192A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2744?compare_to=2739&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2744, Order: 161483, Start Time: 2012-08-08 12:28:37, End Time: 2012-08-08 15:11:57 To: 2739, Order: 161481, Start Time: 2012-08-08 09:17:15, End Time: 2012-08-08 12:00:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (105 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (774 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 5.66% (0.3919 => 0.4141, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (1.3818 => 1.3978, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.82% (0.3465 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.82% (0.3496 => 0.3979, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 13.29% (0.3643 => 0.4127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.12% (0.3650 => 0.4129, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.20% (0.3792 => 0.4141, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5826 => 0.6259, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.27% (0.5889 => 0.6317, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.1619 => 0.1732, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.72% (1.5932 => 1.7002, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (1.6211 => 1.7261, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.28% (3.5627 => 3.7866, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.28% (1.3152 => 1.3978, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (0.5000 => 0.5301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (0.4361 => 0.4622, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.91% (0.4029 => 0.4267, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.72% (0.7171 => 0.7581, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.61% (0.4994 => 0.5274, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (0.3930 => 0.4148, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 5.54% (4.2109 => 4.4440, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (0.5026 => 0.5294, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.29% (0.5900 => 0.6212, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.1968 => 0.2071, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.96% (2.7292 => 2.8645, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 4.83% (1.0781 => 1.1302, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.53% (0.2736 => 0.2860, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.43% (1.9694 => 2.0566, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 4.42% (2.1013 => 2.1942, std. dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 4.36% (0.2566 => 0.2678, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.36% (0.4658 => 0.4861, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (0.3890 => 0.4056, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 4.22% (5.5417 => 5.7755, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.20% (1.9966 => 2.0805, std. dev.: 0.0059) MultiSource/Applications/treecc/treecc: 4.09% (0.7875 => 0.8197, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 4.06% (0.9909 => 1.0311, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.97% (0.2875 => 0.2989, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.3271 => 0.3400, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.92% (4.6177 => 4.7989, std. dev.: 0.0096) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.3004 => 0.3120, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.84% (2.1653 => 2.2484, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.69% (1.8794 => 1.9488, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.3903 => 0.4047, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (4.4195 => 4.5815, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 3.63% (0.6634 => 0.6875, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (2.0673 => 2.1420, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.61% (0.2911 => 0.3016, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (0.3625 => 0.3755, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.58% (0.2792 => 0.2892, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.51% (0.9697 => 1.0037, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3124 => 0.3232, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.43% (0.3267 => 0.3379, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.4139 => 0.4277, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.33% (0.3096 => 0.3199, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3258 => 0.3366, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.31% (1.4269 => 1.4741, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.30% (0.3060 => 0.3161, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3317 => 0.3424, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.20% (0.3348 => 0.3455, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.18% (0.3336 => 0.3442, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.08% (0.3282 => 0.3383, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.03% (0.5546 => 0.5714, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.89% (0.4251 => 0.4374, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.6435 => 0.6603, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.56% (0.3981 => 0.4083, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.53% (23.5202 => 24.1164, std. dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.24% (2.0346 => 2.0801, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.96% (0.2122 => 0.2291, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6737, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8953, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1666, std. dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6373, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6421, std. dev.: 0.0511) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2069, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.85% (41.7953 => 42.5668, std. dev.: 0.0361) MultiSource/Applications/lua/lua: 1.73% (50.0626 => 50.9306, std. dev.: 0.0714) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5901, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2214, std. dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3073, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5659, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7879, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8000, std. dev.: 0.0065) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.81% (17.2379 => 16.7538, std. dev.: 0.0701) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.34% (0.6293 => 0.6146, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5731, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9687, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 09:18:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 11:18:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808161805.267792A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2745?compare_to=2742&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2745, Order: 161489, Start Time: 2012-08-08 15:04:49, End Time: 2012-08-08 16:18:41 To: 2742, Order: 161487, Start Time: 2012-08-08 13:22:45, End Time: 2012-08-08 14:36:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.34% (55.7640 => 56.5122, std. dev.: 0.0826) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.21% (2.0176 => 2.3044, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3578 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.22% (0.3601 => 0.3933, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.16% (0.3646 => 0.3980, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.01% (0.5748 => 0.6266, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.00% (0.3623 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.84% (0.3914 => 0.4260, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.13% (0.7061 => 0.7635, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.35% (1.3693 => 1.4699, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.7710 => 0.8276, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (3.9660 => 4.2453, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.91% (0.5265 => 0.5629, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7038 => 0.7513, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4328 => 0.4606, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.13% (0.2690 => 0.2855, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.4379 => 0.4642, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (1.2193 => 1.2909, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.6959 => 0.7362, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5577 => 0.5893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.54% (0.9199 => 0.9709, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.41% (1.9828 => 2.0901, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.27% (0.3246 => 0.3417, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.14% (13.8202 => 14.5309, std. dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (1.4563 => 1.5295, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.93% (7.2180 => 7.5738, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.92% (1.1364 => 1.1923, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.5637 => 0.5912, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4390 => 0.4604, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.77% (0.7506 => 0.7864, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.71% (0.7460 => 0.7811, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.67% (0.8310 => 0.8698, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.62% (3.8646 => 4.0430, std. dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 4.61% (16.6129 => 17.3785, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.3813 => 1.4444, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.49% (1.3245 => 1.3840, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (1.3819 => 1.4434, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0116, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.35% (1.1061 => 1.1542, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2292 => 1.2824, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (13.2842 => 13.8481, std. dev.: 0.0169) MultiSource/Applications/sqlite3/sqlite3: 4.19% (16.2614 => 16.9424, std. dev.: 0.0140) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (4.4433 => 4.6288, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 4.16% (1.0594 => 1.1035, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5543, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (3.6692 => 3.8141, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.87% (2.1791 => 2.2634, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.61% (0.3131 => 0.3244, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1333 => 1.1713, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.33% (0.6135 => 0.6339, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.15% (0.6283 => 0.6481, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.8698 => 0.8969, std. dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (8.4961 => 8.7603, std. dev.: 0.0091) MultiSource/Applications/d/make_dparser: 3.06% (3.1889 => 3.2866, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.04% (4.9865 => 5.1382, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.90% (3.2742 => 3.3693, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (6.5754 => 6.7630, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2710, std. dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 2.77% (14.5298 => 14.9328, std. dev.: 0.0174) MultiSource/Applications/oggenc/oggenc: 2.66% (4.6629 => 4.7867, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1525, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5188 => 1.5552, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.59% (0.9108 => 0.9253, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.35% (1.0313 => 1.0452, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (6.2785 => 6.3551, std. dev.: 0.0107) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7896, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 23.95% (1.8175 => 2.2528, std. dev.: 0.0551) SingleSource/Benchmarks/Misc/mandel-2: 10.18% (1.2998 => 1.4321, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.13% (1.0895 => 1.1781, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.20% (1.5824 => 1.6647, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 4.13% (1.1560 => 1.2037, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.89% (3.2729 => 3.4002, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6844, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9570, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 2.91% (2.1753 => 2.2385, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.89% (1.7688 => 1.8200, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4383, std. dev.: 0.0407) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4271 => 7.6149, std. dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 2.45% (10.7476 => 11.0112, std. dev.: 0.0492) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 2.02% (3.1476 => 3.2111, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9574, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9702, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1956, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.28% (1.5089 => 1.5282, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.14% (0.4657 => 0.4138, std. dev.: 0.0137) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.41% (22.5627 => 21.1171, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.71% (1.2308 => 1.0990, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9710, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.25% (1.3780 => 1.3194, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.81% (20.3410 => 19.5664, std. dev.: 0.0566) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4867 => 0.4712, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.8259 => 8.5717, std. dev.: 0.0238) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.60% (0.8342 => 0.8125, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.58% (1.9762 => 1.9253, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.31% (0.6589 => 0.6437, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2218, std. dev.: 0.0090) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9625, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0198) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8033, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.38% (9.3358 => 9.2070, std. dev.: 0.0186) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4440, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8718, std. dev.: 0.0157) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.11% (6.6320 => 6.5581, std. dev.: 0.0084) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 09:28:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 11:28:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808162800.D32F62A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2746?compare_to=2743&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2746, Order: 161489, Start Time: 2012-08-08 15:09:55, End Time: 2012-08-08 16:28:38 To: 2743, Order: 161487, Start Time: 2012-08-08 13:23:00, End Time: 2012-08-08 14:41:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.92% (78.2570 => 80.5388, std. dev.: 0.3680) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.23% (10.3673 => 14.1233, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3473 => 0.3948, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3497 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.48% (0.3561 => 0.4041, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-4: 13.46% (0.3543 => 0.4020, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.46% (0.3543 => 0.4020, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.45% (0.3516 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.05% (0.3694 => 0.4176, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.67% (0.3828 => 0.4313, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.43% (0.3886 => 0.4369, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3927 => 0.4415, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.05% (1.1194 => 1.2543, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.86% (1.7609 => 1.9170, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.53% (2.2022 => 2.3900, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.94% (0.1584 => 0.1694, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.87% (0.6030 => 0.6444, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.82% (0.5925 => 0.6329, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.3177 => 0.3388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.27% (0.7326 => 0.7785, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.4615 => 0.4883, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.61% (10.4361 => 11.0218, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.3282 => 0.3465, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.50% (7.0540 => 7.4417, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 5.31% (0.7433 => 0.7828, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.96% (0.5569 => 0.5845, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: 4.93% (0.2554 => 0.2680, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.92% (9.4845 => 9.9509, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.79% (0.2107 => 0.2208, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.74% (0.8172 => 0.8559, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.73% (4.9449 => 5.1787, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.71% (5.0018 => 5.2372, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.54% (0.2271 => 0.2374, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.50% (4.2646 => 4.4564, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.49% (0.3121 => 0.3261, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 4.44% (0.3423 => 0.3575, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.5860 => 0.6115, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 4.12% (1.5603 => 1.6246, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 4.12% (0.3180 => 0.3311, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.11% (0.7835 => 0.8157, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.2758 => 0.2871, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.06% (8.1363 => 8.4668, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.04% (1.3050 => 1.3577, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.96% (0.2700 => 0.2807, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.89% (0.3109 => 0.3230, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 3.86% (17.1811 => 17.8447, std. dev.: 0.0247) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.3092 => 0.3209, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.78% (1.1861 => 1.2309, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4636 => 0.4808, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.67% (5.7591 => 5.9705, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.63% (0.3387 => 0.3510, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.63% (0.4103 => 0.4252, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.56% (1.1642 => 1.2057, std. dev.: 0.0079) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.8067 => 0.8353, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.52% (2.0273 => 2.0986, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.51% (3.3354 => 3.4524, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.5415 => 1.5949, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (14.3668 => 14.8636, std. dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.42% (0.3650 => 0.3775, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.37% (0.5105 => 0.5277, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.35% (0.3136 => 0.3241, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.32% (1.5859 => 1.6386, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4299 => 0.4439, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3826 => 0.3950, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.21% (0.9765 => 1.0078, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.18% (0.6456 => 0.6661, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3441 => 0.3550, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.17% (3.8723 => 3.9949, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/lists: 3.16% (0.3422 => 0.3530, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.16% (2.2024 => 2.2719, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.4289 => 0.4422, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 3.09% (0.3232 => 0.3332, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.08% (0.3307 => 0.3409, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.07% (2.0665 => 2.1300, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6675 => 0.6880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.02% (0.3935 => 0.4054, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.99% (0.6450 => 0.6643, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.4064 => 0.4182, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 2.86% (0.3603 => 0.3706, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4620 => 0.4751, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.83% (2.2969 => 2.3620, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.4186 => 1.4586, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2842 => 1.3193, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.73% (0.5020 => 0.5157, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.71% (0.8921 => 0.9163, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4203 => 0.4317, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.4048 => 0.4157, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5981 => 0.6139, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.29% (0.7115 => 0.7278, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.19% (1.1840 => 1.2099, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.08% (1.0722 => 1.0945, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (7.9617 => 8.0469, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.38% (1.1145 => 1.1967, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (4.2280 => 4.4014, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.65% (3.2827 => 3.4024, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7529, std. dev.: 0.0030) MultiSource/Applications/aha/aha: 2.76% (3.1595 => 3.2468, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 2.59% (2.1825 => 2.2391, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.96% (3.1578 => 3.2196, std. dev.: 0.0081) MultiSource/Applications/lua/lua: 1.87% (26.0924 => 26.5797, std. dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7957, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.5086 => 1.5270, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 1.14% (1.1396 => 1.1526, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.00% (9.1159 => 9.2074, std. dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.79% (5.2763 => 3.1770, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.90% (5.3855 => 3.7213, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7179, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0429, std. dev.: 0.0373) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5528, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -11.50% (22.1758 => 19.6260, std. dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2373 => 1.1113, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -7.23% (1.5373 => 1.4262, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5565, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.89% (1.5660 => 1.4894, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -4.35% (1.9577 => 1.8726, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (8.1563 => 7.9007, std. dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4956, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4237, std. dev.: 0.0073) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.95% (0.4808 => 0.4666, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.94% (10.2830 => 9.9811, std. dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.06% (19.9488 => 19.5377, std. dev.: 0.0675) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3404, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.55% (9.5636 => 9.4153, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.36% (1.6805 => 1.6577, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 11:00:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 13:00:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808180003.5A27C2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2747?compare_to=2745&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2747, Order: 161495, Start Time: 2012-08-08 16:46:53, End Time: 2012-08-08 18:00:40 To: 2745, Order: 161489, Start Time: 2012-08-08 15:04:49, End Time: 2012-08-08 16:18:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.17% (2.0176 => 2.3035, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3578 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.25% (0.3601 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.22% (0.3646 => 0.3982, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.07% (0.3650 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3914 => 0.4261, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 8.60% (0.3940 => 0.4279, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.02% (0.7061 => 0.7627, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.44% (0.7710 => 0.8284, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 7.31% (1.3693 => 1.4694, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (3.9660 => 4.2476, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.91% (0.5265 => 0.5629, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7038 => 0.7502, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.51% (0.2782 => 0.2963, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.10% (0.2607 => 0.2766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2690 => 0.2853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2655 => 0.2815, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.4379 => 0.4642, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.89% (0.2937 => 0.3110, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.2193 => 1.2911, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.6959 => 0.7362, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5577 => 0.5893, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.62% (0.3899 => 0.4118, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.60% (0.9199 => 0.9714, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.40% (1.9828 => 2.0898, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.30% (0.3246 => 0.3418, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3192 => 0.3360, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.09% (13.8202 => 14.5230, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2127 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.94% (1.4563 => 1.5282, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5712, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (1.1364 => 1.1918, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.82% (0.7506 => 0.7868, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.64% (16.6129 => 17.3832, std. dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/football/football: 4.63% (0.8310 => 0.8695, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.62% (0.7460 => 0.7805, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (3.8646 => 4.0421, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.55% (1.3813 => 1.4442, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.3819 => 1.4447, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3835, std. dev.: 0.0061) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.36% (1.9270 => 2.0111, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.29% (13.2842 => 13.8547, std. dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2815, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.22% (16.2614 => 16.9469, std. dev.: 0.0148) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.0594 => 1.1037, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (4.4433 => 4.6263, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.3801 => 4.5566, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.02% (3.6692 => 3.8166, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 3.93% (2.1791 => 2.2647, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.68% (0.3755 => 0.3893, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.44% (0.6135 => 0.6346, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 3.31% (0.4113 => 0.4249, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.6283 => 0.6484, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.14% (4.9865 => 5.1430, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.08% (0.8698 => 0.8966, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.05% (3.1889 => 3.2861, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7545, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.88% (3.2742 => 3.3686, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.82% (14.5298 => 14.9397, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 2.80% (14.8535 => 15.2699, std. dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7594, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.66% (4.6629 => 4.7867, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1525, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.32% (1.5188 => 1.5541, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.38% (1.0313 => 1.0455, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.16% (3.7467 => 3.7901, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (6.2785 => 6.3502, std. dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std. dev.: 0.0485) SingleSource/Benchmarks/Misc/mandel-2: 9.39% (1.2998 => 1.4218, std. dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.19% (1.5824 => 1.6646, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 4.16% (1.1560 => 1.2041, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.87% (3.2729 => 3.3994, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6840, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 2.91% (2.1753 => 2.2387, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.87% (1.7688 => 1.8196, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4377, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 2.79% (10.7476 => 11.0477, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4271 => 7.6175, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.02% (3.1476 => 3.2112, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.32% (1.5089 => 1.5288, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.17% (1.0310 => 1.0431, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.97% (0.4657 => 0.4146, std. dev.: 0.0094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.5627 => 21.1054, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0983, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std. dev.: 0.0119) SingleSource/UnitTests/Vector/multiplies: -4.94% (2.6470 => 2.5163, std. dev.: 0.0125) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.91% (20.3410 => 19.5454, std. dev.: 0.0975) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5908, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.60% (0.8342 => 0.8125, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.57% (1.9762 => 1.9254, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.14% (3.0263 => 2.9615, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2294, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8039, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0083, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2170, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4332, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8712, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 11:14:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 13:14:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808181450.DE2572A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2748?compare_to=2746&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2748, Order: 161495, Start Time: 2012-08-08 16:56:48, End Time: 2012-08-08 18:15:27 To: 2746, Order: 161489, Start Time: 2012-08-08 15:09:55, End Time: 2012-08-08 16:28:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (111 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (727 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.31% (80.5388 => 78.6764, std. dev.: 0.3315) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.02% (1.3280 => 1.3144, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.20% (10.3673 => 14.1201, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 13.76% (0.3473 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3497 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.58% (0.3543 => 0.4024, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.45% (0.3516 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.43% (0.3543 => 0.4019, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3561 => 0.4038, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 13.02% (0.3694 => 0.4175, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.80% (0.3828 => 0.4318, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.58% (0.3886 => 0.4375, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2540, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.85% (1.7609 => 1.9168, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.57% (2.2022 => 2.3910, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2065 => 0.2219, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.07% (0.1584 => 0.1696, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.90% (0.5925 => 0.6334, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.85% (0.6030 => 0.6443, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.70% (0.3177 => 0.3390, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.50% (0.1892 => 0.2015, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.4615 => 0.4883, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7326 => 0.7742, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (10.4361 => 11.0236, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.51% (0.3282 => 0.3463, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 5.48% (0.7433 => 0.7840, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.41% (7.0540 => 7.4355, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 4.99% (9.4845 => 9.9578, std. dev.: 0.0135) MultiSource/Benchmarks/McCat/08-main/main: 4.82% (0.2554 => 0.2677, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.74% (0.5569 => 0.5833, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.73% (5.0018 => 5.2382, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.72% (4.9449 => 5.1782, std. dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.8172 => 0.8557, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.51% (4.2646 => 4.4569, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.45% (0.5860 => 0.6121, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.38% (0.7835 => 0.8178, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 4.29% (0.3423 => 0.3570, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.23% (0.3121 => 0.3253, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.19% (0.2700 => 0.2813, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.17% (8.1363 => 8.4752, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 4.15% (1.5603 => 1.6251, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.2758 => 0.2871, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.09% (0.3180 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.01% (1.3050 => 1.3573, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.91% (17.1811 => 17.8530, std. dev.: 0.0265) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.84% (0.4636 => 0.4814, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.83% (0.3109 => 0.3228, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.80% (0.2891 => 0.3001, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.3092 => 0.3209, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.76% (1.1861 => 1.2307, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.73% (0.4103 => 0.4256, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.71% (5.7591 => 5.9725, std. dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 3.63% (0.3387 => 0.3510, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (0.5105 => 0.5290, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 3.62% (3.3354 => 3.4560, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.59% (1.1642 => 1.2060, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.58% (1.5415 => 1.5967, std. dev.: 0.0097) MultiSource/Applications/treecc/treecc: 3.49% (2.0273 => 2.0981, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (14.3668 => 14.8645, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.8067 => 0.8344, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.35% (0.3826 => 0.3954, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.28% (0.3441 => 0.3554, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (1.5859 => 1.6377, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.4289 => 0.4427, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 3.19% (0.3422 => 0.3531, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.18% (0.9765 => 1.0076, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4299 => 0.4435, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.6456 => 0.6660, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (2.2024 => 2.2715, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 3.10% (2.2969 => 2.3681, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (2.0665 => 2.1298, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.00% (0.4064 => 0.4186, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.97% (0.4203 => 0.4328, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.97% (0.6675 => 0.6873, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 2.91% (0.3603 => 0.3708, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.90% (0.6450 => 0.6637, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 2.87% (0.4048 => 0.4164, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.81% (0.4620 => 0.4750, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8921 => 0.9169, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.78% (1.4186 => 1.4580, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.72% (1.2842 => 1.3191, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5981 => 0.6143, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.19% (1.1840 => 1.2099, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 2.15% (1.0722 => 1.0953, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (7.9617 => 8.0425, std. dev.: 0.0228) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.1145 => 1.1964, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (4.2280 => 4.4162, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.58% (3.2827 => 3.4002, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std. dev.: 0.0019) MultiSource/Applications/aha/aha: 2.79% (3.1595 => 3.2476, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.59% (2.1825 => 2.2391, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.63% (26.0924 => 26.5168, std. dev.: 0.0607) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7958, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0313 => 1.0439, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.5086 => 1.5270, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 1.16% (1.1396 => 1.1528, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1280, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.89% (5.2763 => 3.1717, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.86% (5.3855 => 3.7235, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.44% (5.3526 => 3.7232, std. dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0745, std. dev.: 0.0387) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5509, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -11.53% (22.1758 => 19.6200, std. dev.: 0.0296) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2373 => 1.1024, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -7.40% (1.5373 => 1.4236, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.34% (2.7294 => 2.5564, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.91% (1.9577 => 1.8615, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.89% (1.5660 => 1.4895, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4977, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (8.1563 => 7.9055, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4231, std. dev.: 0.0184) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.93% (0.4808 => 0.4667, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9919, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (19.9488 => 19.5961, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3400, std. dev.: 0.0087) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4170, std. dev.: 0.0063) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.35% (1.6805 => 1.6578, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 11:22:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 13:22:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120808182253.DC5DC2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2749?compare_to=2744&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2749, Order: 161491, Start Time: 2012-08-08 15:40:03, End Time: 2012-08-08 18:23:31 To: 2744, Order: 161483, Start Time: 2012-08-08 12:28:37, End Time: 2012-08-08 15:11:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (111 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 11.79% (117.1643 => 130.9731, std. dev.: 0.3616) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.50% (2.1228 => 2.0486, std. dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.99% (0.3460 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.89% (0.3442 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.82% (0.3488 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.76% (0.3496 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.56% (0.3643 => 0.4137, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.32% (0.3650 => 0.4136, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.18% (0.3724 => 0.4215, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.67% (0.5826 => 0.6273, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.37% (0.5889 => 0.6323, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.83% (1.5932 => 1.7020, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.53% (1.6211 => 1.7270, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.38% (3.5627 => 3.7901, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.18% (1.3152 => 1.3965, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.16% (0.5000 => 0.5308, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.13% (0.4994 => 0.5300, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.03% (0.4361 => 0.4624, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (0.5026 => 0.5327, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.5900 => 0.6245, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.76% (0.7171 => 0.7584, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (0.3930 => 0.4152, std. dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 5.63% (4.2109 => 4.4480, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: 5.51% (0.4029 => 0.4251, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.1968 => 0.2072, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.28% (2.7292 => 2.8733, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.23% (0.2866 => 0.3016, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01% (0.2736 => 0.2873, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.89% (0.4658 => 0.4886, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 4.87% (1.0781 => 1.1306, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.77% (2.1013 => 2.2016, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.77% (1.9694 => 2.0634, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.53% (1.9966 => 2.0871, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.48% (0.2566 => 0.2681, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (0.3890 => 0.4064, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.42% (5.5417 => 5.7867, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.23% (0.3195 => 0.3330, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (2.1653 => 2.2542, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2875 => 0.2991, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.02% (4.6177 => 4.8034, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 3.95% (0.9909 => 1.0300, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.93% (1.4269 => 1.4830, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.3004 => 0.3121, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.89% (0.7875 => 0.8181, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.87% (0.6634 => 0.6891, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.87% (0.3903 => 0.4054, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.83% (0.2738 => 0.2843, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3267 => 0.3391, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (4.4195 => 4.5869, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (1.8794 => 1.9505, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.77% (2.0673 => 2.1452, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.74% (0.2911 => 0.3020, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.72% (0.2792 => 0.2896, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2803 => 0.2905, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.2823 => 0.2925, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.61% (0.9697 => 1.0047, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.52% (0.3096 => 0.3205, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3258 => 0.3372, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.41% (0.4139 => 0.4280, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.40% (0.3060 => 0.3164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.32% (0.3317 => 0.3427, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.30% (0.3362 => 0.3473, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.29% (0.3348 => 0.3458, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.28% (0.5546 => 0.5728, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (0.3625 => 0.3743, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3477 => 0.3590, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3726 => 0.3845, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.18% (0.3336 => 0.3442, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.15% (0.4251 => 0.4385, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4146 => 0.4268, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3690 => 0.3797, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.6435 => 0.6617, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.3981 => 0.4093, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.5012 => 0.5146, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 2.62% (23.5202 => 24.1362, std. dev.: 0.0512) MultiSource/Applications/sqlite3/sqlite3: 2.45% (2.0346 => 2.0845, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.68% (0.7426 => 0.7551, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8950, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1709, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6302, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6884, std. dev.: 0.0273) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2016, std. dev.: 0.0359) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.82% (3.1722 => 3.2298, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9071, std. dev.: 0.0115) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3149, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2851, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.27% (41.7953 => 42.3263, std. dev.: 0.1607) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5815, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7981, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7945, std. dev.: 0.0040) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.91% (17.2379 => 16.7355, std. dev.: 0.0611) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.88% (0.6293 => 0.6112, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.60% (2.0820 => 2.0486, std. dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9594, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 12:42:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 14:42:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808194205.E6B3B2A6C073@llvm.org> http://llvm.org/perf/db_default/v4/nts/2750?compare_to=2747&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2750, Order: 161504, Start Time: 2012-08-08 18:28:51, End Time: 2012-08-08 19:42:43 To: 2747, Order: 161495, Start Time: 2012-08-08 16:46:53, End Time: 2012-08-08 18:00:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (153 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.53% (2.0176 => 2.3108, std. dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.17% (0.1072 => 0.1181, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.5818 => 0.6334, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5748 => 0.6236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.40% (0.7061 => 0.7654, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3646 => 0.3935, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.91% (0.3601 => 0.3886, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3663 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.84% (0.3650 => 0.3936, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3914 => 0.4217, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.59% (0.3940 => 0.4239, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.35% (3.9660 => 4.2574, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 7.34% (1.3693 => 1.4698, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.33% (0.7710 => 0.8275, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.32% (0.2596 => 0.2786, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.25% (0.7038 => 0.7548, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5265 => 0.5645, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4328 => 0.4606, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.31% (0.6959 => 0.7398, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4379 => 0.4653, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.16% (1.2193 => 1.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4062 => 0.4309, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.91% (0.9199 => 0.9743, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.79% (0.5577 => 0.5900, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.77% (0.3899 => 0.4124, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3246 => 0.3431, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.59% (13.8202 => 14.5928, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.53% (0.2914 => 0.3075, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.49% (0.4390 => 0.4631, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.39% (0.3489 => 0.3677, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.31% (1.4563 => 1.5337, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.29% (0.2023 => 0.2130, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.26% (0.2925 => 0.3079, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 5.26% (3.8646 => 4.0678, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.21% (1.1364 => 1.1956, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.16% (16.6129 => 17.4701, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/methcall: 5.14% (0.2761 => 0.2903, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.13% (1.9828 => 2.0845, std. dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.09% (0.8310 => 0.8733, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.07% (0.5637 => 0.5923, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.05% (0.7506 => 0.7885, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.02% (0.2988 => 0.3138, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.99% (7.2180 => 7.5780, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.91% (1.1061 => 1.1604, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (1.3813 => 1.4490, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 4.89% (0.3453 => 0.3622, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.87% (1.3245 => 1.3890, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.87% (1.9270 => 2.0208, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.80% (0.7460 => 0.7818, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (1.3819 => 1.4475, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 4.73% (2.1791 => 2.2821, std. dev.: 0.0110) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.61% (13.2842 => 13.8967, std. dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 4.60% (16.2614 => 17.0099, std. dev.: 0.0190) MultiSource/Benchmarks/nbench/nbench: 4.59% (1.0594 => 1.1080, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 4.57% (0.2995 => 0.3132, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.43% (3.6692 => 3.8317, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.36% (4.4433 => 4.6370, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 4.35% (0.3220 => 0.3360, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.26% (4.3801 => 4.5667, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.22% (0.4791 => 0.4993, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.19% (1.2292 => 1.2807, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.90% (0.3131 => 0.3253, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.87% (0.2945 => 0.3059, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.76% (4.9865 => 5.1742, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.73% (0.6135 => 0.6364, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1333 => 1.1752, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.55% (0.6283 => 0.6506, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.54% (3.1889 => 3.3017, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (8.4961 => 8.7876, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.37% (0.8698 => 0.8991, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 3.33% (0.4113 => 0.4250, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.30% (3.2742 => 3.3823, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.30% (6.5754 => 6.7923, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 3.23% (14.8535 => 15.3334, std. dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 3.09% (14.5298 => 14.9792, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.01% (2.1007 => 2.1640, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.92% (1.5188 => 1.5631, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.80% (4.6629 => 4.7936, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.15% (0.9108 => 0.9304, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.95% (1.0313 => 1.0514, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.76% (0.6744 => 0.6863, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6250 => 0.6356, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.68% (3.7467 => 3.8095, std. dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (6.2785 => 6.3736, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0415) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.18% (1.0895 => 1.1786, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.92% (1.2998 => 1.4027, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.19% (1.5824 => 1.6646, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 4.12% (1.1560 => 1.2036, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.90% (3.2729 => 3.4007, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6840, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 2.94% (2.1753 => 2.2392, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.92% (1.7688 => 1.8204, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.87% (12.0921 => 12.4387, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4271 => 7.6138, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 2.27% (10.7476 => 10.9914, std. dev.: 0.0599) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.01% (3.1476 => 3.2108, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5089 => 1.5319, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.40% (0.4657 => 0.4126, std. dev.: 0.0096) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.86% (22.5627 => 21.2411, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.99% (1.2308 => 1.1079, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9710, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4867 => 0.4712, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.08% (20.3410 => 19.7142, std. dev.: 0.0265) MultiSource/Benchmarks/Olden/bh/bh: -2.63% (1.9762 => 1.9242, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.59% (0.8342 => 0.8126, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6038, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9588, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2255, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.53% (0.6615 => 0.6514, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8036, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0081, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2149, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4376, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 13:02:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 15:02:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808200206.EF40D2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2751?compare_to=2748&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2751, Order: 161505, Start Time: 2012-08-08 18:43:49, End Time: 2012-08-08 20:02:32 To: 2748, Order: 161495, Start Time: 2012-08-08 16:56:48, End Time: 2012-08-08 18:15:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (100 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.04% (54.7693 => 56.4334, std. dev.: 0.1277) SingleSource/Regression/C/uint64_to_float: 2.10% (0.5373 => 0.5486, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: 2.04% (1.4236 => 1.4526, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 1.04% (1.1024 => 1.1139, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.98% (14.1201 => 13.8407, std. dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.50% (10.3673 => 13.8407, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.94% (0.3543 => 0.3966, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3561 => 0.3982, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.51% (1.7609 => 1.9108, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (2.2022 => 2.3754, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.97% (0.2065 => 0.2209, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.61% (0.6030 => 0.6368, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.55% (0.5925 => 0.6254, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.35% (0.4615 => 0.4862, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.18% (10.4361 => 10.9766, std. dev.: 0.0122) MultiSource/Applications/lambda-0_1_3/lambda: 5.09% (0.7433 => 0.7811, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.90% (7.0540 => 7.3993, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.81% (0.3282 => 0.3440, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.50% (0.7326 => 0.7656, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2554 => 0.2668, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.43% (9.4845 => 9.9048, std. dev.: 0.0143) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.30% (0.8172 => 0.8523, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.27% (4.9449 => 5.1559, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.5569 => 0.5806, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2081, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3121 => 0.3247, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.03% (0.5860 => 0.6096, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.01% (4.2646 => 4.4354, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.93% (0.2700 => 0.2806, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.77% (0.7835 => 0.8130, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 3.76% (17.1811 => 17.8263, std. dev.: 0.0122) MultiSource/Benchmarks/Olden/bh/bh: 3.75% (0.3092 => 0.3208, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 3.71% (0.3180 => 0.3298, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.65% (0.3423 => 0.3548, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4295, std. dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.45% (1.3050 => 1.3500, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.36% (2.0273 => 2.0955, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1861 => 1.2251, std. dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (14.3668 => 14.8272, std. dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 3.19% (5.7591 => 5.9428, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.15% (0.4636 => 0.4782, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.14% (1.1642 => 1.2008, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 3.12% (3.3354 => 3.4393, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.5415 => 1.5891, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.02% (0.5105 => 0.5259, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.8067 => 0.8306, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 2.96% (1.5603 => 1.6065, std. dev.: 0.0127) MultiSource/Applications/lua/lua: 2.94% (3.8723 => 3.9861, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (1.5859 => 1.6317, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.81% (0.9765 => 1.0039, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.78% (2.2024 => 2.2637, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 2.71% (0.6456 => 0.6631, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.71% (2.2969 => 2.3591, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.4289 => 0.4403, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.61% (0.4299 => 0.4411, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6450 => 0.6617, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (0.4064 => 0.4164, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (1.4186 => 1.4534, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.38% (0.6675 => 0.6834, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8921 => 0.9129, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.26% (2.0665 => 2.1132, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.5020 => 0.5132, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2842 => 1.3106, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.80% (0.7115 => 0.7243, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2049, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.75% (1.0722 => 1.0910, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.18% (1.1145 => 1.1945, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (4.2280 => 4.4102, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.59% (3.2827 => 3.4007, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std. dev.: 0.0060) MultiSource/Applications/aha/aha: 2.78% (3.1595 => 3.2474, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 2.56% (2.1825 => 2.2383, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.90% (3.1578 => 3.2177, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.59% (26.0924 => 26.5069, std. dev.: 0.0553) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.42% (1.5086 => 1.5300, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7967, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 1.11% (1.1396 => 1.1522, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5777, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2080, std. dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1616, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.09% (5.3855 => 3.7114, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7058, std. dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0601, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5464, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -11.74% (22.1758 => 19.5725, std. dev.: 0.0249) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.97% (1.2373 => 1.1139, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -5.51% (1.5373 => 1.4526, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.89% (1.5660 => 1.4894, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.75% (1.9577 => 1.8648, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4808 => 0.4655, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4072, std. dev.: 0.0171) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4993, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (8.1563 => 7.9062, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0040, std. dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.01% (19.9488 => 19.5481, std. dev.: 0.0425) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4195, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3483, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.36% (1.6805 => 1.6576, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 14:24:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 16:24:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808212400.9FAA62A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2752?compare_to=2750&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2752, Order: 161517, Start Time: 2012-08-08 20:10:53, End Time: 2012-08-08 21:24:38 To: 2750, Order: 161504, Start Time: 2012-08-08 18:28:51, End Time: 2012-08-08 19:42:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.62% (78.9925 => 80.2695, std. dev.: 0.4657) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.69% (2.0176 => 2.3140, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.88% (0.5818 => 0.6393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5748 => 0.6297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3578 => 0.3919, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.50% (0.3601 => 0.3943, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3646 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.36% (0.7061 => 0.7722, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3650 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.23% (0.3663 => 0.4001, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3789 => 0.4137, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.15% (0.3914 => 0.4272, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.97% (0.4003 => 0.4362, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.88% (0.3940 => 0.4290, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.40% (0.3130 => 0.3393, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4704, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.22% (0.7710 => 0.8267, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (3.9660 => 4.2420, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4328 => 0.4629, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7038 => 0.7520, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4062 => 0.4334, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2607 => 0.2778, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2760 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.40% (0.2937 => 0.3125, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.28% (0.3489 => 0.3708, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.26% (0.2765 => 0.2938, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.12% (0.3022 => 0.3207, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.07% (0.2966 => 0.3146, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.01% (0.2696 => 0.2858, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.00% (1.9828 => 2.1017, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.2988 => 0.3166, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3107 => 0.3291, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3149 => 0.3335, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.77% (1.2193 => 1.2896, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.66% (0.9199 => 0.9720, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 5.64% (0.3192 => 0.3372, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.59% (0.3453 => 0.3646, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.50% (0.5577 => 0.5884, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.41% (13.8202 => 14.5683, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.39% (0.3246 => 0.3421, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.25% (0.4016 => 0.4227, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.22% (0.3293 => 0.3465, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.91% (0.3868 => 0.4058, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4236, std. dev.: 0.0147) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.4563 => 1.5266, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.81% (1.1364 => 1.1911, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.75% (0.5637 => 0.5905, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.70% (7.2180 => 7.5570, std. dev.: 0.0192) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.64% (3.8646 => 4.0440, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 4.61% (0.8310 => 0.8693, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.56% (1.2292 => 1.2852, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7460 => 0.7793, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (13.2842 => 13.8717, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (1.3819 => 1.4428, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0116, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4416, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.36% (1.3245 => 1.3822, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1048, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 4.27% (16.2614 => 16.9558, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3755 => 0.3911, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.96% (2.1791 => 2.2653, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (4.4433 => 4.6170, std. dev.: 0.0087) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8124, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.3801 => 4.5485, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.56% (4.9865 => 5.1640, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.47% (0.6283 => 0.6501, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1719, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.32% (0.8698 => 0.8987, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.16% (0.6135 => 0.6329, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 3.02% (3.1889 => 3.2851, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7496, std. dev.: 0.0147) MultiSource/Benchmarks/McCat/05-eks/eks: 2.92% (0.4113 => 0.4233, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.81% (3.2742 => 3.3661, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 2.77% (14.5298 => 14.9326, std. dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (6.5754 => 6.7543, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 2.66% (14.8535 => 15.2490, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.64% (2.1007 => 2.1561, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.5188 => 1.5574, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.28% (4.6629 => 4.7690, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 1.92% (0.6250 => 0.6370, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.54% (0.9108 => 0.9248, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.16% (3.7467 => 3.7901, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2652, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/mandel-2: 9.27% (1.2998 => 1.4203, std. dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.16% (1.5824 => 1.6640, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 4.13% (1.1560 => 1.2038, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.90% (3.2729 => 3.4005, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6844, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 2.90% (2.1753 => 2.2384, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4376, std. dev.: 0.0225) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.85% (1.7688 => 1.8192, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4271 => 7.6138, std. dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 2.36% (10.7476 => 11.0008, std. dev.: 0.0580) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2107, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0014) MultiSource/Benchmarks/llubenchmark/llu: 1.65% (3.7731 => 3.8352, std. dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5283, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 1.26% (0.8239 => 0.8343, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.22% (1.9290 => 1.9525, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.15% (0.4657 => 0.4091, std. dev.: 0.0159) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1645, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.6576 => 0.6469, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2308 => 1.0969, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.53% (1.3780 => 1.3156, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/perlin: -4.45% (6.2497 => 5.9713, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.53% (20.3410 => 19.6226, std. dev.: 0.0445) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5918, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.60% (0.8342 => 0.8125, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.57% (1.9762 => 1.9254, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9634, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2264, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8049, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.40% (9.3358 => 9.2052, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4405, std. dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 14:34:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 16:34:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120808213420.870352A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2753?compare_to=2749&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2753, Order: 161505, Start Time: 2012-08-08 18:51:40, End Time: 2012-08-08 21:34:58 To: 2749, Order: 161491, Start Time: 2012-08-08 15:40:03, End Time: 2012-08-08 18:23:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (93 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (786 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.13% (2.0486 => 2.0923, std. dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.06% (0.3446 => 0.3896, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3442 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3465 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.84% (0.3496 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.82% (0.3488 => 0.3935, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3460 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3643 => 0.4100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.30% (0.3650 => 0.4099, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.04% (0.1619 => 0.1733, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5826 => 0.6218, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.47% (0.5889 => 0.6270, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.40% (1.5932 => 1.6952, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.09% (1.6211 => 1.7199, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.05% (3.5627 => 3.7783, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (0.4361 => 0.4618, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.88% (0.4029 => 0.4266, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.82% (1.3152 => 1.3917, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (0.5026 => 0.5317, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.2014 => 0.2128, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (0.4994 => 0.5269, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.43% (4.2109 => 4.4394, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.36% (0.5900 => 0.6216, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (0.5000 => 0.5267, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.32% (0.3930 => 0.4139, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7171 => 0.7533, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.05% (2.7292 => 2.8669, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 4.93% (1.0781 => 1.1312, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.2866 => 0.3007, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.62% (0.4658 => 0.4873, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.2736 => 0.2862, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.45% (2.1013 => 2.1948, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 4.29% (5.5417 => 5.7793, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.24% (0.6634 => 0.6915, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (0.3890 => 0.4051, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.11% (1.9694 => 2.0504, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.09% (0.2566 => 0.2671, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.08% (1.9966 => 2.0780, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 3.97% (0.7875 => 0.8188, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.89% (1.8794 => 1.9525, std. dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 3.80% (4.6177 => 4.7933, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (4.4195 => 4.5848, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.3903 => 0.4048, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (2.1653 => 2.2455, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (0.3195 => 0.3310, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.58% (0.2875 => 0.2978, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.55% (0.9909 => 1.0261, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.44% (2.0673 => 2.1385, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.38% (0.4139 => 0.4279, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 3.36% (1.4269 => 1.4749, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.27% (0.9697 => 1.0014, std. dev.: 0.0053) MultiSource/Applications/Burg/burg: 3.12% (0.5546 => 0.5719, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.10% (0.3258 => 0.3359, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.09% (0.3267 => 0.3368, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3726 => 0.3839, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.3362 => 0.3462, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.3678 => 0.3786, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (0.3625 => 0.3731, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.86% (0.3845 => 0.3955, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4146 => 0.4262, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.62% (23.5202 => 24.1363, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.6435 => 0.6603, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.39% (2.0346 => 2.0833, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.19% (0.5012 => 0.5122, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (0.7426 => 0.7546, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6633, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8969, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1714, std. dev.: 0.1472) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6433, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (105.3826 => 107.6087, std. dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2007, std. dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.93% (41.7953 => 42.6024, std. dev.: 0.0247) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5902, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9230, std. dev.: 0.0187) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2203, std. dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3072, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5452, std. dev.: 0.0217) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8032, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std. dev.: 0.0061) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -2.15% (17.2379 => 16.8665, std. dev.: 0.0692) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9697, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 14:49:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 16:49:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808214914.4EDE62A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2754?compare_to=2751&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2754, Order: 161518, Start Time: 2012-08-08 20:31:11, End Time: 2012-08-08 21:49:48 To: 2751, Order: 161505, Start Time: 2012-08-08 18:43:49, End Time: 2012-08-08 20:02:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (97 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.71% (10.3673 => 13.8625, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.87% (0.0834 => 0.0958, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3473 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.35% (0.3497 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.12% (0.3516 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.05% (0.3543 => 0.3970, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.75% (0.3694 => 0.4128, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.85% (2.2022 => 2.3971, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.06% (1.7609 => 1.9028, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 7.95% (0.1622 => 0.1751, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1892 => 0.2021, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5925 => 0.6293, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.6030 => 0.6400, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.80% (10.4361 => 11.0413, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/oourafft: 5.61% (0.3282 => 0.3466, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.54% (7.0540 => 7.4448, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.29% (0.4615 => 0.4859, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.16% (0.7326 => 0.7704, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.06% (0.4879 => 0.5126, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7433 => 0.7772, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.53% (9.4845 => 9.9146, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.39% (4.9449 => 5.1619, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 4.27% (0.2554 => 0.2663, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.26% (0.8172 => 0.8520, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (5.0018 => 5.2087, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.99% (0.5569 => 0.5791, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.88% (5.7591 => 5.9824, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (4.2646 => 4.4277, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: 3.82% (0.7835 => 0.8134, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 3.79% (17.1811 => 17.8320, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 3.74% (0.3423 => 0.3551, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4294, std. dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 3.57% (0.3109 => 0.3220, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.51% (0.3387 => 0.3506, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.3050 => 1.3498, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1861 => 1.2242, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.17% (3.3354 => 3.4411, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.12% (1.5603 => 1.6090, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.5415 => 1.5893, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.3668 => 14.8116, std. dev.: 0.0214) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.4636 => 0.4779, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.07% (2.0273 => 2.0895, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.02% (0.6450 => 0.6645, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.01% (1.1642 => 1.1993, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3826 => 0.3935, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9765 => 1.0040, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.81% (3.8723 => 3.9810, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.78% (0.8067 => 0.8291, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4289 => 0.4404, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.64% (2.2024 => 2.2606, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 2.61% (0.4299 => 0.4411, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.58% (1.5859 => 1.6268, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (2.0665 => 2.1196, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.44% (2.2969 => 2.3530, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.32% (0.6675 => 0.6830, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8921 => 0.9128, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.32% (1.4186 => 1.4515, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.26% (1.2842 => 1.3132, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.5020 => 0.5131, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.74% (0.7115 => 0.7239, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.70% (1.1840 => 1.2041, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.60% (1.0722 => 1.0894, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.36% (1.1145 => 1.1965, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (4.2280 => 4.4082, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.62% (3.2827 => 3.4015, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7607, std. dev.: 0.0009) MultiSource/Applications/aha/aha: 2.77% (3.1595 => 3.2471, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.59% (2.1825 => 2.2390, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.93% (3.1578 => 3.2186, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.67% (26.0924 => 26.5270, std. dev.: 0.0248) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.32% (1.3045 => 1.3217, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7948, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: 1.15% (1.1396 => 1.1527, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5760, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.13% (5.2763 => 3.1590, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7224, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.62% (5.3526 => 3.7135, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0601, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.56% (2.9384 => 2.5400, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -11.69% (22.1758 => 19.5830, std. dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2373 => 1.1065, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -8.20% (1.5373 => 1.4112, std. dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5565, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.89% (1.5660 => 1.4894, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.41% (1.9577 => 1.8713, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4937, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9053, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4231, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9839, std. dev.: 0.0267) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.75% (0.4808 => 0.4676, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.66% (19.9488 => 19.6170, std. dev.: 0.0329) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3376, std. dev.: 0.0084) MultiSource/Benchmarks/NPB-serial/is/is: -1.56% (9.5636 => 9.4148, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.37% (1.6805 => 1.6574, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 16:06:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 18:06:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120808230603.0C3992A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2755?compare_to=2752&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2755, Order: 161525, Start Time: 2012-08-08 21:52:47, End Time: 2012-08-08 23:06:37 To: 2752, Order: 161517, Start Time: 2012-08-08 20:10:53, End Time: 2012-08-08 21:24:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (150 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.22% (1.4203 => 1.4518, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.72% (2.0176 => 2.3145, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.28% (0.3601 => 0.3935, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 9.23% (0.5818 => 0.6355, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5748 => 0.6275, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.99% (0.3650 => 0.3978, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 8.94% (0.3646 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.89% (0.3623 => 0.3945, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: 8.84% (0.3789 => 0.4124, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.79% (0.4003 => 0.4355, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7061 => 0.7678, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 8.50% (0.3940 => 0.4275, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.97% (1.3693 => 1.4784, std. dev.: 0.0083) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (3.9660 => 4.2490, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.7710 => 0.8260, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.05% (0.2782 => 0.2978, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (0.4328 => 0.4632, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.88% (0.5265 => 0.5627, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4062 => 0.4332, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2607 => 0.2778, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.56% (0.2760 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2765 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2628 => 0.2795, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3022 => 0.3212, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3899 => 0.4144, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2696 => 0.2861, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.3107 => 0.3296, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3149 => 0.3339, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.03% (0.4379 => 0.4643, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.02% (0.3489 => 0.3699, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.02% (1.9828 => 2.1021, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3453 => 0.3658, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.6959 => 0.7370, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3192 => 0.3380, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.2193 => 1.2908, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.56% (0.4390 => 0.4634, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.55% (0.4016 => 0.4239, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9199 => 0.9707, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.47% (0.5577 => 0.5882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.43% (0.3534 => 0.3726, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.42% (0.1865 => 0.1966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.3293 => 0.3471, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.39% (0.3246 => 0.3421, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.35% (13.8202 => 14.5594, std. dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.3756 => 0.3952, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 5.02% (16.6129 => 17.4470, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/moments: 4.99% (0.3868 => 0.4061, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2945 => 0.3091, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.92% (1.4563 => 1.5279, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.90% (1.1364 => 1.1921, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.85% (7.2180 => 7.5678, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 4.82% (3.8646 => 4.0508, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.78% (0.7506 => 0.7865, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.71% (1.2292 => 1.2871, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8310 => 0.8701, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.58% (1.1061 => 1.1568, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (1.3245 => 1.3843, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.38% (1.0594 => 1.1058, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4412, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4417, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.32% (13.2842 => 13.8576, std. dev.: 0.0189) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0094, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 4.22% (16.2614 => 16.9477, std. dev.: 0.0179) MultiSource/Applications/siod/siod: 4.16% (2.1791 => 2.2698, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.4791 => 0.4985, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3220 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6206, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.98% (3.6692 => 3.8154, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5537, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.74% (4.9865 => 5.1728, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.62% (0.8698 => 0.9013, std. dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.1333 => 1.1728, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.45% (0.6283 => 0.6500, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2884, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (8.4961 => 8.7563, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3724, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2743, std. dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7600, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.72% (2.1007 => 2.1578, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9227, std. dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.58% (1.5188 => 1.5580, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 2.34% (4.6629 => 4.7719, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6250 => 0.6377, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.56% (0.6744 => 0.6849, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.55% (0.9108 => 0.9249, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.44% (1.0313 => 1.0461, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.23% (3.7467 => 3.7929, std. dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.2785 => 6.3472, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std. dev.: 0.0513) SingleSource/Benchmarks/Misc/mandel-2: 11.69% (1.2998 => 1.4518, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.19% (1.5824 => 1.6645, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 4.12% (1.1560 => 1.2036, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.92% (3.2729 => 3.4013, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6840, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.94% (2.1753 => 2.2393, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.91% (1.7688 => 1.8203, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4380, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.45% (10.7476 => 11.0108, std. dev.: 0.0373) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6053, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2105, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.94% (3.7731 => 3.8463, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9574, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1970, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5283, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.00% (0.4657 => 0.4098, std. dev.: 0.0111) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1903, std. dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.21% (1.2308 => 1.1051, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.38% (20.3410 => 19.6531, std. dev.: 0.0572) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.60% (0.8342 => 0.8125, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.58% (1.9762 => 1.9253, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6055, std. dev.: 0.0145) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9593, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2173, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8039, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0084, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0179) MultiSource/Applications/minisat/minisat: -1.36% (9.3358 => 9.2086, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.15% (84.4286 => 83.4567, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 16:36:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 18:36:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120808233624.85A8E2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2756?compare_to=2754&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2756, Order: 161527, Start Time: 2012-08-08 22:18:14, End Time: 2012-08-08 23:36:59 To: 2754, Order: 161518, Start Time: 2012-08-08 20:31:11, End Time: 2012-08-08 21:49:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (88 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (749 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.39% (11.0413 => 10.8874, std. dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.02% (2.3971 => 2.3726, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.81% (10.3673 => 13.8720, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.42% (1.1194 => 1.2472, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.56% (0.3543 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.95% (0.3828 => 0.4209, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.3927 => 0.4314, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.74% (2.2022 => 2.3726, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.57% (1.7609 => 1.8942, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.05% (0.2065 => 0.2190, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 5.65% (0.5925 => 0.6260, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.51% (0.6030 => 0.6362, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.93% (7.0540 => 7.4021, std. dev.: 0.0210) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.65% (0.4879 => 0.5106, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.64% (0.7433 => 0.7778, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 4.52% (0.7326 => 0.7657, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.32% (10.4361 => 10.8874, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/oourafft: 4.30% (0.3282 => 0.3423, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8723, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5569 => 0.5782, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.72% (0.8172 => 0.8476, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (4.9449 => 5.1271, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (5.0018 => 5.1837, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5860 => 0.6070, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (4.2646 => 4.4142, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 3.46% (5.7591 => 5.9585, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 3.43% (17.1811 => 17.7703, std. dev.: 0.0191) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.30% (0.3121 => 0.3224, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 3.20% (0.7835 => 0.8086, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3909, std. dev.: 0.0102) MultiSource/Applications/hbd/hbd: 2.99% (1.5603 => 1.6070, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.99% (1.3050 => 1.3440, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1861 => 1.2213, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4636 => 0.4770, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.82% (3.3354 => 3.4294, std. dev.: 0.0111) MultiSource/Applications/treecc/treecc: 2.81% (2.0273 => 2.0842, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7659, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.73% (0.4103 => 0.4215, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.5415 => 1.5827, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.66% (1.1642 => 1.1952, std. dev.: 0.0098) MultiSource/Applications/lua/lua: 2.57% (3.8723 => 3.9720, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.8067 => 0.8268, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5859 => 1.6251, std. dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.43% (0.5105 => 0.5229, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.40% (0.9765 => 0.9999, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.2024 => 2.2539, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.27% (2.2969 => 2.3491, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (0.6675 => 0.6821, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.17% (0.5020 => 0.5129, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6450 => 0.6590, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.12% (0.6456 => 0.6593, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.07% (2.0665 => 2.1092, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.4186 => 1.4456, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 1.90% (1.2842 => 1.3086, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.88% (0.8921 => 0.9089, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.52% (1.1840 => 1.2020, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.26% (1.0722 => 1.0857, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.36% (1.1145 => 1.1965, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (4.2280 => 4.3823, std. dev.: 0.0154) MultiSource/Applications/siod/siod: 3.63% (3.2827 => 3.4019, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0037) MultiSource/Applications/aha/aha: 2.79% (3.1595 => 3.2477, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.59% (2.1825 => 2.2390, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.91% (3.1578 => 3.2180, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 1.62% (26.0924 => 26.5164, std. dev.: 0.0291) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7961, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (1.5086 => 1.5273, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 1.11% (1.1396 => 1.1522, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5757, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.34% (5.2763 => 3.1476, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7100, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7062, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0350, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.72% (2.9384 => 2.5353, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -11.86% (22.1758 => 19.5464, std. dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.63% (1.6925 => 1.4280, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2373 => 1.1113, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -7.25% (1.5373 => 1.4258, std. dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.34% (2.7294 => 2.5563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4893, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -4.39% (1.9577 => 1.8717, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (4.8142 => 4.6141, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4969, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4131, std. dev.: 0.0239) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.97% (0.4808 => 0.4665, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (8.1563 => 7.9152, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0086, std. dev.: 0.0183) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.13% (19.9488 => 19.5248, std. dev.: 0.0554) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.56% (9.5636 => 9.4145, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3394, std. dev.: 0.0108) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.36% (1.6805 => 1.6576, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 17:45:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 19:45:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120809004544.938502A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2757?compare_to=2753&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2757, Order: 161525, Start Time: 2012-08-08 22:03:02, End Time: 2012-08-09 00:46:21 To: 2753, Order: 161505, Start Time: 2012-08-08 18:51:40, End Time: 2012-08-08 21:34:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (112 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2136 => 0.2290, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.48% (120.7817 => 127.4058, std. dev.: 1.9397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (54.2338 => 54.8327, std. dev.: 0.0461) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 13.76% (0.3460 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3442 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.62% (0.3465 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.56% (0.3496 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.52% (0.3469 => 0.3938, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 13.34% (0.3643 => 0.4129, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.92% (0.3724 => 0.4205, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.16% (0.1063 => 0.1171, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.84% (0.3792 => 0.4165, std. dev.: 0.0139) SingleSource/UnitTests/ObjC++/Hello: 7.59% (0.5826 => 0.6268, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 7.37% (1.5932 => 1.7106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.5889 => 0.6313, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.1619 => 0.1730, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.11% (1.6211 => 1.7201, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.06% (1.3152 => 1.3949, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.98% (3.5627 => 3.7757, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.79% (0.4994 => 0.5283, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (0.4361 => 0.4612, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.2014 => 0.2129, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.69% (0.7171 => 0.7579, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.68% (0.5900 => 0.6235, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.56% (0.5000 => 0.5278, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: 5.56% (0.4029 => 0.4253, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.32% (0.3930 => 0.4139, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.06% (0.2866 => 0.3011, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.99% (4.2109 => 4.4211, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 4.89% (1.0781 => 1.1308, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.87% (0.5026 => 0.5271, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.71% (2.7292 => 2.8577, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (0.4658 => 0.4866, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.45% (5.5417 => 5.7885, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.22% (1.9694 => 2.0525, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.10% (2.1013 => 2.1875, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (0.3890 => 0.4049, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.01% (0.2566 => 0.2669, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2792 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.00% (0.2875 => 0.2990, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.98% (0.9909 => 1.0303, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 3.91% (0.2714 => 0.2820, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.88% (0.3195 => 0.3319, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.83% (0.2738 => 0.2843, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (1.9966 => 2.0731, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 3.81% (0.4146 => 0.4304, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.78% (0.2725 => 0.2828, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.72% (2.0673 => 2.1443, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 3.72% (0.6634 => 0.6881, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.3903 => 0.4048, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.70% (0.2813 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.68% (0.2823 => 0.2927, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.4139 => 0.4291, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.66% (0.2729 => 0.2829, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.66% (0.7875 => 0.8163, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (0.3625 => 0.3757, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.63% (0.9697 => 1.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2803 => 0.2904, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.54% (4.6177 => 4.7810, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3726 => 0.3857, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3362 => 0.3480, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.49% (0.3267 => 0.3381, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.3845 => 0.3979, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.3678 => 0.3806, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 3.48% (1.4269 => 1.4765, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.47% (0.3317 => 0.3432, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (4.4195 => 4.5725, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3124 => 0.3232, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.40% (2.1653 => 2.2390, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.37% (0.3060 => 0.3163, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (1.8794 => 1.9422, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists: 3.32% (0.3348 => 0.3459, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.3271 => 0.3378, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.08% (0.3477 => 0.3584, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.06% (0.4251 => 0.4381, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.99% (0.5546 => 0.5712, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.89% (0.3981 => 0.4096, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.74% (23.5202 => 24.1638, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.5012 => 0.5138, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.6435 => 0.6594, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.2122 => 0.2290, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6690, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 5.07% (1.8057 => 1.8973, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6311, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6297, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1978, std. dev.: 0.0425) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.78% (41.7953 => 42.5377, std. dev.: 0.0554) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.68% (50.0626 => 50.9061, std. dev.: 0.0153) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std. dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3099, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.24% (2.4764 => 2.4457, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5608, std. dev.: 0.0118) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7976, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: -7.08% (0.2402 => 0.2232, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7989, std. dev.: 0.0084) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.93% (17.2379 => 16.7333, std. dev.: 0.0594) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9596, std. dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: -1.42% (5.5810 => 5.5020, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 17:47:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 19:47:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120809004754.27F552A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2758?compare_to=2755&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2758, Order: 161532, Start Time: 2012-08-08 23:34:48, End Time: 2012-08-09 00:48:29 To: 2755, Order: 161525, Start Time: 2012-08-08 21:52:47, End Time: 2012-08-08 23:06:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.36% (2.0176 => 2.3073, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 8.63% (0.5818 => 0.6320, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5748 => 0.6233, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.24% (0.3130 => 0.3388, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.05% (0.3578 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3601 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.78% (0.3650 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.75% (0.3663 => 0.3947, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3914 => 0.4217, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.73% (0.3789 => 0.4082, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7061 => 0.7597, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.27% (1.3693 => 1.4689, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 7.12% (0.7038 => 0.7539, std. dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.01% (3.9660 => 4.2441, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.74% (0.5265 => 0.5620, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.59% (0.7710 => 0.8218, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2781 => 0.2961, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4062 => 0.4312, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.74% (1.2193 => 1.2893, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.73% (0.2966 => 0.3136, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 5.72% (0.2760 => 0.2918, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.69% (0.3899 => 0.4121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.6959 => 0.7355, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.64% (0.3580 => 0.3782, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.45% (0.9199 => 0.9700, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.40% (1.9828 => 2.0899, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3107 => 0.3274, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.33% (0.3246 => 0.3419, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2988 => 0.3146, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5493, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.95% (1.4563 => 1.5284, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.85% (0.4390 => 0.4603, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.80% (16.6129 => 17.4108, std. dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/football/football: 4.79% (0.8310 => 0.8708, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.79% (1.1364 => 1.1908, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.76% (0.7506 => 0.7863, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0446, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.51% (7.2180 => 7.5438, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.46% (1.3245 => 1.3836, std. dev.: 0.0080) MultiSource/Applications/Burg/burg: 4.44% (1.1061 => 1.1552, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8666, std. dev.: 0.0061) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0113, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.37% (1.0594 => 1.1057, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.31% (16.2614 => 16.9624, std. dev.: 0.0264) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2809, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.3819 => 1.4399, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.17% (0.4791 => 0.4991, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.15% (2.1791 => 2.2695, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (3.6692 => 3.8155, std. dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6173, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3755 => 0.3900, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.3801 => 4.5480, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.70% (0.3131 => 0.3247, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (4.9865 => 5.1676, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.6283 => 0.6505, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.44% (0.6135 => 0.6346, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.40% (1.1333 => 1.1718, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.32% (0.8698 => 0.8987, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.22% (3.1889 => 3.2915, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (8.4961 => 8.7576, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3723, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 2.88% (6.5754 => 6.7650, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.1007 => 2.1605, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.82% (14.5298 => 14.9402, std. dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: 2.76% (14.8535 => 15.2639, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.68% (1.5188 => 1.5595, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.50% (4.6629 => 4.7797, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6250 => 0.6363, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.73% (0.9108 => 0.9266, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.72% (1.0313 => 1.0490, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.53% (0.6744 => 0.6847, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.27% (3.7467 => 3.7944, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0441) SingleSource/Benchmarks/Misc/mandel-2: 9.85% (1.2998 => 1.4278, std. dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.18% (1.0895 => 1.1786, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.18% (1.5824 => 1.6643, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 4.11% (1.1560 => 1.2035, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.91% (3.2729 => 3.4010, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6846, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.96% (1.7688 => 1.8211, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 2.90% (2.1753 => 2.2384, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.87% (12.0921 => 12.4388, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.61% (7.4271 => 7.6213, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 2.41% (10.7476 => 11.0061, std. dev.: 0.0611) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.02% (3.1476 => 3.2113, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.63% (1.9290 => 1.9604, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.48% (1.5089 => 1.5313, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5944, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5069, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1961, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6878, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.13% (0.4657 => 0.3999, std. dev.: 0.0163) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.97% (22.5627 => 21.2168, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.34% (0.0997 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2308 => 1.0996, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.07% (1.3780 => 1.3219, std. dev.: 0.0103) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.25% (0.4867 => 0.4709, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.14% (20.3410 => 19.7013, std. dev.: 0.0192) MultiSource/Benchmarks/Olden/bh/bh: -2.59% (1.9762 => 1.9250, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.59% (0.8342 => 0.8126, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6079, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9638, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2290, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.47% (28.2225 => 27.8084, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8616, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0087, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2127, std. dev.: 0.0158) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4361, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 18:37:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 20:37:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120809013726.3D6212A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2759?compare_to=2756&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2759, Order: 161543, Start Time: 2012-08-09 00:19:28, End Time: 2012-08-09 01:37:59 To: 2756, Order: 161527, Start Time: 2012-08-08 22:18:14, End Time: 2012-08-08 23:36:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (91 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (747 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.49% (13.8720 => 14.0784, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 1.13% (10.8874 => 11.0105, std. dev.: 0.0142) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.80% (10.3673 => 14.0784, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3473 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.90% (0.3497 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3543 => 0.3998, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.45% (0.3694 => 0.4154, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.10% (0.3828 => 0.4291, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.89% (0.3886 => 0.4348, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (2.2022 => 2.3917, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.78% (1.7609 => 1.8979, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.3282 => 0.3465, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.50% (10.4361 => 11.0105, std. dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.40% (0.4615 => 0.4864, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.13% (7.0540 => 7.4157, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 5.01% (0.7326 => 0.7693, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.76% (0.7433 => 0.7787, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.60% (0.5569 => 0.5825, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.57% (0.2758 => 0.2884, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2554 => 0.2669, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 4.37% (9.4845 => 9.8989, std. dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.8172 => 0.8529, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.33% (4.9449 => 5.1592, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (5.0018 => 5.2105, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.97% (4.2646 => 4.4338, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5860 => 0.6084, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.3121 => 0.3240, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 3.75% (0.3092 => 0.3208, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.69% (8.1363 => 8.4362, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.65% (0.7835 => 0.8121, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 3.56% (0.3423 => 0.3545, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.44% (1.3050 => 1.3499, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.38% (17.1811 => 17.7621, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 3.37% (5.7591 => 5.9532, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1861 => 1.2242, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.12% (1.1642 => 1.2005, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.4636 => 0.4777, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.02% (3.3354 => 3.4361, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.98% (2.0273 => 2.0877, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7900, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 2.93% (1.5603 => 1.6060, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.93% (0.9765 => 1.0051, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.5415 => 1.5862, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.8067 => 0.8300, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.88% (3.8723 => 3.9837, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (0.5105 => 0.5242, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.2024 => 2.2608, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5859 => 1.6263, std. dev.: 0.0056) MultiSource/Applications/siod/siod: 2.49% (2.2969 => 2.3542, std. dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.6450 => 0.6607, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.41% (1.4186 => 1.4528, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.31% (0.8921 => 0.9127, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.25% (0.6675 => 0.6825, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.6456 => 0.6594, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.08% (2.0665 => 2.1095, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3098, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.77% (0.7115 => 0.7241, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.69% (1.1840 => 1.2040, std. dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.1145 => 1.1964, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (4.2280 => 4.3998, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.63% (3.2827 => 3.4017, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7471, std. dev.: 0.0064) MultiSource/Applications/aha/aha: 2.77% (3.1595 => 3.2471, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.57% (2.1825 => 2.2386, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2113, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.58% (26.0924 => 26.5040, std. dev.: 0.0373) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8011, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2279, std. dev.: 0.0392) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5086 => 1.5269, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 1.11% (1.1396 => 1.1523, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1611, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7028, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7005, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1136, std. dev.: 0.0235) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.68% (2.9384 => 2.5363, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -11.56% (22.1758 => 19.6113, std. dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2373 => 1.1096, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -8.77% (1.5373 => 1.4025, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5565, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4892, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.38% (1.9577 => 1.8719, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4986, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9038, std. dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4808 => 0.4664, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4214, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0021, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.02% (19.9488 => 19.5450, std. dev.: 0.0406) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6778, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3426, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.37% (1.6805 => 1.6575, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 21:44:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 23:44:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120809044400.9D6672A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2760?compare_to=2758&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2760, Order: 161567, Start Time: 2012-08-09 03:30:46, End Time: 2012-08-09 04:44:35 To: 2758, Order: 161532, Start Time: 2012-08-08 23:34:48, End Time: 2012-08-09 00:48:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.10% (2.0176 => 2.3223, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3601 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.52% (0.3650 => 0.3961, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.39% (0.3623 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.38% (0.3663 => 0.3970, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions: 8.35% (0.3914 => 0.4241, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7061 => 0.7634, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.27% (3.9660 => 4.2544, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.7710 => 0.8266, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.14% (0.5265 => 0.5641, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.13% (0.7038 => 0.7540, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 7.03% (1.3693 => 1.4656, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.34% (0.6959 => 0.7400, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.10% (0.4379 => 0.4646, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.2193 => 1.2911, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2655 => 0.2811, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.79% (0.2782 => 0.2943, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.75% (0.2781 => 0.2941, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5577 => 0.5890, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.61% (0.9199 => 0.9715, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.49% (13.8202 => 14.5793, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.48% (0.3246 => 0.3424, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.41% (0.2607 => 0.2748, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.33% (0.3489 => 0.3675, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.33% (0.4390 => 0.4624, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.30% (0.2925 => 0.3080, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.2937 => 0.3088, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.11% (0.3485 => 0.3663, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.10% (1.4563 => 1.5306, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.06% (0.2765 => 0.2905, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 5.05% (16.6129 => 17.4513, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/football/football: 5.04% (0.8310 => 0.8729, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 5.03% (3.8646 => 4.0589, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.02% (1.9828 => 2.0824, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (1.1364 => 1.1928, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 4.96% (0.2761 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.96% (0.3107 => 0.3261, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.5637 => 0.5911, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (1.3813 => 1.4484, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.85% (7.2180 => 7.5680, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.73% (1.3245 => 1.3872, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.70% (1.3819 => 1.4469, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.65% (13.2842 => 13.9021, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 4.65% (1.1061 => 1.1575, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.58% (0.7460 => 0.7802, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.55% (1.9270 => 2.0147, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3453 => 0.3610, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.50% (1.0594 => 1.1071, std. dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 4.49% (16.2614 => 16.9915, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/lists: 4.43% (0.3293 => 0.3439, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.43% (2.1791 => 2.2756, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2995 => 0.3126, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.36% (0.3534 => 0.3688, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (4.4433 => 4.6311, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 4.22% (0.3220 => 0.3356, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3868 => 0.4029, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.15% (4.3801 => 4.5620, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (3.6692 => 3.8198, std. dev.: 0.0151) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2292 => 1.2779, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.86% (0.3131 => 0.3252, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.86% (0.4791 => 0.4976, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1333 => 1.1750, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.50% (4.9865 => 5.1612, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.46% (0.6135 => 0.6347, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 3.45% (3.1889 => 3.2990, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.25% (6.5754 => 6.7888, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 3.25% (8.4961 => 8.7718, std. dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 3.09% (14.8535 => 15.3121, std. dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (3.2742 => 3.3744, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 3.04% (14.5298 => 14.9715, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.93% (0.8698 => 0.8953, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.78% (2.1007 => 2.1591, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.75% (1.5188 => 1.5605, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.65% (4.6629 => 4.7864, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.00% (0.9108 => 0.9290, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.89% (1.0313 => 1.0508, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.46% (3.7467 => 3.8014, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (6.2785 => 6.3452, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2664, std. dev.: 0.0423) SingleSource/Benchmarks/Misc/mandel-2: 9.56% (1.2998 => 1.4240, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.13% (1.0895 => 1.1781, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.21% (1.5824 => 1.6648, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 4.13% (1.1560 => 1.2037, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.93% (3.2729 => 3.4015, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6843, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 2.92% (2.1753 => 2.2389, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4368, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.84% (1.7688 => 1.8190, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4271 => 7.6137, std. dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: 2.51% (10.7476 => 11.0170, std. dev.: 0.0570) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.01% (3.1476 => 3.2110, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5075, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5281, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: 1.26% (1.9290 => 1.9533, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.35% (0.4657 => 0.4082, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.88% (22.5627 => 21.2355, std. dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3183, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.33% (20.3410 => 19.6638, std. dev.: 0.0539) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.23% (0.4867 => 0.4710, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5930, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.61% (0.8342 => 0.8124, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.59% (1.9762 => 1.9251, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9623, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2327, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8041, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0162) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2192, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4357, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 21:48:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 8 Aug 2012 23:48:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120809044856.062552A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2761?compare_to=2759&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2761, Order: 161567, Start Time: 2012-08-09 03:30:47, End Time: 2012-08-09 04:49:33 To: 2759, Order: 161543, Start Time: 2012-08-09 00:19:28, End Time: 2012-08-09 01:37:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (92 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (746 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.67% (10.3673 => 14.1695, std. dev.: 0.0150) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.05% (0.3543 => 0.3970, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.02% (0.3543 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.72% (0.3694 => 0.4127, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2464, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.10% (2.2022 => 2.4026, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.75% (1.7609 => 1.8973, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.66% (0.1892 => 0.2018, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.06% (7.0540 => 7.4817, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.3177 => 0.3361, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.21% (10.4361 => 10.9796, std. dev.: 0.0187) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.4615 => 0.4851, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.01% (0.7326 => 0.7693, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 4.97% (0.3282 => 0.3445, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (0.7433 => 0.7770, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.42% (9.4845 => 9.9037, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.02% (0.5569 => 0.5793, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.01% (0.8172 => 0.8500, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.9449 => 5.1404, std. dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 3.95% (5.7591 => 5.9864, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (5.0018 => 5.1955, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.83% (4.2646 => 4.4279, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.79% (0.5860 => 0.6082, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.51% (17.1811 => 17.7836, std. dev.: 0.0180) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (8.1363 => 8.4141, std. dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.38% (0.7835 => 0.8100, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.3050 => 1.3481, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.08% (1.5603 => 1.6084, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.5415 => 1.5873, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 2.96% (3.3354 => 3.4342, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (14.3668 => 14.7853, std. dev.: 0.0110) MultiSource/Applications/Burg/burg: 2.88% (1.1642 => 1.1977, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.79% (2.0273 => 2.0838, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.75% (0.4103 => 0.4216, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.61% (0.3826 => 0.3926, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.9765 => 1.0018, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.57% (0.8067 => 0.8274, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 2.51% (2.2969 => 2.3546, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9681, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.43% (0.6675 => 0.6837, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.42% (0.4299 => 0.4403, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.6450 => 0.6600, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6225, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.2024 => 2.2521, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.4186 => 1.4500, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8921 => 0.9118, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.17% (0.5981 => 0.6111, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (2.0665 => 2.1114, std. dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6456 => 0.6595, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.92% (1.2842 => 1.3089, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.72% (1.1840 => 1.2044, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.48% (0.7115 => 0.7220, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.45% (1.0722 => 1.0877, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9733, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.36% (1.1145 => 1.1965, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.52% (4.2280 => 4.4191, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.61% (3.2827 => 3.4011, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7590, std. dev.: 0.0006) MultiSource/Applications/aha/aha: 2.79% (3.1595 => 3.2475, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 2.58% (2.1825 => 2.2389, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.80% (26.0924 => 26.5622, std. dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2143, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8003, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5086 => 1.5277, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 1.13% (1.1396 => 1.1525, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2107, std. dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.24% (5.2763 => 3.1532, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.79% (5.3855 => 3.7272, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.46% (5.3526 => 3.7220, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0581, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.57% (2.9384 => 2.5397, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -11.88% (22.1758 => 19.5422, std. dev.: 0.0335) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2373 => 1.1132, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -7.24% (1.5373 => 1.4260, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5041, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4893, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.40% (1.9577 => 1.8716, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.23% (8.6802 => 8.3994, std. dev.: 0.0178) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4980, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (8.1563 => 7.9135, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -2.92% (10.2830 => 9.9830, std. dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.78% (19.9488 => 19.5932, std. dev.: 0.0508) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.55% (9.5636 => 9.4151, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3515, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.38% (1.6805 => 1.6573, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 8 23:13:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 01:13:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120809061322.1EB672A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2762?compare_to=2757&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2762, Order: 161567, Start Time: 2012-08-09 03:30:45, End Time: 2012-08-09 06:13:59 To: 2757, Order: 161525, Start Time: 2012-08-08 22:03:02, End Time: 2012-08-09 00:46:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (84 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (794 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.93% (0.3465 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3496 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3488 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.66% (0.3460 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3643 => 0.4091, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.14% (0.3650 => 0.4093, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3724 => 0.4168, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.50% (1.5932 => 1.7127, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.67% (0.1619 => 0.1727, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.06% (1.6211 => 1.7193, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5826 => 0.6178, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.85% (1.3152 => 1.3922, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 5.81% (0.5889 => 0.6231, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (3.5627 => 3.7641, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (0.4361 => 0.4605, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.35% (0.5026 => 0.5295, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.24% (0.5000 => 0.5262, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.23% (4.2109 => 4.4313, std. dev.: 0.0091) MultiSource/Applications/d/make_dparser: 5.22% (1.0781 => 1.1344, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.22% (0.3930 => 0.4135, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.13% (0.7171 => 0.7539, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.07% (0.5900 => 0.6199, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.91% (0.4029 => 0.4227, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (2.7292 => 2.8532, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.2866 => 0.2993, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.39% (0.2736 => 0.2856, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (0.4658 => 0.4853, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (2.1013 => 2.1888, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.12% (5.5417 => 5.7702, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 4.08% (4.6177 => 4.8063, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.06% (0.3890 => 0.4048, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (1.9694 => 2.0490, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.98% (0.2566 => 0.2668, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.90% (0.6634 => 0.6893, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (4.4195 => 4.5902, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 3.82% (2.1653 => 2.2481, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (1.9966 => 2.0723, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (1.8794 => 1.9482, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.3903 => 0.4039, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.46% (1.4269 => 1.4763, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.44% (0.7875 => 0.8146, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.3271 => 0.3378, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (0.4139 => 0.4274, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.05% (0.9909 => 1.0211, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.98% (2.0673 => 2.1290, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.96% (0.3845 => 0.3959, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.85% (0.5546 => 0.5704, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.82% (0.9697 => 0.9970, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4146 => 0.4261, std. dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 2.74% (23.5202 => 24.1641, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.50% (2.0346 => 2.0854, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4251 => 0.4356, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.6435 => 0.6577, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 9.71% (0.2122 => 0.2328, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6712, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6317, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6797, std. dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2056, std. dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.82% (41.7953 => 42.5576, std. dev.: 0.0413) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9099, std. dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2207, std. dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3114, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2898, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.14% (11.9555 => 11.8191, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5684, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/ary2: -8.16% (0.2402 => 0.2206, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7932, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7947, std. dev.: 0.0070) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7767, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7950, std. dev.: 0.0583) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.49% (0.6293 => 0.6136, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9608, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 10:16:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 12:16:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120809171648.048252A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2763?compare_to=2760&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2763, Order: 161581, Start Time: 2012-08-09 16:03:27, End Time: 2012-08-09 17:17:26 To: 2760, Order: 161567, Start Time: 2012-08-09 03:30:46, End Time: 2012-08-09 04:44:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (143 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.6314 => 56.5842, std. dev.: 0.1031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.99% (2.0176 => 2.3200, std. dev.: 0.0170) SingleSource/UnitTests/ObjC++/property-reference-object: 9.04% (0.5818 => 0.6344, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5748 => 0.6257, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.53% (0.3646 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.40% (0.3130 => 0.3393, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/synchronized: 8.38% (0.3663 => 0.3970, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.34% (0.3623 => 0.3925, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3650 => 0.3953, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.09% (0.4003 => 0.4327, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.02% (0.7061 => 0.7627, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.03% (3.9660 => 4.2447, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.99% (0.7038 => 0.7530, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0051) MultiSource/Applications/hbd/hbd: 6.78% (1.3693 => 1.4621, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.5265 => 0.5618, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 6.12% (0.4328 => 0.4593, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.93% (0.2782 => 0.2947, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.2781 => 0.2942, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.6959 => 0.7355, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.67% (1.2193 => 1.2884, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 5.52% (0.2607 => 0.2751, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.42% (0.4062 => 0.4282, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.42% (0.5577 => 0.5879, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9199 => 0.9696, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.18% (0.3246 => 0.3414, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2937 => 0.3089, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.14% (0.2760 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.13% (13.8202 => 14.5290, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/strcat: 5.10% (0.2726 => 0.2865, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3022 => 0.3174, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.97% (0.3580 => 0.3758, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4244, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (1.4563 => 1.5268, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.82% (0.3485 => 0.3653, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.81% (1.9828 => 2.0781, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3107 => 0.3255, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.74% (3.8646 => 4.0476, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary3: 4.73% (0.3149 => 0.3298, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.66% (1.1364 => 1.1894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.62% (0.8310 => 0.8694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 4.60% (0.3453 => 0.3612, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.58% (7.2180 => 7.5489, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.56% (0.4390 => 0.4590, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.52% (0.7506 => 0.7845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.51% (0.4016 => 0.4197, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.50% (13.2842 => 13.8826, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4434, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4435, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.43% (0.5637 => 0.5887, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.43% (0.3293 => 0.3439, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.7460 => 0.7785, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.35% (1.3245 => 1.3821, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 4.30% (0.3534 => 0.3686, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.26% (1.9270 => 2.0090, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.22% (1.0594 => 1.1041, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 4.21% (0.2995 => 0.3121, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.13% (16.2614 => 16.9336, std. dev.: 0.0111) MultiSource/Applications/siod/siod: 4.10% (2.1791 => 2.2685, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (0.3756 => 0.3909, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.98% (0.3868 => 0.4022, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.89% (4.4433 => 4.6160, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (3.6692 => 3.8102, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 3.83% (1.2292 => 1.2763, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.3801 => 4.5463, std. dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 3.67% (0.3131 => 0.3246, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.9865 => 5.1581, std. dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.12% (0.6283 => 0.6479, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2879, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7545, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.5754 => 6.7720, std. dev.: 0.0131) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2661, std. dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: 2.75% (14.5298 => 14.9290, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (3.2742 => 3.3629, std. dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 2.42% (4.6629 => 4.7758, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1509, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.32% (1.5188 => 1.5541, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.68% (0.9108 => 0.9261, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.51% (1.0313 => 1.0469, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.19% (3.7467 => 3.7911, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 26.70% (1.8175 => 2.3027, std. dev.: 0.0296) SingleSource/Benchmarks/Misc/mandel-2: 10.61% (1.2998 => 1.4377, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.19% (1.5824 => 1.6646, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 4.14% (1.1560 => 1.2039, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.90% (3.2729 => 3.4007, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6845, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9570, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.98% (1.7688 => 1.8215, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 2.92% (2.1753 => 2.2389, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4381, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4271 => 7.6173, std. dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 2.54% (10.7476 => 11.0202, std. dev.: 0.0351) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.01% (3.1476 => 3.2108, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9568, std. dev.: 0.0091) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5073, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1951, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (1.5089 => 1.5275, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1687, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1026, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.45% (6.2497 => 5.9713, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.38% (1.3780 => 1.3176, std. dev.: 0.0144) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.57% (20.3410 => 19.6142, std. dev.: 0.0612) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5915, std. dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.59% (0.8342 => 0.8126, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.59% (1.9762 => 1.9251, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9587, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2192, std. dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.49% (28.2225 => 27.8028, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2223, std. dev.: 0.0433) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4384, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 10:21:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 12:21:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120809172127.25F272A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2764?compare_to=2761&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2764, Order: 161581, Start Time: 2012-08-09 16:03:21, End Time: 2012-08-09 17:22:06 To: 2761, Order: 161567, Start Time: 2012-08-09 03:30:47, End Time: 2012-08-09 04:49:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (81 on baseline) Performance Improvements: 5 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.82% (14.1695 => 13.6286, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.71% (2.4026 => 2.3614, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.59% (7.4817 => 7.3625, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.24% (3.7272 => 3.6810, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.19% (3.7220 => 3.6776, std. dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.46% (10.3673 => 13.6286, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3473 => 0.3894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.02% (0.3543 => 0.3969, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.92% (0.3516 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3561 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (1.1194 => 1.2438, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.27% (1.7609 => 1.8890, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.23% (2.2022 => 2.3614, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.77% (0.1892 => 0.2020, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5925 => 0.6285, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7326 => 0.7681, std. dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 4.60% (10.4361 => 10.9157, std. dev.: 0.0248) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.55% (0.4879 => 0.5101, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.51% (0.7433 => 0.7768, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.37% (7.0540 => 7.3625, std. dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8890, std. dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.93% (0.5569 => 0.5788, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 3.90% (0.3282 => 0.3410, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.67% (0.5860 => 0.6075, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.9449 => 5.1237, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (5.0018 => 5.1819, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (4.2646 => 4.4128, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 3.47% (5.7591 => 5.9587, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 3.33% (17.1811 => 17.7524, std. dev.: 0.0102) MultiSource/Applications/spiff/spiff: 3.27% (0.7835 => 0.8091, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.12% (8.1363 => 8.3905, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.3050 => 1.3457, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.84% (1.5603 => 1.6046, std. dev.: 0.0131) MultiSource/Applications/d/make_dparser: 2.82% (3.3354 => 3.4293, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0098) MultiSource/Applications/treecc/treecc: 2.68% (2.0273 => 2.0817, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (14.3668 => 14.7472, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5415 => 1.5821, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9765 => 1.0012, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.52% (0.4636 => 0.4753, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.49% (0.5105 => 0.5232, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.42% (0.4289 => 0.4393, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.35% (2.0665 => 2.1151, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.32% (0.6675 => 0.6830, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6225, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (2.2024 => 2.2531, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.26% (0.6456 => 0.6602, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9598, std. dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8921 => 0.9106, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.03% (1.4186 => 1.4474, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.01% (0.5020 => 0.5121, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 1.33% (1.1840 => 1.1997, std. dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.27% (1.0722 => 1.0858, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.33% (1.1145 => 1.1962, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (4.2280 => 4.3844, std. dev.: 0.0085) MultiSource/Applications/siod/siod: 3.59% (3.2827 => 3.4007, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7480, std. dev.: 0.0042) MultiSource/Applications/aha/aha: 2.77% (3.1595 => 3.2469, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.58% (2.1825 => 2.2387, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1578 => 3.2275, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 1.77% (26.0924 => 26.5538, std. dev.: 0.0164) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7955, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.26% (1.0313 => 1.0443, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.17% (1.1396 => 1.1529, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.22% (5.2763 => 3.1540, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.65% (5.3855 => 3.6810, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.29% (5.3526 => 3.6776, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0786, std. dev.: 0.0290) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.66% (2.9384 => 2.5369, std. dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: -12.17% (22.1758 => 19.4766, std. dev.: 0.0576) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.62% (1.6925 => 1.4281, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2373 => 1.1095, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -8.65% (1.5373 => 1.4043, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5566, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.07% (1.9577 => 1.8585, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4893, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.19% (8.1563 => 7.8960, std. dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4996, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4257, std. dev.: 0.0140) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.87% (0.4808 => 0.4670, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3293, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9982, std. dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.15% (19.9488 => 19.5206, std. dev.: 0.1024) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3267, std. dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.57% (9.5636 => 9.4139, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.36% (1.6805 => 1.6576, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std. dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 11:45:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 13:45:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120809184537.801C92A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2765?compare_to=2762&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2765, Order: 161581, Start Time: 2012-08-09 16:03:06, End Time: 2012-08-09 18:46:16 To: 2762, Order: 161567, Start Time: 2012-08-09 03:30:45, End Time: 2012-08-09 06:13:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (77 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (801 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 20.09% (62.3674 => 74.8955, std. dev.: 0.0353) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.27% (2.0731 => 2.1201, std. dev.: 0.0071) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.93% (0.3446 => 0.3857, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 11.92% (0.3465 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3442 => 0.3851, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.85% (0.3460 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.84% (0.3496 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3469 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.75% (0.3488 => 0.3898, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.53% (0.3643 => 0.4063, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.45% (0.3650 => 0.4068, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.17% (0.3724 => 0.4140, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.43% (1.5932 => 1.6956, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.20% (0.5826 => 0.6187, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.99% (0.5889 => 0.6242, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (1.6211 => 1.7141, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.14% (3.5627 => 3.7460, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.12% (1.3152 => 1.3825, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.02% (0.4361 => 0.4580, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.87% (0.5026 => 0.5271, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (0.4994 => 0.5237, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 4.73% (4.2109 => 4.4102, std. dev.: 0.0096) MultiSource/Applications/spiff/spiff: 4.64% (0.4029 => 0.4216, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (0.5000 => 0.5232, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.63% (0.3930 => 0.4112, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.56% (0.7171 => 0.7498, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.51% (0.5900 => 0.6166, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 4.40% (1.0781 => 1.1255, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.76% (0.2736 => 0.2839, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.67% (2.7292 => 2.8293, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.63% (5.5417 => 5.7430, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.62% (0.3890 => 0.4031, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (1.9694 => 2.0390, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 3.39% (4.6177 => 4.7742, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (1.9966 => 2.0640, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (2.1013 => 2.1717, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (4.4195 => 4.5648, std. dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: 3.04% (2.1653 => 2.2311, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.03% (0.9909 => 1.0209, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.3903 => 0.4020, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.97% (0.7875 => 0.8109, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.95% (0.6634 => 0.6830, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (1.8794 => 1.9344, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.82% (2.0673 => 2.1257, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.69% (1.4269 => 1.4653, std. dev.: 0.0094) MultiSource/Applications/Burg/burg: 2.52% (0.5546 => 0.5686, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.40% (0.9697 => 0.9930, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.09% (23.5202 => 24.0109, std. dev.: 0.0302) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.6435 => 0.6564, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.93% (2.0346 => 2.0739, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1750, std. dev.: 0.0288) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6485, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6506, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1970, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.83% (2.0820 => 2.1201, std. dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.80% (41.7953 => 42.5472, std. dev.: 0.0539) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9107, std. dev.: 0.0277) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.51% (3.1722 => 3.2202, std. dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3065, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.47% (11.9555 => 11.7794, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5471, std. dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ary2: -9.74% (0.2402 => 0.2168, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8100, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7999, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0039) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7783, std. dev.: 0.0279) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5760, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9671, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 12:04:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 14:04:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120809190421.48BA02A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2766?compare_to=2763&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2766, Order: 161594, Start Time: 2012-08-09 17:51:17, End Time: 2012-08-09 19:04:59 To: 2763, Order: 161581, Start Time: 2012-08-09 16:03:27, End Time: 2012-08-09 17:17:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 3.02% (0.5326 => 0.5487, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.91% (2.3027 => 2.2587, std. dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.68% (2.0176 => 2.3138, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.01% (0.5818 => 0.6342, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.87% (0.5748 => 0.6258, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.60% (0.3663 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.58% (0.3650 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3623 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.43% (0.3914 => 0.4244, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.87% (0.7061 => 0.7617, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (3.9660 => 4.2475, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 7.03% (0.7038 => 0.7533, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.92% (1.3693 => 1.4640, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.86% (0.5265 => 0.5626, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 6.01% (0.4328 => 0.4588, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.79% (0.1865 => 0.1973, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2781 => 0.2939, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (1.2193 => 1.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2607 => 0.2750, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.42% (0.9199 => 0.9698, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.40% (0.5577 => 0.5878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.39% (0.3899 => 0.4109, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.37% (0.4062 => 0.4280, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.33% (0.2628 => 0.2768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2726 => 0.2867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.14% (13.8202 => 14.5306, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.14% (0.2765 => 0.2907, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.07% (0.3489 => 0.3666, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.06% (0.2966 => 0.3116, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.95% (16.6129 => 17.4357, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/except: 4.93% (0.2760 => 0.2896, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.86% (0.3149 => 0.3302, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.4563 => 1.5267, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (1.9828 => 2.0773, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.74% (0.5637 => 0.5904, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.73% (3.8646 => 4.0475, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: 4.67% (0.2761 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.65% (7.2180 => 7.5535, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (1.1364 => 1.1892, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.2988 => 0.3126, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.61% (0.7506 => 0.7852, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 4.58% (0.3453 => 0.3611, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.56% (0.8310 => 0.8689, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (1.3245 => 1.3847, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 4.53% (1.1061 => 1.1562, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.49% (1.9270 => 2.0135, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.44% (0.4390 => 0.4585, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.36% (0.4016 => 0.4191, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 4.34% (0.3293 => 0.3436, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.26% (16.2614 => 16.9548, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (13.2842 => 13.8496, std. dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.25% (1.3819 => 1.4406, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.22% (1.3813 => 1.4396, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.17% (2.1791 => 2.2700, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 4.14% (1.0594 => 1.1033, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (0.3756 => 0.3909, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (4.4433 => 4.6201, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.3868 => 0.4020, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.88% (3.6692 => 3.8116, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (4.3801 => 4.5494, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.76% (1.2292 => 1.2754, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (0.4791 => 0.4969, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 3.43% (0.2945 => 0.3046, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1333 => 1.1713, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.30% (4.9865 => 5.1513, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.25% (0.3755 => 0.3877, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.16% (0.6135 => 0.6329, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.11% (3.1889 => 3.2880, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.8698 => 0.8958, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.6283 => 0.6470, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.92% (3.2742 => 3.3698, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7638, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 2.86% (8.4961 => 8.7389, std. dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 2.75% (14.8535 => 15.2616, std. dev.: 0.0110) MultiSource/Applications/ClamAV/clamscan: 2.75% (14.5298 => 14.9290, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5188 => 1.5587, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1007 => 2.1558, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.44% (4.6629 => 4.7769, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.51% (1.0313 => 1.0469, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.23% (3.7467 => 3.7928, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5138, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2587, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/mandel-2: 10.12% (1.2998 => 1.4313, std. dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.12% (1.0895 => 1.1780, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.18% (1.5824 => 1.6644, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 4.11% (1.1560 => 1.2035, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.91% (3.2729 => 3.4010, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6846, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.93% (1.7688 => 1.8206, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 2.90% (2.1753 => 2.2384, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.85% (12.0921 => 12.4369, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6060, std. dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 2.40% (10.7476 => 11.0059, std. dev.: 0.0521) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.02% (3.1476 => 3.2112, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9577, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.48% (1.5089 => 1.5312, std. dev.: 0.0059) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5069, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1933, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6867, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1620, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.34% (0.0997 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.58% (1.2308 => 1.1006, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9710, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3173, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.73% (20.3410 => 19.5818, std. dev.: 0.0873) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.59% (1.9762 => 1.9250, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.59% (0.8342 => 0.8126, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6036, std. dev.: 0.0133) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9636, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2369, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8042, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8624, std. dev.: 0.0073) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2159, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4330, std. dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 12:08:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 14:08:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120809190831.C9E262A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2767?compare_to=2764&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2767, Order: 161594, Start Time: 2012-08-09 17:51:02, End Time: 2012-08-09 19:09:10 To: 2764, Order: 161581, Start Time: 2012-08-09 16:03:21, End Time: 2012-08-09 17:22:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.09% (1.4043 => 1.4196, std. dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.36% (10.3673 => 13.6180, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.08% (0.3543 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3497 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3516 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3561 => 0.3987, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3694 => 0.4124, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (1.1194 => 1.2466, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.12% (0.3886 => 0.4318, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.55% (2.2022 => 2.3685, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.47% (1.7609 => 1.8924, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.03% (0.1892 => 0.2025, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5925 => 0.6265, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.67% (0.6030 => 0.6372, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 4.68% (10.4361 => 10.9249, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 4.65% (0.7326 => 0.7667, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (0.7433 => 0.7765, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.45% (7.0540 => 7.3682, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 4.24% (0.3282 => 0.3421, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (9.4845 => 9.8745, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.8172 => 0.8505, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.5569 => 0.5783, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (4.9449 => 5.1267, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (5.0018 => 5.1851, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5860 => 0.6073, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.63% (5.7591 => 5.9679, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (4.2646 => 4.4149, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.42% (0.7835 => 0.8103, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 3.26% (17.1811 => 17.7415, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.26% (8.1363 => 8.4016, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.3050 => 1.3462, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.3423 => 0.3531, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.92% (1.1861 => 1.2207, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.83% (3.3354 => 3.4298, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.82% (1.5603 => 1.6043, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.74% (2.0273 => 2.0829, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.8067 => 0.8287, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (14.3668 => 14.7533, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 2.67% (1.1642 => 1.1953, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.66% (1.5415 => 1.5825, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (0.9765 => 1.0015, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.5105 => 0.5231, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.34% (3.8723 => 3.9628, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6212, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.2024 => 2.2509, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6456 => 0.6597, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.14% (2.0665 => 2.1108, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.10% (0.6675 => 0.6815, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.09% (2.2969 => 2.3449, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6450 => 0.6582, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5020 => 0.5122, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.01% (0.8921 => 0.9100, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.4186 => 1.4466, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.78% (1.2842 => 1.3071, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2004, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0848, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.36% (1.1145 => 1.1965, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.4001, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.59% (3.2827 => 3.4007, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7459, std. dev.: 0.0064) MultiSource/Applications/aha/aha: 2.76% (3.1595 => 3.2468, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.58% (2.1825 => 2.2387, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2194, std. dev.: 0.0049) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5641, std. dev.: 0.0157) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8009, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (1.5086 => 1.5284, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 1.14% (1.1396 => 1.1526, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2082, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.45% (0.8651 => 0.1691, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1564, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6885, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.21% (5.3526 => 3.6819, std. dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.0992, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.68% (2.9384 => 2.5363, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -12.08% (22.1758 => 19.4964, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2373 => 1.1000, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -7.66% (1.5373 => 1.4196, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.34% (2.7294 => 2.5563, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.97% (1.9577 => 1.8604, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.89% (1.5660 => 1.4895, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4887, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4236, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (8.1563 => 7.9170, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9880, std. dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.82% (1.3677 => 1.3291, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.79% (0.4808 => 0.4674, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.91% (19.9488 => 19.5686, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.56% (9.5636 => 9.4141, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3492, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.36% (1.6805 => 1.6577, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.8329 => 1.8143, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 13:46:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 15:46:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120809204604.E622C2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2768?compare_to=2766&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2768, Order: 161603, Start Time: 2012-08-09 19:32:59, End Time: 2012-08-09 20:46:43 To: 2766, Order: 161594, Start Time: 2012-08-09 17:51:17, End Time: 2012-08-09 19:04:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (143 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.72% (77.8723 => 81.5466, std. dev.: 0.0877) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.82% (2.0176 => 2.3166, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3578 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5818 => 0.6330, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.78% (0.3646 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.65% (0.3663 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.58% (0.3623 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3789 => 0.4113, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.40% (0.3130 => 0.3393, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.34% (0.4003 => 0.4337, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.83% (0.7061 => 0.7614, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.11% (0.7710 => 0.8258, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (3.9660 => 4.2460, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.99% (1.3693 => 1.4650, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7038 => 0.7525, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4328 => 0.4592, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.86% (0.2782 => 0.2945, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.6959 => 0.7362, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.79% (0.2781 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2875, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.52% (0.9199 => 0.9707, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.44% (0.4062 => 0.4283, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.41% (0.3899 => 0.4110, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.27% (0.3246 => 0.3417, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.22% (0.3489 => 0.3671, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.20% (0.3022 => 0.3179, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.17% (0.2726 => 0.2867, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2696 => 0.2835, std. dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 5.09% (13.8202 => 14.5241, std. dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3149 => 0.3307, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (1.4563 => 1.5287, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (1.9828 => 2.0804, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3107 => 0.3259, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.82% (16.6129 => 17.4133, std. dev.: 0.0122) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 4.78% (3.8646 => 4.0495, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.74% (0.2761 => 0.2892, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.73% (1.1364 => 1.1901, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 4.69% (0.2988 => 0.3128, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.67% (0.8310 => 0.8698, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.67% (0.3192 => 0.3341, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.67% (0.5637 => 0.5900, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.65% (7.2180 => 7.5537, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.7460 => 0.7801, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.50% (1.3245 => 1.3841, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4390 => 0.4587, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.46% (1.1061 => 1.1554, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.41% (1.9270 => 2.0120, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 4.40% (0.3293 => 0.3438, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (1.3813 => 1.4421, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (13.2842 => 13.8638, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.3819 => 1.4413, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 4.23% (2.1791 => 2.2712, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.3534 => 0.3683, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.3756 => 0.3914, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.19% (1.0594 => 1.1038, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.14% (16.2614 => 16.9350, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3868 => 0.4023, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6180, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (3.6692 => 3.8106, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.3801 => 4.5478, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2756, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.4791 => 0.4970, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.67% (0.3131 => 0.3246, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.1333 => 1.1723, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (4.9865 => 5.1506, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 3.16% (3.1889 => 3.2896, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.06% (0.6283 => 0.6475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.00% (0.8698 => 0.8959, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.99% (8.4961 => 8.7499, std. dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (6.5754 => 6.7702, std. dev.: 0.0110) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2732, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.2742 => 3.3655, std. dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9223, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.65% (4.6629 => 4.7865, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1550, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5567, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (0.9108 => 0.9260, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.50% (1.0313 => 1.0468, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.27% (3.7467 => 3.7944, std. dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2660, std. dev.: 0.0313) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.17% (1.0895 => 1.1785, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: 8.15% (1.2998 => 1.4057, std. dev.: 0.0188) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.19% (1.5824 => 1.6646, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 4.15% (1.1560 => 1.2040, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.90% (3.2729 => 3.4007, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6844, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.91% (2.1753 => 2.2387, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9757, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4376, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.83% (1.7688 => 1.8189, std. dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 2.62% (10.7476 => 11.0287, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5997, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.01% (3.1476 => 3.2110, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5104, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.42% (1.5089 => 1.5303, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1962, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.96% (0.4657 => 0.4007, std. dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1751, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2308 => 1.0997, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.37% (20.3410 => 19.6551, std. dev.: 0.0427) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.23% (0.4867 => 0.4710, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5872, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.61% (0.8342 => 0.8124, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.54% (1.9762 => 1.9261, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9636, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2292, std. dev.: 0.0234) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8041, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0081, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2247, std. dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4413, std. dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 13:54:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 15:54:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120809205459.062382A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2769?compare_to=2767&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2769, Order: 161604, Start Time: 2012-08-09 19:37:15, End Time: 2012-08-09 20:55:36 To: 2767, Order: 161594, Start Time: 2012-08-09 17:51:02, End Time: 2012-08-09 19:09:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (85 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.75% (13.6180 => 13.8558, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.58% (79.5376 => 80.7918, std. dev.: 0.3116) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.3123 => 1.3258, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.00% (29.8108 => 29.5126, std. dev.: 0.1059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.65% (10.3673 => 13.8558, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.79% (1.1194 => 1.2514, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.07% (0.3886 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.04% (1.7609 => 1.9025, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.71% (2.2022 => 2.3720, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1892 => 0.2017, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5925 => 0.6293, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.14% (0.4879 => 0.5130, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.09% (0.4615 => 0.4850, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 4.95% (0.7326 => 0.7689, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.84% (7.0540 => 7.3953, std. dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (10.4361 => 10.9410, std. dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 4.24% (0.3282 => 0.3421, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.09% (0.8172 => 0.8506, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5569 => 0.5796, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (9.4845 => 9.8677, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (4.9449 => 5.1361, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (5.0018 => 5.1938, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (4.2646 => 4.4215, std. dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 3.63% (5.7591 => 5.9680, std. dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 3.61% (17.1811 => 17.8016, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.44% (8.1363 => 8.4161, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3423 => 0.3540, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.41% (0.7835 => 0.8102, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.27% (1.3050 => 1.3477, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1861 => 1.2216, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.93% (3.3354 => 3.4331, std. dev.: 0.0076) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0853, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (14.3668 => 14.7754, std. dev.: 0.0158) MultiSource/Applications/Burg/burg: 2.78% (1.1642 => 1.1966, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.5415 => 1.5840, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.75% (0.8067 => 0.8289, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.62% (1.5603 => 1.6012, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (0.9765 => 1.0015, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5859 => 1.6260, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.50% (3.8723 => 3.9691, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.5105 => 0.5231, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.2024 => 2.2559, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.23% (2.2969 => 2.3481, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.23% (1.4186 => 1.4502, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.21% (0.5981 => 0.6113, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8921 => 0.9112, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6450 => 0.6588, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6456 => 0.6579, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.0665 => 2.1037, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.60% (1.2842 => 1.3048, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.50% (1.1840 => 1.2018, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.40% (1.0722 => 1.0872, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.38% (1.1145 => 1.1967, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (4.2280 => 4.3965, std. dev.: 0.0122) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.56% (3.2827 => 3.3995, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7466, std. dev.: 0.0046) MultiSource/Applications/aha/aha: 2.77% (3.1595 => 3.2469, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 2.57% (2.1825 => 2.2385, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.94% (3.1578 => 3.2192, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 1.90% (26.0924 => 26.5876, std. dev.: 0.0187) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.63% (1.3045 => 1.3258, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.37% (11.6436 => 11.8035, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 1.14% (1.1396 => 1.1526, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.00% (5.2763 => 3.1656, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.15% (5.3855 => 3.7079, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7000, std. dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0527, std. dev.: 0.0552) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.47% (2.9384 => 2.5427, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -11.87% (22.1758 => 19.5437, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.17% (1.6925 => 1.4189, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1057, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -8.74% (1.5373 => 1.4029, std. dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.34% (2.7294 => 2.5563, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4893, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -4.60% (1.9577 => 1.8676, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.19% (8.1563 => 7.8961, std. dev.: 0.0105) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4938, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4129, std. dev.: 0.0125) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.75% (0.4808 => 0.4676, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0135, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.90% (19.9488 => 19.5704, std. dev.: 0.0468) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4166, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3461, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.37% (1.6805 => 1.6574, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 14:57:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 16:57:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120809215704.CC4DA2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2770?compare_to=2765&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2770, Order: 161602, Start Time: 2012-08-09 19:14:25, End Time: 2012-08-09 21:57:43 To: 2765, Order: 161581, Start Time: 2012-08-09 16:03:06, End Time: 2012-08-09 18:46:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (84 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (793 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.2140 => 0.2299, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.51% (2.1201 => 2.0881, std. dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.53% (0.3465 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.45% (0.3469 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.41% (0.3496 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3442 => 0.3869, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3488 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.11% (0.3643 => 0.4084, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.84% (0.3650 => 0.4082, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.65% (0.3724 => 0.4158, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.41% (0.3792 => 0.4111, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.68% (1.5932 => 1.6997, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5826 => 0.6193, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5889 => 0.6241, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (0.4994 => 0.5279, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (1.6211 => 1.7111, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.44% (3.5627 => 3.7564, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.25% (1.3152 => 1.3842, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.09% (0.5026 => 0.5282, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.09% (0.4361 => 0.4583, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.97% (0.2014 => 0.2114, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.83% (0.5900 => 0.6185, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 4.81% (4.2109 => 4.4134, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (0.5000 => 0.5240, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.78% (0.3930 => 0.4118, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 4.66% (0.7171 => 0.7505, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 4.57% (1.0781 => 1.1274, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.2736 => 0.2846, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.2866 => 0.2980, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.91% (0.4658 => 0.4840, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.90% (0.2566 => 0.2666, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (0.3890 => 0.4034, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (1.9694 => 2.0420, std. dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 3.61% (5.5417 => 5.7416, std. dev.: 0.0163) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (1.9966 => 2.0680, std. dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.57% (2.7292 => 2.8267, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (2.1013 => 2.1730, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 3.32% (1.8794 => 1.9418, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.32% (0.3195 => 0.3301, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 3.21% (0.7875 => 0.8128, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.21% (0.3271 => 0.3376, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 3.20% (2.1653 => 2.2345, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (4.4195 => 4.5601, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 3.17% (4.6177 => 4.7643, std. dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: 2.99% (0.9909 => 1.0205, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 2.98% (0.6634 => 0.6832, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.3362 => 0.3462, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.3903 => 0.4019, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.4139 => 0.4259, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (2.0673 => 2.1242, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.64% (1.4269 => 1.4646, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 2.51% (0.9697 => 0.9940, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.42% (0.5546 => 0.5680, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4251 => 0.4352, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.31% (23.5202 => 24.0626, std. dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (0.6435 => 0.6564, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.89% (2.0346 => 2.0730, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 8.34% (0.2122 => 0.2299, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6768, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6286, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6602, std. dev.: 0.0324) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2032, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9242, std. dev.: 0.0120) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.72% (41.7953 => 42.5125, std. dev.: 0.0677) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2211, std. dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3030, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.39% (11.9555 => 11.7889, std. dev.: 0.0119) SingleSource/UnitTests/Vector/constpool: -1.07% (2.4764 => 2.4498, std. dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5807, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2402 => 0.2210, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8040, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7971, std. dev.: 0.0137) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std. dev.: 0.0070) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.04% (17.2379 => 16.8855, std. dev.: 0.0426) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5752, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (16.2163 => 15.9539, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 15:27:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 17:27:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120809222753.20FE12A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2771?compare_to=2768&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2771, Order: 161610, Start Time: 2012-08-09 21:14:52, End Time: 2012-08-09 22:28:31 To: 2768, Order: 161603, Start Time: 2012-08-09 19:32:59, End Time: 2012-08-09 20:46:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 1 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.09% (81.5466 => 78.2134, std. dev.: 1.1558) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.90% (2.0176 => 2.3182, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.75% (0.5818 => 0.6327, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.63% (0.3663 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3646 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5748 => 0.6240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.53% (0.3623 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3914 => 0.4246, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.40% (0.3130 => 0.3393, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 8.34% (0.4003 => 0.4337, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.27% (0.3940 => 0.4266, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7061 => 0.7600, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.42% (0.1819 => 0.1954, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (3.9660 => 4.2457, std. dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 6.98% (0.7038 => 0.7529, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.7710 => 0.8246, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 6.95% (1.3693 => 1.4644, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.86% (0.5265 => 0.5626, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4328 => 0.4591, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.82% (0.2782 => 0.2944, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.6959 => 0.7361, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.74% (1.2193 => 1.2893, std. dev.: 0.0070) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2781 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.49% (0.4062 => 0.4285, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.48% (0.3246 => 0.3424, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9199 => 0.9703, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.35% (0.2937 => 0.3094, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.18% (13.8202 => 14.5356, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.11% (0.2760 => 0.2901, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.96% (0.3022 => 0.3172, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.93% (16.6129 => 17.4325, std. dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3485 => 0.3656, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.4563 => 1.5275, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.86% (1.9828 => 2.0792, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary3: 4.83% (0.3149 => 0.3301, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.76% (3.8646 => 4.0485, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.69% (0.4390 => 0.4596, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.1364 => 1.1896, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.67% (0.8310 => 0.8698, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5637 => 0.5898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.61% (7.2180 => 7.5507, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.52% (1.1061 => 1.1561, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.50% (1.3245 => 1.3841, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7460 => 0.7793, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (13.2842 => 13.8684, std. dev.: 0.0072) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0115, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.38% (0.4016 => 0.4192, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4416, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.26% (1.3819 => 1.4408, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.26% (0.3756 => 0.3916, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.26% (1.0594 => 1.1045, std. dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 4.24% (16.2614 => 16.9516, std. dev.: 0.0292) MultiSource/Applications/siod/siod: 4.19% (2.1791 => 2.2705, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.3868 => 0.4026, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (4.4433 => 4.6203, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5527, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (3.6692 => 3.8111, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.86% (1.2292 => 1.2766, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.74% (0.3131 => 0.3248, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9865 => 5.1556, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.38% (0.3755 => 0.3882, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.1333 => 1.1716, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 3.26% (3.1889 => 3.2929, std. dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.18% (0.6135 => 0.6330, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.12% (0.6283 => 0.6479, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.8698 => 0.8964, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.5754 => 6.7725, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 2.99% (8.4961 => 8.7501, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.98% (3.2742 => 3.3719, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2734, std. dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 2.81% (14.5298 => 14.9386, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.1007 => 2.1584, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.74% (4.6629 => 4.7906, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5188 => 1.5603, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.27% (3.7467 => 3.7943, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5117, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 25.91% (1.8175 => 2.2884, std. dev.: 0.0337) SingleSource/Benchmarks/Misc/mandel-2: 10.04% (1.2998 => 1.4303, std. dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.17% (1.0895 => 1.1785, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.18% (1.5824 => 1.6644, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 4.13% (1.1560 => 1.2038, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.91% (3.2729 => 3.4010, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6846, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 2.92% (2.1753 => 2.2389, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.87% (12.0921 => 12.4389, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.83% (1.7688 => 1.8188, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.55% (10.7476 => 11.0212, std. dev.: 0.0556) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4271 => 7.6153, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.00% (3.1476 => 3.2107, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9575, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (1.5089 => 1.5299, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5071, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1958, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.45% (0.4657 => 0.3984, std. dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1787, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.2308 => 1.0963, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9710, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.68% (20.3410 => 19.5924, std. dev.: 0.0491) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.23% (0.4867 => 0.4710, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5941, std. dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.63% (0.8342 => 0.8123, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9248, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.16% (3.0263 => 2.9609, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2245, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8047, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2180, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4426, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 16:06:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 18:06:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120809230649.BC6582A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2772?compare_to=2769&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2772, Order: 161620, Start Time: 2012-08-09 21:48:59, End Time: 2012-08-09 23:07:28 To: 2769, Order: 161604, Start Time: 2012-08-09 19:37:15, End Time: 2012-08-09 20:55:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (80 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.36% (13.8558 => 14.1830, std. dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.83% (54.8011 => 56.3499, std. dev.: 0.0972) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (1.9025 => 1.8797, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.81% (10.3673 => 14.1830, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (1.1194 => 1.2430, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.80% (0.3473 => 0.3848, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.95% (0.3828 => 0.4209, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 9.80% (0.3927 => 0.4312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.75% (0.3886 => 0.4265, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.76% (2.2022 => 2.3510, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.75% (1.7609 => 1.8797, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.10% (0.3177 => 0.3339, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.09% (0.6030 => 0.6337, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.00% (0.5925 => 0.6221, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.59% (0.4615 => 0.4827, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.32% (0.4879 => 0.5090, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (0.7433 => 0.7754, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.13% (7.0540 => 7.3454, std. dev.: 0.0114) SingleSource/UnitTests/ObjC++/property-reference: 4.12% (0.7326 => 0.7628, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 4.09% (10.4361 => 10.8627, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.84% (0.8172 => 0.8486, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.60% (0.5860 => 0.6071, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.60% (9.4845 => 9.8259, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.48% (4.9449 => 5.1168, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 3.41% (0.3282 => 0.3394, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4100, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 3.40% (0.7835 => 0.8101, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (5.0018 => 5.1695, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 3.28% (17.1811 => 17.7454, std. dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 3.26% (5.7591 => 5.9466, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.24% (0.3121 => 0.3222, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 3.10% (0.3423 => 0.3529, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.90% (8.1363 => 8.3725, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.85% (1.5415 => 1.5855, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.3050 => 1.3421, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.80% (1.1861 => 1.2193, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.70% (3.3354 => 3.4253, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.63% (2.0273 => 2.0807, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (14.3668 => 14.7386, std. dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.8067 => 0.8270, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9765 => 1.0003, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 2.38% (1.5603 => 1.5975, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.28% (3.8723 => 3.9605, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5859 => 1.6210, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5105 => 0.5213, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.11% (2.2969 => 2.3453, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.07% (0.6675 => 0.6813, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (2.2024 => 2.2478, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.4186 => 1.4456, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.77% (0.6450 => 0.6564, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 1.67% (0.6456 => 0.6564, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.55% (2.0665 => 2.0986, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.32% (1.2842 => 1.3011, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.24% (1.1840 => 1.1987, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0848, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.13% (1.1145 => 1.1940, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (4.2280 => 4.3992, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.63% (3.2827 => 3.4017, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7467, std. dev.: 0.0076) MultiSource/Applications/aha/aha: 2.77% (3.1595 => 3.2469, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 2.60% (2.1825 => 2.2392, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.78% (3.1578 => 3.2141, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.71% (26.0924 => 26.5389, std. dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.28% (11.6436 => 11.7922, std. dev.: 0.0106) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5086 => 1.5277, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 1.17% (1.1396 => 1.1529, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.59% (0.8651 => 0.1679, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.50% (5.2763 => 3.1396, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.74% (5.3855 => 3.6760, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.44% (5.3526 => 3.6695, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0469, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -14.02% (2.9384 => 2.5264, std. dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -12.23% (22.1758 => 19.4641, std. dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2373 => 1.1024, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -8.44% (1.5373 => 1.4076, std. dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.34% (2.7294 => 2.5564, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.90% (1.5660 => 1.4893, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -4.59% (1.9577 => 1.8679, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.21% (8.1563 => 7.8945, std. dev.: 0.0083) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.20% (0.4808 => 0.4654, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5000, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4303, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9989, std. dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (19.9488 => 19.5790, std. dev.: 0.0229) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3342, std. dev.: 0.0063) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.38% (1.6805 => 1.6573, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 17:09:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 19:09:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810000942.BAF1F2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2773?compare_to=2771&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2773, Order: 161628, Start Time: 2012-08-09 22:56:34, End Time: 2012-08-10 00:10:20 To: 2771, Order: 161610, Start Time: 2012-08-09 21:14:52, End Time: 2012-08-09 22:28:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.53% (2.2884 => 2.2535, std. dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.38% (2.0176 => 2.3078, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.40% (0.5818 => 0.6307, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.30% (0.5748 => 0.6225, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.77% (0.3578 => 0.3856, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7061 => 0.7597, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 7.53% (0.3601 => 0.3872, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3650 => 0.3919, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.35% (1.3693 => 1.4700, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.34% (0.3663 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3914 => 0.4198, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.15% (0.7038 => 0.7541, std. dev.: 0.0152) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.4003 => 0.4288, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (3.9660 => 4.2478, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.7710 => 0.8241, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 6.69% (0.2781 => 0.2967, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4062 => 0.4317, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.08% (0.3899 => 0.4136, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4379 => 0.4645, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (0.2765 => 0.2931, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.99% (0.2937 => 0.3113, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.2193 => 1.2918, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.79% (0.9199 => 0.9732, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary: 5.79% (0.3107 => 0.3287, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.78% (1.9828 => 2.0975, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3489 => 0.3690, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2761 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2988 => 0.3151, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.42% (0.3246 => 0.3422, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4390 => 0.4621, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: 5.22% (0.3293 => 0.3465, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.2914 => 0.3066, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.20% (13.8202 => 14.5386, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.18% (0.4016 => 0.4224, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.07% (1.4563 => 1.5302, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.01% (0.3534 => 0.3711, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (0.3756 => 0.3944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.98% (0.8310 => 0.8724, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.98% (1.1364 => 1.1930, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 4.97% (16.6129 => 17.4378, std. dev.: 0.0164) MultiSource/Benchmarks/MallocBench/gs/gs: 4.95% (3.8646 => 4.0559, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3868 => 0.4054, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.79% (0.5637 => 0.5907, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.67% (1.3245 => 1.3864, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.67% (1.1061 => 1.1577, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.64% (7.2180 => 7.5529, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.58% (0.7460 => 0.7802, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.56% (1.9270 => 2.0149, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2292 => 1.2848, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (1.3813 => 1.4423, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (13.2842 => 13.8700, std. dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.0594 => 1.1060, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.38% (1.3819 => 1.4424, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.33% (16.2614 => 16.9657, std. dev.: 0.0098) MultiSource/Applications/siod/siod: 4.29% (2.1791 => 2.2725, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.21% (0.2995 => 0.3121, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.16% (0.3220 => 0.3354, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.13% (0.4791 => 0.4989, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.99% (0.3755 => 0.3905, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6194, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (4.3801 => 4.5498, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (3.6692 => 3.8094, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.9865 => 5.1752, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.8698 => 0.9015, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.62% (0.6135 => 0.6357, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.6283 => 0.6507, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (1.1333 => 1.1731, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.27% (3.1889 => 3.2933, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.20% (3.2742 => 3.3789, std. dev.: 0.0187) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (8.4961 => 8.7579, std. dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 2.97% (14.5298 => 14.9619, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 2.92% (0.4113 => 0.4233, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7640, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.86% (2.1007 => 2.1608, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.80% (1.5188 => 1.5613, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.76% (14.8535 => 15.2637, std. dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 2.60% (4.6629 => 4.7841, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6250 => 0.6363, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.80% (0.9108 => 0.9272, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.78% (1.0313 => 1.0497, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: 1.69% (0.6744 => 0.6858, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.31% (3.7467 => 3.7958, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5107, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2535, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 7.90% (1.2998 => 1.4025, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.17% (1.5824 => 1.6642, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 4.18% (1.1560 => 1.2043, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 3.92% (3.2729 => 3.4011, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.2619 => 11.6852, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.36% (2.8606 => 2.9568, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 2.92% (2.1753 => 2.2388, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.92% (1.7688 => 1.8204, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.86% (12.0921 => 12.4383, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.52% (10.7476 => 11.0184, std. dev.: 0.0363) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5982, std. dev.: 0.0186) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 2.02% (3.1476 => 3.2112, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5941, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.18% (1.0310 => 1.0432, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6870, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.05% (1.9290 => 1.9493, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.03% (4.5928 => 4.6402, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.48% (0.4657 => 0.3936, std. dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.04% (22.5627 => 21.2008, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.92% (1.0460 => 0.8586, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.54% (0.0997 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2308 => 1.0978, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.57% (20.3410 => 19.6152, std. dev.: 0.0626) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.61% (0.8342 => 0.8124, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.61% (1.9762 => 1.9246, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5981, std. dev.: 0.0059) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9637, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2260, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8046, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0085, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std. dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4388, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2386, std. dev.: 0.0164) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 17:53:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 19:53:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810005318.804822A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2774?compare_to=2772&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2774, Order: 161637, Start Time: 2012-08-09 23:35:35, End Time: 2012-08-10 00:53:57 To: 2772, Order: 161620, Start Time: 2012-08-09 21:48:59, End Time: 2012-08-09 23:07:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (83 on baseline) Performance Improvements: 4 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 925 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.19% (1.8797 => 1.9020, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 1.17% (14.1830 => 14.3495, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.07% (2.3510 => 2.3762, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.19% (2.9198 => 3.2174, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.40% (19.5790 => 19.8522, std. dev.: 0.0805) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.23% (17.7454 => 17.5265, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -5.09% (5.0265 => 4.7708, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -1.33% (3.4017 => 3.3566, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.15% (1.3300 => 1.3147, std. dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.41% (10.3673 => 14.3495, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3543 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.43% (0.3543 => 0.3948, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.38% (1.1194 => 1.2468, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.26% (0.3694 => 0.4110, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.01% (1.7609 => 1.9020, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.90% (2.2022 => 2.3762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 5.62% (0.5925 => 0.6258, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.6030 => 0.6366, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.92% (7.0540 => 7.4008, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.4361 => 10.9268, std. dev.: 0.0111) SingleSource/UnitTests/ObjC++/property-reference: 4.61% (0.7326 => 0.7664, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.02% (0.7433 => 0.7732, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.9449 => 5.1373, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (9.4845 => 9.8527, std. dev.: 0.0120) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8172 => 0.8482, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5569 => 0.5775, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (5.0018 => 5.1863, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (4.2646 => 4.4172, std. dev.: 0.0094) MultiSource/Applications/oggenc/oggenc: 3.52% (5.7591 => 5.9616, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.43% (0.5860 => 0.6061, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.29% (0.7835 => 0.8093, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3907, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.88% (1.3050 => 1.3426, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.76% (1.1861 => 1.2188, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.62% (2.0273 => 2.0805, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.60% (1.1642 => 1.1945, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 2.56% (3.3354 => 3.4207, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.8067 => 0.8271, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.46% (0.9765 => 1.0005, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.44% (1.5415 => 1.5791, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.31% (1.5603 => 1.5964, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.5105 => 0.5217, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.14% (3.8723 => 3.9553, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.14% (1.5859 => 1.6198, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.01% (17.1811 => 17.5265, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8921 => 0.9093, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6450 => 0.6572, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.89% (0.6456 => 0.6578, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.83% (1.4186 => 1.4446, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.78% (2.2969 => 2.3377, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.72% (14.3668 => 14.6132, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.71% (2.0665 => 2.1019, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.64% (2.2024 => 2.2385, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.52% (1.2842 => 1.3037, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.36% (1.1840 => 1.2001, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.1145 => 1.1964, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.48% (4.2280 => 4.4174, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) MultiSource/Applications/aha/aha: 3.57% (3.1595 => 3.2722, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std. dev.: 0.0062) MultiSource/Applications/siod/siod: 2.25% (3.2827 => 3.3566, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2193, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/queens: 1.89% (2.1825 => 2.2237, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.64% (26.0924 => 26.5209, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8132, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5086 => 1.5281, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.29% (1.0313 => 1.0446, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.11% (1.1396 => 1.1523, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std. dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1561, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.14% (5.3855 => 3.7082, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7037, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0055, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.77% (2.9384 => 2.5339, std. dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: -12.20% (22.1758 => 19.4702, std. dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2373 => 1.1089, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -6.55% (1.5373 => 1.4366, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.50% (5.0483 => 4.7708, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8652, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4653, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4066, std. dev.: 0.0194) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (8.1563 => 7.9010, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0114, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.61% (1.6805 => 1.6535, std. dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5130, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4176, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3524, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 18:08:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 20:08:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120810010829.307832A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2775?compare_to=2770&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2775, Order: 161622, Start Time: 2012-08-09 22:25:47, End Time: 2012-08-10 01:09:08 To: 2770, Order: 161602, Start Time: 2012-08-09 19:14:25, End Time: 2012-08-09 21:57:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (93 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (785 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.48% (2.0881 => 2.1191, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (54.1696 => 54.7677, std. dev.: 0.0810) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 11.71% (0.3442 => 0.3845, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3446 => 0.3846, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3465 => 0.3867, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.56% (0.3460 => 0.3860, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3496 => 0.3900, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.53% (0.3488 => 0.3890, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.50% (0.3469 => 0.3868, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3643 => 0.4052, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.21% (0.3650 => 0.4059, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.01% (0.3724 => 0.4134, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.11% (1.5932 => 1.7065, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5826 => 0.6185, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.08% (0.5889 => 0.6247, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.61% (1.6211 => 1.7121, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.59% (0.5026 => 0.5307, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.47% (1.3152 => 1.3872, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.24% (3.5627 => 3.7494, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (0.4361 => 0.4589, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.01% (0.4994 => 0.5244, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.99% (0.3930 => 0.4126, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (0.5000 => 0.5243, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 4.83% (4.2109 => 4.4142, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.62% (0.4029 => 0.4215, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.5900 => 0.6171, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 4.49% (0.7171 => 0.7493, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.49% (1.0781 => 1.1265, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.2866 => 0.2985, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.00% (5.5417 => 5.7632, std. dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.91% (2.7292 => 2.8359, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (0.3890 => 0.4042, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.90% (0.2566 => 0.2666, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.72% (0.2875 => 0.2982, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.70% (2.1013 => 2.1790, std. dev.: 0.0086) SingleSource/Regression/C++/ofstream_ctor: 3.63% (0.3004 => 0.3113, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (0.3195 => 0.3310, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.58% (0.2792 => 0.2892, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.56% (0.6634 => 0.6870, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (4.4195 => 4.5758, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 3.52% (0.9909 => 1.0258, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (1.9694 => 2.0384, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (1.9966 => 2.0662, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 3.44% (0.3726 => 0.3854, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.3903 => 0.4037, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.42% (2.0673 => 2.1380, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 3.40% (4.6177 => 4.7749, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.3271 => 0.3382, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.37% (1.8794 => 1.9427, std. dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 3.32% (2.1653 => 2.2372, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3317 => 0.3426, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.29% (0.4139 => 0.4275, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.26% (0.3096 => 0.3197, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.14% (0.7875 => 0.8122, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 3.12% (0.3267 => 0.3369, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.11% (0.9697 => 0.9999, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.09% (0.3362 => 0.3466, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (0.3625 => 0.3735, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.3678 => 0.3788, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.96% (1.4269 => 1.4692, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 2.86% (23.5202 => 24.1933, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash: 2.85% (0.4146 => 0.4264, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.80% (0.4251 => 0.4370, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.6435 => 0.6611, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 2.60% (0.5546 => 0.5690, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.5012 => 0.5134, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 2.42% (2.0346 => 2.0838, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.68% (0.2122 => 0.2285, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6709, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1703, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.57% (1.8057 => 1.8883, std. dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6555, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6877, std. dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1957, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.78% (2.0820 => 2.1191, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5917, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9261, std. dev.: 0.0266) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.64% (41.7953 => 42.4822, std. dev.: 0.0736) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std. dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3046, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2850, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.11% (11.9555 => 11.8229, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5792, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8085, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.79% (0.2402 => 0.2263, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7991, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0031) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.84% (17.2379 => 16.7475, std. dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9594, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5006, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 18:52:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 20:52:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810015235.13E022A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2776?compare_to=2773&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2776, Order: 161642, Start Time: 2012-08-10 00:39:19, End Time: 2012-08-10 01:53:13 To: 2773, Order: 161628, Start Time: 2012-08-09 22:56:34, End Time: 2012-08-10 00:10:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (153 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.70% (54.9535 => 56.4373, std. dev.: 0.0823) SingleSource/Benchmarks/Misc/mandel-2: 1.38% (1.4025 => 1.4218, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.76% (3.8422 => 3.7747, std. dev.: 0.0194) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.92% (2.0176 => 2.3186, std. dev.: 0.0077) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.26% (0.1072 => 0.1182, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.85% (0.3130 => 0.3407, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.73% (0.5818 => 0.6326, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5748 => 0.6239, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.52% (0.3578 => 0.3883, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3663 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.09% (0.3623 => 0.3916, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0086) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7061 => 0.7618, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.57% (0.2721 => 0.2927, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.56% (1.3693 => 1.4728, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.43% (3.9660 => 4.2608, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 7.43% (0.7038 => 0.7561, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.7710 => 0.8268, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5265 => 0.5645, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.79% (0.2782 => 0.2971, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.62% (0.2781 => 0.2965, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3899 => 0.4153, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.39% (0.4379 => 0.4659, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.25% (0.6959 => 0.7394, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2628 => 0.2792, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.20% (1.2193 => 1.2949, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.18% (0.2655 => 0.2819, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.07% (0.2966 => 0.3146, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.05% (0.3489 => 0.3700, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (0.2765 => 0.2931, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.99% (0.9199 => 0.9750, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.94% (0.3485 => 0.3692, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.88% (0.5577 => 0.5905, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.84% (0.3149 => 0.3333, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.79% (1.9828 => 2.0977, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.71% (13.8202 => 14.6089, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.61% (16.6129 => 17.5453, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.53% (0.3453 => 0.3644, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.49% (0.2914 => 0.3074, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.44% (0.2243 => 0.2365, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.40% (0.2925 => 0.3083, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.38% (0.4016 => 0.4232, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.35% (0.4390 => 0.4625, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.32% (3.8646 => 4.0702, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 5.32% (0.8310 => 0.8752, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3534 => 0.3721, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.26% (1.4563 => 1.5329, std. dev.: 0.0079) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.19% (0.3293 => 0.3464, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.12% (1.1364 => 1.1946, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.08% (0.2127 => 0.2235, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.06% (0.5637 => 0.5922, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.00% (7.2180 => 7.5790, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 5.00% (1.1061 => 1.1614, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (1.3245 => 1.3904, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 4.97% (0.7506 => 0.7879, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.92% (1.9270 => 2.0219, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (1.3813 => 1.4485, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.79% (0.7460 => 0.7817, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (1.3819 => 1.4476, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.75% (1.0594 => 1.1097, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.71% (2.1791 => 2.2817, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2292 => 1.2863, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (13.2842 => 13.8978, std. dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.61% (0.4791 => 0.5012, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.53% (4.9865 => 5.2122, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 4.51% (0.2995 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.48% (0.2945 => 0.3077, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.44% (0.3220 => 0.3363, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.40% (16.2614 => 16.9761, std. dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.27% (3.6692 => 3.8260, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.26% (4.4433 => 4.6327, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.17% (4.3801 => 4.5628, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.88% (0.6283 => 0.6527, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.87% (1.1333 => 1.1772, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.83% (0.3131 => 0.3251, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.78% (0.8698 => 0.9027, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6135 => 0.6358, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.53% (3.1889 => 3.3015, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.51% (3.2742 => 3.3891, std. dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (8.4961 => 8.7858, std. dev.: 0.0135) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.34% (2.1007 => 2.1708, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.30% (1.5188 => 1.5689, std. dev.: 0.0161) MultiSource/Applications/oggenc/oggenc: 3.29% (4.6629 => 4.8162, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 3.23% (6.5754 => 6.7876, std. dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: 3.14% (14.5298 => 14.9858, std. dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: 3.11% (14.8535 => 15.3160, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.6250 => 0.6383, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.10% (0.9108 => 0.9299, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.04% (1.0313 => 1.0523, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: 1.94% (0.6744 => 0.6875, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.61% (3.7467 => 3.8072, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (6.2785 => 6.3548, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.07% (33.2944 => 33.6493, std. dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5158, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: 9.39% (1.2998 => 1.4218, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.17% (1.0895 => 1.1785, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.16% (1.5824 => 1.6640, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 4.12% (1.1560 => 1.2036, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.90% (3.2729 => 3.4007, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6845, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9569, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.94% (1.7688 => 1.8208, std. dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 2.94% (2.1753 => 2.2392, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.87% (12.0921 => 12.4389, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.60% (7.4271 => 7.6203, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.38% (10.7476 => 11.0031, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/aha/aha: 1.99% (3.1476 => 3.2103, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: 1.29% (9.0760 => 9.1933, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.54% (22.5627 => 21.3120, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.93% (1.0460 => 0.8585, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.10% (1.2308 => 1.1065, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3187, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.40% (20.3410 => 19.6503, std. dev.: 0.0362) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.61% (0.8342 => 0.8124, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9249, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6077, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.24% (3.0263 => 2.9585, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2387, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.48% (28.2225 => 27.8041, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0083, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2231, std. dev.: 0.0352) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.16% (84.4286 => 83.4456, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8717, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 19:39:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 21:39:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810023945.F044B2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2777?compare_to=2774&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2777, Order: 161645, Start Time: 2012-08-10 01:21:58, End Time: 2012-08-10 02:40:24 To: 2774, Order: 161637, Start Time: 2012-08-09 23:35:35, End Time: 2012-08-10 00:53:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (82 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.17% (79.5267 => 80.4587, std. dev.: 0.2706) SingleSource/Benchmarks/Misc/lowercase: 1.00% (7.9738 => 8.0539, std. dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -6.60% (14.3495 => 13.4020, std. dev.: 0.0150) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.27% (10.3673 => 13.4020, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.39% (1.1194 => 1.2469, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.83% (0.3473 => 0.3849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.88% (0.3927 => 0.4315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.06% (1.7609 => 1.9029, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.95% (2.2022 => 2.3773, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 5.15% (0.5925 => 0.6230, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.4879 => 0.5128, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.07% (0.6030 => 0.6336, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.78% (7.0540 => 7.3915, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 4.67% (10.4361 => 10.9236, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 4.20% (0.7326 => 0.7634, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (9.4845 => 9.8621, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.74% (0.8172 => 0.8478, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.72% (0.5569 => 0.5776, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.70% (5.0018 => 5.1867, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.9449 => 5.1251, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 3.61% (5.7591 => 5.9668, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5860 => 0.6070, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (4.2646 => 4.4061, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.23% (0.7835 => 0.8088, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.08% (8.1363 => 8.3870, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.96% (1.3050 => 1.3436, std. dev.: 0.0097) MultiSource/Applications/hbd/hbd: 2.80% (1.5603 => 1.6040, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.1861 => 1.2182, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.69% (0.8067 => 0.8284, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.61% (1.1642 => 1.1946, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.59% (2.0273 => 2.0799, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.9765 => 1.0017, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.57% (3.3354 => 3.4212, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.5415 => 1.5782, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5859 => 1.6234, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.33% (0.4636 => 0.4744, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (2.0665 => 2.1137, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.6456 => 0.6599, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.21% (17.1811 => 17.5616, std. dev.: 0.0113) MultiSource/Applications/lua/lua: 2.21% (3.8723 => 3.9580, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.5105 => 0.5217, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3098, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.96% (1.4186 => 1.4464, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.92% (2.2969 => 2.3411, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.2024 => 2.2427, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (14.3668 => 14.5814, std. dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1840 => 1.1983, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.04% (1.0722 => 1.0833, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.16% (1.1145 => 1.1943, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (4.2280 => 4.3923, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0022) MultiSource/Applications/aha/aha: 3.57% (3.1595 => 3.2723, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7574, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.25% (3.2827 => 3.3567, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2193, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 1.89% (2.1825 => 2.2237, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.71% (26.0924 => 26.5380, std. dev.: 0.0434) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8130, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5838, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 1.15% (1.1396 => 1.1527, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1614, std. dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.99% (5.3855 => 3.7164, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7106, std. dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -15.17% (54.1659 => 45.9477, std. dev.: 0.0349) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.83% (2.9384 => 2.5320, std. dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: -12.25% (22.1758 => 19.4592, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2373 => 1.1019, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -8.61% (1.5373 => 1.4049, std. dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.50% (5.0483 => 4.7705, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -4.87% (1.9577 => 1.8623, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4680, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.8998, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4260, std. dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0059, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.61% (1.6805 => 1.6534, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3372, std. dev.: 0.0074) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4162, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 20:34:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 22:34:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810033441.EB74D2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2778?compare_to=2776&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2778, Order: 161650, Start Time: 2012-08-10 02:21:21, End Time: 2012-08-10 03:35:20 To: 2776, Order: 161642, Start Time: 2012-08-10 00:39:19, End Time: 2012-08-10 01:53:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (155 on baseline) Performance Improvements: 2 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (706 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.41% (2.8907 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 4.67% (2.0024 => 2.0960, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.07% (26.4335 => 26.7171, std. dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.11% (17.5453 => 17.3506, std. dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -5.13% (5.0257 => 4.7678, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.03% (2.0176 => 2.3006, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.5818 => 0.6369, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5748 => 0.6277, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.15% (0.7061 => 0.7707, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.22% (0.3650 => 0.3950, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4703, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.36% (3.9660 => 4.2578, std. dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: 7.35% (0.7038 => 0.7555, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.33% (0.7710 => 0.8275, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.91% (0.4328 => 0.4627, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 6.72% (0.4062 => 0.4335, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.51% (0.2782 => 0.2963, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.47% (0.6959 => 0.7409, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.39% (0.4379 => 0.4659, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.22% (1.2193 => 1.2951, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.18% (0.3899 => 0.4140, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.14% (0.9199 => 0.9764, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.14% (0.2607 => 0.2767, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2690 => 0.2854, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.99% (0.3489 => 0.3698, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.98% (0.3580 => 0.3794, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.97% (0.2966 => 0.3143, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.97% (0.2765 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2760 => 0.2923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.82% (0.3246 => 0.3435, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.77% (0.5577 => 0.5899, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2726 => 0.2882, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.69% (13.8202 => 14.6060, std. dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.68% (0.1865 => 0.1971, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.68% (0.3485 => 0.3683, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.62% (0.3149 => 0.3326, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.60% (1.9828 => 2.0939, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.2988 => 0.3154, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.49% (0.2914 => 0.3074, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2023 => 0.2134, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.35% (0.4390 => 0.4625, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.35% (0.2243 => 0.2363, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.27% (0.8310 => 0.8748, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.26% (0.2925 => 0.3079, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (1.3813 => 1.4539, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.22% (1.4563 => 1.5323, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 5.21% (3.8646 => 4.0659, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4016 => 0.4225, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.3756 => 0.3950, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.16% (0.7506 => 0.7893, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 5.15% (1.1061 => 1.1631, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.15% (1.1364 => 1.1949, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.13% (0.3293 => 0.3462, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.12% (1.3819 => 1.4527, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.07% (0.5637 => 0.5923, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (7.2180 => 7.5801, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/moments: 4.96% (0.3868 => 0.4060, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.93% (1.3245 => 1.3898, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.93% (1.9270 => 2.0220, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.88% (0.7460 => 0.7824, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.68% (1.0594 => 1.1090, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.68% (2.1791 => 2.2810, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.67% (0.2995 => 0.3135, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.57% (0.4791 => 0.5010, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.48% (1.2292 => 1.2843, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.44% (16.6129 => 17.3506, std. dev.: 0.0179) MultiSource/Benchmarks/McCat/18-imp/imp: 4.41% (0.3220 => 0.3362, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.40% (4.4433 => 4.6389, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.32% (4.9865 => 5.2019, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.26% (4.3801 => 4.5669, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (3.6692 => 3.8245, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.90% (0.3131 => 0.3253, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.79% (0.8698 => 0.9028, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6135 => 0.6367, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.77% (0.6283 => 0.6520, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (13.2842 => 13.7809, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.72% (1.1333 => 1.1755, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.63% (3.1889 => 3.3046, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.55% (8.4961 => 8.7973, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.4113 => 0.4254, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 3.40% (16.2614 => 16.8142, std. dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (6.5754 => 6.7942, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.30% (3.2742 => 3.3824, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.19% (1.5188 => 1.5672, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.04% (14.8535 => 15.3046, std. dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 3.03% (4.6629 => 4.8044, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.5298 => 14.9503, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1571, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.22% (0.9108 => 0.9310, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.00% (0.6744 => 0.6879, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.99% (1.0313 => 1.0518, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.6250 => 0.6373, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.58% (3.7467 => 3.8059, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (6.2785 => 6.3511, std. dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 1.13% (33.2944 => 33.6713, std. dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std. dev.: 0.0463) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 10.08% (1.2998 => 1.4308, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.72% (1.5824 => 1.6571, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 4.17% (1.1560 => 1.2042, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.66% (11.2619 => 11.6742, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.43% (7.4271 => 7.6817, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.39% (2.8606 => 2.9575, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9768, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.87% (3.2729 => 3.3669, std. dev.: 0.0141) MultiSource/Applications/hexxagon/hexxagon: 2.68% (12.0921 => 12.4163, std. dev.: 0.0010) MultiSource/Applications/aha/aha: 2.59% (3.1476 => 3.2292, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2236, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.03% (10.7476 => 10.9660, std. dev.: 0.0494) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5928 => 4.6655, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (1.9290 => 1.9576, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5076, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (1.5089 => 1.5299, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1857, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.03% (1.0310 => 1.0416, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.45% (22.5627 => 21.3325, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.87% (1.0460 => 0.8591, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2308 => 1.1001, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.96% (5.0168 => 4.7678, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.15% (1.3780 => 1.3208, std. dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5827, std. dev.: 0.0147) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9249, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.59% (20.3410 => 19.8135, std. dev.: 0.0921) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.34% (0.8342 => 0.8147, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2300, std. dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: -1.70% (28.2225 => 27.7417, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: -1.31% (3.0263 => 2.9866, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2185, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4225, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 21:20:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 23:20:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120810042007.73D2E2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2779?compare_to=2775&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2779, Order: 161647, Start Time: 2012-08-10 01:37:22, End Time: 2012-08-10 04:20:44 To: 2775, Order: 161622, Start Time: 2012-08-09 22:25:47, End Time: 2012-08-10 01:09:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (86 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (792 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.77% (125.8685 => 128.0970, std. dev.: 0.5838) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.31% (1.7065 => 1.6842, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 10.65% (0.3465 => 0.3834, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.56% (0.3446 => 0.3810, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.55% (0.3469 => 0.3835, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.46% (0.3442 => 0.3802, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.38% (0.3496 => 0.3859, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3460 => 0.3818, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.29% (0.3488 => 0.3847, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.13% (0.3643 => 0.4012, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 10.00% (0.3650 => 0.4015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.77% (0.3724 => 0.4088, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.36% (0.3792 => 0.4071, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.23% (0.1620 => 0.1721, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.71% (1.5932 => 1.6842, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.36% (0.5826 => 0.6138, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.18% (0.5889 => 0.6194, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.10% (1.6211 => 1.7038, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (1.3152 => 1.3795, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.86% (0.4361 => 0.4573, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.82% (3.5627 => 3.7346, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (0.5026 => 0.5262, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.55% (0.4994 => 0.5221, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.44% (0.4029 => 0.4208, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.41% (4.2109 => 4.3967, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.38% (0.5000 => 0.5219, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.38% (0.3930 => 0.4102, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.10% (0.5900 => 0.6142, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.05% (1.0781 => 1.1218, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 3.95% (0.7171 => 0.7454, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.2866 => 0.2975, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.77% (0.6634 => 0.6884, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.73% (5.5417 => 5.7486, std. dev.: 0.0152) SingleSource/Regression/C++/ofstream_ctor: 3.53% (0.3004 => 0.3110, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.46% (0.4658 => 0.4819, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (0.3890 => 0.4023, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (1.9966 => 2.0648, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 3.39% (2.1013 => 2.1725, std. dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.30% (2.7292 => 2.8193, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.26% (1.9694 => 2.0336, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 3.23% (0.9909 => 1.0229, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.16% (0.3195 => 0.3296, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.14% (1.8794 => 1.9384, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 3.06% (0.7875 => 0.8116, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.05% (2.0673 => 2.1303, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.01% (0.3625 => 0.3734, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (4.4195 => 4.5499, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.3903 => 0.4018, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.93% (4.6177 => 4.7532, std. dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (2.1653 => 2.2279, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 2.87% (0.3726 => 0.3833, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.85% (0.4139 => 0.4257, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 2.83% (0.3678 => 0.3782, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.75% (1.4269 => 1.4661, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.69% (0.5546 => 0.5695, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.61% (0.4251 => 0.4362, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.55% (23.5202 => 24.1197, std. dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.4146 => 0.4248, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.6435 => 0.6589, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.36% (0.9697 => 0.9926, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.5012 => 0.5119, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.74% (2.0346 => 2.0700, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (0.7426 => 0.7527, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.24% (0.2122 => 0.2318, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6723, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8905, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1682, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6367, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6856, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2095, std. dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (41.7953 => 42.6313, std. dev.: 0.0203) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9247, std. dev.: 0.0149) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3134, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.27% (7.1849 => 7.2765, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.24% (11.9555 => 11.8071, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -1.18% (2.4764 => 2.4473, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.72% (25.4195 => 16.5933, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8070, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std. dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std. dev.: 0.0136) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.07% (17.2379 => 16.8816, std. dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9562, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/bh/bh: -1.40% (5.5810 => 5.5028, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 21:26:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 9 Aug 2012 23:26:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810042618.7AFBA2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2780?compare_to=2777&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2780, Order: 161651, Start Time: 2012-08-10 03:08:27, End Time: 2012-08-10 04:26:56 To: 2777, Order: 161645, Start Time: 2012-08-10 01:21:58, End Time: 2012-08-10 02:40:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (94 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (744 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.51% (13.4020 => 14.2751, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.63% (55.0723 => 56.5183, std. dev.: 0.1052) SingleSource/Benchmarks/McGill/chomp: 1.12% (1.1019 => 1.1142, std. dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.69% (10.3673 => 14.2751, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3473 => 0.3894, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3561 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.64% (1.1194 => 1.2497, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.13% (2.2022 => 2.3813, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.93% (1.7609 => 1.9005, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.61% (0.3177 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5925 => 0.6289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.88% (0.4879 => 0.5166, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.24% (0.3282 => 0.3454, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.22% (0.4615 => 0.4856, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.10% (7.0540 => 7.4138, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 5.09% (0.7326 => 0.7699, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.78% (10.4361 => 10.9346, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 4.65% (0.7433 => 0.7779, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.35% (0.2554 => 0.2665, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.10% (9.4845 => 9.8737, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1432, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (5.0018 => 5.2005, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.89% (0.2700 => 0.2805, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.85% (4.2646 => 4.4289, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.79% (0.5860 => 0.6082, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.70% (0.7835 => 0.8125, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.52% (5.7591 => 5.9620, std. dev.: 0.0148) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.47% (8.1363 => 8.4187, std. dev.: 0.0060) MultiSource/Benchmarks/sim/sim: 3.28% (0.3387 => 0.3498, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.3050 => 1.3464, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.10% (1.1861 => 1.2229, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.05% (1.1642 => 1.1997, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 3.02% (2.0273 => 2.0886, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.94% (0.3441 => 0.3542, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.8067 => 0.8303, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 2.90% (3.3354 => 3.4321, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.83% (0.4103 => 0.4219, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9765 => 1.0038, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.5415 => 1.5845, std. dev.: 0.0061) MultiSource/Applications/hbd/hbd: 2.76% (1.5603 => 1.6033, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.53% (3.8723 => 3.9703, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5859 => 1.6251, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.5105 => 0.5231, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6456 => 0.6609, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.37% (17.1811 => 17.5881, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.34% (0.6450 => 0.6601, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.28% (0.6675 => 0.6827, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.22% (2.2969 => 2.3480, std. dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5981 => 0.6114, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.22% (0.8921 => 0.9119, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.19% (1.4186 => 1.4496, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.2024 => 2.2491, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (2.0665 => 2.1103, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (14.3668 => 14.6416, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.87% (1.2842 => 1.3082, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.70% (0.7115 => 0.7236, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.61% (1.1840 => 1.2031, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.32% (1.0722 => 1.0864, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.34% (1.1145 => 1.1963, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (4.2280 => 4.3877, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 3.54% (3.1595 => 3.2715, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7564, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.25% (3.2827 => 3.3565, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.88% (2.1825 => 2.2235, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.86% (26.0924 => 26.5790, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2134, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8127, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.28% (1.0313 => 1.0445, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2280, std. dev.: 0.0332) SingleSource/Benchmarks/Misc/richards_benchmark: 1.16% (1.1396 => 1.1528, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.11% (1.5086 => 1.5254, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5748, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1467, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7171, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.67% (5.3526 => 3.7112, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -15.18% (54.1659 => 45.9442, std. dev.: 0.0391) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.70% (2.9384 => 2.5359, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -11.86% (22.1758 => 19.5454, std. dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.16% (1.6925 => 1.4190, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.95% (1.2373 => 1.1142, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -7.52% (1.5373 => 1.4217, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5566, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -5.49% (5.0483 => 4.7709, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.66% (1.9577 => 1.8664, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4693, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9088, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4177, std. dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0005, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.61% (1.6805 => 1.6534, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.55% (9.5636 => 9.4152, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.41% (12.5348 => 12.3586, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 22:16:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 00:16:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810051652.7663E2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2781?compare_to=2778&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2781, Order: 161654, Start Time: 2012-08-10 04:03:39, End Time: 2012-08-10 05:17:30 To: 2778, Order: 161650, Start Time: 2012-08-10 02:21:21, End Time: 2012-08-10 03:35:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (148 on baseline) Performance Improvements: 3 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.85% (0.8591 => 0.9523, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 3.60% (2.2639 => 2.3455, std. dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/aha/aha: -5.55% (3.2292 => 3.0499, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.65% (7.3518 => 7.2304, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.6655 => 4.5990, std. dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.94% (2.0176 => 2.2989, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 8.82% (0.5818 => 0.6331, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5748 => 0.6250, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference: 8.64% (0.7061 => 0.7671, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3130 => 0.3381, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.62% (1.3693 => 1.4737, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (0.4328 => 0.4654, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2781 => 0.2988, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4062 => 0.4354, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.13% (0.7038 => 0.7540, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 6.96% (0.3578 => 0.3827, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.94% (3.9660 => 4.2413, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/except: 6.92% (0.2760 => 0.2951, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5265 => 0.5625, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.82% (0.7710 => 0.8236, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.80% (0.3914 => 0.4180, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.79% (0.3650 => 0.3898, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.79% (0.2726 => 0.2911, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.75% (0.3022 => 0.3226, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3646 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.72% (0.3601 => 0.3843, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.72% (0.3899 => 0.4161, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.69% (0.4003 => 0.4271, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.68% (0.3789 => 0.4042, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3663 => 0.3907, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.59% (0.3489 => 0.3719, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.56% (0.2761 => 0.2942, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (1.9828 => 2.1122, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.45% (0.3580 => 0.3811, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.32% (0.3940 => 0.4189, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.11% (0.3453 => 0.3664, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.6959 => 0.7377, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.78% (0.4016 => 0.4248, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 5.77% (0.3293 => 0.3483, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.9199 => 0.9727, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.66% (1.2193 => 1.2883, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.63% (0.3534 => 0.3733, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.3756 => 0.3964, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.5577 => 0.5880, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.42% (0.3246 => 0.3422, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.14% (13.8202 => 14.5303, std. dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 5.11% (1.2292 => 1.2920, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.83% (1.4563 => 1.5266, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.74% (3.8646 => 4.0479, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.73% (1.1364 => 1.1902, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.58% (0.8310 => 0.8691, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.58% (0.3755 => 0.3927, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.57% (7.2180 => 7.5479, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.50% (0.7460 => 0.7796, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3835, std. dev.: 0.0072) MultiSource/Applications/Burg/burg: 4.44% (1.1061 => 1.1552, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4413, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.32% (1.9270 => 2.0103, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4411, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.25% (1.0594 => 1.1044, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.10% (2.1791 => 2.2685, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 4.09% (16.6129 => 17.2925, std. dev.: 0.0212) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.98% (4.9865 => 5.1848, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (4.4433 => 4.6187, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5476, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (0.4791 => 0.4971, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.72% (3.6692 => 3.8058, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.8698 => 0.9018, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6283 => 0.6495, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.31% (13.2842 => 13.7239, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1333 => 1.1694, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.16% (16.2614 => 16.7749, std. dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.10% (0.6135 => 0.6325, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.05% (3.1889 => 3.2862, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (8.4961 => 8.7445, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.2742 => 3.3656, std. dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (6.5754 => 6.7573, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.66% (1.5188 => 1.5592, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4113 => 0.4222, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2453, std. dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.5298 => 14.9013, std. dev.: 0.0253) MultiSource/Applications/oggenc/oggenc: 2.39% (4.6629 => 4.7742, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.1007 => 2.1498, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 2.24% (0.6250 => 0.6390, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.0313 => 1.0470, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 1.28% (33.2944 => 33.7214, std. dev.: 0.0106) MultiSource/Applications/lua/lua: 1.22% (3.7467 => 3.7924, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5111, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 29.05% (1.8175 => 2.3455, std. dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 8.62% (1.2998 => 1.4119, std. dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.18% (1.0895 => 1.1786, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.90% (1.5824 => 1.6600, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 3.87% (1.1560 => 1.2007, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9874, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6801, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.40% (1.7688 => 1.8290, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9569, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 3.27% (7.4271 => 7.6696, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2236, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9782, std. dev.: 0.0073) MultiSource/Applications/siod/siod: 2.00% (3.2729 => 3.3382, std. dev.: 0.0240) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.57% (26.5159 => 26.9311, std. dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.38% (1.5089 => 1.5297, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.36% (8.3908 => 8.5052, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (1.9290 => 1.9552, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0310 => 1.0435, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1860, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.02% (22.5627 => 21.2049, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.05% (0.0997 => 0.0847, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2308 => 1.1013, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.96% (1.0460 => 0.9523, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7962, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.82% (1.3780 => 1.3254, std. dev.: 0.0131) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.10% (3.1476 => 3.0499, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5848, std. dev.: 0.0175) MultiSource/Benchmarks/Olden/bh/bh: -2.58% (1.9762 => 1.9253, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2382, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.74% (20.3410 => 19.9869, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7632, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2304, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: -1.33% (3.0263 => 2.9861, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2133, std. dev.: 0.0329) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4388, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2605, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 9 23:12:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 01:12:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810061249.C80E02A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2782?compare_to=2780&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2782, Order: 161654, Start Time: 2012-08-10 04:55:12, End Time: 2012-08-10 06:13:29 To: 2780, Order: 161651, Start Time: 2012-08-10 03:08:27, End Time: 2012-08-10 04:26:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (87 on baseline) Performance Improvements: 4 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 927 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.76% (0.8582 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.16% (4.3877 => 4.4384, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.10% (1.3133 => 1.3277, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.01% (3.7112 => 3.6737, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/aha/aha: -5.35% (3.2715 => 3.0965, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.05% (80.9195 => 77.6438, std. dev.: 0.9049) MultiSource/Applications/lemon/lemon: -1.95% (1.4571 => 1.4287, std. dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.42% (10.3673 => 14.1435, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.65% (1.1194 => 1.2498, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.47% (1.7609 => 1.8925, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.24% (2.2022 => 2.3617, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.6030 => 0.6407, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.28% (0.7326 => 0.7713, std. dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.57% (10.4361 => 10.9131, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.7433 => 0.7756, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.30% (7.0540 => 7.3571, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 4.11% (0.3282 => 0.3417, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.83% (9.4845 => 9.8480, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8172 => 0.8482, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (5.0018 => 5.1889, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.9449 => 5.1248, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.27% (0.7835 => 0.8091, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.1363 => 8.3882, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.3050 => 1.3441, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.88% (0.4103 => 0.4221, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.84% (5.7591 => 5.9228, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.1861 => 1.2191, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.66% (2.0273 => 2.0813, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.63% (1.1642 => 1.1948, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 2.60% (3.3354 => 3.4220, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9765 => 1.0016, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.54% (1.5415 => 1.5806, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 2.52% (1.5603 => 1.5996, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.48% (0.4636 => 0.4751, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.4289 => 0.4395, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4620 => 0.4732, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1164, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.39% (1.5859 => 1.6238, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.5105 => 0.5220, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.18% (17.1811 => 17.5556, std. dev.: 0.0190) MultiSource/Applications/lua/lua: 2.17% (3.8723 => 3.9562, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6675 => 0.6817, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3102, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.4186 => 1.4455, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.2024 => 2.2433, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.85% (2.2969 => 2.3395, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8921 => 0.9085, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (14.3668 => 14.6029, std. dev.: 0.0142) MultiSource/Benchmarks/nbench/nbench: 1.34% (1.1840 => 1.1999, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.04% (1.0722 => 1.0834, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.37% (1.1145 => 1.1966, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (4.2280 => 4.4384, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7556, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 2.53% (26.0924 => 26.7518, std. dev.: 0.0055) SingleSource/Benchmarks/McGill/queens: 1.89% (2.1825 => 2.2237, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.87% (3.1578 => 3.2168, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.78% (1.3045 => 1.3277, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.63% (3.2827 => 3.3361, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 1.34% (1.1396 => 1.1549, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7741, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.08% (2.6546 => 2.6832, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1613, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.63% (5.3855 => 3.6818, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.37% (5.3526 => 3.6737, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0167, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.48% (2.9384 => 2.5423, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.19% (22.1758 => 19.4724, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.09% (1.2373 => 1.1001, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: -9.71% (1.5373 => 1.3880, std. dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7971, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -4.71% (1.9577 => 1.8654, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (4.8142 => 4.6141, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4643, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9039, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4203, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9833, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -1.99% (3.1595 => 3.0965, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.52% (1.6805 => 1.6549, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3461, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4231, std. dev.: 0.0050) MultiSource/Applications/lemon/lemon: -1.20% (1.4460 => 1.4287, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 00:34:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 02:34:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120810073406.BDFD92A6C075@llvm.org> http://llvm.org/perf/db_default/v4/nts/2783?compare_to=2779&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2783, Order: 161654, Start Time: 2012-08-10 04:48:54, End Time: 2012-08-10 07:34:45 To: 2779, Order: 161647, Start Time: 2012-08-10 01:37:22, End Time: 2012-08-10 04:20:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (776 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.58% (2.4473 => 2.4087, std. dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3496 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3446 => 0.3844, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3465 => 0.3864, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.50% (0.3460 => 0.3858, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.44% (0.3469 => 0.3866, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.42% (0.3442 => 0.3835, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.38% (0.3488 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3643 => 0.4052, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.01% (0.3650 => 0.4052, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3724 => 0.4128, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5826 => 0.6196, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.28% (1.5932 => 1.6932, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 6.16% (0.5889 => 0.6252, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (1.6211 => 1.7127, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.59% (1.3152 => 1.3887, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (0.4361 => 0.4590, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (0.5026 => 0.5289, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.21% (0.4994 => 0.5254, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.15% (3.5627 => 3.7461, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 4.97% (4.2109 => 4.4201, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.5900 => 0.6193, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (0.5000 => 0.5248, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.88% (0.7171 => 0.7521, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.67% (1.0781 => 1.1284, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.28% (0.9909 => 1.0333, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 4.05% (0.3336 => 0.3471, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (0.3890 => 0.4041, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.87% (0.2738 => 0.2844, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.86% (0.2875 => 0.2986, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (2.1013 => 2.1819, std. dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 3.83% (0.2691 => 0.2794, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.79% (5.5417 => 5.7519, std. dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.78% (0.4658 => 0.4834, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.76% (1.9966 => 2.0716, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.67% (4.6177 => 4.7873, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (2.7292 => 2.8292, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 3.64% (2.1653 => 2.2442, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3195 => 0.3311, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.59% (1.9694 => 2.0401, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.53% (2.0673 => 2.1403, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (4.4195 => 4.5732, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 3.44% (1.8794 => 1.9440, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.43% (0.3060 => 0.3165, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 3.42% (0.3096 => 0.3202, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (0.3625 => 0.3749, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.39% (0.6634 => 0.6859, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3317 => 0.3429, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 3.32% (23.5202 => 24.3013, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3258 => 0.3366, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3267 => 0.3375, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.26% (0.3348 => 0.3457, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.3362 => 0.3471, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.13% (1.4269 => 1.4716, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.3903 => 0.4025, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.10% (0.3678 => 0.3792, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.05% (0.9697 => 0.9993, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.05% (0.3282 => 0.3382, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.3845 => 0.3961, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.01% (0.7875 => 0.8112, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 2.99% (0.3477 => 0.3581, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.4139 => 0.4259, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 2.85% (0.4251 => 0.4372, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.4146 => 0.4263, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.3981 => 0.4086, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.60% (0.5546 => 0.5690, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.6435 => 0.6597, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.07% (2.0346 => 2.0768, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (0.7426 => 0.7527, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.72% (0.2122 => 0.2307, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6720, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-2: 4.50% (1.8057 => 1.8870, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6374, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6957, std. dev.: 0.5470) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1996, std. dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.92% (41.7953 => 42.5965, std. dev.: 0.0235) MultiSource/Applications/lua/lua: 1.73% (50.0626 => 50.9274, std. dev.: 0.0263) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5915, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2250, std. dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3065, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.73% (2.4764 => 2.4087, std. dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.02% (25.4195 => 16.5176, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7939, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8028, std. dev.: 0.0027) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.89% (0.6293 => 0.6111, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7774, std. dev.: 0.0508) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9651, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 01:04:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 03:04:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810080410.2E58C2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2784?compare_to=2781&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2784, Order: 161655, Start Time: 2012-08-10 06:47:26, End Time: 2012-08-10 08:04:47 To: 2781, Order: 161654, Start Time: 2012-08-10 04:03:39, End Time: 2012-08-10 05:17:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.43% (54.6642 => 56.5392, std. dev.: 0.0392) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.07% (2.0176 => 2.3015, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.5818 => 0.6334, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7061 => 0.7675, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.65% (0.5748 => 0.6245, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.89% (1.3693 => 1.4774, std. dev.: 0.0417) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4062 => 0.4363, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 7.41% (0.2781 => 0.2987, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4328 => 0.4645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.96% (0.7710 => 0.8247, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 6.93% (0.3578 => 0.3826, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.82% (0.3914 => 0.4181, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3601 => 0.3845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.77% (0.3899 => 0.4163, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 6.72% (0.3646 => 0.3891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.68% (0.3022 => 0.3224, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.65% (0.3489 => 0.3721, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.64% (1.9828 => 2.1145, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.63% (0.3650 => 0.3892, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.61% (0.3663 => 0.3905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.60% (0.3789 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.60% (0.4003 => 0.4267, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.58% (0.4390 => 0.4679, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3623 => 0.3861, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.48% (0.2761 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.46% (0.3485 => 0.3710, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2988 => 0.3180, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (0.3149 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.40% (0.3580 => 0.3809, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.35% (0.3940 => 0.4190, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.77% (0.3293 => 0.3483, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.4016 => 0.4245, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.3756 => 0.3966, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.3868 => 0.4083, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.52% (0.3534 => 0.3729, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (1.4563 => 1.5268, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.84% (1.1364 => 1.1914, std. dev.: 0.0089) MultiSource/Applications/Burg/burg: 4.82% (1.1061 => 1.1594, std. dev.: 0.0154) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.58% (1.3819 => 1.4452, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.58% (0.3755 => 0.3927, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.47% (1.0594 => 1.1068, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6219, std. dev.: 0.0377) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.99% (4.9865 => 5.1856, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.3801 => 4.5516, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (3.6692 => 3.8111, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.76% (0.8698 => 0.9025, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (13.2842 => 13.7312, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.97% (8.4961 => 8.7486, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.81% (1.5188 => 1.5615, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3641, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.1007 => 2.1512, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6250 => 0.6398, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 1.30% (33.2944 => 33.7277, std. dev.: 0.0351) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5212, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 29.85% (1.8175 => 2.3600, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.73% (1.2998 => 1.4263, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.23% (1.0895 => 1.1792, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.90% (1.5824 => 1.6599, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 3.80% (1.1560 => 1.1999, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6806, std. dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.24% (7.4271 => 7.6675, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.24% (0.9692 => 0.9909, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2237, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: 1.61% (1.9290 => 1.9601, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.85% (22.5627 => 21.2438, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2308 => 1.1096, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.95% (1.0460 => 0.9524, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -4.39% (5.0168 => 4.7965, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -3.09% (3.1476 => 3.0503, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5918, std. dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2357, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.87% (20.3410 => 19.9602, std. dev.: 0.0285) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7636, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0085, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2328, std. dev.: 0.0232) MultiSource/Applications/spiff/spiff: -1.29% (3.0263 => 2.9872, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4430, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 01:08:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 03:08:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810080849.575602A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2785?compare_to=2782&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2785, Order: 161655, Start Time: 2012-08-10 06:47:15, End Time: 2012-08-10 08:09:26 To: 2782, Order: 161654, Start Time: 2012-08-10 04:55:12, End Time: 2012-08-10 06:13:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (62 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.35% (77.6438 => 80.2419, std. dev.: 0.3743) SingleSource/Benchmarks/Misc/lowercase: 1.09% (7.9591 => 8.0460, std. dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.51% (10.3673 => 14.1528, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.56% (1.1194 => 1.2488, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.18% (0.3561 => 0.3959, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/parameter-passing: 10.26% (0.3927 => 0.4330, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.52% (2.2022 => 2.3677, std. dev.: 0.0329) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.51% (1.7609 => 1.8932, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 6.50% (0.5925 => 0.6310, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.45% (0.6030 => 0.6419, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 5.69% (0.7326 => 0.7743, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (10.4361 => 10.9183, std. dev.: 0.1480) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.8172 => 0.8535, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.36% (7.0540 => 7.3616, std. dev.: 0.0222) SingleSource/Benchmarks/Misc/oourafft: 4.05% (0.3282 => 0.3415, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (5.0018 => 5.1953, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.81% (9.4845 => 9.8461, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (4.9449 => 5.1289, std. dev.: 0.0085) MultiSource/Applications/oggenc/oggenc: 2.90% (5.7591 => 5.9263, std. dev.: 0.0561) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.87% (0.3865 => 0.3976, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.61% (1.5415 => 1.5817, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.52% (0.4636 => 0.4753, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.51% (0.5105 => 0.5233, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1164, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash: 2.40% (0.4289 => 0.4392, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (0.4620 => 0.4729, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5859 => 1.6229, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6675 => 0.6816, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.2024 => 2.2468, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (14.3668 => 14.6099, std. dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.36% (0.8614 => 0.9506, std. dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.32% (1.1145 => 1.1961, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (4.2280 => 4.4364, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7550, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 1.90% (3.1578 => 3.2178, std. dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.89% (2.1825 => 2.2237, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.62% (3.2827 => 3.3358, std. dev.: 0.0196) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (1.5086 => 1.5296, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 1.37% (1.1396 => 1.1552, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7748, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5817, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.07% (1.3045 => 1.3185, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1618, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.61% (5.3855 => 3.6833, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.22% (5.3526 => 3.6814, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -15.06% (54.1659 => 46.0102, std. dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5436, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.14% (22.1758 => 19.4832, std. dev.: 0.4824) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.54% (1.2373 => 1.1069, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -8.55% (1.5373 => 1.4058, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7975, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.40% (1.9577 => 1.8716, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4661, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9018, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4140, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0076, std. dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3315, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -1.98% (3.1595 => 3.0970, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3368, std. dev.: 0.0097) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4159, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.51% (1.6805 => 1.6552, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 03:45:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 05:45:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120810104534.3B1A32A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2786?compare_to=2783&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2786, Order: 161655, Start Time: 2012-08-10 08:03:08, End Time: 2012-08-10 10:46:14 To: 2783, Order: 161654, Start Time: 2012-08-10 04:48:54, End Time: 2012-08-10 07:34:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (98 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.54% (73.7978 => 74.9334, std. dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.25% (54.1616 => 54.8404, std. dev.: 0.1124) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3446 => 0.3847, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3465 => 0.3868, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.50% (0.3442 => 0.3838, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.47% (0.3496 => 0.3897, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.47% (0.3488 => 0.3888, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 11.45% (0.3460 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.42% (0.3469 => 0.3865, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3643 => 0.4052, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.01% (0.3650 => 0.4052, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.79% (0.3724 => 0.4126, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5826 => 0.6200, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.25% (1.5932 => 1.6927, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 6.23% (0.5889 => 0.6256, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.48% (1.6211 => 1.7099, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.34% (0.4361 => 0.4594, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.27% (3.5627 => 3.7504, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.15% (1.3152 => 1.3829, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7171 => 0.7523, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (0.3930 => 0.4120, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.83% (0.4994 => 0.5235, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.70% (0.5026 => 0.5262, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 4.62% (0.4029 => 0.4215, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 4.59% (4.2109 => 4.4040, std. dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (0.5000 => 0.5225, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.49% (1.0781 => 1.1265, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.47% (0.5900 => 0.6164, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.94% (0.2866 => 0.2979, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.90% (0.2875 => 0.2987, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.3004 => 0.3121, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (0.3890 => 0.4041, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.74% (0.9909 => 1.0280, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.70% (5.5417 => 5.7469, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (0.4658 => 0.4830, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.64% (2.1013 => 2.1777, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (1.9694 => 2.0409, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.62% (2.7292 => 2.8279, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (0.3195 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.58% (2.0673 => 2.1413, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (1.9966 => 2.0674, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.46% (0.3726 => 0.3855, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 3.45% (4.6177 => 4.7769, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.43% (0.3060 => 0.3165, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (4.4195 => 4.5696, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/wc: 3.39% (0.3096 => 0.3201, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.34% (2.1653 => 2.2376, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 3.32% (0.3317 => 0.3427, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.28% (0.3258 => 0.3365, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3124 => 0.3226, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.26% (0.3348 => 0.3457, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.3903 => 0.4030, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.21% (0.3267 => 0.3372, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.21% (0.3362 => 0.3470, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.15% (23.5202 => 24.2611, std. dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.10% (1.8794 => 1.9376, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 3.08% (0.3477 => 0.3584, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.06% (0.7875 => 0.8116, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.01% (0.9697 => 0.9989, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.95% (0.6634 => 0.6830, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4146 => 0.4268, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.86% (0.3845 => 0.3955, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.80% (0.4251 => 0.4370, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.73% (1.4269 => 1.4658, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.3981 => 0.4087, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (0.4139 => 0.4249, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 2.52% (0.5546 => 0.5686, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.6435 => 0.6597, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.5012 => 0.5127, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.02% (2.0346 => 2.0758, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.15% (0.2122 => 0.2295, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6685, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1684, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 4.68% (1.8057 => 1.8902, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6437, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (105.3826 => 107.6197, std. dev.: 0.0409) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1913, std. dev.: 0.0440) MultiSource/Applications/lua/lua: 1.74% (50.0626 => 50.9332, std. dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.74% (41.7953 => 42.5212, std. dev.: 0.0554) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5914, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2238, std. dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3030, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2820, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.27% (2.4764 => 2.3953, std. dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: -1.02% (11.9555 => 11.8331, std. dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5586, std. dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7948, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary2: -7.62% (0.2402 => 0.2219, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7917, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0008) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -1.94% (17.2379 => 16.9035, std. dev.: 0.0376) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5801, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9561, std. dev.: 0.0176) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 04:54:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 06:54:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810115437.D66102A6C077@llvm.org> http://llvm.org/perf/db_default/v4/nts/2787?compare_to=2784&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2787, Order: 161656, Start Time: 2012-08-10 10:41:26, End Time: 2012-08-10 11:55:17 To: 2784, Order: 161655, Start Time: 2012-08-10 06:47:26, End Time: 2012-08-10 08:04:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.28% (0.5487 => 0.5362, std. dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.02% (2.0176 => 2.3004, std. dev.: 0.0130) SingleSource/UnitTests/ObjC++/property-reference-object: 8.83% (0.5818 => 0.6332, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5748 => 0.6250, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.96% (0.7061 => 0.7623, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.76% (1.3693 => 1.4756, std. dev.: 0.0052) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4328 => 0.4649, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4062 => 0.4361, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.22% (0.7038 => 0.7546, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.08% (0.7710 => 0.8256, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.00% (3.9660 => 4.2437, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.84% (0.2765 => 0.2954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3663 => 0.3913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.80% (0.3601 => 0.3846, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.80% (0.3899 => 0.4164, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.78% (0.3022 => 0.3227, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.71% (0.3650 => 0.3895, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2726 => 0.2908, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3623 => 0.3864, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.64% (0.3914 => 0.4174, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.64% (0.3646 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.62% (0.3789 => 0.4040, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.56% (0.2761 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/parameter-passing: 6.52% (0.4003 => 0.4264, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.51% (0.3580 => 0.3813, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.51% (1.9828 => 2.1118, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.40% (0.3485 => 0.3708, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.2988 => 0.3179, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.37% (0.3940 => 0.4191, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.6959 => 0.7377, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.85% (0.4390 => 0.4647, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.72% (0.9199 => 0.9725, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.4016 => 0.4245, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.58% (0.5577 => 0.5888, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.54% (1.2193 => 1.2869, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.3756 => 0.3964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.3868 => 0.4082, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.39% (0.3246 => 0.3421, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.13% (13.8202 => 14.5291, std. dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: 4.99% (1.2292 => 1.2905, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.88% (1.4563 => 1.5274, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 4.88% (3.8646 => 4.0531, std. dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.77% (1.1364 => 1.1906, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 4.66% (0.7506 => 0.7856, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.66% (0.8310 => 0.8697, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.58% (0.3755 => 0.3927, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.50% (1.1061 => 1.1559, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.48% (7.2180 => 7.5416, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4435, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3834, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (1.3813 => 1.4422, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0116, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1048, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.28% (2.1791 => 2.2724, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.06% (16.6129 => 17.2876, std. dev.: 0.0127) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.98% (4.9865 => 5.1849, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.97% (0.4791 => 0.4981, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (4.4433 => 4.6158, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.3801 => 4.5466, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (3.6692 => 3.8068, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.8698 => 0.9018, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.59% (0.6135 => 0.6355, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (13.2842 => 13.7354, std. dev.: 0.0085) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1333 => 1.1713, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.28% (0.6283 => 0.6489, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7845, std. dev.: 0.0124) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2876, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7466, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.83% (3.2742 => 3.3668, std. dev.: 0.0113) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9269, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (6.5754 => 6.7542, std. dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2459, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5188 => 1.5573, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (2.1007 => 2.1513, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.33% (4.6629 => 4.7716, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6250 => 0.6395, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.58% (1.0313 => 1.0476, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.49% (0.9108 => 0.9244, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.29% (33.2944 => 33.7249, std. dev.: 0.0163) MultiSource/Applications/lua/lua: 1.22% (3.7467 => 3.7925, std. dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5144, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2522, std. dev.: 0.0485) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 10.41% (1.2998 => 1.4351, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.21% (1.0895 => 1.1789, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.89% (1.5824 => 1.6598, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 3.91% (1.1560 => 1.2012, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6783, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.43% (1.7688 => 1.8295, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.34% (7.4271 => 7.6753, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.45% (10.7476 => 11.0113, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3849, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2237, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.98% (3.2729 => 3.3377, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.71% (26.5159 => 26.9694, std. dev.: 0.0418) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5089 => 1.5335, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5100, std. dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9554, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.20% (1.0310 => 1.0434, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6863, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.08% (0.4657 => 0.3908, std. dev.: 0.0235) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.95% (22.5627 => 21.2196, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.84% (0.0997 => 0.0849, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2308 => 1.1085, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.96% (1.0460 => 0.9523, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7960, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.07% (1.3780 => 1.3219, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.12% (3.1476 => 3.0494, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.57% (1.9762 => 1.9254, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6055, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2327, std. dev.: 0.0145) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.67% (20.3410 => 20.0010, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7658, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0083, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2306, std. dev.: 0.0103) MultiSource/Applications/spiff/spiff: -1.30% (3.0263 => 2.9870, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.27% (9.9194 => 9.7931, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4424, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8728, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2338, std. dev.: 0.0210) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 04:59:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 06:59:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810115928.6FC3C2A6C077@llvm.org> http://llvm.org/perf/db_default/v4/nts/2788?compare_to=2785&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2788, Order: 161656, Start Time: 2012-08-10 10:41:29, End Time: 2012-08-10 12:00:08 To: 2785, Order: 161655, Start Time: 2012-08-10 06:47:15, End Time: 2012-08-10 08:09:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (86 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.51% (1.4058 => 1.4270, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.65% (2.3462 => 2.3075, std. dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.47% (10.3673 => 14.1481, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.61% (1.1194 => 1.2494, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 11.24% (0.3497 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.3927 => 0.4329, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.45% (1.7609 => 1.8921, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.15% (2.2022 => 2.3596, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.30% (0.6030 => 0.6410, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7326 => 0.7717, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (0.4615 => 0.4838, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.57% (10.4361 => 10.9128, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.7433 => 0.7756, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.35% (7.0540 => 7.3605, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 4.05% (0.3282 => 0.3415, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (9.4845 => 9.8565, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5569 => 0.5785, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.82% (0.8172 => 0.8484, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (5.0018 => 5.1840, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.9449 => 5.1247, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (4.2646 => 4.4165, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: 3.51% (0.7835 => 0.8110, std. dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.21% (8.1363 => 8.3978, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.04% (1.3050 => 1.3447, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.84% (5.7591 => 5.9228, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.1861 => 1.2189, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.8067 => 0.8290, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 2.73% (2.0273 => 2.0827, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.66% (1.5415 => 1.5825, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.64% (0.3865 => 0.3967, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.61% (1.5603 => 1.6011, std. dev.: 0.0085) MultiSource/Applications/d/make_dparser: 2.56% (3.3354 => 3.4209, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.55% (0.9765 => 1.0014, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.54% (3.8723 => 3.9705, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.52% (0.4636 => 0.4753, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5859 => 1.6254, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.46% (0.6456 => 0.6615, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1162, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.27% (0.5105 => 0.5221, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.21% (17.1811 => 17.5600, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2842 => 1.3107, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.04% (0.6675 => 0.6811, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.4186 => 1.4475, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.00% (2.2969 => 2.3429, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6450 => 0.6575, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8921 => 0.9093, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.2024 => 2.2439, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.82% (0.5981 => 0.6090, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.60% (14.3668 => 14.5961, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 1.30% (1.1840 => 1.1994, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.15% (1.0722 => 1.0845, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.18% (1.1145 => 1.1945, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (4.2280 => 4.4520, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7553, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.48% (26.0924 => 26.7402, std. dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/hash2: 1.96% (3.1578 => 3.2197, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.89% (2.1825 => 2.2237, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.69% (3.2827 => 3.3381, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.37% (1.1396 => 1.1552, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 1.34% (2.2771 => 2.3075, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7742, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6821, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1634, std. dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.65% (5.3855 => 3.6811, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.33% (5.3526 => 3.6754, std. dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0255, std. dev.: 0.0516) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.53% (2.9384 => 2.5408, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: -12.18% (22.1758 => 19.4746, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2373 => 1.1092, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -7.17% (1.5373 => 1.4270, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.99% (1.5835 => 1.5045, std. dev.: 0.0029) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7976, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8653, std. dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.26% (32.5116 => 31.4530, std. dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9050, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.6802 => 8.4368, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0020, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -1.96% (3.1595 => 3.0976, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4168, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3457, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.50% (1.6805 => 1.6553, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.25% (1.4460 => 1.4279, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 06:36:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 08:36:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810133646.27D242A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2789?compare_to=2787&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2789, Order: 161660, Start Time: 2012-08-10 12:23:24, End Time: 2012-08-10 13:37:25 To: 2787, Order: 161656, Start Time: 2012-08-10 10:41:26, End Time: 2012-08-10 11:55:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (149 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.09% (2.0176 => 2.3019, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.94% (0.5818 => 0.6338, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.63% (0.5748 => 0.6244, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.04% (1.3693 => 1.4794, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.00% (0.7061 => 0.7626, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.52% (0.7038 => 0.7567, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.2781 => 0.2990, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.37% (0.4328 => 0.4647, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.26% (0.5265 => 0.5647, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.7710 => 0.8263, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.4062 => 0.4353, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.2937 => 0.3142, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 6.93% (0.3578 => 0.3826, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (3.9660 => 4.2408, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3646 => 0.3896, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.85% (0.3022 => 0.3229, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3489 => 0.3726, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.76% (0.3789 => 0.4045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 6.74% (0.3663 => 0.3910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.67% (0.3914 => 0.4175, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.3107 => 0.3312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.60% (0.3623 => 0.3862, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.58% (0.3650 => 0.3890, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.55% (1.9828 => 2.1126, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 6.55% (0.4003 => 0.4265, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.51% (0.4390 => 0.4676, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.40% (0.3580 => 0.3809, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.39% (0.6959 => 0.7404, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 6.35% (0.3940 => 0.4190, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.22% (0.2988 => 0.3174, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3453 => 0.3666, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.4016 => 0.4247, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.9199 => 0.9727, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 5.74% (0.3293 => 0.3482, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.66% (0.3534 => 0.3734, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (0.3756 => 0.3968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.58% (1.2193 => 1.2873, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.50% (0.5577 => 0.5884, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.36% (0.3246 => 0.3420, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.22% (1.2292 => 1.2934, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.17% (13.8202 => 14.5342, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.07% (0.5637 => 0.5923, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.06% (1.4563 => 1.5300, std. dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.81% (1.1364 => 1.1911, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (3.8646 => 4.0500, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.68% (0.8310 => 0.8699, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.3819 => 1.4457, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.58% (0.3755 => 0.3927, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.54% (0.7506 => 0.7847, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 4.54% (1.9270 => 2.0144, std. dev.: 0.0098) MultiSource/Applications/Burg/burg: 4.52% (1.1061 => 1.1561, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (1.3245 => 1.3842, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.48% (7.2180 => 7.5413, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.45% (1.3813 => 1.4427, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.33% (1.0594 => 1.1053, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 4.21% (16.6129 => 17.3127, std. dev.: 0.0091) MultiSource/Applications/siod/siod: 4.19% (2.1791 => 2.2703, std. dev.: 0.0159) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.3801 => 4.5552, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.4433 => 4.6151, std. dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.9865 => 5.1785, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.78% (3.6692 => 3.8080, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.8698 => 0.9010, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.47% (0.6283 => 0.6501, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1333 => 1.1707, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (13.2842 => 13.7190, std. dev.: 0.0168) MultiSource/Applications/sqlite3/sqlite3: 3.26% (16.2614 => 16.7923, std. dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2883, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 2.97% (8.4961 => 8.7482, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (3.2742 => 3.3682, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.75% (0.4113 => 0.4226, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2579, std. dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.5754 => 6.7523, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5188 => 1.5590, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.5298 => 14.9083, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (2.1007 => 2.1532, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6250 => 0.6396, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.33% (4.6629 => 4.7717, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.62% (1.0313 => 1.0480, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.9108 => 0.9241, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.34% (33.2944 => 33.7415, std. dev.: 0.0196) MultiSource/Applications/lua/lua: 1.33% (3.7467 => 3.7965, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.95% (0.4846 => 0.6976, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2670, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.66% (1.2998 => 1.3994, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 3.93% (1.1560 => 1.2014, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6798, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 3.48% (7.4271 => 7.6854, std. dev.: 0.0094) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8302, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.06% (1.9199 => 1.9786, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2235, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.08% (3.2729 => 3.3409, std. dev.: 0.0229) MultiSource/Applications/SPASS/SPASS: 2.04% (10.7476 => 10.9664, std. dev.: 0.0658) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.62% (26.5159 => 26.9460, std. dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5067, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5089 => 1.5296, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.17% (3.6469 => 3.6895, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.22% (0.4657 => 0.3995, std. dev.: 0.0116) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.96% (22.5627 => 21.2186, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.12% (1.2308 => 1.1062, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.97% (1.0460 => 0.9522, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7961, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3180, std. dev.: 0.0124) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -3.15% (3.1476 => 3.0486, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.62% (1.9762 => 1.9244, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5988, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.35% (20.3410 => 19.8627, std. dev.: 0.0841) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2253, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7644, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.40% (3.0263 => 2.9840, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2101, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2344, std. dev.: 0.0220) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.16% (84.4286 => 83.4454, std. dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 06:46:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 08:46:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810134618.487EE2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2790?compare_to=2788&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2790, Order: 161660, Start Time: 2012-08-10 12:28:24, End Time: 2012-08-10 13:46:58 To: 2788, Order: 161656, Start Time: 2012-08-10 10:41:29, End Time: 2012-08-10 12:00:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (88 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (749 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.74% (55.0942 => 56.6013, std. dev.: 0.0540) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.48% (10.3673 => 14.1488, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.58% (1.1194 => 1.2490, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.54% (0.3817 => 0.4143, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.47% (1.7609 => 1.8925, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.25% (2.2022 => 2.3618, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.6030 => 0.6418, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.34% (0.7326 => 0.7717, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.60% (10.4361 => 10.9160, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.7433 => 0.7756, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.31% (7.0540 => 7.3578, std. dev.: 0.0239) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.96% (0.8172 => 0.8496, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 3.93% (9.4845 => 9.8577, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.5569 => 0.5779, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.65% (4.9449 => 5.1252, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (5.0018 => 5.1790, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (4.2646 => 4.4149, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.36% (0.7835 => 0.8098, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.20% (8.1363 => 8.3965, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.3423 => 0.3531, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.05% (1.3050 => 1.3448, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.4103 => 0.4224, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.90% (1.5603 => 1.6056, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.83% (5.7591 => 5.9218, std. dev.: 0.0133) MultiSource/Applications/Burg/burg: 2.80% (1.1642 => 1.1968, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 2.80% (2.0273 => 2.0840, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.73% (1.1861 => 1.2185, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.66% (2.0665 => 2.1214, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.61% (0.3826 => 0.3926, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.61% (3.3354 => 3.4225, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (0.9765 => 1.0015, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.51% (1.5415 => 1.5802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.6456 => 0.6608, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5105 => 0.5223, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (0.4620 => 0.4726, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9597, std. dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: 2.19% (17.1811 => 17.5579, std. dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3111, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.07% (2.2969 => 2.3444, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6450 => 0.6582, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4453, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.2024 => 2.2434, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 1.86% (0.8921 => 0.9087, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (14.3668 => 14.6010, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.45% (0.7115 => 0.7218, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1992, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.06% (1.0722 => 1.0836, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.1145 => 1.1964, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (4.2280 => 4.4454, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7565, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 2.39% (26.0924 => 26.7163, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1578 => 3.2174, std. dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.88% (2.1825 => 2.2235, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.67% (3.2827 => 3.3376, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 1.40% (1.1396 => 1.1556, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (1.5086 => 1.5282, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7743, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5771, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.11% (5.2763 => 3.1602, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.60% (5.3855 => 3.6838, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6748, std. dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -15.11% (54.1659 => 45.9789, std. dev.: 0.0451) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5438, std. dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: -12.14% (22.1758 => 19.4846, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.84% (1.2373 => 1.1032, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel-2: -7.38% (1.5373 => 1.4238, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7972, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.81% (1.9577 => 1.8635, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4649, std. dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4096, std. dev.: 0.0266) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (8.1563 => 7.9127, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9852, std. dev.: 0.0274) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -1.97% (3.1595 => 3.0971, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (12.5348 => 12.3328, std. dev.: 0.0092) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4167, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.50% (1.6805 => 1.6553, std. dev.: 0.0033) MultiSource/Applications/lemon/lemon: -1.13% (1.4460 => 1.4296, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 06:56:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 08:56:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120810135649.891092A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2791?compare_to=2786&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2791, Order: 161656, Start Time: 2012-08-10 11:14:16, End Time: 2012-08-10 13:57:28 To: 2786, Order: 161655, Start Time: 2012-08-10 08:03:08, End Time: 2012-08-10 10:46:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (781 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3465 => 0.3869, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3446 => 0.3845, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3496 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.48% (0.3442 => 0.3837, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-3: 11.47% (0.3460 => 0.3857, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.47% (0.3488 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.36% (0.3469 => 0.3863, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3643 => 0.4052, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.04% (0.3650 => 0.4053, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.74% (0.3724 => 0.4124, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5826 => 0.6200, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.20% (0.5889 => 0.6254, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.19% (1.5932 => 1.6918, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (1.6211 => 1.7109, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (0.4361 => 0.4589, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.17% (1.3152 => 1.3832, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.16% (3.5627 => 3.7466, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.90% (0.5900 => 0.6189, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.84% (0.7171 => 0.7518, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (0.3930 => 0.4115, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (0.4994 => 0.5226, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.64% (4.2109 => 4.4061, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (0.5000 => 0.5226, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.48% (0.5026 => 0.5251, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: 4.44% (0.4029 => 0.4208, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.42% (1.0781 => 1.1257, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.89% (2.1013 => 2.1831, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.83% (0.2875 => 0.2985, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.75% (0.3890 => 0.4036, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.67% (0.4658 => 0.4829, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 3.66% (0.3004 => 0.3114, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.66% (5.5417 => 5.7444, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 3.63% (0.9909 => 1.0269, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.58% (2.7292 => 2.8269, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (1.9694 => 2.0393, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (0.3195 => 0.3308, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.48% (2.0673 => 2.1393, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.47% (4.6177 => 4.7779, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wc: 3.39% (0.3096 => 0.3201, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (4.4195 => 4.5691, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (1.9966 => 2.0641, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3317 => 0.3429, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.34% (2.1653 => 2.2377, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3267 => 0.3376, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.33% (0.3060 => 0.3162, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.26% (0.3348 => 0.3457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3258 => 0.3363, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.20% (0.3124 => 0.3224, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (1.8794 => 1.9394, std. dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 3.15% (23.5202 => 24.2606, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.14% (0.3625 => 0.3739, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3726 => 0.3843, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.14% (0.3282 => 0.3385, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.3903 => 0.4024, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.03% (0.3362 => 0.3464, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3678 => 0.3789, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.95% (0.9697 => 0.9983, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.91% (0.7875 => 0.8104, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.85% (1.4269 => 1.4675, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.4139 => 0.4256, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.82% (0.6634 => 0.6821, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.80% (0.4251 => 0.4370, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4146 => 0.4261, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.3981 => 0.4084, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.56% (0.5546 => 0.5688, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.6435 => 0.6584, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.5012 => 0.5128, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.94% (2.0346 => 2.0741, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.74% (0.2122 => 0.2265, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6673, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1707, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6470, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (105.3826 => 107.6133, std. dev.: 0.0784) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1917, std. dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (41.7953 => 42.6098, std. dev.: 0.0182) MultiSource/Applications/lua/lua: 1.73% (50.0626 => 50.9304, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5931, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2256, std. dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3058, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.17% (2.4764 => 2.3978, std. dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: -1.06% (11.9555 => 11.8292, std. dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5338, std. dev.: 0.0334) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: -6.79% (0.2402 => 0.2239, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std. dev.: 0.0101) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7763, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7645, std. dev.: 0.0991) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.54% (0.6293 => 0.6133, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9580, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 08:56:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 10:56:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810155641.EFB052A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2792?compare_to=2789&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2792, Order: 161663, Start Time: 2012-08-10 14:43:23, End Time: 2012-08-10 15:57:21 To: 2789, Order: 161660, Start Time: 2012-08-10 12:23:24, End Time: 2012-08-10 13:37:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (149 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.00% (54.8492 => 56.4944, std. dev.: 0.0811) SingleSource/Benchmarks/Misc/mandel-2: 1.73% (1.3994 => 1.4236, std. dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.99% (2.0176 => 2.2999, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5818 => 0.6330, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.59% (0.5748 => 0.6242, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7061 => 0.7620, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.75% (1.3693 => 1.4754, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.60% (0.7038 => 0.7573, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2781 => 0.2988, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4328 => 0.4649, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.7710 => 0.8274, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.4062 => 0.4353, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.12% (0.5265 => 0.5640, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.00% (3.9660 => 4.2437, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.88% (0.3578 => 0.3824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.77% (0.3899 => 0.4163, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3601 => 0.3844, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.72% (0.3646 => 0.3891, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 6.69% (0.3663 => 0.3908, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3489 => 0.3722, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.62% (0.3789 => 0.4040, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.62% (0.3914 => 0.4173, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 6.60% (0.3623 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.58% (0.3650 => 0.3890, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.54% (1.9828 => 2.1124, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 6.52% (0.4003 => 0.4264, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3107 => 0.3309, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2761 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.42% (0.4390 => 0.4672, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.40% (0.3580 => 0.3809, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.37% (0.3940 => 0.4191, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.31% (0.3485 => 0.3705, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.22% (0.2988 => 0.3174, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.15% (0.6959 => 0.7387, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.11% (0.3453 => 0.3664, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.77% (1.2193 => 1.2896, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.76% (0.9199 => 0.9729, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.73% (0.4016 => 0.4246, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.70% (0.2914 => 0.3080, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 5.60% (0.3534 => 0.3732, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3246 => 0.3427, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.3756 => 0.3965, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.3868 => 0.4082, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.42% (0.5577 => 0.5879, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 5.23% (13.8202 => 14.5425, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 5.08% (1.2292 => 1.2917, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.92% (1.4563 => 1.5279, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.89% (3.8646 => 4.0536, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.85% (1.1364 => 1.1915, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.77% (0.8310 => 0.8706, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.74% (0.5637 => 0.5904, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.65% (0.7506 => 0.7855, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3855, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.60% (1.1061 => 1.1570, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3755 => 0.3926, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (7.2180 => 7.5460, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.51% (1.3819 => 1.4442, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4434, std. dev.: 0.0025) MultiSource/Applications/treecc/treecc: 4.49% (1.9270 => 2.0136, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 4.47% (0.2995 => 0.3129, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.44% (0.7460 => 0.7791, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 4.36% (2.1791 => 2.2742, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.22% (1.0594 => 1.1041, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.09% (16.6129 => 17.2928, std. dev.: 0.0170) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.99% (4.9865 => 5.1853, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6185, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.4791 => 0.4979, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5493, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.78% (3.6692 => 3.8079, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.71% (0.8698 => 0.9021, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (13.2842 => 13.7310, std. dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.32% (1.1333 => 1.1709, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.29% (0.6135 => 0.6337, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7852, std. dev.: 0.0139) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (8.4961 => 8.7647, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2879, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.89% (3.2742 => 3.3687, std. dev.: 0.0134) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7603, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9251, std. dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 2.67% (14.8535 => 15.2508, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5188 => 1.5594, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (2.1007 => 2.1530, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.42% (4.6629 => 4.7757, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6250 => 0.6393, std. dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.75% (1.0313 => 1.0493, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.9108 => 0.9256, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.33% (3.7467 => 3.7965, std. dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 1.29% (33.2944 => 33.7254, std. dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 25.88% (1.8175 => 2.2878, std. dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.52% (1.2998 => 1.4236, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.92% (1.5824 => 1.6603, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 3.88% (1.1560 => 1.2009, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.87% (1.9144 => 1.9884, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6788, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.47% (1.7688 => 1.8301, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.35% (7.4271 => 7.6760, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.23% (2.1753 => 2.2238, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.22% (10.7476 => 10.9860, std. dev.: 0.0473) MultiSource/Applications/siod/siod: 1.99% (3.2729 => 3.3379, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.65% (26.5159 => 26.9546, std. dev.: 0.0209) SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (1.9290 => 1.9588, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5067, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6860, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.18% (0.4657 => 0.4043, std. dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.94% (22.5627 => 21.2221, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1069, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.96% (1.0460 => 0.9523, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.57% (1.3780 => 1.3150, std. dev.: 0.0135) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7963, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.15% (3.1476 => 3.0485, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.58% (1.9762 => 1.9253, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6030, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2358, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7651, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.54% (20.3410 => 20.0270, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0081, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2309, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: -1.33% (3.0263 => 2.9862, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7924, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2214, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4439, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 09:01:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 11:01:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810160106.694912A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2793?compare_to=2790&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2793, Order: 161663, Start Time: 2012-08-10 14:43:19, End Time: 2012-08-10 16:01:46 To: 2790, Order: 161660, Start Time: 2012-08-10 12:28:24, End Time: 2012-08-10 13:46:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (90 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (748 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.45% (10.3673 => 14.1463, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2492, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.46% (1.7609 => 1.8923, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.23% (2.2022 => 2.3615, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.38% (0.5925 => 0.6303, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.6030 => 0.6411, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.74% (0.3817 => 0.4036, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.81% (0.4615 => 0.4837, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.73% (0.4879 => 0.5110, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.59% (10.4361 => 10.9155, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (7.0540 => 7.3589, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (0.7433 => 0.7754, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.05% (0.3282 => 0.3415, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.81% (9.4845 => 9.8456, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.74% (0.8172 => 0.8478, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.70% (4.9449 => 5.1279, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (5.0018 => 5.1791, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (4.2646 => 4.4141, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.15% (0.7835 => 0.8082, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.1363 => 8.3883, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3437, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.85% (0.4103 => 0.4220, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.80% (5.7591 => 5.9202, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (1.1861 => 1.2184, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.70% (2.0273 => 2.0821, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 2.69% (1.1642 => 1.1955, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6008, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.59% (3.3354 => 3.4218, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.58% (0.9765 => 1.0017, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.57% (0.4636 => 0.4755, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.4289 => 0.4398, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.48% (1.5415 => 1.5797, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.41% (1.5859 => 1.6241, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6456 => 0.6609, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (2.0665 => 2.1149, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9599, std. dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 2.12% (17.1811 => 17.5457, std. dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.07% (0.6675 => 0.6813, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.03% (1.2842 => 1.3103, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.03% (0.6450 => 0.6581, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4453, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.87% (2.2969 => 2.3398, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.85% (2.2024 => 2.2432, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 1.75% (0.8921 => 0.9077, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.58% (14.3668 => 14.5932, std. dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1991, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.34% (1.1145 => 1.1963, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (4.2280 => 4.4385, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7475, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.44% (26.0924 => 26.7289, std. dev.: 0.0211) SingleSource/Benchmarks/McGill/queens: 1.88% (2.1825 => 2.2236, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.85% (3.2827 => 3.3434, std. dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2151, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.49% (1.3045 => 1.3239, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: 1.38% (1.1396 => 1.1553, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (1.5086 => 1.5290, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7737, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6826, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1606, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.64% (5.3855 => 3.6817, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.33% (5.3526 => 3.6757, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0037, std. dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.52% (2.9384 => 2.5412, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -12.22% (22.1758 => 19.4666, std. dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2373 => 1.1000, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -8.25% (1.5373 => 1.4105, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7971, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -4.57% (1.9577 => 1.8683, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4685, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (8.1563 => 7.8969, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4216, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0001, std. dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -1.98% (3.1595 => 3.0970, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.54% (1.6805 => 1.6547, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4176, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (12.5348 => 12.3444, std. dev.: 0.0073) MultiSource/Applications/lemon/lemon: -1.15% (1.4460 => 1.4294, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 10:07:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 12:07:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120810170751.9576B2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2794?compare_to=2791&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2794, Order: 161660, Start Time: 2012-08-10 14:25:21, End Time: 2012-08-10 17:08:32 To: 2791, Order: 161656, Start Time: 2012-08-10 11:14:16, End Time: 2012-08-10 13:57:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (781 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.14% (54.0865 => 54.7048, std. dev.: 0.1205) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3465 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3446 => 0.3846, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.50% (0.3469 => 0.3868, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.50% (0.3496 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.42% (0.3442 => 0.3835, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.30% (0.3460 => 0.3851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.30% (0.3488 => 0.3882, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.20% (0.3643 => 0.4051, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.07% (0.3650 => 0.4054, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.79% (0.3724 => 0.4126, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5826 => 0.6200, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.23% (0.5889 => 0.6256, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.18% (1.5932 => 1.6916, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.40% (1.6211 => 1.7087, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.20% (3.5627 => 3.7479, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.06% (1.3152 => 1.3818, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (0.5026 => 0.5276, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7171 => 0.7522, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (0.3930 => 0.4115, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.71% (0.4994 => 0.5229, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.66% (0.5900 => 0.6175, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.63% (4.2109 => 4.4060, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (0.5000 => 0.5228, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 4.39% (1.0781 => 1.1254, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.37% (0.4029 => 0.4205, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.2736 => 0.2844, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.93% (0.2875 => 0.2988, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.2866 => 0.2977, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.79% (0.9909 => 1.0285, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.67% (0.4658 => 0.4829, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.65% (5.5417 => 5.7442, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.62% (0.3890 => 0.4031, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (2.7292 => 2.8278, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0670, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (1.9694 => 2.0384, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.50% (2.1013 => 2.1749, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.48% (4.6177 => 4.7785, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.45% (2.0673 => 2.1386, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.43% (0.3060 => 0.3165, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (4.4195 => 4.5691, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.34% (2.1653 => 2.2377, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 3.33% (0.3096 => 0.3199, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3317 => 0.3426, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.29% (0.3348 => 0.3458, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3267 => 0.3374, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.23% (0.3124 => 0.3225, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.3903 => 0.4028, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.19% (0.3258 => 0.3362, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.14% (0.3282 => 0.3385, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 3.08% (23.5202 => 24.2442, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/moments: 3.07% (0.3678 => 0.3791, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (0.3625 => 0.3735, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3726 => 0.3839, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.02% (0.9697 => 0.9990, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (1.8794 => 1.9359, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.93% (0.7875 => 0.8106, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.88% (0.6634 => 0.6825, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3690 => 0.3794, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4146 => 0.4262, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 2.76% (1.4269 => 1.4663, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4251 => 0.4368, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.74% (0.3981 => 0.4090, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.63% (0.4139 => 0.4248, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.6435 => 0.6590, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.34% (0.5546 => 0.5676, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.23% (0.5012 => 0.5124, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.95% (2.0346 => 2.0742, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 9.10% (0.2122 => 0.2315, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6129, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8937, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6268, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6711, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2052, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (41.7953 => 42.6383, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.71% (50.0626 => 50.9197, std. dev.: 0.0195) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std. dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3071, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.60% (2.4764 => 2.3872, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5858, std. dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -7.66% (0.2402 => 0.2218, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std. dev.: 0.0074) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.67% (0.6293 => 0.6125, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7942, std. dev.: 0.0572) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5725, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (16.2163 => 15.9541, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4965, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 10:39:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 12:39:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810173902.A030F2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2795?compare_to=2792&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2795, Order: 161664, Start Time: 2012-08-10 16:25:35, End Time: 2012-08-10 17:39:41 To: 2792, Order: 161663, Start Time: 2012-08-10 14:43:23, End Time: 2012-08-10 15:57:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.02% (2.0176 => 2.3005, std. dev.: 0.0472) SingleSource/UnitTests/ObjC++/property-reference: 8.95% (0.7061 => 0.7693, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.90% (0.5818 => 0.6336, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5748 => 0.6240, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4062 => 0.4382, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.68% (1.3693 => 1.4745, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.67% (0.3130 => 0.3370, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.41% (0.2781 => 0.2987, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4328 => 0.4645, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.19% (0.7038 => 0.7544, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2655 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.01% (3.9660 => 4.2439, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.88% (0.3578 => 0.3824, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 6.83% (0.3646 => 0.3895, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3663 => 0.3913, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.76% (0.3789 => 0.4045, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.74% (0.2760 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.70% (0.3580 => 0.3820, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 6.69% (0.3601 => 0.3842, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.68% (0.3022 => 0.3224, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.68% (0.2966 => 0.3164, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 6.67% (0.3914 => 0.4175, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.59% (0.3899 => 0.4156, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.55% (0.3650 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.51% (0.3623 => 0.3859, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3107 => 0.3309, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.50% (1.9828 => 2.1117, std. dev.: 0.0301) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.4003 => 0.4262, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.45% (0.3489 => 0.3714, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2761 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2988 => 0.3180, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.31% (0.3485 => 0.3705, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.24% (0.3940 => 0.4186, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.05% (0.3453 => 0.3662, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.6959 => 0.7380, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.88% (0.4390 => 0.4648, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.77% (0.3293 => 0.3483, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.63% (0.9199 => 0.9717, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (1.2193 => 1.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.3756 => 0.3965, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.5577 => 0.5885, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.52% (0.3534 => 0.3729, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.48% (0.3868 => 0.4080, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.39% (0.3246 => 0.3421, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5334, std. dev.: 0.0131) MultiSource/Applications/hexxagon/hexxagon: 5.04% (1.2292 => 1.2911, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (1.4563 => 1.5268, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.84% (3.8646 => 4.0515, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.74% (1.1364 => 1.1903, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.73% (0.7506 => 0.7861, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.70% (0.2127 => 0.2227, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.66% (0.8310 => 0.8697, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (1.3813 => 1.4443, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 4.56% (1.1061 => 1.1565, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3755 => 0.3926, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.49% (7.2180 => 7.5420, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3835, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.3819 => 1.4430, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.7460 => 0.7788, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0115, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0594 => 1.1039, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.13% (2.1791 => 2.2692, std. dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 4.05% (16.6129 => 17.2857, std. dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.95% (4.9865 => 5.1837, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (3.6692 => 3.8129, std. dev.: 0.0127) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6145, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.3801 => 4.5466, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.74% (0.8698 => 0.9023, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.31% (13.2842 => 13.7234, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.28% (0.6283 => 0.6489, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1333 => 1.1701, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7855, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.16% (0.6135 => 0.6329, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.14% (3.1889 => 3.2890, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.05% (8.4961 => 8.7551, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7642, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.85% (3.2742 => 3.3674, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4113 => 0.4224, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2450, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (1.5188 => 1.5586, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9045, std. dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.6250 => 0.6402, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.1007 => 2.1512, std. dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 2.38% (4.6629 => 4.7739, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.63% (1.0313 => 1.0481, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.57% (0.9108 => 0.9251, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.30% (33.2944 => 33.7256, std. dev.: 0.0062) MultiSource/Applications/lua/lua: 1.23% (3.7467 => 3.7926, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5129, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std. dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.26% (1.2998 => 1.4332, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.91% (1.5824 => 1.6601, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 3.83% (1.1560 => 1.2003, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6792, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.55% (1.7688 => 1.8316, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.44% (7.4271 => 7.6823, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9763, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2235, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.13% (10.7476 => 10.9768, std. dev.: 0.0347) MultiSource/Applications/siod/siod: 2.00% (3.2729 => 3.3384, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.61% (26.5159 => 26.9431, std. dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (1.5089 => 1.5308, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5094, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1857, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.14% (1.0310 => 1.0428, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.96% (22.5627 => 21.2189, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2308 => 1.1069, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.97% (1.0460 => 0.9522, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.41% (5.0168 => 4.7958, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.11% (3.1476 => 3.0496, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5898, std. dev.: 0.0148) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9248, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2190, std. dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.70% (20.3410 => 19.9945, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7635, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0084, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.42% (3.0263 => 2.9834, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2330, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.27% (9.9194 => 9.7930, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4450, std. dev.: 0.0709) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2294, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 10:47:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 12:47:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810174743.E254C2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2796?compare_to=2793&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2796, Order: 161664, Start Time: 2012-08-10 16:29:59, End Time: 2012-08-10 17:48:23 To: 2793, Order: 161663, Start Time: 2012-08-10 14:43:19, End Time: 2012-08-10 16:01:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (87 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (752 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.20% (56.5414 => 54.7320, std. dev.: 0.6224) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.51% (10.3673 => 14.1528, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.59% (1.1194 => 1.2491, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3497 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.23% (0.3543 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3516 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.47% (1.7609 => 1.8925, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.31% (2.2022 => 2.3631, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.35% (0.5925 => 0.6301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.6030 => 0.6412, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.3177 => 0.3361, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.4615 => 0.4839, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.55% (0.7433 => 0.7771, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.54% (10.4361 => 10.9095, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.34% (7.0540 => 7.3604, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.17% (0.8172 => 0.8513, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 4.08% (0.3282 => 0.3416, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (9.4845 => 9.8491, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (4.9449 => 5.1274, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (5.0018 => 5.1833, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (4.2646 => 4.4130, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 3.23% (0.7835 => 0.8088, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.17% (0.8067 => 0.8323, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3923, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.03% (1.3050 => 1.3446, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.86% (5.7591 => 5.9237, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.1861 => 1.2190, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.77% (1.1642 => 1.1964, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.69% (2.0273 => 2.0819, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5415 => 1.5820, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.58% (0.4620 => 0.4739, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.55% (3.3354 => 3.4206, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.51% (1.5603 => 1.5994, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.49% (2.0665 => 2.1180, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.48% (0.9765 => 1.0007, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.47% (0.6450 => 0.6609, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.44% (0.4636 => 0.4749, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5859 => 1.6242, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.5105 => 0.5220, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.24% (3.8723 => 3.9590, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.12% (17.1811 => 17.5448, std. dev.: 0.0186) MultiSource/Applications/hexxagon/hexxagon: 2.01% (1.2842 => 1.3100, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.01% (0.6675 => 0.6809, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4463, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.94% (2.2969 => 2.3415, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 1.92% (0.8921 => 0.9092, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (2.2024 => 2.2444, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5981 => 0.6091, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.58% (14.3668 => 14.5936, std. dev.: 0.0244) MultiSource/Applications/minisat/minisat: 1.46% (0.7115 => 0.7219, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.30% (1.1840 => 1.1994, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.07% (1.0722 => 1.0837, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.36% (1.1145 => 1.1965, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.68% (4.2280 => 4.4260, std. dev.: 0.0201) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7496, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 2.42% (26.0924 => 26.7226, std. dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2195, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.88% (2.1825 => 2.2236, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.60% (3.2827 => 3.3352, std. dev.: 0.0157) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5086 => 1.5306, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: 1.37% (1.1396 => 1.1552, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7746, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.07% (5.2763 => 3.1623, std. dev.: 0.0153) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.64% (5.3855 => 3.6813, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6744, std. dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -15.06% (54.1659 => 46.0107, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.46% (2.9384 => 2.5429, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: -12.20% (22.1758 => 19.4702, std. dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.95% (1.2373 => 1.1142, std. dev.: 0.0254) SingleSource/Benchmarks/Misc/mandel-2: -8.57% (1.5373 => 1.4056, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7974, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.58% (1.9577 => 1.8680, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6146, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4699, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9047, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4312, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9898, std. dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -1.97% (3.1595 => 3.0971, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (12.5348 => 12.3333, std. dev.: 0.0087) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4174, std. dev.: 0.0068) MultiSource/Applications/lemon/lemon: -1.21% (1.4460 => 1.4285, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 12:21:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 14:21:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810192129.445162A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2797?compare_to=2795&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2797, Order: 161668, Start Time: 2012-08-10 18:08:06, End Time: 2012-08-10 19:22:07 To: 2795, Order: 161664, Start Time: 2012-08-10 16:25:35, End Time: 2012-08-10 17:39:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.3113 => 1.3255, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.39% (3.8529 => 3.7609, std. dev.: 0.0300) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.04% (2.0176 => 2.3008, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.5818 => 0.6325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.62% (0.7061 => 0.7670, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.37% (0.5748 => 0.6229, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 7.76% (1.3693 => 1.4755, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.66% (0.4062 => 0.4373, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4328 => 0.4649, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2781 => 0.2984, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2782 => 0.2983, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.7710 => 0.8266, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.20% (0.7038 => 0.7545, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5265 => 0.5637, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.00% (3.9660 => 4.2435, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.76% (0.3578 => 0.3820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.74% (0.2937 => 0.3135, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.72% (0.3601 => 0.3843, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.69% (0.3914 => 0.4176, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 6.66% (0.3646 => 0.3889, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.64% (0.2966 => 0.3163, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 6.62% (0.3789 => 0.4040, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2765 => 0.2948, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3623 => 0.3861, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.55% (0.3022 => 0.3220, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (1.9828 => 2.1122, std. dev.: 0.0110) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 6.50% (0.4003 => 0.4263, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.49% (0.2726 => 0.2903, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.45% (0.3489 => 0.3714, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3107 => 0.3305, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.35% (0.3940 => 0.4190, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.26% (0.3485 => 0.3703, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.23% (0.3453 => 0.3668, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.20% (0.4390 => 0.4662, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.08% (0.3192 => 0.3386, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.06% (0.2988 => 0.3169, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.6959 => 0.7370, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.5577 => 0.5901, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.80% (0.9199 => 0.9733, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.80% (0.4016 => 0.4249, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.72% (1.2193 => 1.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.62% (0.3293 => 0.3478, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.52% (0.3534 => 0.3729, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.48% (0.3246 => 0.3424, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.19% (13.8202 => 14.5371, std. dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2945 => 0.3093, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.94% (1.4563 => 1.5283, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2292 => 1.2896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.5637 => 0.5911, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.81% (1.1364 => 1.1911, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.79% (0.8310 => 0.8708, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.76% (3.8646 => 4.0487, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.60% (1.1061 => 1.1570, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.58% (1.3245 => 1.3851, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.47% (7.2180 => 7.5406, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7460 => 0.7793, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.44% (1.9270 => 2.0125, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4417, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.37% (0.3755 => 0.3919, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4417, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1048, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.18% (2.1791 => 2.2701, std. dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 4.06% (16.6129 => 17.2869, std. dev.: 0.0179) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.98% (4.9865 => 5.1851, std. dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6150, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (3.6692 => 3.8105, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.3801 => 4.5469, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.62% (0.8698 => 0.9013, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.1333 => 1.1704, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.26% (0.6135 => 0.6335, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (13.2842 => 13.7172, std. dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7852, std. dev.: 0.0140) MultiSource/Applications/d/make_dparser: 3.15% (3.1889 => 3.2894, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.90% (8.4961 => 8.7428, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.88% (3.2742 => 3.3686, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (6.5754 => 6.7573, std. dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 2.70% (14.8535 => 15.2544, std. dev.: 0.0210) MultiSource/Applications/ClamAV/clamscan: 2.69% (14.5298 => 14.9202, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5188 => 1.5584, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.1007 => 2.1500, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.34% (4.6629 => 4.7721, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.27% (0.6250 => 0.6392, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.65% (1.0313 => 1.0483, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.65% (0.6744 => 0.6855, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.47% (0.9108 => 0.9242, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.21% (33.2944 => 33.6959, std. dev.: 0.0121) MultiSource/Applications/lua/lua: 1.17% (3.7467 => 3.7904, std. dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5213, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2632, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 8.42% (1.2998 => 1.4092, std. dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.92% (1.5824 => 1.6602, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 3.88% (1.1560 => 1.2009, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6797, std. dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8306, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.37% (7.4271 => 7.6774, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-6: 2.98% (1.9199 => 1.9772, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3859, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.28% (10.7476 => 10.9927, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2237, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.98% (3.2729 => 3.3378, std. dev.: 0.0242) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.57% (26.5159 => 26.9326, std. dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5103, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6855, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.98% (22.5627 => 21.2134, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.28% (0.3511 => 0.3396, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.74% (0.0997 => 0.0850, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.50% (1.2308 => 1.1139, std. dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.97% (1.0460 => 0.9522, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.41% (5.0168 => 4.7958, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.81% (1.3780 => 1.3255, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0040) MultiSource/Applications/aha/aha: -3.12% (3.1476 => 3.0495, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9249, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6068, std. dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2338, std. dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.85% (20.3410 => 19.9640, std. dev.: 0.0497) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7646, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2326, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2132, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: -1.28% (3.0263 => 2.9876, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7929, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4417, std. dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 12:34:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 14:34:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810193412.CCD302A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2798?compare_to=2796&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2798, Order: 161668, Start Time: 2012-08-10 18:16:33, End Time: 2012-08-10 19:34:51 To: 2796, Order: 161664, Start Time: 2012-08-10 16:29:59, End Time: 2012-08-10 17:48:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (87 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.71% (54.7320 => 56.2164, std. dev.: 0.1708) SingleSource/Benchmarks/Misc/mandel-2: 1.93% (1.4056 => 1.4327, std. dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.50% (10.3673 => 14.1513, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2492, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.75% (0.3543 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.45% (1.7609 => 1.8921, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.23% (2.2022 => 2.3614, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.38% (0.5925 => 0.6303, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.19% (0.6030 => 0.6403, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7326 => 0.7709, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.81% (0.4615 => 0.4837, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.69% (10.4361 => 10.9255, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.36% (7.0540 => 7.3616, std. dev.: 0.0266) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (0.7433 => 0.7751, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 3.81% (9.4845 => 9.8458, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5569 => 0.5775, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.57% (4.9449 => 5.1213, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (4.2646 => 4.4139, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (5.0018 => 5.1766, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.15% (0.7835 => 0.8082, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.04% (8.1363 => 8.3840, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.3050 => 1.3433, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.81% (5.7591 => 5.9212, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.1861 => 1.2186, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.71% (0.4103 => 0.4214, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4289 => 0.4405, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.64% (0.3865 => 0.3967, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9765 => 1.0019, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 2.60% (2.0273 => 2.0800, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4214, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.55% (1.1642 => 1.1939, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.49% (1.5603 => 1.5991, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.48% (0.4636 => 0.4751, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.47% (1.5415 => 1.5795, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.5105 => 0.5228, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6239, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6456 => 0.6606, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.30% (2.0665 => 2.1140, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.18% (3.8723 => 3.9569, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.14% (17.1811 => 17.5484, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.00% (1.2842 => 1.3099, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.4186 => 1.4455, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6450 => 0.6572, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.85% (2.2024 => 2.2431, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5981 => 0.6091, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.84% (2.2969 => 2.3391, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 1.80% (0.8921 => 0.9082, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.51% (14.3668 => 14.5838, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 1.33% (1.1840 => 1.1998, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.01% (1.0722 => 1.0830, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.1145 => 1.1964, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (4.2280 => 4.4337, std. dev.: 0.0121) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7454, std. dev.: 0.0095) MultiSource/Applications/lua/lua: 2.36% (26.0924 => 26.7070, std. dev.: 0.0151) SingleSource/Benchmarks/McGill/queens: 1.88% (2.1825 => 2.2235, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2162, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5086 => 1.5293, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 1.35% (1.1396 => 1.1550, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 1.26% (2.2771 => 2.3059, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7741, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1595, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.66% (5.3855 => 3.6806, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.39% (5.3526 => 3.6723, std. dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0567, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.57% (2.9384 => 2.5398, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -12.18% (22.1758 => 19.4749, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.00% (1.2373 => 1.1136, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -6.80% (1.5373 => 1.4327, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7974, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -4.51% (1.9577 => 1.8694, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4649, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8979, std. dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4131, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0122, std. dev.: 0.0077) MultiSource/Applications/aha/aha: -1.96% (3.1595 => 3.0977, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.55% (9.5636 => 9.4155, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.53% (1.6805 => 1.6548, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3433, std. dev.: 0.0039) MultiSource/Applications/lemon/lemon: -1.15% (1.4460 => 1.4293, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 13:19:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 15:19:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120810201914.BBD232A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2799?compare_to=2794&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2799, Order: 161668, Start Time: 2012-08-10 17:36:36, End Time: 2012-08-10 20:19:54 To: 2794, Order: 161660, Start Time: 2012-08-10 14:25:21, End Time: 2012-08-10 17:08:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (89 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (789 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 11.59% (0.3442 => 0.3841, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 11.49% (0.3446 => 0.3842, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3465 => 0.3861, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.36% (0.3496 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3488 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.30% (0.3460 => 0.3851, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 11.30% (0.3469 => 0.3861, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.12% (0.3650 => 0.4056, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3643 => 0.4047, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3724 => 0.4125, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.20% (0.5826 => 0.6187, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.03% (1.5932 => 1.6892, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 5.91% (0.5889 => 0.6237, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (0.5026 => 0.5302, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (1.3152 => 1.3870, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.38% (1.6211 => 1.7083, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (0.4361 => 0.4590, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.17% (3.5627 => 3.7469, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.89% (0.4029 => 0.4226, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.67% (4.2109 => 4.4075, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.63% (0.3930 => 0.4112, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.62% (0.7171 => 0.7502, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.61% (0.4994 => 0.5224, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (0.5000 => 0.5220, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.5900 => 0.6158, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.37% (1.0781 => 1.1252, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.2736 => 0.2846, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.87% (0.2866 => 0.2977, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.83% (5.5417 => 5.7541, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.72% (0.2875 => 0.2982, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.70% (0.9909 => 1.0276, std. dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 3.70% (0.3004 => 0.3115, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (2.7292 => 2.8291, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (0.3890 => 0.4030, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 3.54% (4.6177 => 4.7812, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3195 => 0.3304, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (2.1013 => 2.1729, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.41% (1.9694 => 2.0365, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.36% (2.0673 => 2.1367, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.33% (1.9966 => 2.0631, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (4.4195 => 4.5662, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 3.27% (2.1653 => 2.2360, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.3903 => 0.4029, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.17% (0.3348 => 0.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.17% (0.3317 => 0.3422, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.15% (1.8794 => 1.9386, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 3.13% (0.3258 => 0.3360, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.12% (0.3267 => 0.3369, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.03% (0.3362 => 0.3464, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.03% (1.4269 => 1.4701, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.95% (23.5202 => 24.2150, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/sieve: 2.95% (0.3726 => 0.3836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.3678 => 0.3786, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.86% (0.7875 => 0.8100, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.78% (0.9697 => 0.9967, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4146 => 0.4259, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.71% (0.3690 => 0.3790, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4251 => 0.4366, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.3981 => 0.4081, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.46% (0.4139 => 0.4241, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.6435 => 0.6584, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.5012 => 0.5128, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.31% (0.5546 => 0.5674, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.95% (2.0346 => 2.0742, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8937, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1681, std. dev.: 0.0991) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6353, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6809, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1971, std. dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.93% (41.7953 => 42.6024, std. dev.: 0.0273) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5920, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9228, std. dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.50% (3.1722 => 3.2199, std. dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3095, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2799, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.11% (2.4764 => 2.3995, std. dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: -1.09% (11.9555 => 11.8250, std. dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5391, std. dev.: 0.0259) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7879, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7881, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8438, std. dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5688, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9602, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: -1.41% (5.5810 => 5.5022, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 14:03:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 16:03:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810210340.2CDDD2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2800?compare_to=2797&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2800, Order: 161686, Start Time: 2012-08-10 19:50:33, End Time: 2012-08-10 21:04:19 To: 2797, Order: 161668, Start Time: 2012-08-10 18:08:06, End Time: 2012-08-10 19:22:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 3 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.94% (1.4092 => 1.4365, std. dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.21% (2.1122 => 2.0867, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.06% (1.4755 => 1.4598, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.19% (1.1139 => 1.1007, std. dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.94% (2.0176 => 2.2989, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.25% (0.5818 => 0.6298, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7061 => 0.7631, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5748 => 0.6211, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.21% (0.3578 => 0.3836, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.12% (0.7710 => 0.8259, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3914 => 0.4188, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.97% (0.3601 => 0.3852, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.86% (0.3789 => 0.4049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3650 => 0.3900, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.85% (0.7038 => 0.7520, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.84% (3.9660 => 4.2374, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5265 => 0.5625, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.4003 => 0.4276, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.61% (1.3693 => 1.4598, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.60% (0.3940 => 0.4200, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.31% (0.4328 => 0.4601, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.08% (0.2781 => 0.2950, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.92% (0.6959 => 0.7371, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.75% (0.4379 => 0.4631, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.9199 => 0.9727, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.69% (1.2193 => 1.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.53% (0.2765 => 0.2918, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3899 => 0.4111, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.38% (0.2937 => 0.3095, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.31% (0.3580 => 0.3770, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4390 => 0.4621, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.26% (0.3022 => 0.3181, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.24% (1.9828 => 2.0867, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.24% (0.3246 => 0.3416, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.23% (0.2966 => 0.3121, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.18% (0.2761 => 0.2904, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2696 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.02% (0.3485 => 0.3660, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.02% (1.4563 => 1.5294, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.99% (13.8202 => 14.5103, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.95% (0.3453 => 0.3624, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (1.3813 => 1.4492, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.86% (1.3819 => 1.4490, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.81% (1.1364 => 1.1911, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.80% (3.8646 => 4.0501, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 4.78% (0.8310 => 0.8707, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.63% (0.5637 => 0.5898, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.56% (0.7506 => 0.7848, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.48% (1.3245 => 1.3839, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 4.47% (0.3534 => 0.3692, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.44% (7.2180 => 7.5387, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3868 => 0.4035, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.29% (1.9270 => 2.0097, std. dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 4.12% (1.0594 => 1.1031, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.04% (2.1791 => 2.2671, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.01% (0.4791 => 0.4983, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.95% (1.2292 => 1.2778, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (4.4433 => 4.6170, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.3801 => 4.5507, std. dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 3.80% (16.6129 => 17.2447, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.2945 => 0.3056, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (3.6692 => 3.8062, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.70% (4.9865 => 5.1712, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3755 => 0.3887, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (13.2842 => 13.7444, std. dev.: 0.0226) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 3.26% (3.1889 => 3.2927, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1333 => 1.1701, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.23% (0.8698 => 0.8979, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.16% (16.2614 => 16.7748, std. dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 2.98% (4.6629 => 4.8018, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.4961 => 8.7354, std. dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7569, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3642, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9245, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4113 => 0.4222, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.62% (14.8535 => 15.2429, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5188 => 1.5566, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (2.1007 => 2.1488, std. dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.48% (0.6744 => 0.6844, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7861, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 25.46% (1.8175 => 2.2802, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 10.52% (1.2998 => 1.4365, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.19% (1.0895 => 1.1787, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.91% (1.5824 => 1.6601, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 3.86% (1.1560 => 1.2006, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6799, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.46% (1.7688 => 1.8300, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9574, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 3.26% (7.4271 => 7.6692, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9761, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.45% (10.7476 => 11.0107, std. dev.: 0.0392) MultiSource/Applications/hexxagon/hexxagon: 2.40% (12.0921 => 12.3825, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.25% (0.9692 => 0.9910, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2237, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.02% (3.2729 => 3.3389, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5333, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.56% (26.5159 => 26.9308, std. dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std. dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9550, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.19% (1.0310 => 1.0433, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5719, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1643, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.78% (0.6576 => 0.6459, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.94% (0.0997 => 0.0848, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2308 => 1.1007, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.97% (1.0460 => 0.9522, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7960, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.62% (0.4867 => 0.4691, std. dev.: 0.0007) MultiSource/Applications/aha/aha: -3.13% (3.1476 => 3.0492, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5760, std. dev.: 0.0140) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9249, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.94% (20.3410 => 19.9459, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2350, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7650, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0083, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2261, std. dev.: 0.0238) MultiSource/Applications/spiff/spiff: -1.38% (3.0263 => 2.9844, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0167) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7925, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4391, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.09% (6.6320 => 6.5594, std. dev.: 0.0124) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2402, std. dev.: 0.0165) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 14:20:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 16:20:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810212048.C5E7C2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2801?compare_to=2798&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2801, Order: 161686, Start Time: 2012-08-10 20:03:16, End Time: 2012-08-10 21:21:27 To: 2798, Order: 161668, Start Time: 2012-08-10 18:16:33, End Time: 2012-08-10 19:34:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (81 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.08% (14.1513 => 13.7160, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.13% (1.4327 => 1.4022, std. dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.30% (10.3673 => 13.7160, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (1.1194 => 1.2433, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.81% (0.3497 => 0.3875, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.02% (1.7609 => 1.8846, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.91% (2.2022 => 2.3544, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.95% (0.3817 => 0.4044, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.34% (0.6030 => 0.6352, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.33% (0.5925 => 0.6241, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.68% (0.4615 => 0.4831, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.35% (0.4879 => 0.5091, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 4.24% (0.7433 => 0.7748, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 4.22% (0.7326 => 0.7635, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (7.0540 => 7.3420, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 4.03% (10.4361 => 10.8566, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 3.78% (0.3282 => 0.3406, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.73% (0.8172 => 0.8477, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.70% (9.4845 => 9.8355, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.48% (0.5569 => 0.5763, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.38% (0.5860 => 0.6058, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.9449 => 5.1100, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.31% (4.2646 => 4.4056, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.28% (5.0018 => 5.1661, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 3.15% (5.7591 => 5.9403, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.3050 => 1.3454, std. dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.96% (0.7835 => 0.8067, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.90% (8.1363 => 8.3722, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.84% (0.8067 => 0.8296, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.1861 => 1.2171, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.60% (1.1642 => 1.1945, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.60% (3.3354 => 3.4221, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.53% (0.4103 => 0.4207, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.53% (2.0273 => 2.0785, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.49% (0.9765 => 1.0008, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.32% (1.5415 => 1.5772, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6212, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.17% (17.1811 => 17.5531, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.08% (0.5105 => 0.5211, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.06% (1.5603 => 1.5924, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 2.03% (3.8723 => 3.9510, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.6450 => 0.6579, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6456 => 0.6581, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.91% (2.2969 => 2.3407, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.4186 => 1.4449, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.81% (2.0665 => 2.1040, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.80% (2.2024 => 2.2420, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 1.77% (0.8921 => 0.9079, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.74% (14.3668 => 14.6174, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3043, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.01% (1.0722 => 1.0830, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.01% (1.1840 => 1.1959, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.18% (1.1145 => 1.1945, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (4.2280 => 4.4397, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 2.40% (26.0924 => 26.7183, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash2: 1.88% (3.1578 => 3.2172, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.87% (2.1825 => 2.2234, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.62% (3.2827 => 3.3359, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 1.35% (1.1396 => 1.1550, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7740, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6818, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.57% (0.8651 => 0.1681, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1475, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.52% (5.3855 => 3.6880, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.25% (5.3526 => 3.6801, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -15.11% (54.1659 => 45.9823, std. dev.: 0.0332) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5360, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -12.40% (22.1758 => 19.4257, std. dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2373 => 1.1054, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -8.79% (1.5373 => 1.4022, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.31% (2.7294 => 2.5571, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7971, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -4.39% (1.9577 => 1.8717, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4716, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9021, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4216, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9885, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0006) MultiSource/Applications/aha/aha: -1.97% (3.1595 => 3.0972, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4166, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.51% (1.6805 => 1.6551, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3456, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: -1.29% (1.4460 => 1.4274, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 15:47:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 17:47:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120810224727.A35D82A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2802?compare_to=2800&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2802, Order: 161697, Start Time: 2012-08-10 21:33:44, End Time: 2012-08-10 22:48:06 To: 2800, Order: 161686, Start Time: 2012-08-10 19:50:33, End Time: 2012-08-10 21:04:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (150 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.13% (54.3563 => 56.6030, std. dev.: 0.0520) SingleSource/Regression/C/uint64_to_float: 2.18% (0.5355 => 0.5472, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.54% (2.0176 => 2.3110, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.28% (0.7061 => 0.7716, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5818 => 0.6350, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.80% (0.3578 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3601 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.49% (0.3663 => 0.3974, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.38% (0.3914 => 0.4242, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.02% (0.3940 => 0.4256, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.33% (0.7710 => 0.8275, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.4328 => 0.4643, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2782 => 0.2983, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4674, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (3.9660 => 4.2478, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.10% (0.5265 => 0.5639, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.01% (0.2781 => 0.2976, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 6.88% (0.7038 => 0.7522, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 6.80% (0.2690 => 0.2873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.75% (0.4062 => 0.4336, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.70% (0.2655 => 0.2833, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.66% (0.2628 => 0.2803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.45% (0.2760 => 0.2938, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.38% (0.2726 => 0.2900, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.3022 => 0.3211, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.24% (0.2966 => 0.3151, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (0.3149 => 0.3345, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.22% (0.3489 => 0.3706, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.21% (0.3107 => 0.3300, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.14% (1.9828 => 2.1045, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.12% (0.4379 => 0.4647, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.11% (0.3485 => 0.3698, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.11% (0.3192 => 0.3387, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.6959 => 0.7382, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.02% (0.2988 => 0.3168, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.94% (1.2193 => 1.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.91% (0.3453 => 0.3657, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.82% (0.9199 => 0.9734, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.74% (0.3293 => 0.3482, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.5577 => 0.5889, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.51% (0.4390 => 0.4632, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 5.49% (0.3534 => 0.3728, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.42% (0.3246 => 0.3422, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.40% (13.8202 => 14.5669, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/moments: 5.38% (0.3868 => 0.4076, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3756 => 0.3956, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.20% (1.4563 => 1.5321, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.18% (0.5637 => 0.5929, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.01% (1.1364 => 1.1933, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.91% (0.8310 => 0.8718, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.84% (0.7506 => 0.7869, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.82% (1.2292 => 1.2885, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.80% (7.2180 => 7.5642, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.71% (1.3813 => 1.4463, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 4.70% (3.8646 => 4.0462, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 4.67% (1.1061 => 1.1577, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.60% (1.0594 => 1.1081, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.58% (0.7460 => 0.7802, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.3245 => 1.3849, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.53% (1.3819 => 1.4445, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.52% (1.9270 => 2.0141, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.47% (0.3755 => 0.3923, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.32% (0.4791 => 0.4998, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.27% (0.2995 => 0.3123, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (4.9865 => 5.1918, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (4.4433 => 4.6255, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 4.09% (2.1791 => 2.2682, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (3.6692 => 3.8188, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.3801 => 4.5568, std. dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 4.01% (16.6129 => 17.2797, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.82% (0.8698 => 0.9030, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.69% (0.6283 => 0.6515, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (13.2842 => 13.7457, std. dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 3.40% (16.2614 => 16.8149, std. dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.39% (1.1333 => 1.1717, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.36% (0.6135 => 0.6341, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.26% (3.1889 => 3.2930, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (8.4961 => 8.7733, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3725, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.5754 => 6.7726, std. dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 2.91% (14.5298 => 14.9523, std. dev.: 0.0138) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.8535 => 15.2758, std. dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 2.76% (4.6629 => 4.7917, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (1.5188 => 1.5601, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.42% (2.1007 => 2.1516, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.6250 => 0.6380, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.78% (1.0313 => 1.0497, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.69% (0.6744 => 0.6858, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 1.33% (3.7467 => 3.7964, std. dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5101, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std. dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.59% (1.2998 => 1.4375, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.21% (1.0895 => 1.1789, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.92% (1.5824 => 1.6602, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 3.83% (1.1560 => 1.2003, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.52% (1.7688 => 1.8311, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 3.46% (7.4271 => 7.6842, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3853, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.40% (10.7476 => 11.0059, std. dev.: 0.0369) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.21% (2.1753 => 2.2234, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.99% (3.2729 => 3.3379, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.73% (26.5159 => 26.9742, std. dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.38% (8.3908 => 8.5070, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.38% (1.5089 => 1.5297, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: 1.25% (1.9290 => 1.9531, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.94% (22.5627 => 21.2231, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.6576 => 0.6463, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.74% (1.2308 => 1.0986, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.96% (1.0460 => 0.9523, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7961, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.62% (0.4867 => 0.4691, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -3.12% (3.1476 => 3.0495, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5859, std. dev.: 0.0130) MultiSource/Benchmarks/Olden/bh/bh: -2.60% (1.9762 => 1.9249, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.05% (20.3410 => 19.9231, std. dev.: 0.0717) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2262, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.04% (0.8342 => 0.8172, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7661, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0085, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0121) MultiSource/Applications/spiff/spiff: -1.35% (3.0263 => 2.9855, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.33% (9.3358 => 9.2115, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2336, std. dev.: 0.0212) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7924, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.16% (84.4286 => 83.4514, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 16:07:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 18:07:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120810230746.A2C042A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2803?compare_to=2801&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2803, Order: 161698, Start Time: 2012-08-10 21:49:56, End Time: 2012-08-10 23:08:25 To: 2801, Order: 161686, Start Time: 2012-08-10 20:03:16, End Time: 2012-08-10 21:21:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.17% (13.7160 => 14.1502, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.49% (10.3673 => 14.1502, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 11.78% (0.3473 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.49% (0.3561 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.46% (0.3543 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.30% (1.1194 => 1.2459, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.3927 => 0.4342, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.66% (2.2022 => 2.3709, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.31% (1.7609 => 1.8896, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.6030 => 0.6406, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.13% (0.7326 => 0.7702, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.35% (0.4879 => 0.5091, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.33% (10.4361 => 10.8877, std. dev.: 0.0160) MultiSource/Applications/lambda-0_1_3/lambda: 4.13% (0.7433 => 0.7740, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (7.0540 => 7.3448, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (9.4845 => 9.8692, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.65% (0.5569 => 0.5772, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.62% (0.8172 => 0.8468, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (5.0018 => 5.1810, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.57% (4.9449 => 5.1216, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.53% (0.5860 => 0.6067, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.48% (4.2646 => 4.4132, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 3.28% (0.7835 => 0.8092, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.25% (5.7591 => 5.9460, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 3.10% (0.3423 => 0.3529, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (8.1363 => 8.3880, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.3050 => 1.3442, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.91% (0.4636 => 0.4771, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.71% (0.8067 => 0.8286, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.70% (2.0273 => 2.0821, std. dev.: 0.0098) MultiSource/Applications/d/make_dparser: 2.67% (3.3354 => 3.4244, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.1861 => 1.2176, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1950, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.61% (0.9765 => 1.0020, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5809, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.49% (0.5105 => 0.5232, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.46% (0.4103 => 0.4204, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.36% (1.5603 => 1.5971, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5859 => 1.6229, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.28% (0.6675 => 0.6827, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.25% (17.1811 => 17.5674, std. dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6456 => 0.6601, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.15% (3.8723 => 3.9557, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (2.0665 => 2.1088, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8921 => 0.9102, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.2024 => 2.2439, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4452, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.73% (1.2842 => 1.3064, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.72% (2.2969 => 2.3363, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (14.3668 => 14.6052, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 1.46% (1.1840 => 1.2013, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.31% (1.1145 => 1.1960, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (4.2280 => 4.4431, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.87% (0.2944 => 0.3058, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7459, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 2.41% (26.0924 => 26.7216, std. dev.: 0.0259) SingleSource/Benchmarks/McGill/queens: 1.89% (2.1825 => 2.2237, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2121, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 1.60% (3.2827 => 3.3352, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 1.40% (1.1396 => 1.1556, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.33% (1.5086 => 1.5287, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 1.26% (2.2771 => 2.3057, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7754, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.12% (1.0313 => 1.0428, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.57% (0.8651 => 0.1681, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.38% (5.2763 => 3.1456, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.54% (5.3855 => 3.6870, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.25% (5.3526 => 3.6799, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -15.10% (54.1659 => 45.9894, std. dev.: 0.0241) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.64% (2.9384 => 2.5375, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.23% (22.1758 => 19.4639, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.03% (1.2373 => 1.1008, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel-2: -7.63% (1.5373 => 1.4200, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7974, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.87% (1.9577 => 1.8624, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (4.8142 => 4.6140, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4744, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9042, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4199, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -2.71% (10.2830 => 10.0039, std. dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -1.99% (3.1595 => 3.0966, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4187, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3450, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.49% (1.6805 => 1.6554, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: -1.17% (1.4460 => 1.4291, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 16:31:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 18:31:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120810233159.EE8F62A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2804?compare_to=2799&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2804, Order: 161688, Start Time: 2012-08-10 20:49:27, End Time: 2012-08-10 23:32:38 To: 2799, Order: 161668, Start Time: 2012-08-10 17:36:36, End Time: 2012-08-10 20:19:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (95 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.35% (0.2158 => 0.2295, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: 1.18% (2.7816 => 2.8145, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3465 => 0.3867, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3446 => 0.3845, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.55% (0.3488 => 0.3891, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.39% (0.3442 => 0.3834, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.38% (0.3496 => 0.3894, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 11.30% (0.3460 => 0.3851, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.27% (0.3469 => 0.3860, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.01% (0.3643 => 0.4044, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.99% (0.3650 => 0.4051, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.66% (0.3724 => 0.4121, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.01% (1.5932 => 1.7049, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.88% (0.3792 => 0.4053, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.73% (0.5826 => 0.6160, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.63% (1.3152 => 1.3893, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.56% (1.6211 => 1.7112, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 5.55% (0.5889 => 0.6216, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.34% (3.5627 => 3.7530, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.31% (0.4029 => 0.4243, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (0.4361 => 0.4589, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (0.5026 => 0.5283, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (0.4994 => 0.5240, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (0.5000 => 0.5246, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 4.86% (1.0781 => 1.1305, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.2866 => 0.3005, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.80% (4.2109 => 4.4132, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.5900 => 0.6178, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 4.31% (0.7171 => 0.7480, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.17% (0.2736 => 0.2850, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.91% (5.5417 => 5.7583, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.75% (0.3890 => 0.4036, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.71% (0.9909 => 1.0277, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0425, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.69% (0.2875 => 0.2981, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (2.1013 => 2.1779, std. dev.: 0.0114) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.62% (1.9966 => 2.0688, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.61% (0.4658 => 0.4826, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.57% (2.7292 => 2.8266, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (4.4195 => 4.5737, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.47% (0.3195 => 0.3306, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.46% (0.3004 => 0.3108, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.39% (4.6177 => 4.7742, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.35% (2.0673 => 2.1366, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.35% (0.3258 => 0.3367, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.34% (2.1653 => 2.2377, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.3903 => 0.4030, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (1.8794 => 1.9395, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 3.20% (0.6634 => 0.6846, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 3.17% (0.7875 => 0.8125, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.14% (0.4139 => 0.4269, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.3271 => 0.3373, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.09% (0.3726 => 0.3841, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.06% (1.4269 => 1.4706, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3678 => 0.3790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.04% (0.3317 => 0.3418, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.3625 => 0.3733, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3477 => 0.3578, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.79% (0.5546 => 0.5701, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4146 => 0.4260, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.73% (23.5202 => 24.1631, std. dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.6435 => 0.6606, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.3981 => 0.4084, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.42% (0.9697 => 0.9932, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: 2.19% (0.5012 => 0.5122, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.10% (2.0346 => 2.0773, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (0.7426 => 0.7540, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (11.6398 => 11.7588, std. dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 8.15% (0.2122 => 0.2295, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1641, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6462, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6283, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2021, std. dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.98% (41.7953 => 42.6227, std. dev.: 0.0092) MultiSource/Applications/lua/lua: 1.74% (50.0626 => 50.9337, std. dev.: 0.0199) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5905, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2243, std. dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3078, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5701, std. dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.16% (0.2402 => 0.2278, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8034, std. dev.: 0.0027) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std. dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (17.2379 => 16.7807, std. dev.: 0.0655) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5708, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9666, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 17:30:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 19:30:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120811003048.96E662A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2805?compare_to=2802&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2805, Order: 161715, Start Time: 2012-08-10 23:17:16, End Time: 2012-08-11 00:31:25 To: 2802, Order: 161697, Start Time: 2012-08-10 21:33:44, End Time: 2012-08-10 22:48:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.56% (7.9398 => 8.0635, std. dev.: 0.0192) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.22% (2.0176 => 2.3046, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5818 => 0.6391, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.81% (0.7061 => 0.7754, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5748 => 0.6307, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.33% (0.3578 => 0.3876, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 8.12% (0.3646 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.92% (0.3789 => 0.4089, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3130 => 0.3372, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 7.61% (0.3940 => 0.4240, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.39% (1.3693 => 1.4705, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.20% (0.2596 => 0.2783, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.19% (0.7710 => 0.8264, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (3.9660 => 4.2451, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.01% (0.5265 => 0.5634, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.94% (0.2781 => 0.2974, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 6.38% (0.2760 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.3899 => 0.4143, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.3022 => 0.3211, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.24% (0.2966 => 0.3151, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (0.3149 => 0.3345, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3489 => 0.3704, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3580 => 0.3799, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.12% (0.3107 => 0.3297, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.10% (1.9828 => 2.1038, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2761 => 0.2929, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.92% (0.6959 => 0.7371, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 5.89% (0.2988 => 0.3164, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3192 => 0.3379, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.81% (0.4390 => 0.4645, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.70% (0.9199 => 0.9723, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 5.62% (0.3453 => 0.3647, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2875, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5577 => 0.5887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.3293 => 0.3476, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.43% (0.4016 => 0.4234, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.39% (0.3246 => 0.3421, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3756 => 0.3955, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.28% (0.2914 => 0.3068, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5264, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.94% (1.4563 => 1.5282, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.79% (1.3813 => 1.4474, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.78% (3.8646 => 4.0495, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.76% (1.1364 => 1.1905, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2127 => 0.2228, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.73% (1.2292 => 1.2874, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.70% (1.3819 => 1.4469, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.67% (0.8310 => 0.8698, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.58% (1.3245 => 1.3852, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.53% (7.2180 => 7.5453, std. dev.: 0.0126) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.53% (0.7460 => 0.7798, std. dev.: 0.0064) MultiSource/Applications/Burg/burg: 4.52% (1.1061 => 1.1561, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.45% (0.3755 => 0.3922, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.41% (1.9270 => 2.0119, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.16% (1.0594 => 1.1035, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.07% (16.6129 => 17.2888, std. dev.: 0.0154) MultiSource/Applications/siod/siod: 4.04% (2.1791 => 2.2671, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (4.4433 => 4.6204, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.3801 => 4.5532, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (3.6692 => 3.8059, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.44% (0.8698 => 0.8997, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9865 => 5.1553, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (13.2842 => 13.7294, std. dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.28% (1.1333 => 1.1705, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.21% (0.6135 => 0.6332, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.15% (3.1889 => 3.2895, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 3.04% (16.2614 => 16.7563, std. dev.: 0.0136) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (8.4961 => 8.7350, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.2742 => 3.3659, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.74% (6.5754 => 6.7557, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.68% (4.6629 => 4.7877, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.60% (14.8535 => 15.2399, std. dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 2.57% (14.5298 => 14.9034, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.56% (1.5188 => 1.5577, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.23% (2.1007 => 2.1476, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.6250 => 0.6359, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.61% (1.0313 => 1.0479, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9108 => 0.9252, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7899, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std. dev.: 0.0480) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.59% (1.2998 => 1.4115, std. dev.: 0.0183) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.17% (1.0895 => 1.1785, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.92% (1.5824 => 1.6602, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 3.89% (1.1560 => 1.2010, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6795, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.44% (1.7688 => 1.8297, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.22% (7.4271 => 7.6659, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3848, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2235, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.12% (10.7476 => 10.9754, std. dev.: 0.0728) MultiSource/Applications/siod/siod: 1.98% (3.2729 => 3.3378, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.63% (26.5159 => 26.9482, std. dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9567, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5071, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6855, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.03% (1.0310 => 1.0416, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.06% (22.5627 => 21.1960, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.96% (1.2308 => 1.1082, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.97% (1.0460 => 0.9522, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7960, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0008) MultiSource/Applications/aha/aha: -3.12% (3.1476 => 3.0494, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.63% (1.9762 => 1.9243, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.39% (20.3410 => 19.8543, std. dev.: 0.0580) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.30% (8.8259 => 8.6226, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2276, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7643, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.41% (9.3358 => 9.2040, std. dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3305 => 7.2285, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: -1.32% (3.0263 => 2.9863, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7925, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4410, std. dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 17:54:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 19:54:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120811005437.92E982A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2806?compare_to=2803&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2806, Order: 161715, Start Time: 2012-08-10 23:36:43, End Time: 2012-08-11 00:55:14 To: 2803, Order: 161698, Start Time: 2012-08-10 21:49:56, End Time: 2012-08-10 23:08:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (112 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (726 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.32% (2.1088 => 2.1367, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.57% (78.3299 => 81.1296, std. dev.: 0.2727) SingleSource/Benchmarks/Misc/lowercase: 1.04% (7.9660 => 8.0487, std. dev.: 0.0146) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.74% (10.3673 => 14.0723, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 11.21% (0.3516 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.14% (1.7609 => 1.9042, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.42% (2.2022 => 2.3657, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.94% (0.5925 => 0.6336, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.92% (0.7326 => 0.7760, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.54% (7.0540 => 7.3741, std. dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 4.49% (10.4361 => 10.9046, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.44% (0.7433 => 0.7763, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8793, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.15% (0.2891 => 0.3011, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.4636 => 0.4824, std. dev.: 0.0055) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2905 => 0.3020, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.9449 => 5.1327, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.76% (0.8172 => 0.8479, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.75% (0.5569 => 0.5778, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.72% (0.5860 => 0.6078, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (5.0018 => 5.1874, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2831 => 0.2936, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.3098 => 0.3211, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.63% (0.2756 => 0.2856, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (4.2646 => 4.4192, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.4103 => 0.4249, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4289 => 0.4439, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.47% (0.3865 => 0.3999, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 3.47% (0.3232 => 0.3344, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.44% (0.3052 => 0.3157, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.43% (0.7835 => 0.8104, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 3.42% (0.3422 => 0.3539, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.40% (0.3650 => 0.3774, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.40% (2.0665 => 2.1367, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.38% (5.7591 => 5.9535, std. dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.32% (0.3162 => 0.3267, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.32% (0.3283 => 0.3392, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.29% (1.5603 => 1.6117, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.22% (1.1642 => 1.2017, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3603 => 0.3719, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.21% (0.3826 => 0.3949, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.20% (8.1363 => 8.3970, std. dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.10% (0.3935 => 0.4057, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.07% (1.3050 => 1.3451, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 2.99% (0.3684 => 0.3794, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.4064 => 0.4185, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.97% (0.6456 => 0.6648, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.91% (1.1861 => 1.2206, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.90% (0.4203 => 0.4325, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4620 => 0.4751, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.4048 => 0.4160, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4273, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.8067 => 0.8288, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2842 => 1.3193, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.73% (1.5415 => 1.5836, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.71% (2.0273 => 2.0823, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9765 => 1.0029, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (0.5105 => 0.5242, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5859 => 1.6251, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.41% (0.6675 => 0.6836, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.22% (3.8723 => 3.9583, std. dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.21% (17.1811 => 17.5610, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5020 => 0.5130, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.06% (1.4186 => 1.4478, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6450 => 0.6582, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.2024 => 2.2474, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 1.99% (2.2969 => 2.3425, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (14.3668 => 14.6156, std. dev.: 0.0079) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 1.43% (1.1840 => 1.2009, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.37% (1.0722 => 1.0869, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.17% (1.1145 => 1.1944, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (4.2280 => 4.4273, std. dev.: 0.0145) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (3.6395 => 3.7567, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 2.53% (26.0924 => 26.7517, std. dev.: 0.0053) SingleSource/Benchmarks/McGill/queens: 1.89% (2.1825 => 2.2237, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.86% (3.1578 => 3.2164, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.63% (3.2827 => 3.3363, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5086 => 1.5306, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 1.34% (1.1396 => 1.1549, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7752, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1618, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6936, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.14% (5.3526 => 3.6860, std. dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0168, std. dev.: 0.0391) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.54% (2.9384 => 2.5404, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -12.12% (22.1758 => 19.4874, std. dev.: 0.0307) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.34% (1.2373 => 1.0970, std. dev.: 0.0209) SingleSource/Benchmarks/Misc/mandel-2: -8.58% (1.5373 => 1.4054, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7976, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -4.50% (1.9577 => 1.8696, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4697, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9046, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4208, std. dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0067, std. dev.: 0.0174) MultiSource/Applications/aha/aha: -1.98% (3.1595 => 3.0968, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.52% (1.6805 => 1.6549, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3453, std. dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: -1.22% (1.4460 => 1.4284, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 19:12:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 21:12:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120811021251.EE0CB2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2807?compare_to=2805&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2807, Order: 161717, Start Time: 2012-08-11 00:59:39, End Time: 2012-08-11 02:13:30 To: 2805, Order: 161715, Start Time: 2012-08-10 23:17:16, End Time: 2012-08-11 00:31:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (150 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (706 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.53% (2.0176 => 2.3108, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 9.90% (0.5818 => 0.6394, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.69% (0.5748 => 0.6305, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 8.88% (0.7061 => 0.7688, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 8.27% (0.3578 => 0.3874, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.15% (0.3646 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.05% (0.3663 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.00% (0.3623 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.00% (0.3914 => 0.4227, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.67% (0.7710 => 0.8301, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.64% (0.3940 => 0.4241, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.52% (1.3693 => 1.4723, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.51% (3.9660 => 4.2638, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 7.40% (0.7038 => 0.7559, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.18% (0.5265 => 0.5643, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (0.4328 => 0.4635, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.08% (0.2781 => 0.2978, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.90% (0.2607 => 0.2787, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.68% (0.2966 => 0.3164, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2765 => 0.2947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2726 => 0.2902, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.45% (0.2760 => 0.2938, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.31% (0.3899 => 0.4145, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2988 => 0.3176, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.23% (0.2761 => 0.2933, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.23% (0.3580 => 0.3803, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3485 => 0.3701, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.19% (0.3489 => 0.3705, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.18% (1.9828 => 2.1054, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.16% (0.6959 => 0.7388, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.12% (0.4379 => 0.4647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.08% (0.3192 => 0.3386, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.07% (0.3149 => 0.3340, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.99% (0.9199 => 0.9750, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (1.2193 => 1.2911, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.74% (0.4390 => 0.4642, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 5.73% (0.3453 => 0.3651, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5577 => 0.5895, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 5.65% (0.3293 => 0.3479, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3246 => 0.3428, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.3756 => 0.3966, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.57% (0.3534 => 0.3731, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4016 => 0.4235, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.35% (13.8202 => 14.5593, std. dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/moments: 5.20% (0.3868 => 0.4069, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.4563 => 1.5314, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.12% (0.7506 => 0.7890, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.98% (1.2292 => 1.2904, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.95% (1.1364 => 1.1927, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.93% (0.8310 => 0.8720, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.90% (3.8646 => 4.0540, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2945 => 0.3089, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 4.76% (1.1061 => 1.1588, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.76% (1.3245 => 1.3875, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.74% (0.3755 => 0.3933, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.70% (7.2180 => 7.5572, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.68% (0.7460 => 0.7809, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.68% (1.9270 => 2.0171, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.3819 => 1.4462, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (1.3813 => 1.4443, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.44% (2.1791 => 2.2758, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.43% (1.0594 => 1.1063, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.26% (16.6129 => 17.3208, std. dev.: 0.0198) MultiSource/Benchmarks/McCat/18-imp/imp: 4.22% (0.3220 => 0.3356, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.21% (0.2995 => 0.3121, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (4.4433 => 4.6275, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (3.6692 => 3.8189, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.03% (0.4791 => 0.4984, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.3801 => 4.5558, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.69% (4.9865 => 5.1705, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.8698 => 0.9015, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (13.2842 => 13.7530, std. dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.45% (0.6283 => 0.6500, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.44% (0.6135 => 0.6346, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1720, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.35% (3.1889 => 3.2956, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 3.32% (16.2614 => 16.8007, std. dev.: 0.0250) MultiSource/Benchmarks/mafft/pairlocalalign: 3.03% (8.4961 => 8.7538, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 2.97% (0.4113 => 0.4235, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.92% (3.2742 => 3.3698, std. dev.: 0.0162) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (6.5754 => 6.7669, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.86% (4.6629 => 4.7961, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2702, std. dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: 2.80% (14.5298 => 14.9361, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5188 => 1.5591, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.1007 => 2.1494, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.92% (0.6250 => 0.6370, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.77% (0.9108 => 0.9269, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.75% (0.6744 => 0.6862, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.75% (1.0313 => 1.0493, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.33% (3.7467 => 3.7964, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5119, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 25.80% (1.8175 => 2.2865, std. dev.: 0.0324) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.16% (1.2998 => 1.4319, std. dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.90% (1.5824 => 1.6600, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 3.86% (1.1560 => 1.2006, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9882, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6803, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.42% (1.7688 => 1.8293, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 3.42% (7.4271 => 7.6809, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.99% (1.9199 => 1.9773, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.63% (10.7476 => 11.0304, std. dev.: 0.0301) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2235, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.03% (3.2729 => 3.3394, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: 1.55% (1.9290 => 1.9589, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0510, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.51% (26.5159 => 26.9168, std. dev.: 0.0267) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5112, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.19% (1.0310 => 1.0433, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.02% (22.5627 => 21.2046, std. dev.: 0.0257) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.15% (0.0997 => 0.0846, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2308 => 1.0978, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.96% (1.0460 => 0.9523, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.91% (1.3780 => 1.3104, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7960, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -3.12% (3.1476 => 3.0493, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.65% (1.9762 => 1.9238, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5982, std. dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.14% (20.3410 => 19.9051, std. dev.: 0.0621) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.07% (0.8342 => 0.8169, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2333, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7641, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0081, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2297, std. dev.: 0.0125) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2101, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -1.27% (3.0263 => 2.9880, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std. dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4369, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.03% (5.5401 => 5.4832, std. dev.: 0.0100) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 19:41:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 21:41:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120811024123.234252A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2808?compare_to=2806&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2808, Order: 161717, Start Time: 2012-08-11 01:23:37, End Time: 2012-08-11 02:42:01 To: 2806, Order: 161715, Start Time: 2012-08-10 23:36:43, End Time: 2012-08-11 00:55:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (107 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (730 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.09% (27.8933 => 29.5927, std. dev.: 0.0441) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.52% (81.1296 => 78.2733, std. dev.: 0.6944) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.44% (10.3673 => 14.0411, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2464, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3473 => 0.3864, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.90% (0.3561 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.19% (1.7609 => 1.9051, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.68% (2.2022 => 2.3714, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.90% (0.5925 => 0.6334, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.73% (0.6030 => 0.6436, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.71% (0.7326 => 0.7744, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.84% (7.0540 => 7.3953, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.73% (0.4879 => 0.5110, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.70% (0.7433 => 0.7782, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.40% (10.4361 => 10.8953, std. dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (9.4845 => 9.8745, std. dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.92% (0.8172 => 0.8492, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4636 => 0.4817, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.87% (0.2891 => 0.3003, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.9449 => 5.1325, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (5.0018 => 5.1872, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5860 => 0.6076, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (4.2646 => 4.4194, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.59% (5.7591 => 5.9659, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 3.53% (0.2831 => 0.2931, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.4103 => 0.4239, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 3.30% (0.3422 => 0.3535, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.29% (0.3826 => 0.3952, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.26% (2.0665 => 2.1338, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.25% (0.3136 => 0.3238, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.22% (8.1363 => 8.3984, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.4289 => 0.4427, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.3050 => 1.3460, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.11% (1.5603 => 1.6088, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3283 => 0.3385, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (1.1861 => 1.2217, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.00% (0.3603 => 0.3711, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.93% (3.3354 => 3.4330, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.91% (0.6456 => 0.6644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3684 => 0.3791, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.4064 => 0.4182, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.88% (2.0273 => 2.0857, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.86% (0.4203 => 0.4323, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.8067 => 0.8295, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (1.5415 => 1.5850, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.77% (1.1642 => 1.1964, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.71% (0.9765 => 1.0030, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4620 => 0.4743, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3175, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.53% (3.8723 => 3.9702, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.53% (0.5105 => 0.5234, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.50% (17.1811 => 17.6101, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/moments: 2.50% (0.4048 => 0.4149, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.43% (0.6675 => 0.6837, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.42% (0.4299 => 0.4403, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.37% (1.5859 => 1.6235, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.5020 => 0.5132, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.11% (2.2969 => 2.3454, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.00% (0.8921 => 0.9099, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (14.3668 => 14.6360, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.80% (0.7115 => 0.7243, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.62% (1.0722 => 1.0896, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2024, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.13% (1.1145 => 1.1940, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.99% (4.2280 => 4.4388, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (3.6395 => 3.7567, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 2.54% (26.0924 => 26.7543, std. dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2194, std. dev.: 0.0080) SingleSource/Benchmarks/McGill/queens: 1.88% (2.1825 => 2.2235, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.86% (2.2771 => 2.3194, std. dev.: 0.0106) MultiSource/Applications/siod/siod: 1.65% (3.2827 => 3.3368, std. dev.: 0.0196) SingleSource/Benchmarks/Misc/richards_benchmark: 1.36% (1.1396 => 1.1551, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5086 => 1.5275, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7740, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.25% (5.2763 => 3.1526, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6979, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.00% (5.3526 => 3.6935, std. dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -15.12% (54.1659 => 45.9767, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.79% (2.9384 => 2.5331, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -12.04% (22.1758 => 19.5068, std. dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2373 => 1.1070, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -8.68% (1.5373 => 1.4039, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7972, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -4.55% (1.9577 => 1.8686, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/flops-5: -4.45% (1.5835 => 1.5130, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4672, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (8.1563 => 7.9002, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4185, std. dev.: 0.0218) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9995, std. dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -1.99% (3.1595 => 3.0966, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4183, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.51% (1.6805 => 1.6551, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.43% (12.5348 => 12.3555, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: -1.24% (1.4460 => 1.4281, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 19:43:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 21:43:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120811024323.BCE632A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2809?compare_to=2804&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2809, Order: 161715, Start Time: 2012-08-11 00:00:50, End Time: 2012-08-11 02:44:03 To: 2804, Order: 161688, Start Time: 2012-08-10 20:49:27, End Time: 2012-08-10 23:32:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 8 (114 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 945 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 2.17% (0.9932 => 1.0148, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 1.77% (0.6160 => 0.6269, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 1.66% (0.6216 => 0.6319, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.56% (2.1366 => 2.1700, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 1.55% (0.7480 => 0.7596, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.0277 => 1.0412, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.14% (125.3041 => 130.4940, std. dev.: 0.4020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.09% (54.1375 => 54.7257, std. dev.: 0.1001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.34% (2.4555 => 2.3981, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3446 => 0.3851, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.73% (0.3488 => 0.3897, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.72% (0.3465 => 0.3871, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 11.71% (0.3442 => 0.3845, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3496 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.59% (0.3460 => 0.3861, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.56% (0.3469 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3643 => 0.4059, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 11.40% (0.3650 => 0.4066, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3724 => 0.4133, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.31% (0.3792 => 0.4107, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 7.61% (1.5932 => 1.7144, std. dev.: 0.0107) SingleSource/UnitTests/ObjC++/Hello: 7.60% (0.5826 => 0.6269, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 7.30% (0.5889 => 0.6319, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.93% (0.7171 => 0.7596, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.85% (1.3152 => 1.3922, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.83% (1.6211 => 1.7156, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.64% (3.5627 => 3.7635, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.46% (0.2875 => 0.3032, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (0.4361 => 0.4596, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.35% (0.2823 => 0.2974, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.35% (0.4994 => 0.5261, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.31% (0.5026 => 0.5293, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.23% (0.2792 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.19% (0.2813 => 0.2959, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.13% (0.3195 => 0.3359, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.12% (0.2714 => 0.2853, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.11% (0.2738 => 0.2878, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.10% (0.2725 => 0.2864, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.09% (0.2750 => 0.2890, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.08% (0.5000 => 0.5254, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.08% (0.9909 => 1.0412, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.06% (0.2729 => 0.2867, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.04% (4.2109 => 4.4233, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (0.3930 => 0.4128, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.2780 => 0.2920, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.99% (0.3004 => 0.3154, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.99% (0.4029 => 0.4230, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.98% (1.0781 => 1.1318, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.97% (0.3096 => 0.3250, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.97% (2.0673 => 2.1700, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.88% (0.2911 => 0.3053, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.87% (0.2811 => 0.2948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.85% (0.2803 => 0.2939, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.5900 => 0.6186, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.83% (0.3124 => 0.3275, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.78% (0.3267 => 0.3423, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.77% (0.3060 => 0.3206, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 4.65% (0.9697 => 1.0148, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3258 => 0.3409, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3317 => 0.3470, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.54% (0.3678 => 0.3845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.54% (0.3282 => 0.3431, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.2866 => 0.2996, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.50% (0.2736 => 0.2859, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3362 => 0.3512, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3726 => 0.3892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.39% (0.3348 => 0.3495, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.36% (0.3625 => 0.3783, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.29% (0.3477 => 0.3626, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (2.7292 => 2.8440, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3690 => 0.3843, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4146 => 0.4313, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.02% (0.4251 => 0.4422, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.00% (5.5417 => 5.7631, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.98% (0.3890 => 0.4045, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.98% (0.2566 => 0.2668, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.92% (0.3981 => 0.4137, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (1.9694 => 2.0449, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.3845 => 0.3992, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (1.9966 => 2.0721, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (0.4658 => 0.4832, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (2.1013 => 2.1793, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.62% (1.8794 => 1.9475, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (4.4195 => 4.5778, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.45% (4.6177 => 4.7772, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.44% (2.1653 => 2.2397, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 3.40% (23.5202 => 24.3188, std. dev.: 0.0072) MultiSource/Applications/siod/siod: 3.36% (0.6634 => 0.6857, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.5012 => 0.5180, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.34% (0.7875 => 0.8138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.6435 => 0.6645, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.3903 => 0.4030, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.24% (0.4139 => 0.4273, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.20% (1.4269 => 1.4725, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.81% (0.5546 => 0.5702, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.15% (2.0346 => 2.0784, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6124, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6773, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1721, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6325, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6594, std. dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2088, std. dev.: 0.0431) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.75% (41.7953 => 42.5258, std. dev.: 0.0599) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5905, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9138, std. dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.51% (3.1722 => 3.2201, std. dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3048, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2791, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.16% (2.4764 => 2.3981, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5660, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -9.20% (0.2402 => 0.2181, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7930, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std. dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7925, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std. dev.: 0.0042) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.00% (17.2379 => 16.8937, std. dev.: 0.0422) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5821, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9631, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 20:55:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 22:55:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120811035512.75A7A2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2810?compare_to=2807&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2810, Order: 161722, Start Time: 2012-08-11 02:41:57, End Time: 2012-08-11 03:55:48 To: 2807, Order: 161717, Start Time: 2012-08-11 00:59:39, End Time: 2012-08-11 02:13:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (149 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.53% (2.0176 => 2.3107, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7061 => 0.7634, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.89% (0.3650 => 0.3938, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3601 => 0.3885, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 7.74% (1.3693 => 1.4753, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/for-in: 7.73% (0.3789 => 0.4082, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.72% (0.3914 => 0.4216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.4003 => 0.4305, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.41% (0.3940 => 0.4232, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4328 => 0.4645, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.22% (0.7710 => 0.8267, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.20% (0.5265 => 0.5644, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7038 => 0.7542, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (3.9660 => 4.2457, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.95% (0.2690 => 0.2877, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3899 => 0.4168, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 6.89% (0.4062 => 0.4342, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.57% (1.9828 => 2.1131, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.48% (0.3149 => 0.3353, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4390 => 0.4673, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2988 => 0.3180, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.42% (0.3489 => 0.3713, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.40% (0.3485 => 0.3708, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.37% (0.3580 => 0.3808, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.15% (0.6959 => 0.7387, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.05% (0.3453 => 0.3662, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.85% (0.9199 => 0.9737, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.81% (1.2193 => 1.2901, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 5.77% (0.3534 => 0.3738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (0.3756 => 0.3967, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.5577 => 0.5889, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 5.48% (0.3868 => 0.4080, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.30% (0.3246 => 0.3418, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5498, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.10% (1.4563 => 1.5305, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.02% (1.1364 => 1.1934, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 5.00% (1.2292 => 1.2907, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.79% (0.8310 => 0.8708, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.69% (3.8646 => 4.0459, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.68% (1.3245 => 1.3865, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.59% (7.2180 => 7.5492, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.58% (0.3755 => 0.3927, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.3813 => 1.4444, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.52% (1.1061 => 1.1561, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.50% (1.3819 => 1.4441, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 4.49% (1.0594 => 1.1070, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 4.45% (1.9270 => 2.0128, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.7460 => 0.7792, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.11% (2.1791 => 2.2687, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (3.6692 => 3.8197, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.4791 => 0.4985, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (4.4433 => 4.6214, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5546, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 3.98% (16.6129 => 17.2741, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.75% (4.9865 => 5.1735, std. dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.69% (0.8698 => 0.9019, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.67% (0.3131 => 0.3246, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.41% (0.6283 => 0.6497, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1719, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.37% (0.6135 => 0.6342, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (13.2842 => 13.7323, std. dev.: 0.0162) MultiSource/Applications/d/make_dparser: 3.29% (3.1889 => 3.2938, std. dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7849, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7509, std. dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (6.5754 => 6.7653, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (3.2742 => 3.3681, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2659, std. dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.5298 => 14.9310, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (1.5188 => 1.5597, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.63% (4.6629 => 4.7854, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.1007 => 2.1499, std. dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6250 => 0.6389, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.79% (0.9108 => 0.9271, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.73% (1.0313 => 1.0491, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.56% (0.6744 => 0.6849, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7899, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 25.15% (1.8175 => 2.2746, std. dev.: 0.0381) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 8.81% (1.2998 => 1.4143, std. dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.0895 => 1.1788, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 3.83% (1.1560 => 1.2003, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.71% (11.2619 => 11.6793, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.48% (1.7688 => 1.8304, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 3.21% (7.4271 => 7.6658, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.52% (10.7476 => 11.0182, std. dev.: 0.0280) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3830, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2236, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.97% (3.2729 => 3.3373, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5089 => 1.5321, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.48% (26.5159 => 26.9094, std. dev.: 0.0506) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5118, std. dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/fldry: 1.34% (1.9290 => 1.9548, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1863, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6870, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.01% (0.4657 => 0.3958, std. dev.: 0.0206) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.02% (22.5627 => 21.2037, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.44% (0.0997 => 0.0853, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.15% (1.2308 => 1.1059, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.97% (1.0460 => 0.9522, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7959, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.07% (1.3780 => 1.3219, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0007) MultiSource/Applications/aha/aha: -3.14% (3.1476 => 3.0489, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5832, std. dev.: 0.0172) MultiSource/Benchmarks/Olden/bh/bh: -2.59% (1.9762 => 1.9250, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.07% (0.8342 => 0.8169, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2377, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.63% (28.2225 => 27.7635, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0372, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0085, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: -1.37% (9.3358 => 9.2075, std. dev.: 0.0294) MultiSource/Benchmarks/Bullet/bullet: -1.32% (7.3305 => 7.2340, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: -1.30% (3.0263 => 2.9870, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7924, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8703, std. dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4374, std. dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 21:28:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 10 Aug 2012 23:28:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120811042816.2B2A02A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2811?compare_to=2808&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2811, Order: 161722, Start Time: 2012-08-11 03:10:24, End Time: 2012-08-11 04:28:53 To: 2808, Order: 161717, Start Time: 2012-08-11 01:23:37, End Time: 2012-08-11 02:42:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (96 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.82% (78.2733 => 81.2601, std. dev.: 0.1761) SingleSource/Benchmarks/Misc/mandel-2: 2.83% (1.4039 => 1.4436, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.36% (10.3673 => 14.1364, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.31% (1.1194 => 1.2460, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.26% (0.3927 => 0.4330, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (2.2022 => 2.3733, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.23% (1.7609 => 1.8883, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.38% (0.5925 => 0.6244, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.30% (10.4361 => 10.9889, std. dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference-object: 5.29% (0.6030 => 0.6349, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: 4.82% (0.7433 => 0.7791, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.59% (7.0540 => 7.3775, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.46% (0.7326 => 0.7653, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.8172 => 0.8517, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.18% (9.4845 => 9.8813, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5569 => 0.5785, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.9449 => 5.1354, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.76% (5.0018 => 5.1897, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (4.2646 => 4.4214, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.65% (0.5860 => 0.6074, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 3.45% (0.3387 => 0.3504, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.4636 => 0.4794, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.32% (0.7835 => 0.8095, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.4103 => 0.4239, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9447, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.22% (8.1363 => 8.3980, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.19% (0.3136 => 0.3236, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1985, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.94% (0.8067 => 0.8304, std. dev.: 0.0066) MultiSource/Applications/hbd/hbd: 2.94% (1.5603 => 1.6061, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 2.93% (2.0273 => 2.0868, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2209, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.93% (0.3650 => 0.3757, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.86% (3.3354 => 3.4308, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3826 => 0.3935, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.5415 => 1.5852, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.76% (0.9765 => 1.0035, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (2.0665 => 2.1227, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.6456 => 0.6628, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.51% (17.1811 => 17.6120, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4620 => 0.4735, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5859 => 1.6251, std. dev.: 0.0060) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9680, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.37% (0.6675 => 0.6833, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.32% (2.2969 => 2.3503, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.29% (0.6450 => 0.6598, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.23% (1.2842 => 1.3128, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.22% (1.4186 => 1.4501, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8921 => 0.9111, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.01% (0.5020 => 0.5121, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.92% (14.3668 => 14.6421, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (2.2024 => 2.2422, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.49% (1.0722 => 1.0882, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.42% (1.1840 => 1.2008, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.18% (1.1145 => 1.1945, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (4.2280 => 4.4508, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7488, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 2.46% (26.0924 => 26.7348, std. dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1578 => 3.2175, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.88% (2.1825 => 2.2235, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.61% (3.2827 => 3.3355, std. dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5086 => 1.5292, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 1.33% (1.1396 => 1.1548, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5836, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7744, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1489, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6978, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.08% (5.3526 => 3.6892, std. dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -15.13% (54.1659 => 45.9733, std. dev.: 0.0341) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.52% (2.9384 => 2.5411, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -12.05% (22.1758 => 19.5027, std. dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.08% (1.2373 => 1.1126, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.10% (1.5373 => 1.4436, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5044, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7974, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -4.29% (1.9577 => 1.8737, std. dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4616, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9037, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4246, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9963, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -1.97% (3.1595 => 3.0974, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: -1.56% (9.5636 => 9.4144, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3395, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.52% (1.6805 => 1.6550, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.15% (1.4460 => 1.4293, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 10 22:55:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 00:55:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120811055512.CBF6C2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2812?compare_to=2809&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2812, Order: 161722, Start Time: 2012-08-11 03:12:20, End Time: 2012-08-11 05:55:50 To: 2809, Order: 161715, Start Time: 2012-08-11 00:00:50, End Time: 2012-08-11 02:44:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (112 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.37% (103.6220 => 118.5174, std. dev.: 0.0752) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.2185 => 0.2287, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 2.00% (0.6097 => 0.6219, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 11.73% (0.3496 => 0.3906, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3465 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3446 => 0.3844, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 11.53% (0.3442 => 0.3839, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.47% (0.3488 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.45% (0.3460 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.42% (0.3469 => 0.3865, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3643 => 0.4047, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.07% (0.3650 => 0.4054, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3724 => 0.4128, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.10% (0.3792 => 0.4175, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 7.08% (1.5932 => 1.7060, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.42% (0.5826 => 0.6200, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.5889 => 0.6257, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.63% (0.5026 => 0.5309, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.60% (1.6211 => 1.7119, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (3.5627 => 3.7563, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.37% (1.0781 => 1.1360, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (1.3152 => 1.3858, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (0.4361 => 0.4589, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.00% (0.5900 => 0.6195, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.97% (0.2875 => 0.3018, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.94% (0.7171 => 0.7525, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (0.5000 => 0.5244, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.86% (4.2109 => 4.4154, std. dev.: 0.0056) MultiSource/Applications/spiff/spiff: 4.82% (0.4029 => 0.4223, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 4.72% (0.9909 => 1.0377, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.70% (0.2725 => 0.2853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2738 => 0.2866, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.61% (0.2714 => 0.2839, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.56% (0.3004 => 0.3141, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.54% (0.2729 => 0.2853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.50% (0.2780 => 0.2905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.49% (0.3096 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2792 => 0.2917, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2803 => 0.2928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2750 => 0.2872, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.43% (2.0673 => 2.1589, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.38% (0.3195 => 0.3335, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.36% (0.2911 => 0.3038, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.34% (0.2813 => 0.2935, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.3362 => 0.3507, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3258 => 0.3397, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.25% (0.3267 => 0.3406, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3348 => 0.3487, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3124 => 0.3253, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.11% (5.5417 => 5.7694, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.08% (0.3060 => 0.3185, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3317 => 0.3452, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.99% (0.3282 => 0.3413, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (0.4658 => 0.4843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.92% (0.3726 => 0.3872, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.89% (0.3678 => 0.3821, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3625 => 0.3765, std. dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.81% (2.7292 => 2.8331, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.80% (0.3477 => 0.3609, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.77% (0.9697 => 1.0063, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.75% (0.3890 => 0.4036, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.71% (0.3690 => 0.3827, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (1.9694 => 2.0421, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.68% (1.9966 => 2.0701, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 3.67% (23.5202 => 24.3827, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 3.62% (0.4251 => 0.4405, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4146 => 0.4295, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.59% (1.8794 => 1.9469, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.58% (0.7875 => 0.8157, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (2.1013 => 2.1751, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.49% (0.3981 => 0.4120, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 3.48% (4.6177 => 4.7784, std. dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: 3.30% (2.1653 => 2.2367, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 3.23% (0.6634 => 0.6848, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.3903 => 0.4028, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.20% (0.3845 => 0.3968, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.15% (4.4195 => 4.5586, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.6435 => 0.6632, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (0.4139 => 0.4265, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.5012 => 0.5164, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.94% (1.4269 => 1.4689, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.97% (2.0346 => 2.0746, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.47% (0.7426 => 0.7535, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.78% (0.2122 => 0.2287, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6748, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 4.61% (1.8057 => 1.8890, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6328, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (105.3826 => 107.6195, std. dev.: 0.0441) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2063, std. dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (41.7953 => 42.6430, std. dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2274, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5923, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9258, std. dev.: 0.0117) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3120, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.79% (2.4764 => 2.4074, std. dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5351, std. dev.: 0.0346) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7977, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/ary2: -7.54% (0.2402 => 0.2221, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -7.34% (2.1113 => 1.9564, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8053, std. dev.: 0.0121) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -1.67% (17.2379 => 16.9498, std. dev.: 0.0286) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9610, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 4.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 12:33:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 14:33:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120811193329.30CEE2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2813?compare_to=2810&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2813, Order: 161725, Start Time: 2012-08-11 18:20:02, End Time: 2012-08-11 19:34:08 To: 2810, Order: 161722, Start Time: 2012-08-11 02:41:57, End Time: 2012-08-11 03:55:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.53% (55.6030 => 56.4543, std. dev.: 0.0619) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.55% (2.0176 => 2.3112, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 9.18% (0.5818 => 0.6352, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5748 => 0.6259, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 8.06% (0.7061 => 0.7630, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 8.02% (0.3578 => 0.3865, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 7.76% (0.3646 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.73% (0.3623 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.72% (0.3914 => 0.4216, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.68% (1.3693 => 1.4744, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3650 => 0.3928, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.4003 => 0.4307, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2781 => 0.2988, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.30% (0.4328 => 0.4644, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.15% (0.7038 => 0.7541, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.97% (0.4062 => 0.4345, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.95% (0.2690 => 0.2877, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.95% (3.9660 => 4.2416, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.2937 => 0.3140, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2655 => 0.2838, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.3899 => 0.4162, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3149 => 0.3358, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (1.9828 => 2.1122, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.45% (0.3580 => 0.3811, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2988 => 0.3180, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.37% (0.3485 => 0.3707, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.11% (0.3453 => 0.3664, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.86% (0.3293 => 0.3486, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.6959 => 0.7366, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.82% (0.9199 => 0.9734, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (1.2193 => 1.2892, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.4390 => 0.4641, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (0.3756 => 0.3968, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.54% (0.5577 => 0.5886, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.51% (0.3246 => 0.3425, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.40% (0.3868 => 0.4077, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.38% (13.8202 => 14.5631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.2945 => 0.3101, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.01% (1.1364 => 1.1933, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.99% (1.2292 => 1.2905, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.88% (1.4563 => 1.5274, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.79% (0.5637 => 0.5907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.73% (0.8310 => 0.8703, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0447, std. dev.: 0.0106) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.58% (7.2180 => 7.5487, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 4.55% (1.1061 => 1.1564, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.2243 => 0.2345, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.54% (1.3245 => 1.3846, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (1.3813 => 1.4437, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.7460 => 0.7795, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.49% (0.7506 => 0.7843, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 4.48% (1.9270 => 2.0134, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4436, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.0594 => 1.1062, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3755 => 0.3920, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.03% (2.1791 => 2.2670, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 3.98% (16.6129 => 17.2747, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6181, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.93% (3.6692 => 3.8135, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.90% (0.4791 => 0.4978, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.3801 => 4.5487, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.9865 => 5.1718, std. dev.: 0.0084) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.63% (0.8698 => 0.9014, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6135 => 0.6353, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.52% (0.6283 => 0.6504, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.43% (13.2842 => 13.7392, std. dev.: 0.0215) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.32% (1.1333 => 1.1709, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 3.26% (3.1889 => 3.2929, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.16% (16.2614 => 16.7757, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 3.03% (8.4961 => 8.7538, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.5754 => 6.7672, std. dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9424, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.2742 => 3.3660, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2602, std. dev.: 0.0168) MultiSource/Applications/oggenc/oggenc: 2.56% (4.6629 => 4.7825, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (2.1007 => 2.1496, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6250 => 0.6393, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.20% (3.7467 => 3.7917, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/fbench: 25.11% (1.8175 => 2.2739, std. dev.: 0.0327) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1915, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 8.82% (1.2998 => 1.4144, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.21% (1.0895 => 1.1789, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.92% (1.5824 => 1.6603, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 3.88% (1.1560 => 1.2008, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6803, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.49% (1.7688 => 1.8305, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.27% (7.4271 => 7.6702, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-6: 2.89% (1.9199 => 1.9754, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 2.22% (2.1753 => 2.2235, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.21% (10.7476 => 10.9854, std. dev.: 0.0320) MultiSource/Applications/siod/siod: 1.99% (3.2729 => 3.3379, std. dev.: 0.0228) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.59% (26.5159 => 26.9367, std. dev.: 0.0294) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9584, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.51% (1.5089 => 1.5317, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5081, std. dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0096) MultiSource/Benchmarks/llubenchmark/llu: 1.27% (3.7731 => 3.8212, std. dev.: 0.0181) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1862, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1983, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.64% (0.0997 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2308 => 1.0975, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.97% (1.0460 => 0.9522, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.42% (1.3780 => 1.3171, std. dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -4.40% (5.0168 => 4.7960, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -3.15% (3.1476 => 3.0485, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5942, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -2.62% (1.9762 => 1.9244, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2274, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (20.3410 => 19.9769, std. dev.: 0.0189) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.62% (28.2225 => 27.7654, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2318, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7927, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: -1.27% (3.0263 => 2.9880, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8678, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4323, std. dev.: 0.0142) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 12:38:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 14:38:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120811193807.5B9D12A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2814?compare_to=2811&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2814, Order: 161725, Start Time: 2012-08-11 18:19:55, End Time: 2012-08-11 19:38:47 To: 2811, Order: 161722, Start Time: 2012-08-11 03:10:24, End Time: 2012-08-11 04:28:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (91 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (747 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.17% (81.2601 => 79.4994, std. dev.: 0.6097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.31% (10.3673 => 14.1321, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 11.43% (0.3473 => 0.3870, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (1.1194 => 1.2466, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (2.2022 => 2.3725, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.19% (1.7609 => 1.8875, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 5.41% (10.4361 => 11.0009, std. dev.: 0.0145) SingleSource/UnitTests/ObjC++/Hello: 5.40% (0.5925 => 0.6245, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.27% (0.6030 => 0.6348, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.7433 => 0.7797, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.56% (7.0540 => 7.3758, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.48% (0.7326 => 0.7654, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.43% (0.4879 => 0.5095, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8791, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.9449 => 5.1310, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.75% (0.5860 => 0.6080, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (5.0018 => 5.1890, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.64% (4.2646 => 4.4197, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.62% (0.8172 => 0.8468, std. dev.: 0.0094) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.34% (0.4103 => 0.4240, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.27% (0.7835 => 0.8091, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 3.23% (5.7591 => 5.9451, std. dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.19% (0.3136 => 0.3236, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.18% (8.1363 => 8.3951, std. dev.: 0.0192) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.01% (1.1642 => 1.1993, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.98% (0.3826 => 0.3940, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.91% (1.5603 => 1.6057, std. dev.: 0.0121) MultiSource/Applications/treecc/treecc: 2.89% (2.0273 => 2.0859, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.88% (0.3650 => 0.3755, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.87% (1.1861 => 1.2202, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 2.83% (3.3354 => 3.4297, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9765 => 1.0036, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4636 => 0.4761, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.69% (2.0665 => 2.1220, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.6456 => 0.6627, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5415 => 1.5820, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.59% (0.5105 => 0.5237, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9710, std. dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.46% (17.1811 => 17.6042, std. dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (0.4620 => 0.4728, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.29% (0.6450 => 0.6598, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.28% (0.6675 => 0.6827, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.24% (1.2842 => 1.3130, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.24% (2.2969 => 2.3484, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.19% (1.4186 => 1.4497, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.01% (0.5020 => 0.5121, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (14.3668 => 14.6346, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.2024 => 2.2426, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.37% (1.0722 => 1.0869, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.34% (1.1145 => 1.1963, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.67% (4.2280 => 4.4256, std. dev.: 0.0132) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7485, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 2.41% (26.0924 => 26.7206, std. dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/hash2: 1.93% (3.1578 => 3.2187, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.88% (2.1825 => 2.2235, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.63% (3.2827 => 3.3362, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (1.5086 => 1.5302, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 1.34% (1.1396 => 1.1549, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.12% (11.6436 => 11.7744, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1488, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.35% (5.3855 => 3.6970, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.05% (5.3526 => 3.6904, std. dev.: 0.0074) SingleSource/UnitTests/Vector/constpool: -15.10% (54.1659 => 45.9890, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.57% (2.9384 => 2.5397, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -12.10% (22.1758 => 19.4929, std. dev.: 0.0372) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.96% (1.2373 => 1.1141, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -8.80% (1.5373 => 1.4020, std. dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5566, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.97% (5.0483 => 4.7974, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -4.58% (1.9577 => 1.8681, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4739, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (8.1563 => 7.8997, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4195, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0049, std. dev.: 0.0164) MultiSource/Applications/aha/aha: -1.97% (3.1595 => 3.0973, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4172, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.52% (1.6805 => 1.6550, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3487, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 14:02:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 16:02:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120811210256.610702A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2815?compare_to=2812&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2815, Order: 161725, Start Time: 2012-08-11 18:19:45, End Time: 2012-08-11 21:03:37 To: 2812, Order: 161722, Start Time: 2012-08-11 03:12:20, End Time: 2012-08-11 05:55:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (115 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.58% (128.0147 => 130.0371, std. dev.: 0.5568) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (2.0618 => 2.0909, std. dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3496 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.49% (0.3465 => 0.3863, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.46% (0.3446 => 0.3841, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.42% (0.3460 => 0.3855, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.41% (0.3488 => 0.3886, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.36% (0.3442 => 0.3833, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.33% (0.3469 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.15% (0.3650 => 0.4057, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.98% (0.3643 => 0.4043, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.71% (0.3724 => 0.4123, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.29% (1.5932 => 1.7093, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.45% (0.5826 => 0.6202, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.23% (0.5889 => 0.6256, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.5900 => 0.6237, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.63% (1.6211 => 1.7124, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.48% (1.3152 => 1.3873, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.47% (0.3930 => 0.4145, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.46% (3.5627 => 3.7571, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2738 => 0.2881, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.21% (0.4994 => 0.5254, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (0.5000 => 0.5255, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.01% (4.2109 => 4.4217, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 4.94% (1.0781 => 1.1314, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 4.92% (0.7171 => 0.7524, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2875 => 0.3012, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.56% (0.5026 => 0.5255, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.47% (0.9909 => 1.0352, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.47% (0.2729 => 0.2851, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.46% (0.3004 => 0.3138, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.44% (2.0673 => 2.1591, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.43% (0.2911 => 0.3040, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.41% (0.3195 => 0.3336, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.41% (0.2811 => 0.2935, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.39% (0.2736 => 0.2856, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.35% (0.3060 => 0.3193, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3096 => 0.3230, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2750 => 0.2869, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.32% (0.2823 => 0.2945, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.32% (0.2803 => 0.2924, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 4.32% (0.2780 => 0.2900, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2792 => 0.2912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 4.19% (0.3267 => 0.3404, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.17% (0.3258 => 0.3394, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.16% (0.2813 => 0.2930, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.12% (5.5417 => 5.7698, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3317 => 0.3453, std. dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (0.2691 => 0.2801, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 3.99% (0.3336 => 0.3469, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3348 => 0.3481, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.95% (0.3845 => 0.3997, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.91% (0.9697 => 1.0076, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3282 => 0.3410, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.87% (0.6634 => 0.6891, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3726 => 0.3870, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (0.4658 => 0.4838, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.3625 => 0.3765, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.86% (0.3678 => 0.3820, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (1.9694 => 2.0449, std. dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.80% (2.7292 => 2.8330, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3477 => 0.3606, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.67% (23.5202 => 24.3834, std. dev.: 0.0207) MultiSource/Applications/JM/ldecod/ldecod: 3.63% (2.1653 => 2.2438, std. dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: 3.60% (1.8794 => 1.9471, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (1.9966 => 2.0681, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.58% (0.3690 => 0.3822, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.55% (0.3890 => 0.4028, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.4146 => 0.4293, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 3.52% (4.6177 => 4.7802, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.48% (2.1013 => 2.1744, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 3.46% (0.4251 => 0.4398, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.3903 => 0.4037, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.3981 => 0.4114, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.30% (0.3271 => 0.3379, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (4.4195 => 4.5623, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.6435 => 0.6636, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 3.08% (1.4269 => 1.4709, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.06% (0.7875 => 0.8116, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.99% (0.5012 => 0.5162, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.4139 => 0.4259, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.54% (0.5546 => 0.5687, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.18% (2.0346 => 2.0789, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (0.7426 => 0.7536, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (11.6398 => 11.7588, std. dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6745, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std. dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6415, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6885, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2016, std. dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (41.7953 => 42.6332, std. dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5919, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.71% (50.0626 => 50.9203, std. dev.: 0.0169) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2212, std. dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.28% (7.1849 => 7.2767, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.37% (2.4764 => 2.3929, std. dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5790, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.56% (35.5013 => 32.8164, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7910, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.62% (0.6293 => 0.6128, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -2.35% (17.2379 => 16.8328, std. dev.: 0.0875) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5798, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9583, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 14:15:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 16:15:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120811211531.CE3DF2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2816?compare_to=2813&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2816, Order: 161728, Start Time: 2012-08-11 20:02:24, End Time: 2012-08-11 21:16:11 To: 2813, Order: 161725, Start Time: 2012-08-11 18:20:02, End Time: 2012-08-11 19:34:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (144 on baseline) Performance Improvements: 8 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 941 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.80% (0.0851 => 0.0994, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 12.43% (1.0975 => 1.2339, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.16% (79.0940 => 80.8020, std. dev.: 0.3423) MultiSource/Applications/lemon/lemon: 1.25% (1.4343 => 1.4522, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.13% (5.2668 => 5.3263, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (0.9522 => 0.8487, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.20% (1.2008 => 1.1023, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -7.57% (1.9584 => 1.8101, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.40% (1.1789 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.80% (1.0438 => 1.0250, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.67% (0.9912 => 0.9746, std. dev.: 0.0000) MultiSource/Applications/lua/lua: -1.59% (26.9367 => 26.5087, std. dev.: 0.0208) MultiSource/Applications/siod/siod: -1.44% (3.3379 => 3.2898, std. dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.40% (2.0176 => 2.3081, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 12.35% (0.0826 => 0.0928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.01% (0.5818 => 0.6342, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5748 => 0.6259, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.16% (0.7061 => 0.7637, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.94% (0.3578 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.76% (1.3693 => 1.4755, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.67% (0.3623 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3663 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.65% (0.3789 => 0.4079, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.56% (0.3650 => 0.3926, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.41% (0.3940 => 0.4232, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2781 => 0.2986, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.4328 => 0.4643, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.2937 => 0.3148, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2655 => 0.2845, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (3.9660 => 4.2457, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.96% (0.7710 => 0.8247, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.95% (0.5265 => 0.5631, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.89% (0.7038 => 0.7523, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2696 => 0.2880, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.78% (0.3022 => 0.3227, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.60% (0.2726 => 0.2906, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2765 => 0.2947, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.54% (0.3899 => 0.4154, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.50% (1.9828 => 2.1116, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.48% (0.3580 => 0.3812, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.45% (0.2761 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.43% (0.3485 => 0.3709, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3107 => 0.3306, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2988 => 0.3176, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 6.29% (0.3149 => 0.3347, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.25% (1.2193 => 1.2955, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.22% (0.3489 => 0.3706, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.19% (0.9199 => 0.9768, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.6959 => 0.7373, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 5.89% (0.3293 => 0.3487, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3534 => 0.3742, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.88% (0.3453 => 0.3656, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.88% (0.4390 => 0.4648, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.68% (0.5577 => 0.5894, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (0.3756 => 0.3968, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.43% (0.3868 => 0.4078, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.36% (0.3246 => 0.3420, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.36% (13.8202 => 14.5609, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.29% (0.5637 => 0.5935, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.24% (1.4563 => 1.5326, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.07% (1.1364 => 1.1940, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.96% (1.2292 => 1.2902, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.93% (7.2180 => 7.5738, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 4.90% (0.8310 => 0.8717, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.83% (3.8646 => 4.0511, std. dev.: 0.0068) MultiSource/Applications/Burg/burg: 4.81% (1.1061 => 1.1593, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.3245 => 1.3879, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.71% (1.0594 => 1.1093, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.67% (2.1791 => 2.2808, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (1.3813 => 1.4456, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.65% (0.7506 => 0.7855, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.3819 => 1.4455, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.56% (1.9270 => 2.0148, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.7460 => 0.7776, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.14% (16.6129 => 17.3003, std. dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6218, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.93% (3.6692 => 3.8134, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.3801 => 4.5521, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (13.2842 => 13.7976, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.8698 => 0.9022, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.67% (4.9865 => 5.1695, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1333 => 1.1747, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6135 => 0.6356, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.26% (16.2614 => 16.7923, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 3.22% (8.4961 => 8.7697, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 3.17% (3.1889 => 3.2901, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 3.00% (14.8535 => 15.2995, std. dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.5754 => 6.7727, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.82% (3.2742 => 3.3664, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9217, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5188 => 1.5588, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.58% (4.6629 => 4.7832, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1007 => 2.1517, std. dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6250 => 0.6377, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.74% (1.0313 => 1.0492, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.21% (3.7467 => 3.7922, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5194, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std. dev.: 0.0504) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.62% (1.2998 => 1.4249, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7432, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.36% (2.8606 => 2.9567, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0173) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3830, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6008, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.18% (10.7476 => 10.9818, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1728, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.60% (1.3780 => 1.3146, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8018, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0219, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5844, std. dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.54% (20.3410 => 19.8245, std. dev.: 0.0354) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9285, std. dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.16% (0.8342 => 0.8162, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2223, std. dev.: 0.0108) MultiSource/Applications/spiff/spiff: -2.05% (3.0263 => 2.9642, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2006, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.37% (9.3358 => 9.2078, std. dev.: 0.0308) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3828, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8020, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 14:25:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 16:25:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120811212511.809CE2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2817?compare_to=2814&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2817, Order: 161728, Start Time: 2012-08-11 20:07:11, End Time: 2012-08-11 21:25:51 To: 2814, Order: 161725, Start Time: 2012-08-11 18:19:55, End Time: 2012-08-11 19:38:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (98 on baseline) Performance Improvements: 10 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 917 (737 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3952 => 10.8953, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.39% (0.0854 => 0.0994, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 11.31% (1.1141 => 1.2401, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.07% (54.8374 => 56.5190, std. dev.: 0.1761) MultiSource/Applications/lemon/lemon: 1.43% (1.4290 => 1.4494, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9541 => 0.9671, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 1.18% (5.2735 => 5.3357, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.73% (14.1321 => 13.8876, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.87% (0.9505 => 0.8472, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.28% (1.1549 => 1.0593, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.10% (1.1963 => 1.1233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.95% (1.0449 => 1.0245, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -1.50% (3.0973 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.31% (2.3172 => 2.2868, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -1.29% (3.3362 => 3.2932, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.21% (19.9662 => 19.7245, std. dev.: 0.0292) SingleSource/Benchmarks/Dhrystone/fldry: -1.10% (1.8681 => 1.8476, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.96% (10.3673 => 13.8876, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/trivial-interface: 11.55% (0.3473 => 0.3874, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 11.35% (0.3497 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.31% (1.1194 => 1.2460, std. dev.: 0.0158) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3543 => 0.3943, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.61% (0.3828 => 0.4234, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.62% (2.2022 => 2.3700, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.09% (1.7609 => 1.8858, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.83% (10.4361 => 11.0449, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.33% (0.5925 => 0.6241, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.32% (0.6030 => 0.6351, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.7433 => 0.7795, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.48% (0.7326 => 0.7654, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.40% (7.0540 => 7.3646, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.29% (9.4845 => 9.8917, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1381, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (4.2646 => 4.4291, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5860 => 0.6085, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (5.0018 => 5.1905, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.63% (1.3050 => 1.3524, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.51% (0.7835 => 0.8110, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.4103 => 0.4247, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.1363 => 8.4157, std. dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.28% (0.3387 => 0.3498, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.26% (5.7591 => 5.9471, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1861 => 1.2243, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.14% (1.1642 => 1.2008, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 3.09% (0.3232 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.06% (0.9765 => 1.0064, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.04% (1.5603 => 1.6077, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.00% (1.5415 => 1.5878, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.4289 => 0.4417, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.96% (0.3441 => 0.3543, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.96% (3.3354 => 3.4341, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists: 2.92% (0.3422 => 0.3522, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.8067 => 0.8301, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.88% (0.5105 => 0.5252, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.85% (0.4636 => 0.4768, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.77% (2.0273 => 2.0834, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 2.76% (0.6456 => 0.6634, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (2.0665 => 2.1223, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.61% (17.1811 => 17.6299, std. dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.56% (0.4064 => 0.4168, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.54% (0.4048 => 0.4151, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.53% (0.6450 => 0.6613, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.53% (3.8723 => 3.9701, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4620 => 0.4732, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.37% (1.2842 => 1.3146, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (14.3668 => 14.6986, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6225, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.4186 => 1.4509, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.5020 => 0.5132, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.20% (2.2969 => 2.3474, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8921 => 0.9110, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.85% (2.2024 => 2.2432, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.66% (0.7115 => 0.7233, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.57% (1.1840 => 1.2026, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.47% (1.0722 => 1.0880, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (4.2280 => 4.4374, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7565, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.87% (26.0924 => 26.5812, std. dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8425, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 1.37% (5.2636 => 5.3357, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 1.30% (3.1578 => 3.1990, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.19% (1.3045 => 1.3200, std. dev.: 0.0058) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5766, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1490, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6916, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.18% (5.3526 => 3.6838, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0004, std. dev.: 0.0530) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.63% (2.9384 => 2.5380, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -11.96% (22.1758 => 19.5232, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4196, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -8.88% (1.5373 => 1.4008, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8028, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4739, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4282, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9957, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9636, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3359, std. dev.: 0.0104) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4252, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2868, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.12% (19.9488 => 19.7245, std. dev.: 0.0292) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std. dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 15:57:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 17:57:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120811225744.7BADB2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2818?compare_to=2816&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2818, Order: 161729, Start Time: 2012-08-11 21:44:34, End Time: 2012-08-11 22:58:23 To: 2816, Order: 161728, Start Time: 2012-08-11 20:02:24, End Time: 2012-08-11 21:16:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3002, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.23% (0.0826 => 0.0927, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.01% (0.5818 => 0.6342, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5748 => 0.6259, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7061 => 0.7640, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.94% (0.3578 => 0.3862, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.76% (0.3646 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.75% (0.3663 => 0.3947, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.66% (1.3693 => 1.4742, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 7.65% (0.3789 => 0.4079, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3650 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.59% (0.3623 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.59% (0.3914 => 0.4211, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.34% (0.2781 => 0.2985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4328 => 0.4645, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2721 => 0.2917, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2655 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.15% (0.2937 => 0.3147, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (3.9660 => 4.2461, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.5265 => 0.5635, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.7710 => 0.8246, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 6.95% (0.7038 => 0.7527, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.85% (0.3022 => 0.3229, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2765 => 0.2950, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2726 => 0.2904, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.2966 => 0.3159, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.45% (1.9828 => 2.1107, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3107 => 0.3307, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.41% (0.3899 => 0.4149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.32% (0.3149 => 0.3348, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.28% (0.3489 => 0.3708, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.22% (0.2988 => 0.3174, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.18% (1.2193 => 1.2947, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.03% (0.9199 => 0.9754, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3453 => 0.3659, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.6959 => 0.7370, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.88% (0.4390 => 0.4648, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3293 => 0.3480, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5577 => 0.5892, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (0.3756 => 0.3968, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3246 => 0.3428, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.3868 => 0.4082, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (1.4563 => 1.5333, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 5.18% (13.8202 => 14.5360, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.12% (1.1364 => 1.1946, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.92% (1.2292 => 1.2897, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (0.8310 => 0.8715, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.77% (7.2180 => 7.5624, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.3813 => 1.4465, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.71% (0.3755 => 0.3932, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.62% (1.1061 => 1.1572, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.61% (1.0594 => 1.1082, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.58% (1.3819 => 1.4452, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.57% (3.8646 => 4.0414, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (1.3245 => 1.3847, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.44% (0.7506 => 0.7839, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.35% (1.9270 => 2.0108, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.32% (0.7460 => 0.7782, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.05% (16.6129 => 17.2858, std. dev.: 0.0164) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (3.6692 => 3.8143, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 3.95% (2.1791 => 2.2651, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6173, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.3801 => 4.5485, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (13.2842 => 13.7898, std. dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1746, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.60% (1.1333 => 1.1741, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.8698 => 0.9005, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.34% (0.6135 => 0.6340, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.29% (0.6283 => 0.6490, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.12% (16.2614 => 16.7689, std. dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 3.10% (8.4961 => 8.7596, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.06% (3.1889 => 3.2866, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 2.96% (14.8535 => 15.2930, std. dev.: 0.0127) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.5754 => 6.7661, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.70% (3.2742 => 3.3626, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 2.67% (0.4113 => 0.4223, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.5298 => 14.9115, std. dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 2.51% (4.6629 => 4.7798, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5188 => 1.5560, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1472, std. dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.6250 => 0.6383, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.71% (0.6744 => 0.6859, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (0.9108 => 0.9260, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.62% (1.0313 => 1.0480, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7868, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5109, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std. dev.: 0.0528) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.37% (1.2998 => 1.4216, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7446, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9571, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3849, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6003, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.11% (10.7476 => 10.9748, std. dev.: 0.0603) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5158, std. dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6875, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 1.02% (3.7731 => 3.8116, std. dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1914, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5111, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.56% (1.1560 => 1.1033, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0219) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8016, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0210, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.74% (0.4867 => 0.4685, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5875, std. dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.67% (20.3410 => 19.7981, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9628, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2307, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2134, std. dev.: 0.0207) MultiSource/Applications/minisat/minisat: -1.37% (9.3358 => 9.2082, std. dev.: 0.0335) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3608, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8695, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8016, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5652, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 16:12:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 18:12:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120811231214.2113E2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2819?compare_to=2817&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2819, Order: 161729, Start Time: 2012-08-11 21:54:08, End Time: 2012-08-11 23:12:54 To: 2817, Order: 161728, Start Time: 2012-08-11 20:07:11, End Time: 2012-08-11 21:25:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (92 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (744 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.96% (10.3673 => 13.8885, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 11.55% (0.3473 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.27% (1.1194 => 1.2456, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.83% (0.3694 => 0.4094, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.61% (0.3828 => 0.4234, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.65% (2.2022 => 2.3707, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.12% (1.7609 => 1.8862, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 5.66% (10.4361 => 11.0273, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.38% (0.5925 => 0.6244, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.6030 => 0.6347, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.94% (0.7433 => 0.7800, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.81% (0.3282 => 0.3440, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.44% (7.0540 => 7.3675, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 4.42% (0.7326 => 0.7650, std. dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 4.28% (9.4845 => 9.8905, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.17% (0.5569 => 0.5801, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1960, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.8172 => 0.8489, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.9449 => 5.1325, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.74% (4.2646 => 4.4242, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.72% (0.5860 => 0.6078, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.62% (1.3050 => 1.3523, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.50% (8.1363 => 8.4213, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 3.48% (0.7835 => 0.8108, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.25% (5.7591 => 5.9465, std. dev.: 0.0151) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.11% (0.3826 => 0.3945, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 3.09% (1.5603 => 1.6085, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.5415 => 1.5889, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 3.04% (0.3422 => 0.3526, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.03% (0.9765 => 1.0061, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.00% (0.4636 => 0.4775, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.99% (3.3354 => 3.4351, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.4289 => 0.4417, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.93% (0.3650 => 0.3757, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.88% (1.1642 => 1.1977, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.8067 => 0.8295, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 2.81% (2.0273 => 2.0843, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6456 => 0.6632, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (2.0665 => 2.1222, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.69% (17.1811 => 17.6439, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.62% (0.5105 => 0.5239, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (0.4064 => 0.4164, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.45% (14.3668 => 14.7195, std. dev.: 0.0148) MultiSource/Applications/lua/lua: 2.45% (3.8723 => 3.9673, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.6675 => 0.6835, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.37% (0.6450 => 0.6603, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.32% (1.2842 => 1.3140, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (0.4620 => 0.4727, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.30% (1.5859 => 1.6223, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.26% (1.4186 => 1.4507, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.18% (2.2969 => 2.3470, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.16% (0.8921 => 0.9114, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.2024 => 2.2410, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.58% (1.1840 => 1.2027, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.57% (0.7115 => 0.7227, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.39% (1.0722 => 1.0871, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.64% (4.2280 => 4.4241, std. dev.: 0.0141) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7530, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.75% (26.0924 => 26.5497, std. dev.: 0.0279) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8423, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.35% (5.2636 => 5.3345, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1997, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.32% (5.2763 => 3.1491, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.44% (5.3855 => 3.6921, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.19% (5.3526 => 3.6829, std. dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0242, std. dev.: 0.0252) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5372, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -11.96% (22.1758 => 19.5238, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -6.99% (1.5373 => 1.4299, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8031, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4654, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4102, std. dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.52% (10.2830 => 10.0243, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9638, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std. dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3380, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2867, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.8329 => 1.8143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 17:15:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 19:15:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120812001501.8A50F2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2820?compare_to=2815&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2820, Order: 161729, Start Time: 2012-08-11 21:32:00, End Time: 2012-08-12 00:15:41 To: 2815, Order: 161725, Start Time: 2012-08-11 18:19:45, End Time: 2012-08-11 21:03:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 22.05% (0.3792 => 0.4628, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 11.50% (0.3496 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.40% (0.3465 => 0.3860, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.39% (0.3442 => 0.3834, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3446 => 0.3838, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3488 => 0.3884, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 11.30% (0.3460 => 0.3851, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.30% (0.3469 => 0.3861, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.96% (0.3650 => 0.4050, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3643 => 0.4039, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.63% (0.3724 => 0.4120, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.99% (1.5932 => 1.7046, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5826 => 0.6195, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 5.99% (0.5889 => 0.6242, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (0.4994 => 0.5269, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (1.6211 => 1.7101, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.47% (1.3152 => 1.3872, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.44% (3.5627 => 3.7566, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.1968 => 0.2075, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 5.42% (0.7171 => 0.7560, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (0.5900 => 0.6215, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2738 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.16% (0.4361 => 0.4586, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.06% (0.2866 => 0.3011, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.01% (0.2875 => 0.3019, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.5000 => 0.5250, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.99% (0.3930 => 0.4126, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.82% (4.2109 => 4.4139, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 4.73% (1.0781 => 1.1291, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.62% (0.2725 => 0.2851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.58% (0.2729 => 0.2854, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.57% (0.2714 => 0.2838, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.52% (0.9909 => 1.0357, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.45% (0.2811 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2780 => 0.2903, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.37% (2.0673 => 2.1576, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/strcat: 4.36% (0.2750 => 0.2870, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.34% (0.3362 => 0.3508, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.3625 => 0.3782, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3096 => 0.3230, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.3195 => 0.3333, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.32% (0.2803 => 0.2924, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.29% (0.3004 => 0.3133, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.29% (0.2823 => 0.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.23% (0.2813 => 0.2932, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.23% (0.2911 => 0.3034, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.22% (0.3267 => 0.3405, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.21% (0.3258 => 0.3395, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.18% (0.3060 => 0.3188, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.17% (0.2566 => 0.2673, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.10% (5.5417 => 5.7690, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3317 => 0.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.05% (0.4146 => 0.4314, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (0.4658 => 0.4845, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3124 => 0.3247, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.93% (0.9697 => 1.0078, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3282 => 0.3410, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3726 => 0.3871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.89% (0.3678 => 0.3821, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.3845 => 0.3994, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 3.82% (0.3348 => 0.3476, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.3271 => 0.3395, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.77% (0.6634 => 0.6884, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 3.77% (0.3477 => 0.3608, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (2.7292 => 2.8289, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.65% (1.9694 => 2.0413, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 3.65% (23.5202 => 24.3777, std. dev.: 0.0149) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.60% (0.4139 => 0.4288, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.58% (2.1013 => 2.1766, std. dev.: 0.0128) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.57% (1.9966 => 2.0679, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4251 => 0.4401, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.52% (0.3890 => 0.4027, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.47% (0.3690 => 0.3818, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 3.43% (4.6177 => 4.7763, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 3.43% (2.1653 => 2.2395, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.3903 => 0.4033, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.29% (0.3981 => 0.4112, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (1.8794 => 1.9403, std. dev.: 0.0049) MultiSource/Applications/lua/lua: 3.15% (1.4269 => 1.4718, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.12% (0.7875 => 0.8121, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (4.4195 => 4.5565, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.95% (0.6435 => 0.6625, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.93% (0.5012 => 0.5159, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.89% (2.0346 => 2.0730, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (0.7426 => 0.7531, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8901, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6484, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6870, std. dev.: 0.0420) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1951, std. dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.90% (41.7953 => 42.5887, std. dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5917, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9086, std. dev.: 0.0288) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std. dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3066, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2815, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5795, std. dev.: 0.0167) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7975, std. dev.: 0.0112) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8025, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std. dev.: 0.0049) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (17.2379 => 16.8384, std. dev.: 0.0495) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9626, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 17:39:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 19:39:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120812003958.1C6EE2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2821?compare_to=2818&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2821, Order: 161730, Start Time: 2012-08-11 23:26:49, End Time: 2012-08-12 00:40:36 To: 2818, Order: 161729, Start Time: 2012-08-11 21:44:34, End Time: 2012-08-11 22:58:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.22% (54.7136 => 56.4762, std. dev.: 0.0219) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3003, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.23% (0.0826 => 0.0927, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.06% (0.5818 => 0.6345, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5748 => 0.6257, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.3130 => 0.3404, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7061 => 0.7640, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 7.97% (0.3578 => 0.3863, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.77% (1.3693 => 1.4757, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 7.75% (0.3601 => 0.3880, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.73% (0.3646 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3623 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.56% (0.3650 => 0.3926, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.4003 => 0.4302, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4328 => 0.4645, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2690 => 0.2883, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 7.15% (0.2628 => 0.2816, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.10% (0.5265 => 0.5639, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2655 => 0.2843, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (3.9660 => 4.2452, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.95% (0.7038 => 0.7527, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.85% (0.3022 => 0.3229, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.79% (0.4062 => 0.4338, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.7710 => 0.8233, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2765 => 0.2945, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.49% (0.2726 => 0.2903, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.48% (0.2761 => 0.2940, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.2966 => 0.3158, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.44% (0.3899 => 0.4150, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3107 => 0.3307, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.39% (1.9828 => 2.1095, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary3: 6.35% (0.3149 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3489 => 0.3710, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3580 => 0.3806, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.22% (0.2988 => 0.3174, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.22% (1.2193 => 1.2952, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.10% (0.9199 => 0.9760, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4390 => 0.4657, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3453 => 0.3659, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.6959 => 0.7373, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5577 => 0.5890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.60% (0.4016 => 0.4241, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.3756 => 0.3964, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.51% (0.3246 => 0.3425, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.38% (0.3868 => 0.4076, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.23% (13.8202 => 14.5431, std. dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.1364 => 1.1952, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.14% (1.4563 => 1.5312, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5637 => 0.5915, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 4.92% (1.2292 => 1.2897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.89% (0.8310 => 0.8716, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.77% (1.1061 => 1.1589, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.77% (7.2180 => 7.5621, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.71% (1.3813 => 1.4464, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3755 => 0.3930, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.64% (3.8646 => 4.0440, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3859, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 4.61% (1.0594 => 1.1082, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.58% (1.3819 => 1.4452, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 4.46% (1.9270 => 2.0130, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.32% (0.7460 => 0.7782, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.21% (2.1791 => 2.2709, std. dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 4.04% (16.6129 => 17.2839, std. dev.: 0.0275) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (4.4433 => 4.6200, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.95% (3.6692 => 3.8142, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.86% (0.4791 => 0.4976, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5490, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1774, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (13.2842 => 13.7855, std. dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.63% (1.1333 => 1.1744, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.8698 => 0.9010, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.50% (0.6135 => 0.6350, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.19% (3.1889 => 3.2906, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.16% (16.2614 => 16.7756, std. dev.: 0.0201) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (8.4961 => 8.7614, std. dev.: 0.0109) MultiSource/Applications/JM/lencod/lencod: 2.97% (14.8535 => 15.2942, std. dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.5754 => 6.7676, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (3.2742 => 3.3653, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 2.75% (0.4113 => 0.4226, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.69% (14.5298 => 14.9212, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5188 => 1.5572, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.50% (4.6629 => 4.7796, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.1007 => 2.1492, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6250 => 0.6377, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.65% (1.0313 => 1.0483, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7859, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5096, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0473) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.20% (1.2998 => 1.4064, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7423, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6041, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.01% (10.7476 => 10.9637, std. dev.: 0.0476) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.43% (2.1753 => 2.2065, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.27% (1.0895 => 1.1033, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1837, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.29% (0.4657 => 0.3945, std. dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1983, std. dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5092, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8017, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.71% (20.3410 => 19.7891, std. dev.: 0.0152) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6069, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.16% (0.8342 => 0.8162, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9624, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2385, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.64% (7.3305 => 7.2102, std. dev.: 0.0083) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3723, std. dev.: 0.0103) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2212, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8020, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8715, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 17:59:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 19:59:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120812005915.F026E2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2822?compare_to=2819&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2822, Order: 161730, Start Time: 2012-08-11 23:41:08, End Time: 2012-08-12 00:59:57 To: 2819, Order: 161729, Start Time: 2012-08-11 21:54:08, End Time: 2012-08-11 23:12:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (97 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (54.4930 => 56.3455, std. dev.: 0.1933) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.06% (1.3135 => 1.3274, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.91% (10.3673 => 13.8830, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.44% (1.1194 => 1.2475, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3497 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3516 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.18% (0.3561 => 0.3959, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.91% (0.3694 => 0.4097, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.59% (0.1432 => 0.1555, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.67% (2.2022 => 2.3711, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.17% (1.7609 => 1.8871, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.70% (10.4361 => 11.0311, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 5.50% (0.5925 => 0.6251, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.34% (0.6030 => 0.6352, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 5.06% (0.7433 => 0.7809, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3282 => 0.3446, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.59% (7.0540 => 7.3777, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.50% (0.7326 => 0.7656, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (9.4845 => 9.8974, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.06% (0.8172 => 0.8504, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (4.9449 => 5.1378, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1948, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.79% (0.5860 => 0.6082, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.74% (4.2646 => 4.4240, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.67% (1.3050 => 1.3529, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.54% (0.3387 => 0.3507, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.52% (0.7835 => 0.8111, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.50% (8.1363 => 8.4213, std. dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.26% (5.7591 => 5.9468, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.4103 => 0.4236, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1861 => 1.2239, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.16% (1.1642 => 1.2010, std. dev.: 0.0089) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.5415 => 1.5893, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3650 => 0.3763, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9765 => 1.0067, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.06% (1.5603 => 1.6081, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.05% (0.4289 => 0.4420, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.02% (0.3441 => 0.3545, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.98% (0.3826 => 0.3940, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.95% (3.3354 => 3.4337, std. dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.8067 => 0.8301, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 2.84% (2.0273 => 2.0848, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.82% (0.6456 => 0.6638, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (2.0665 => 2.1246, std. dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (0.3935 => 0.4043, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (0.4064 => 0.4173, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.64% (17.1811 => 17.6340, std. dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.60% (1.5859 => 1.6272, std. dev.: 0.0148) MultiSource/Applications/lua/lua: 2.53% (3.8723 => 3.9703, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.50% (0.4203 => 0.4308, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.45% (0.6450 => 0.6608, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.38% (0.6675 => 0.6834, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.38% (1.2842 => 1.3147, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (0.4620 => 0.4728, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.33% (0.4299 => 0.4399, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (14.3668 => 14.6974, std. dev.: 0.0183) MultiSource/Applications/siod/siod: 2.27% (2.2969 => 2.3490, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8921 => 0.9121, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.4186 => 1.4504, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5981 => 0.6110, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5020 => 0.5124, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.2024 => 2.2430, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.65% (1.1840 => 1.2035, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.50% (1.0722 => 1.0883, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.43% (2.6778 => 2.9572, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (4.2280 => 4.4507, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7524, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5761, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.76% (1.3045 => 1.3274, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8425, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.35% (5.2636 => 5.3349, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 1.35% (3.1578 => 3.2005, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6817, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.34% (5.2763 => 3.1479, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.41% (5.3855 => 3.6937, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.18% (5.3526 => 3.6836, std. dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0050, std. dev.: 0.0542) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5374, std. dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: -12.02% (22.1758 => 19.5094, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -6.82% (1.5373 => 1.4325, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8028, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4805, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.6802 => 8.4351, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0122, std. dev.: 0.0164) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9613, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3379, std. dev.: 0.0082) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.32% (19.9488 => 19.6851, std. dev.: 0.0409) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2867, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8140, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 19:22:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 21:22:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120812022219.620402A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2823?compare_to=2821&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2823, Order: 161732, Start Time: 2012-08-12 01:09:02, End Time: 2012-08-12 02:22:57 To: 2821, Order: 161730, Start Time: 2012-08-11 23:26:49, End Time: 2012-08-12 00:40:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3048, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.18% (0.5818 => 0.6352, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.82% (0.7061 => 0.7684, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 8.36% (0.3578 => 0.3877, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 8.12% (0.3646 => 0.3942, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.97% (0.3663 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3623 => 0.3910, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 7.92% (0.3914 => 0.4224, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.89% (1.3693 => 1.4774, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.87% (0.2782 => 0.3001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3650 => 0.3937, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.61% (0.3940 => 0.4240, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.51% (0.4328 => 0.4653, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.32% (0.7038 => 0.7553, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.24% (3.9660 => 4.2532, std. dev.: 0.0119) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.7710 => 0.8268, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.69% (0.3899 => 0.4160, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2765 => 0.2950, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.57% (1.9828 => 2.1130, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3580 => 0.3815, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.53% (0.3489 => 0.3717, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.41% (1.2193 => 1.2975, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.31% (0.9199 => 0.9779, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.18% (0.6959 => 0.7389, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.12% (0.4379 => 0.4647, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3453 => 0.3663, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.99% (0.4390 => 0.4653, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.89% (0.3293 => 0.3487, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.85% (0.4016 => 0.4251, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.79% (0.5577 => 0.5900, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (0.3756 => 0.3969, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2127 => 0.2247, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.60% (1.4563 => 1.5379, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 5.47% (13.8202 => 14.5755, std. dev.: 0.0134) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.2914 => 0.3072, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.34% (1.1364 => 1.1971, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.29% (0.5637 => 0.5935, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.12% (7.2180 => 7.5873, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 5.10% (0.8310 => 0.8734, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.09% (1.0594 => 1.1133, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.04% (1.3819 => 1.4515, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 5.03% (1.2292 => 1.2910, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.95% (1.3245 => 1.3900, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.93% (1.1061 => 1.1606, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.92% (0.7506 => 0.7875, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (1.3813 => 1.4492, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3755 => 0.3938, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.84% (3.8646 => 4.0518, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 4.65% (1.9270 => 2.0166, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (0.7460 => 0.7800, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.45% (0.4791 => 0.5004, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.35% (2.1791 => 2.2739, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 4.31% (16.6129 => 17.3297, std. dev.: 0.0179) MultiSource/Applications/sgefa/sgefa: 4.31% (0.2995 => 0.3124, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (4.4433 => 4.6302, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.20% (3.6692 => 3.8232, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.05% (4.9865 => 5.1887, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.05% (13.2842 => 13.8216, std. dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.3801 => 4.5562, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.85% (0.8698 => 0.9033, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.80% (1.1333 => 1.1764, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.77% (0.3131 => 0.3249, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6135 => 0.6366, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.58% (0.6283 => 0.6508, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.42% (8.4961 => 8.7870, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 3.41% (3.1889 => 3.2977, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 3.29% (16.2614 => 16.7961, std. dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 3.21% (14.8535 => 15.3305, std. dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (6.5754 => 6.7764, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.02% (3.2742 => 3.3731, std. dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 2.98% (4.6629 => 4.8019, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 2.92% (0.4113 => 0.4233, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.90% (14.5298 => 14.9508, std. dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5188 => 1.5612, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1007 => 2.1518, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6250 => 0.6398, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.89% (0.9108 => 0.9280, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.87% (0.6744 => 0.6870, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.28% (3.7467 => 3.7948, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.11% (33.2944 => 33.6636, std. dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 27.10% (1.8175 => 2.3100, std. dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.25% (1.2998 => 1.4200, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.01% (1.5824 => 1.6617, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.42% (11.2619 => 11.7596, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8175, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3830, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6037, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.93% (10.7476 => 10.9548, std. dev.: 0.0709) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.82% (22.5627 => 21.2488, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.61% (1.1560 => 1.1027, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8016, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.51% (20.3410 => 19.8304, std. dev.: 0.0269) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.49% (8.8259 => 8.6061, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.98% (3.0263 => 2.9663, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2361, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3305 => 7.2112, std. dev.: 0.0285) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std. dev.: 0.0199) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2103, std. dev.: 0.0183) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3791, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8023, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 19:46:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 21:46:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120812024621.C500C2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2824?compare_to=2822&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2824, Order: 161733, Start Time: 2012-08-12 01:28:13, End Time: 2012-08-12 02:47:02 To: 2822, Order: 161730, Start Time: 2012-08-11 23:41:08, End Time: 2012-08-12 00:59:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (88 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (13.8830 => 14.0332, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.36% (10.3673 => 14.0332, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.38% (0.3516 => 0.3916, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.27% (1.1194 => 1.2456, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 11.27% (0.3497 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.46% (2.2022 => 2.3884, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.29% (1.7609 => 1.8892, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 5.87% (10.4361 => 11.0483, std. dev.: 0.0120) SingleSource/UnitTests/ObjC++/Hello: 5.49% (0.5925 => 0.6250, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.42% (0.6030 => 0.6357, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.8172 => 0.8596, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.65% (0.7326 => 0.7667, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7433 => 0.7772, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.50% (7.0540 => 7.3713, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.43% (0.4879 => 0.5095, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (9.4845 => 9.8763, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (5.0018 => 5.1944, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.9449 => 5.1307, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (4.2646 => 4.4229, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5860 => 0.6076, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.48% (1.3050 => 1.3504, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 3.42% (0.7835 => 0.8103, std. dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.30% (5.7591 => 5.9492, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.30% (8.1363 => 8.4047, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.19% (0.4636 => 0.4784, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.10% (0.3387 => 0.3492, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1861 => 1.2224, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.5415 => 1.5883, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.97% (0.9765 => 1.0055, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1978, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 2.75% (3.3354 => 3.4271, std. dev.: 0.0136) MultiSource/Applications/treecc/treecc: 2.69% (2.0273 => 2.0819, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.68% (0.8067 => 0.8283, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.5105 => 0.5238, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.49% (0.4289 => 0.4396, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5988, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.42% (17.1811 => 17.5977, std. dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.32% (3.8723 => 3.9621, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.29% (2.0665 => 2.1139, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (14.3668 => 14.6909, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (1.5859 => 1.6211, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6675 => 0.6820, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.17% (1.4186 => 1.4494, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6450 => 0.6590, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8921 => 0.9109, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.07% (2.2969 => 2.3444, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5981 => 0.6104, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.99% (0.5020 => 0.5120, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3097, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (2.2024 => 2.2401, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.63% (1.1840 => 1.2033, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.62% (0.7115 => 0.7230, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.33% (1.0722 => 1.0865, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (4.2280 => 4.4430, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7530, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.82% (26.0924 => 26.5679, std. dev.: 0.0206) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8427, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.41% (5.2636 => 5.3380, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (3.1578 => 3.2007, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5775, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6823, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1285, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.22% (5.2763 => 3.1543, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.03% (5.3855 => 3.7143, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.79% (5.3526 => 3.7045, std. dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -15.06% (54.1659 => 46.0063, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.50% (2.9384 => 2.5418, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.13% (22.1758 => 19.4848, std. dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -7.58% (1.5373 => 1.4208, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/richards_benchmark: -6.98% (1.1396 => 1.0600, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8031, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4681, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4254, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.56% (10.2830 => 10.0200, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9642, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.78% (2.5528 => 2.5073, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3513, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2868, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8123, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 20:27:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 22:27:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120812032701.7D5EE2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2825?compare_to=2820&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2825, Order: 161732, Start Time: 2012-08-12 00:44:08, End Time: 2012-08-12 03:27:42 To: 2820, Order: 161729, Start Time: 2012-08-11 21:32:00, End Time: 2012-08-12 00:15:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (113 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (129.4065 => 131.3035, std. dev.: 0.0308) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.45% (0.3446 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.42% (0.3469 => 0.3900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.41% (0.3465 => 0.3895, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3442 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3488 => 0.3919, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.60% (0.3724 => 0.4156, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 7.16% (0.5826 => 0.6243, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.84% (0.5889 => 0.6292, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.58% (1.5932 => 1.6981, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.28% (0.7171 => 0.7621, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.5900 => 0.6245, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (1.6211 => 1.7147, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2738 => 0.2894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (3.5627 => 3.7639, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.60% (1.3152 => 1.3888, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (0.5026 => 0.5299, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.39% (0.4994 => 0.5263, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (0.5000 => 0.5264, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2875 => 0.3026, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.22% (0.3930 => 0.4135, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 4.98% (0.2813 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.94% (0.2792 => 0.2930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.94% (0.2714 => 0.2848, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.92% (0.9909 => 1.0397, std. dev.: 0.0074) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.3004 => 0.3151, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2823 => 0.2961, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.89% (4.2109 => 4.4167, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 4.88% (0.2725 => 0.2858, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.86% (0.4029 => 0.4225, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.86% (0.2780 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2750 => 0.2883, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.76% (0.2729 => 0.2859, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.74% (0.2911 => 0.3049, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.74% (2.0673 => 2.1653, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.73% (0.2811 => 0.2944, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 4.68% (1.0781 => 1.1286, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 4.68% (0.3267 => 0.3420, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.67% (0.2803 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.65% (0.3096 => 0.3240, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3124 => 0.3266, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.51% (0.3258 => 0.3405, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 4.43% (0.3317 => 0.3464, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.41% (0.3060 => 0.3195, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.3282 => 0.3426, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.37% (0.3362 => 0.3509, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.35% (0.3726 => 0.3888, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.2866 => 0.2989, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 4.24% (0.3348 => 0.3490, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3678 => 0.3831, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (0.3625 => 0.3773, std. dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 4.07% (5.5417 => 5.7675, std. dev.: 0.0126) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.07% (2.7292 => 2.8403, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.05% (0.2566 => 0.2670, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (2.1013 => 2.1858, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 3.97% (0.3477 => 0.3615, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (1.9966 => 2.0755, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.93% (0.3890 => 0.4043, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.93% (0.4146 => 0.4309, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (1.9694 => 2.0466, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 3.91% (0.9697 => 1.0076, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.90% (0.3690 => 0.3834, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.77% (0.3981 => 0.4131, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.74% (0.4251 => 0.4410, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.3903 => 0.4047, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.3845 => 0.3985, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 3.50% (4.6177 => 4.7793, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (2.1653 => 2.2402, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.45% (0.4139 => 0.4282, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.42% (0.6634 => 0.6861, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 3.33% (23.5202 => 24.3023, std. dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (1.8794 => 1.9406, std. dev.: 0.0073) MultiSource/Applications/treecc/treecc: 3.23% (0.7875 => 0.8129, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 3.20% (1.4269 => 1.4725, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.3271 => 0.3374, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.11% (0.5012 => 0.5168, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (4.4195 => 4.5565, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.08% (0.6435 => 0.6633, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.98% (2.0346 => 2.0749, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (11.6398 => 11.7616, std. dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6124, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6805, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1669, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.60% (1.8057 => 1.8888, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6346, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (105.3826 => 107.6165, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1965, std. dev.: 0.0081) MultiSource/Applications/lua/lua: 1.74% (50.0626 => 50.9356, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4488, std. dev.: 0.0989) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2209, std. dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3042, std. dev.: 0.0169) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2883, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5116, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.94% (2.4764 => 2.4035, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5719, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary2: -8.58% (0.2402 => 0.2196, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8079, std. dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9593, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8018, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8307, std. dev.: 0.0615) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.66% (10.7630 => 10.5840, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9707, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 21:04:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 23:04:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120812040433.3B0222A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2826?compare_to=2823&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2826, Order: 161733, Start Time: 2012-08-12 02:51:19, End Time: 2012-08-12 04:05:11 To: 2823, Order: 161732, Start Time: 2012-08-12 01:09:02, End Time: 2012-08-12 02:22:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.41% (3.7642 => 3.8551, std. dev.: 0.0208) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.20% (2.3100 => 2.2591, std. dev.: 0.0137) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.00% (2.0176 => 2.3000, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.47% (0.0826 => 0.0929, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.5818 => 0.6375, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.34% (0.5748 => 0.6285, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.25% (0.7061 => 0.7714, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.07% (0.3130 => 0.3414, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3578 => 0.3895, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.63% (0.3663 => 0.3979, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3789 => 0.4113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.35% (0.3914 => 0.4241, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2782 => 0.3010, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.10% (0.3940 => 0.4259, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.04% (1.3693 => 1.4794, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 8.00% (0.4062 => 0.4387, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (0.1413 => 0.1525, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.91% (0.2781 => 0.3001, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.83% (0.4328 => 0.4667, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.75% (0.2607 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.73% (0.2690 => 0.2898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.72% (0.2628 => 0.2831, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.69% (0.2937 => 0.3163, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.68% (0.2655 => 0.2859, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.50% (0.5265 => 0.5660, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.42% (3.9660 => 4.2604, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.38% (0.2696 => 0.2895, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2765 => 0.2965, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.23% (0.7038 => 0.7547, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.7710 => 0.8263, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 7.12% (0.2726 => 0.2920, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.2966 => 0.3173, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.97% (1.9828 => 2.1211, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.97% (0.3485 => 0.3728, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3899 => 0.4168, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.87% (0.3580 => 0.3826, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3489 => 0.3725, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.65% (0.4390 => 0.4682, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.60% (1.2193 => 1.2998, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.46% (0.3453 => 0.3676, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.40% (0.9199 => 0.9788, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.38% (0.3293 => 0.3503, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.21% (0.6959 => 0.7391, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (0.4379 => 0.4650, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.15% (0.4016 => 0.4263, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.14% (0.3534 => 0.3751, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.02% (0.3756 => 0.3982, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.00% (0.3868 => 0.4100, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.99% (0.5577 => 0.5911, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.83% (0.2127 => 0.2251, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.77% (0.2945 => 0.3115, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.61% (13.8202 => 14.5962, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.53% (1.4563 => 1.5368, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.46% (1.1364 => 1.1985, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 5.39% (1.2292 => 1.2955, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.29% (0.2023 => 0.2130, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.25% (7.2180 => 7.5971, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.25% (0.5637 => 0.5933, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.19% (0.3755 => 0.3950, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.19% (0.8310 => 0.8741, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.03% (1.3813 => 1.4508, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.01% (1.3245 => 1.3908, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.97% (0.7506 => 0.7879, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.95% (1.0594 => 1.1118, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.92% (1.1061 => 1.1605, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.89% (1.3819 => 1.4495, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 4.76% (3.8646 => 4.0484, std. dev.: 0.0109) MultiSource/Applications/treecc/treecc: 4.71% (1.9270 => 2.0178, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.66% (0.7460 => 0.7808, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.43% (16.6129 => 17.3491, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.38% (0.4791 => 0.5001, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2995 => 0.3126, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.36% (4.4433 => 4.6370, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.32% (3.6692 => 3.8276, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (4.3801 => 4.5659, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.24% (4.9865 => 5.1978, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 4.22% (0.3220 => 0.3356, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 4.22% (2.1791 => 2.2711, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (13.2842 => 13.8438, std. dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.07% (0.8698 => 0.9052, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.1333 => 1.1781, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.90% (0.6283 => 0.6528, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.77% (0.3131 => 0.3249, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.73% (0.6135 => 0.6364, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (8.4961 => 8.8114, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 3.53% (3.1889 => 3.3015, std. dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 3.45% (16.2614 => 16.8219, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (6.5754 => 6.7980, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 3.36% (0.4113 => 0.4251, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.32% (14.8535 => 15.3467, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.07% (3.2742 => 3.3746, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 3.06% (4.6629 => 4.8055, std. dev.: 0.0164) MultiSource/Applications/ClamAV/clamscan: 2.95% (14.5298 => 14.9582, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (1.5188 => 1.5627, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.6250 => 0.6418, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (2.1007 => 2.1532, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.08% (0.4805 => 0.4905, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.00% (0.9108 => 0.9290, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.93% (0.6744 => 0.6874, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.91% (1.0313 => 1.0510, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.37% (3.7467 => 3.7981, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.2944 => 33.6928, std. dev.: 0.0195) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.13% (6.2785 => 6.3497, std. dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std. dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.66% (1.2998 => 1.4253, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.41% (11.2619 => 11.7580, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9569, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4271 => 7.6104, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.17% (3.7731 => 3.8551, std. dev.: 0.0208) MultiSource/Applications/SPASS/SPASS: 2.12% (10.7476 => 10.9756, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.99% (0.4657 => 0.4052, std. dev.: 0.0207) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.74% (22.5627 => 21.2671, std. dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.32% (1.3780 => 1.3185, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.28% (5.0168 => 4.8019, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5927, std. dev.: 0.0131) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.60% (20.3410 => 19.8126, std. dev.: 0.0216) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.17% (0.8342 => 0.8161, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.04% (3.0263 => 2.9646, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2346, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.64% (7.3305 => 7.2105, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std. dev.: 0.0087) MultiSource/Applications/minisat/minisat: -1.40% (9.3358 => 9.2054, std. dev.: 0.0328) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3699, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8032, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 21:33:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 11 Aug 2012 23:33:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120812043336.95A7C2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2827?compare_to=2824&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2827, Order: 161734, Start Time: 2012-08-12 03:15:14, End Time: 2012-08-12 04:34:14 To: 2824, Order: 161733, Start Time: 2012-08-12 01:28:13, End Time: 2012-08-12 02:47:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (86 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (14.0332 => 13.7388, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.52% (10.3673 => 13.7388, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.34% (1.1194 => 1.2463, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.58% (2.2022 => 2.3692, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.12% (1.7609 => 1.8863, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.52% (10.4361 => 11.0126, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 5.47% (0.5925 => 0.6249, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.46% (0.6030 => 0.6359, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.75% (0.4615 => 0.4834, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.55% (0.7326 => 0.7659, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.43% (0.4879 => 0.5095, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (9.4845 => 9.8932, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.24% (7.0540 => 7.3531, std. dev.: 0.0104) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.79% (5.0018 => 5.1914, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.71% (0.8172 => 0.8475, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.65% (4.9449 => 5.1255, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.53% (4.2646 => 4.4151, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.45% (1.3050 => 1.3500, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.24% (8.1363 => 8.3998, std. dev.: 0.0094) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9443, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.19% (0.7835 => 0.8085, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.18% (0.3423 => 0.3532, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.5415 => 1.5903, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.10% (0.3387 => 0.3492, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.06% (0.4636 => 0.4778, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.95% (1.1861 => 1.2211, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9765 => 1.0049, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.80% (1.1642 => 1.1968, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.75% (0.8067 => 0.8289, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.68% (0.4103 => 0.4213, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.66% (3.3354 => 3.4242, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 2.65% (1.5603 => 1.6017, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 2.63% (2.0273 => 2.0807, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.5105 => 0.5238, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.6456 => 0.6605, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5745, std. dev.: 0.0180) MultiSource/Applications/lua/lua: 2.24% (3.8723 => 3.9591, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6212, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.14% (2.0665 => 2.1108, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8921 => 0.9102, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (14.3668 => 14.6557, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.00% (1.4186 => 1.4470, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.99% (0.5020 => 0.5120, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.95% (2.2969 => 2.3417, std. dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5981 => 0.6097, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.2024 => 2.2439, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 1.77% (1.2842 => 1.3069, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.57% (0.7115 => 0.7227, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.52% (1.1840 => 1.2020, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.31% (1.0722 => 1.0862, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.00% (4.2280 => 4.4393, std. dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7572, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.72% (26.0924 => 26.5415, std. dev.: 0.0342) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8431, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (1.3045 => 1.3248, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.2636 => 5.3350, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1578 => 3.1996, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5757, std. dev.: 0.0098) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2082, std. dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1498, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6899, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.19% (5.3526 => 3.6830, std. dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -15.17% (54.1659 => 45.9493, std. dev.: 0.0262) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.67% (2.9384 => 2.5366, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -12.26% (22.1758 => 19.4574, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -6.85% (1.5373 => 1.4320, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8030, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4716, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -2.89% (10.2830 => 9.9858, std. dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.6802 => 8.4400, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.75% (1.3677 => 1.3301, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (8.1563 => 7.9663, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3361, std. dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5133, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2868, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.15% (1.8329 => 1.8118, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.12% (19.9488 => 19.7258, std. dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 22:47:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 00:47:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120812054723.DAD072A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2828?compare_to=2826&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2828, Order: 161735, Start Time: 2012-08-12 04:33:40, End Time: 2012-08-12 05:48:02 To: 2826, Order: 161733, Start Time: 2012-08-12 02:51:19, End Time: 2012-08-12 04:05:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (151 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.19% (1.4253 => 1.4423, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.08% (1.5030 => 1.4867, std. dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.63% (2.0176 => 2.3127, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.39% (0.3130 => 0.3424, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.5818 => 0.6362, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.21% (0.7061 => 0.7711, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.12% (0.5748 => 0.6272, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3601 => 0.3911, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 8.58% (0.3578 => 0.3885, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.50% (0.3646 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.28% (1.3693 => 1.4827, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.21% (0.1413 => 0.1529, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3650 => 0.3949, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.77% (3.9660 => 4.2742, std. dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 7.74% (0.7038 => 0.7583, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.72% (0.4328 => 0.4662, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.2781 => 0.2993, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.62% (0.5265 => 0.5666, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.59% (0.1819 => 0.1957, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.54% (0.7710 => 0.8291, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4062 => 0.4368, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.47% (0.2690 => 0.2891, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.46% (0.2721 => 0.2924, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.25% (0.2607 => 0.2796, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.22% (0.2937 => 0.3149, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2696 => 0.2889, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.00% (0.3899 => 0.4172, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3489 => 0.3732, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3580 => 0.3824, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.81% (1.9828 => 2.1178, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.77% (0.3485 => 0.3721, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.71% (1.2193 => 1.3011, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.57% (0.9199 => 0.9803, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.55% (0.6959 => 0.7415, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.2988 => 0.3182, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.46% (0.4379 => 0.4662, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.38% (0.4390 => 0.4670, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.35% (0.3246 => 0.3452, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.23% (0.3293 => 0.3498, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.15% (0.3756 => 0.3987, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.11% (0.5577 => 0.5918, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.10% (0.4016 => 0.4261, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.06% (0.3534 => 0.3748, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.92% (1.4563 => 1.5425, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.88% (13.8202 => 14.6328, std. dev.: 0.2180) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.88% (0.2127 => 0.2252, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.87% (0.3868 => 0.4095, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 5.71% (0.2243 => 0.2371, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.68% (0.2023 => 0.2138, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.66% (1.1364 => 1.2007, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.63% (0.1865 => 0.1970, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.50% (0.8310 => 0.8767, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.40% (0.2925 => 0.3083, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.40% (1.1061 => 1.1658, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 5.38% (1.0594 => 1.1164, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.38% (1.2292 => 1.2953, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.2914 => 0.3070, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.31% (3.8646 => 4.0700, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.30% (7.2180 => 7.6004, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.29% (0.5637 => 0.5935, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.22% (1.3245 => 1.3936, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.18% (1.3813 => 1.4528, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.14% (1.3819 => 1.4529, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 5.13% (0.7506 => 0.7891, std. dev.: 0.0089) MultiSource/Applications/treecc/treecc: 5.00% (1.9270 => 2.0233, std. dev.: 0.0131) MultiSource/Applications/siod/siod: 4.87% (2.1791 => 2.2852, std. dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 4.86% (16.6129 => 17.4208, std. dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.3755 => 0.3937, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.82% (0.4791 => 0.5022, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.79% (0.7460 => 0.7817, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.71% (0.2995 => 0.3136, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.65% (4.4433 => 4.6501, std. dev.: 0.0094) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3220 => 0.3367, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.54% (3.6692 => 3.8358, std. dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.53% (4.9865 => 5.2126, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.50% (0.2243 => 0.2344, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.39% (4.3801 => 4.5726, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.34% (13.2842 => 13.8613, std. dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.21% (1.1333 => 1.1810, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.18% (0.8698 => 0.9062, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.14% (0.6135 => 0.6389, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.02% (0.3131 => 0.3257, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.98% (0.6283 => 0.6533, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (8.4961 => 8.8110, std. dev.: 0.0065) MultiSource/Applications/d/make_dparser: 3.67% (3.1889 => 3.3059, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 3.64% (0.2859 => 0.2963, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.62% (0.4113 => 0.4262, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.57% (16.2614 => 16.8418, std. dev.: 0.0176) MultiSource/Applications/JM/lencod/lencod: 3.57% (14.8535 => 15.3834, std. dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.53% (3.2742 => 3.3899, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.42% (6.5754 => 6.8002, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.35% (4.6629 => 4.8190, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.16% (1.5188 => 1.5668, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 3.14% (14.5298 => 14.9855, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.93% (2.1007 => 2.1623, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.6250 => 0.6417, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.33% (0.9108 => 0.9320, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 2.26% (1.0313 => 1.0546, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.08% (0.4805 => 0.4905, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.06% (0.6744 => 0.6883, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.73% (3.7467 => 3.8116, std. dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: 1.49% (33.2944 => 33.7908, std. dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.35% (6.2785 => 6.3630, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2648, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/mandel-2: 10.96% (1.2998 => 1.4423, std. dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7432, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.36% (2.8606 => 2.9568, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8182, std. dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6013, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.54% (22.5627 => 21.3133, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8018, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.76% (0.4867 => 0.4684, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5883, std. dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.51% (20.3410 => 19.8305, std. dev.: 0.0152) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2216, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: -2.05% (3.0263 => 2.9643, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2135, std. dev.: 0.0088) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2128, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8670, std. dev.: 0.0147) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3763, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8021, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.15% (6.6320 => 6.5558, std. dev.: 0.0123) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 23:21:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 01:21:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120812062112.964D22A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2829?compare_to=2827&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2829, Order: 161735, Start Time: 2012-08-12 05:02:55, End Time: 2012-08-12 06:21:51 To: 2827, Order: 161734, Start Time: 2012-08-12 03:15:14, End Time: 2012-08-12 04:34:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (86 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.33% (7.9436 => 8.0494, std. dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.31% (10.3673 => 13.8209, std. dev.: 0.0115) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.38% (0.3516 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.37% (0.3561 => 0.3966, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2454, std. dev.: 0.0184) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.3927 => 0.4337, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.94% (0.1432 => 0.1560, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.58% (2.2022 => 2.3692, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.51% (1.7609 => 1.8932, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.89% (10.4361 => 11.0512, std. dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.3177 => 0.3344, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.16% (0.7326 => 0.7704, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.4879 => 0.5097, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (9.4845 => 9.8932, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.29% (7.0540 => 7.3567, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1933, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (4.9449 => 5.1267, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5860 => 0.6073, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.63% (0.8172 => 0.8469, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.61% (4.2646 => 4.4186, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.52% (1.3050 => 1.3509, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 3.40% (0.3387 => 0.3502, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.30% (8.1363 => 8.4050, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.27% (0.3121 => 0.3223, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.24% (0.7835 => 0.8089, std. dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 3.23% (5.7591 => 5.9450, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.15% (1.5415 => 1.5901, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.4636 => 0.4779, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1861 => 1.2218, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.87% (0.9765 => 1.0045, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.85% (1.1642 => 1.1974, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.8067 => 0.8288, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4261, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4289 => 0.4401, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.59% (2.0273 => 2.0799, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.48% (1.5603 => 1.5990, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.39% (17.1811 => 17.5910, std. dev.: 0.0114) MultiSource/Benchmarks/McCat/05-eks/eks: 2.33% (0.4299 => 0.4399, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6226, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (2.0665 => 2.1136, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (0.6675 => 0.6822, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.20% (0.6450 => 0.6592, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 2.20% (3.8723 => 3.9575, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5020 => 0.5130, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (14.3668 => 14.6805, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8921 => 0.9109, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.92% (1.2842 => 1.3088, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.86% (2.2969 => 2.3397, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.2024 => 2.2409, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.59% (0.7115 => 0.7228, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.37% (1.0722 => 1.0869, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.83% (4.2280 => 4.4324, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8426, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.70% (26.0924 => 26.5354, std. dev.: 0.0322) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.50% (1.3045 => 1.3241, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.35% (3.1578 => 3.2004, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 1.34% (5.2636 => 5.3340, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5839, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6818, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.24% (5.2763 => 3.1533, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6885, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.24% (5.3526 => 3.6806, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9961, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.70% (2.9384 => 2.5358, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -12.14% (22.1758 => 19.4826, std. dev.: 0.0197) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -7.17% (1.5373 => 1.4270, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.87% (5.0483 => 4.8027, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4634, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4167, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9975, std. dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9577, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3340, std. dev.: 0.0097) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2866, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.12% (19.9488 => 19.7253, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 11 23:38:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 01:38:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120812063849.4A4E02A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2830?compare_to=2825&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2830, Order: 161735, Start Time: 2012-08-12 03:56:04, End Time: 2012-08-12 06:39:30 To: 2825, Order: 161732, Start Time: 2012-08-12 00:44:08, End Time: 2012-08-12 03:27:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (113 on baseline) Performance Improvements: 3 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.08% (2.1653 => 2.1420, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -1.04% (1.0397 => 1.0289, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.73% (131.3035 => 125.0935, std. dev.: 0.6093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 20.44% (0.3792 => 0.4567, std. dev.: 0.0262) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3488 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3465 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.71% (0.3446 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3442 => 0.3877, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.63% (0.3469 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.25% (0.3650 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.22% (0.3643 => 0.4088, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.98% (0.3724 => 0.4170, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.26% (0.5826 => 0.6249, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5889 => 0.6300, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.1619 => 0.1728, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.15% (0.7171 => 0.7612, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 6.13% (1.5932 => 1.6908, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.95% (1.6211 => 1.7176, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (3.5627 => 3.7739, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.76% (1.3152 => 1.3910, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.5900 => 0.6237, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (0.4361 => 0.4605, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.29% (4.2109 => 4.4337, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (0.3930 => 0.4136, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 5.21% (0.4029 => 0.4239, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.15% (0.4994 => 0.5251, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (0.5026 => 0.5280, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (0.5000 => 0.5249, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.85% (1.0781 => 1.1304, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (2.7292 => 2.8557, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.2866 => 0.2995, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.42% (0.2736 => 0.2857, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.40% (5.5417 => 5.7855, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.35% (0.2738 => 0.2857, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.32% (2.1013 => 2.1920, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (0.4658 => 0.4852, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 4.09% (0.2566 => 0.2671, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.07% (0.2875 => 0.2992, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.04% (0.3890 => 0.4047, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (1.9694 => 2.0486, std. dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (1.9966 => 2.0747, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.87% (2.1653 => 2.2490, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 3.84% (4.6177 => 4.7948, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.83% (0.9909 => 1.0289, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2780 => 0.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (0.3195 => 0.3313, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2750 => 0.2851, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2792 => 0.2894, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.62% (0.7875 => 0.8160, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.61% (2.0673 => 2.1420, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2803 => 0.2904, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.57% (0.3336 => 0.3455, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.56% (0.3903 => 0.4042, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.4146 => 0.4293, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.53% (0.3060 => 0.3168, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (1.8794 => 1.9446, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.45% (0.3362 => 0.3478, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.44% (0.6634 => 0.6862, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.43% (0.3267 => 0.3379, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.43% (0.3124 => 0.3231, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (4.4195 => 4.5704, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.33% (0.3096 => 0.3199, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3282 => 0.3391, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.31% (0.3625 => 0.3745, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.31% (1.4269 => 1.4741, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3678 => 0.3798, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: 3.20% (0.3348 => 0.3455, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.4139 => 0.4271, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.18% (0.3271 => 0.3375, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.3845 => 0.3967, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3726 => 0.3843, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.13% (0.3477 => 0.3586, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.99% (0.4251 => 0.4378, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.96% (0.9697 => 0.9984, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.95% (23.5202 => 24.2149, std. dev.: 0.0207) MultiSource/Applications/Burg/burg: 2.90% (0.5546 => 0.5707, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.5012 => 0.5138, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.6435 => 0.6594, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.32% (2.0346 => 2.0819, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (0.7426 => 0.7542, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.00% (11.6398 => 11.7562, std. dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6697, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 5.07% (1.8057 => 1.8972, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 4.90% (15.4430 => 16.1994, std. dev.: 0.0167) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6424, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6278, std. dev.: 0.0349) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1930, std. dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (41.7953 => 42.5799, std. dev.: 0.0319) MultiSource/Applications/lua/lua: 1.74% (50.0626 => 50.9319, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2210, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.51% (7.1849 => 7.2934, std. dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3043, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.43% (2.4764 => 2.3915, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5916, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: -9.83% (0.2402 => 0.2166, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7960, std. dev.: 0.0158) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7958, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0054) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7759, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.05% (17.2379 => 16.8853, std. dev.: 0.0526) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5783, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9580, std. dev.: 0.0164) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 00:32:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 02:32:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120812073238.09AE2352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2831?compare_to=2828&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2831, Order: 161738, Start Time: 2012-08-12 06:16:19, End Time: 2012-08-12 07:33:17 To: 2828, Order: 161735, Start Time: 2012-08-12 04:33:40, End Time: 2012-08-12 05:48:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (131 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (729 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.60% (54.9428 => 56.3728, std. dev.: 0.0742) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.56% (2.0176 => 2.2912, std. dev.: 0.0478) SingleSource/UnitTests/ObjC++/property-reference-object: 9.28% (0.5818 => 0.6358, std. dev.: 0.0095) SingleSource/UnitTests/ObjC++/Hello: 9.01% (0.5748 => 0.6266, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference: 8.77% (0.7061 => 0.7680, std. dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 8.11% (0.3578 => 0.3868, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-4: 8.09% (0.3646 => 0.3941, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-2: 7.94% (0.3601 => 0.3887, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3663 => 0.3951, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 7.84% (0.3623 => 0.3907, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 7.81% (0.3789 => 0.4085, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.75% (0.3650 => 0.3933, std. dev.: 0.0106) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 7.62% (1.3693 => 1.4736, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.48% (0.2966 => 0.3188, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.44% (0.4328 => 0.4650, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4062 => 0.4354, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std. dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7038 => 0.7542, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.10% (0.5265 => 0.5639, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 7.10% (0.2760 => 0.2956, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (3.9660 => 4.2454, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.01% (0.2726 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.2937 => 0.3142, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (0.2765 => 0.2957, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.69% (0.3485 => 0.3718, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.65% (0.3580 => 0.3818, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.51% (0.3489 => 0.3716, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3192 => 0.3397, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.41% (1.2193 => 1.2974, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.16% (0.9199 => 0.9766, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.07% (0.3293 => 0.3493, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.86% (0.6959 => 0.7367, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.83% (0.4390 => 0.4646, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists1: 5.83% (0.3534 => 0.3740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.80% (0.4016 => 0.4249, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.78% (0.3756 => 0.3973, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5577 => 0.5895, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.3868 => 0.4083, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.38% (13.8202 => 14.5643, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (1.3813 => 1.4556, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.20% (1.1364 => 1.1955, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (0.2945 => 0.3098, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 5.13% (1.2292 => 1.2922, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.99% (7.2180 => 7.5783, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.95% (0.5637 => 0.5916, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.90% (0.8310 => 0.8717, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.73% (1.1061 => 1.1584, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 4.72% (3.8646 => 4.0470, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.69% (1.3245 => 1.3866, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.58% (0.3755 => 0.3927, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.58% (1.0594 => 1.1079, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.7460 => 0.7801, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.44% (1.9270 => 2.0126, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.23% (2.1791 => 2.2713, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (4.4433 => 4.6313, std. dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 4.18% (16.6129 => 17.3080, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.84% (4.9865 => 5.1778, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.70% (0.3131 => 0.3247, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (1.1333 => 1.1748, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.8698 => 0.9015, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.47% (0.6135 => 0.6348, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6283 => 0.6495, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.23% (16.2614 => 16.7860, std. dev.: 0.0186) MultiSource/Applications/JM/lencod/lencod: 3.16% (14.8535 => 15.3230, std. dev.: 0.0099) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2876, std. dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 3.03% (4.6629 => 4.8042, std. dev.: 0.0189) MultiSource/Applications/JM/ldecod/ldecod: 2.94% (6.5754 => 6.7687, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.82% (3.2742 => 3.3666, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4113 => 0.4228, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5188 => 1.5602, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9129, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.1007 => 2.1468, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.82% (0.9108 => 0.9274, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.64% (1.0313 => 1.0482, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.19% (3.7467 => 3.7912, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 26.78% (1.8175 => 2.3043, std. dev.: 0.0242) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.37% (1.2998 => 1.4216, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3846, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5994, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.99% (10.7476 => 10.9619, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std. dev.: 0.0207) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1392, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.98% (22.5627 => 21.2145, std. dev.: 0.4713) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.91% (0.2670 => 0.2539, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0153) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.28% (5.0168 => 4.8019, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.03% (1.3780 => 1.3224, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.27% (20.3410 => 19.6767, std. dev.: 0.0911) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6078, std. dev.: 0.0656) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2257, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: -2.01% (3.0263 => 2.9656, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2164, std. dev.: 0.0288) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8027, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.00% (5.5401 => 5.4845, std. dev.: 0.0117) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 01:11:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 03:11:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120812081157.47BE92A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2832?compare_to=2829&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2832, Order: 161738, Start Time: 2012-08-12 06:50:32, End Time: 2012-08-12 08:12:36 To: 2829, Order: 161735, Start Time: 2012-08-12 05:02:55, End Time: 2012-08-12 06:21:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (102 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (734 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.81% (3.7765 => 3.9202, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (13.8209 => 13.6471, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.64% (10.3673 => 13.6471, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.72% (0.3516 => 0.3928, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (1.1194 => 1.2496, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.3927 => 0.4342, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.87% (0.1432 => 0.1559, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.05% (1.7609 => 1.9027, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.89% (2.2022 => 2.3760, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 6.38% (10.4361 => 11.1021, std. dev.: 0.2104) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5925 => 0.6285, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.76% (0.7326 => 0.7748, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.62% (0.4879 => 0.5153, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.13% (7.0540 => 7.4161, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.3282 => 0.3450, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.4615 => 0.4851, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2758 => 0.2893, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.8172 => 0.8568, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 4.71% (0.7433 => 0.7783, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.71% (9.4845 => 9.9308, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.30% (0.5860 => 0.6112, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.11% (0.5569 => 0.5798, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.9449 => 5.1454, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.4103 => 0.4269, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (5.0018 => 5.1993, std. dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: 3.84% (5.7591 => 5.9800, std. dev.: 0.0692) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (4.2646 => 4.4245, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (1.3050 => 1.3531, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 3.64% (0.4289 => 0.4445, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.4636 => 0.4804, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3826 => 0.3964, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2871 => 0.2974, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.52% (1.5603 => 1.6152, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/matrix: 3.52% (0.3098 => 0.3207, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.45% (8.1363 => 8.4172, std. dev.: 0.0123) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.32% (0.9765 => 1.0089, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.25% (0.3136 => 0.3238, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.21% (0.3422 => 0.3532, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.20% (2.0665 => 2.1326, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.19% (0.3387 => 0.3495, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1861 => 1.2237, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.00% (1.5415 => 1.5877, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3865 => 0.3980, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 2.97% (0.3603 => 0.3710, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4620 => 0.4751, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.78% (1.2842 => 1.3199, std. dev.: 0.0095) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4299 => 0.4418, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.4203 => 0.4319, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (0.4064 => 0.4175, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.71% (0.6456 => 0.6631, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.60% (3.8723 => 3.9729, std. dev.: 0.0233) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6450 => 0.6617, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.57% (0.4048 => 0.4152, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.46% (17.1811 => 17.6038, std. dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.30% (1.5859 => 1.6223, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.25% (0.5020 => 0.5133, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5981 => 0.6115, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 2.22% (0.8921 => 0.9119, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.4186 => 1.4499, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (14.3668 => 14.6761, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 1.94% (1.1840 => 1.2070, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.79% (2.2024 => 2.2419, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.69% (0.7115 => 0.7235, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.43% (1.0722 => 1.0875, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (4.2280 => 4.4517, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 3.76% (3.7781 => 3.9202, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.79% (26.0924 => 26.5599, std. dev.: 0.0118) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8431, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.35% (5.2636 => 5.3349, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1578 => 3.1995, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5820, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.83% (5.2763 => 3.1750, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7017, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6955, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9954, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5465, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.00% (22.1758 => 19.5144, std. dev.: 0.1814) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -7.24% (1.5373 => 1.4260, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std. dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8029, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4717, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: -2.89% (10.2830 => 9.9858, std. dev.: 0.0168) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4324, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9605, std. dev.: 0.0081) SingleSource/UnitTests/Vector/multiplies: -1.78% (2.5528 => 2.5073, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.45% (12.5348 => 12.3526, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.23% (19.9488 => 19.7036, std. dev.: 0.0568) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2866, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8128, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 02:58:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 04:58:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120812095807.08D242A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2833?compare_to=2830&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2833, Order: 161738, Start Time: 2012-08-12 07:12:42, End Time: 2012-08-12 09:57:40 To: 2830, Order: 161735, Start Time: 2012-08-12 03:56:04, End Time: 2012-08-12 06:39:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.01% (0.3488 => 0.3907, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/for-in: 11.96% (0.3496 => 0.3914, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3446 => 0.3856, std. dev.: 0.0126) SingleSource/UnitTests/ObjC/exceptions-4: 11.89% (0.3465 => 0.3877, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-3: 11.85% (0.3460 => 0.3870, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/synchronized: 11.73% (0.3469 => 0.3876, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3643 => 0.4059, std. dev.: 0.0092) SingleSource/UnitTests/ObjC/property: 11.37% (0.3650 => 0.4065, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/parameter-passing: 11.14% (0.3724 => 0.4139, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/Hello: 7.16% (0.5826 => 0.6243, std. dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference-object: 6.89% (0.5889 => 0.6295, std. dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 6.87% (1.5932 => 1.7027, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (0.5026 => 0.5322, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.86% (1.6211 => 1.7161, std. dev.: 0.0077) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7171 => 0.7587, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.72% (1.3152 => 1.3904, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.55% (3.5627 => 3.7605, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (0.4361 => 0.4600, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.47% (0.3930 => 0.4145, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.24% (0.5000 => 0.5262, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 5.03% (4.2109 => 4.4227, std. dev.: 0.0156) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.03% (0.4994 => 0.5245, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 5.00% (1.0781 => 1.1320, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 4.97% (0.9909 => 1.0401, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.94% (0.2875 => 0.3017, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.2736 => 0.2866, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.73% (0.2725 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.73% (0.2729 => 0.2858, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (0.2738 => 0.2867, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.70% (0.3362 => 0.3520, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.65% (2.0673 => 2.1634, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 4.64% (0.2714 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.58% (0.4146 => 0.4336, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 4.56% (0.3004 => 0.3141, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.54% (0.3195 => 0.3340, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.54% (5.5417 => 5.7931, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.51% (0.3060 => 0.3198, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2803 => 0.2929, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2792 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.44% (0.2750 => 0.2872, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2780 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.41% (0.2813 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.38% (0.2811 => 0.2934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.36% (0.2823 => 0.2946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.34% (0.3317 => 0.3461, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.32% (0.3845 => 0.4011, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.26% (0.2911 => 0.3035, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3258 => 0.3396, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3282 => 0.3421, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.22% (0.3267 => 0.3405, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (2.1013 => 2.1876, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (0.3890 => 0.4049, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.07% (0.6634 => 0.6904, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3726 => 0.3877, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.3903 => 0.4061, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (1.9694 => 2.0490, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3124 => 0.3250, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.02% (0.3678 => 0.3826, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.02% (2.7292 => 2.8389, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.00% (0.3625 => 0.3770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3348 => 0.3481, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (0.4658 => 0.4843, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.94% (0.3477 => 0.3614, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.93% (0.4251 => 0.4418, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (1.9966 => 2.0741, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 3.84% (0.9697 => 1.0069, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.82% (2.1653 => 2.2481, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.82% (0.3690 => 0.3831, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (1.8794 => 1.9505, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 3.66% (0.7875 => 0.8163, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.3981 => 0.4126, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 3.63% (4.6177 => 4.7855, std. dev.: 0.0076) MultiSource/Applications/lua/lua: 3.53% (1.4269 => 1.4773, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.6435 => 0.6662, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.48% (0.4139 => 0.4283, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.42% (23.5202 => 24.3249, std. dev.: 0.0199) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (4.4195 => 4.5638, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.21% (0.3271 => 0.3376, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.17% (0.5012 => 0.5171, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.90% (0.5546 => 0.5707, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.50% (2.0346 => 2.0854, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.24% (0.7426 => 0.7592, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (0.5361 => 0.5471, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.88% (0.5584 => 0.5689, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.74% (11.6398 => 11.8424, std. dev.: 0.0195) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.43% (4.6926 => 4.7598, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6131, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6659, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8934, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 2.88% (14.0481 => 14.4522, std. dev.: 0.0924) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (105.3826 => 107.7288, std. dev.: 0.0383) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2063, std. dev.: 0.0408) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (41.7953 => 42.6374, std. dev.: 0.0162) MultiSource/Applications/lua/lua: 1.75% (50.0626 => 50.9407, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5932, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std. dev.: 0.0105) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3057, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.46% (1.0927 => 1.1086, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2820, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5639, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/ary2: -10.32% (0.2402 => 0.2154, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7972, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0120) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0053) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8292, std. dev.: 0.0326) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9601, std. dev.: 0.0112) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -1.08% (1.3650 => 1.3503, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 03:03:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 05:03:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120812100347.255F32A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2834?compare_to=2831&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2834, Order: 161739, Start Time: 2012-08-12 08:49:37, End Time: 2012-08-12 10:03:29 To: 2831, Order: 161738, Start Time: 2012-08-12 06:16:19, End Time: 2012-08-12 07:33:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 2.05% (2.3043 => 2.3515, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.64% (2.0176 => 2.2928, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5748 => 0.6265, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7061 => 0.7648, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-4: 8.20% (0.3646 => 0.3945, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3663 => 0.3956, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3623 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.92% (0.3650 => 0.3939, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.64% (0.3940 => 0.4241, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.63% (1.3693 => 1.4738, std. dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.2781 => 0.2990, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.44% (0.4328 => 0.4650, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2782 => 0.2987, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2721 => 0.2917, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.7710 => 0.8255, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5265 => 0.5637, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7038 => 0.7534, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.04% (3.9660 => 4.2454, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash: 7.02% (0.4062 => 0.4347, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.82% (0.3107 => 0.3319, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.68% (0.3022 => 0.3224, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3489 => 0.3722, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (1.9828 => 2.1136, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3580 => 0.3815, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.54% (0.3485 => 0.3713, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.41% (1.2193 => 1.2975, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 6.11% (0.3453 => 0.3664, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.08% (0.9199 => 0.9758, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4390 => 0.4655, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.86% (0.3293 => 0.3486, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.6959 => 0.7363, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 5.79% (0.3868 => 0.4092, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.76% (0.3246 => 0.3433, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.73% (0.4016 => 0.4246, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.72% (0.5577 => 0.5896, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (0.3756 => 0.3969, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.26% (13.8202 => 14.5471, std. dev.: 0.0112) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (1.4563 => 1.5324, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.3813 => 1.4524, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.10% (1.1364 => 1.1944, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.06% (1.3819 => 1.4518, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.5637 => 0.5920, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 4.99% (1.2292 => 1.2905, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.98% (7.2180 => 7.5771, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 4.89% (0.8310 => 0.8716, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 4.68% (3.8646 => 4.0454, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.3245 => 1.3858, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.61% (0.7506 => 0.7852, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.58% (1.0594 => 1.1079, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.52% (1.1061 => 1.1561, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.48% (0.7460 => 0.7794, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.47% (0.3755 => 0.3923, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.36% (1.9270 => 2.0111, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.23% (2.1791 => 2.2713, std. dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 4.20% (16.6129 => 17.3105, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (4.4433 => 4.6254, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (3.6692 => 3.8172, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.3801 => 4.5563, std. dev.: 0.0084) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.96% (4.9865 => 5.1841, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.92% (13.2842 => 13.8048, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.74% (0.3131 => 0.3248, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.8698 => 0.9018, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.61% (1.1333 => 1.1742, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6135 => 0.6349, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (8.4961 => 8.7676, std. dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 3.18% (16.2614 => 16.7779, std. dev.: 0.0230) MultiSource/Applications/JM/lencod/lencod: 3.14% (14.8535 => 15.3192, std. dev.: 0.0173) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2886, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.5754 => 6.7727, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.94% (3.2742 => 3.3705, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.93% (4.6629 => 4.7994, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9197, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5568, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.24% (2.1007 => 2.1477, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.05% (0.6250 => 0.6378, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.78% (0.9108 => 0.9270, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.51% (1.0313 => 1.0469, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.23% (3.7467 => 3.7926, std. dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 1.10% (33.2944 => 33.6594, std. dev.: 0.0368) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5122, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 29.38% (1.8175 => 2.3515, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.42% (1.2998 => 1.4353, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7428, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9574, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6045, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.93% (22.5627 => 21.2257, std. dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5117, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -4.57% (1.1560 => 1.1032, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8018, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.8259 => 8.5680, std. dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.82% (20.3410 => 19.7682, std. dev.: 0.0518) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2297, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: -1.98% (3.0263 => 2.9665, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3305 => 7.2119, std. dev.: 0.0082) MultiSource/Applications/minisat/minisat: -1.37% (9.3358 => 9.2082, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3719, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8012, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8725, std. dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 03:07:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 05:07:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120812100756.7D6512A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2835?compare_to=2832&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2835, Order: 161739, Start Time: 2012-08-12 08:49:37, End Time: 2012-08-12 10:08:33 To: 2832, Order: 161738, Start Time: 2012-08-12 06:50:32, End Time: 2012-08-12 08:12:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (119 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.80% (3.9202 => 3.8104, std. dev.: 0.0370) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.50% (10.3673 => 13.6332, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 11.86% (0.3473 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2483, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.58% (0.3886 => 0.4297, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (1.7609 => 1.9057, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.96% (2.2022 => 2.3774, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.58% (0.3177 => 0.3386, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 6.33% (10.4361 => 11.0970, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5925 => 0.6289, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.3282 => 0.3453, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7326 => 0.7706, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.4879 => 0.5128, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.96% (0.7433 => 0.7802, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (7.0540 => 7.3988, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 4.67% (9.4845 => 9.9278, std. dev.: 0.0150) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.52% (0.8172 => 0.8541, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.50% (0.2891 => 0.3021, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3098 => 0.3237, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.48% (0.4103 => 0.4287, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.35% (1.5603 => 1.6282, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2758 => 0.2877, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 4.31% (0.2831 => 0.2953, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.30% (0.5860 => 0.6112, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 4.21% (0.2871 => 0.2992, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.21% (0.2756 => 0.2872, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.17% (0.3162 => 0.3294, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.14% (0.4636 => 0.4828, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3052 => 0.3178, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3232 => 0.3365, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (4.9449 => 5.1470, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.07% (0.2872 => 0.2989, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 4.00% (5.7591 => 5.9895, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0665 => 2.1491, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 3.99% (0.7835 => 0.8148, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.99% (0.3136 => 0.3261, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (5.0018 => 5.2004, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.90% (0.2793 => 0.2902, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.87% (0.4289 => 0.4455, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3603 => 0.3742, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3650 => 0.3790, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.80% (4.2646 => 4.4266, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.79% (0.3826 => 0.3971, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.79% (0.2877 => 0.2986, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (0.3935 => 0.4082, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.73% (0.3379 => 0.3505, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (1.3050 => 1.3532, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.64% (1.1861 => 1.2293, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.54% (8.1363 => 8.4247, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.4064 => 0.4208, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3684 => 0.3810, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.35% (0.4203 => 0.4344, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.4048 => 0.4182, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.26% (1.2842 => 1.3261, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4620 => 0.4770, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.22% (0.6456 => 0.6664, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.5415 => 1.5906, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.07% (3.3354 => 3.4378, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 3.06% (2.0273 => 2.0894, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.06% (0.9765 => 1.0064, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.02% (1.1642 => 1.1994, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.1840 => 1.2174, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (0.5105 => 0.5249, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.71% (0.8067 => 0.8286, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.68% (0.6450 => 0.6623, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.61% (17.1811 => 17.6291, std. dev.: 0.0152) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4299 => 0.4410, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.54% (3.8723 => 3.9708, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8921 => 0.9139, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5859 => 1.6237, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.35% (0.6675 => 0.6832, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.28% (2.2969 => 2.3492, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.26% (1.4186 => 1.4506, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.5020 => 0.5131, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.16% (14.3668 => 14.6778, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.2024 => 2.2417, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.77% (0.7115 => 0.7241, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.36% (1.0722 => 1.0868, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8966, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (4.2280 => 4.4412, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7479, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5650, std. dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8430, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.39% (5.2636 => 5.3369, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.27% (1.3045 => 1.3211, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.17% (6.5088 => 6.5850, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 1.15% (3.1578 => 3.1940, std. dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2182, std. dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.85% (5.2763 => 3.1735, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6995, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.06% (5.3526 => 3.6901, std. dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -15.09% (54.1659 => 45.9896, std. dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.50% (2.9384 => 2.5418, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.07% (22.1758 => 19.4991, std. dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -8.43% (1.5373 => 1.4077, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8031, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4739, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4128, std. dev.: 0.0247) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9840, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9582, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3427, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2868, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (1.6805 => 1.6631, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 5.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 04:45:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 06:45:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120812114557.920BB2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2836?compare_to=2834&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2836, Order: 161740, Start Time: 2012-08-12 10:32:58, End Time: 2012-08-12 11:46:39 To: 2834, Order: 161739, Start Time: 2012-08-12 08:49:37, End Time: 2012-08-12 10:03:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (143 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.13% (79.9908 => 80.8975, std. dev.: 0.2984) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.51% (2.0176 => 2.2902, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.36% (0.3578 => 0.3877, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7061 => 0.7649, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 8.15% (0.3646 => 0.3943, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.08% (0.3663 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.92% (0.3914 => 0.4224, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.66% (0.3940 => 0.4242, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.61% (1.3693 => 1.4735, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.59% (0.2781 => 0.2992, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.46% (0.4328 => 0.4651, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.30% (0.7710 => 0.8273, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.20% (0.5265 => 0.5644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4062 => 0.4354, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.12% (3.9660 => 4.2482, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 7.08% (0.7038 => 0.7536, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.85% (0.3022 => 0.3229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.76% (0.3580 => 0.3822, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.69% (0.3899 => 0.4160, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.64% (1.9828 => 2.1144, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.54% (0.3485 => 0.3713, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.2988 => 0.3178, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.33% (0.9199 => 0.9781, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.29% (1.2193 => 1.2960, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.90% (0.4016 => 0.4253, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.5577 => 0.5903, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.83% (0.6959 => 0.7365, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.83% (0.3293 => 0.3485, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.78% (0.2127 => 0.2250, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.76% (0.4390 => 0.4643, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.76% (0.3246 => 0.3433, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.75% (0.3756 => 0.3972, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.3868 => 0.4083, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.31% (13.8202 => 14.5539, std. dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.25% (1.4563 => 1.5328, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.18% (1.1364 => 1.1953, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.17% (1.2292 => 1.2927, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.3813 => 1.4525, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (1.3819 => 1.4528, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.97% (7.2180 => 7.5767, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 4.96% (1.1061 => 1.1610, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.91% (0.8310 => 0.8718, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.88% (3.8646 => 4.0532, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.5637 => 0.5912, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 4.81% (0.7506 => 0.7867, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.80% (1.3245 => 1.3881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.58% (0.3755 => 0.3927, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.52% (1.0594 => 1.1073, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.7460 => 0.7790, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.42% (1.9270 => 2.0121, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 4.14% (16.6129 => 17.3008, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (4.4433 => 4.6269, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 4.10% (2.1791 => 2.2685, std. dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.3801 => 4.5558, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1865, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (3.6692 => 3.8155, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.91% (13.2842 => 13.8032, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.4791 => 0.4977, std. dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 3.77% (0.3131 => 0.3249, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.71% (1.1333 => 1.1753, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.61% (0.8698 => 0.9012, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (0.6135 => 0.6354, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.50% (0.6283 => 0.6503, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.22% (3.1889 => 3.2915, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.21% (8.4961 => 8.7687, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 3.19% (16.2614 => 16.7797, std. dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 3.17% (14.8535 => 15.3238, std. dev.: 0.0094) MultiSource/Applications/oggenc/oggenc: 2.99% (4.6629 => 4.8025, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (6.5754 => 6.7715, std. dev.: 0.0132) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.81% (3.2742 => 3.3662, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9186, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.1007 => 2.1461, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.11% (0.6250 => 0.6382, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.77% (0.9108 => 0.9269, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.19% (3.7467 => 3.7911, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.18% (33.2944 => 33.6875, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 25.96% (1.8175 => 2.2893, std. dev.: 0.0380) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.24% (1.2998 => 1.4199, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7425, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5979, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.04% (10.7476 => 10.9669, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0093) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.05% (5.5130 => 5.5708, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.82% (0.4657 => 0.3967, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.89% (22.5627 => 21.2333, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.91% (0.2670 => 0.2539, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.57% (1.1560 => 1.1032, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3180, std. dev.: 0.0044) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8016, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5724, std. dev.: 0.0154) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.72% (20.3410 => 19.7887, std. dev.: 0.0284) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.05% (3.0263 => 2.9642, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2334, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.66% (7.3305 => 7.2085, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2142, std. dev.: 0.0384) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3740, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8010, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 04:55:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 06:55:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120812115510.B0EA82A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2837?compare_to=2835&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2837, Order: 161740, Start Time: 2012-08-12 10:37:01, End Time: 2012-08-12 11:55:53 To: 2835, Order: 161739, Start Time: 2012-08-12 08:49:37, End Time: 2012-08-12 10:08:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (115 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.6067 => 56.6244, std. dev.: 0.1019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.52% (10.3673 => 13.6348, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 11.89% (0.3473 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.58% (0.3516 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.50% (1.1194 => 1.2481, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.58% (0.3886 => 0.4297, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.94% (0.1432 => 0.1560, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.14% (1.7609 => 1.9042, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.99% (2.2022 => 2.3782, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.19% (0.1892 => 0.2028, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5925 => 0.6298, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.24% (10.4361 => 11.0869, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.05% (0.2065 => 0.2190, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7326 => 0.7732, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 5.15% (0.3282 => 0.3451, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.08% (0.4879 => 0.5127, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.91% (0.7433 => 0.7798, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.81% (7.0540 => 7.3935, std. dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 4.65% (9.4845 => 9.9260, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2891 => 0.3024, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.60% (0.2871 => 0.3003, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.57% (0.4636 => 0.4848, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.3098 => 0.3236, std. dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 4.41% (0.2905 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.4103 => 0.4282, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.31% (0.2831 => 0.2953, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.26% (1.5603 => 1.6267, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 4.18% (0.3232 => 0.3367, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.11% (0.3283 => 0.3418, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.11% (0.2872 => 0.2990, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3422 => 0.3562, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.04% (2.0665 => 2.1499, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1444, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.99% (0.8172 => 0.8498, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.97% (0.2793 => 0.2904, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.97% (0.3650 => 0.3795, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (5.0018 => 5.1999, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.95% (0.3826 => 0.3977, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.93% (5.7591 => 5.9855, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.92% (0.3136 => 0.3259, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.5860 => 0.6089, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 3.86% (0.2877 => 0.2988, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3379 => 0.3509, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2802 => 0.2909, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.82% (1.3050 => 1.3548, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (4.2646 => 4.4263, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3865 => 0.4011, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.77% (0.3603 => 0.3739, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.75% (0.4289 => 0.4450, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (0.3935 => 0.4080, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.62% (0.3423 => 0.3547, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.4064 => 0.4208, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.53% (8.1363 => 8.4234, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.51% (0.7835 => 0.8110, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.38% (0.6456 => 0.6674, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.29% (1.2842 => 1.3265, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.4048 => 0.4181, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.28% (0.3387 => 0.3498, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.1861 => 1.2248, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.23% (0.4620 => 0.4769, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.9765 => 1.0071, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.06% (1.1642 => 1.1998, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (1.5415 => 1.5880, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 2.95% (3.3354 => 3.4337, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.88% (0.8067 => 0.8299, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.81% (2.0273 => 2.0842, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.74% (0.5105 => 0.5245, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.6450 => 0.6621, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 2.61% (0.4299 => 0.4411, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.45% (17.1811 => 17.6024, std. dev.: 0.0282) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.44% (0.6675 => 0.6838, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.4186 => 1.4529, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.41% (3.8723 => 3.9656, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.5020 => 0.5138, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5981 => 0.6120, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5859 => 1.6217, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.22% (0.8921 => 0.9119, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.21% (2.2969 => 2.3477, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (14.3668 => 14.6704, std. dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (2.2024 => 2.2412, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.74% (1.1840 => 1.2046, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 1.66% (0.7115 => 0.7233, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.40% (1.0722 => 1.0872, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.18% (4.2280 => 4.4471, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7573, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 1.73% (26.0924 => 26.5431, std. dev.: 0.0274) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8426, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (5.2636 => 5.3385, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (1.3045 => 1.3210, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5831, std. dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.10% (3.1578 => 3.1925, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6817, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.85% (5.2763 => 3.1735, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6990, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6911, std. dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9960, std. dev.: 0.0597) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.46% (2.9384 => 2.5428, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.12% (22.1758 => 19.4884, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -8.52% (1.5373 => 1.4063, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5570, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8030, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4613, std. dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4201, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9984, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9606, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5111, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3431, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2866, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.15% (19.9488 => 19.7193, std. dev.: 0.0877) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8124, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 06:10:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 08:10:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120812131054.DC9922A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2838?compare_to=2833&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2838, Order: 161740, Start Time: 2012-08-12 10:28:02, End Time: 2012-08-12 13:11:37 To: 2833, Order: 161738, Start Time: 2012-08-12 07:12:42, End Time: 2012-08-12 09:57:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (115 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.50% (0.2133 => 0.2293, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 1.31% (14.4522 => 14.6416, std. dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 28.88% (0.3792 => 0.4887, std. dev.: 0.0415) SingleSource/UnitTests/ObjC/for-in: 11.93% (0.3496 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3465 => 0.3873, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.77% (0.3442 => 0.3847, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3446 => 0.3851, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.73% (0.3488 => 0.3897, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3469 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3643 => 0.4058, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.26% (0.3650 => 0.4061, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3724 => 0.4130, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.45% (1.5932 => 1.6960, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5826 => 0.6193, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5889 => 0.6241, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.35% (1.3152 => 1.3855, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.33% (1.6211 => 1.7075, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.30% (3.5627 => 3.7517, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.22% (0.5000 => 0.5261, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.11% (0.4994 => 0.5249, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (0.4361 => 0.4572, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 4.74% (0.7171 => 0.7511, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.74% (0.4029 => 0.4220, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.5900 => 0.6179, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.72% (1.0781 => 1.1290, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 4.65% (4.2109 => 4.4066, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.2866 => 0.2998, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2738 => 0.2864, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.60% (0.5026 => 0.5257, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.14% (0.2875 => 0.2994, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2811 => 0.2926, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.06% (0.9909 => 1.0311, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.00% (5.5417 => 5.7633, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.2736 => 0.2845, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.3004 => 0.3123, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.93% (0.4658 => 0.4841, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.2780 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.73% (0.2813 => 0.2918, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.73% (2.0673 => 2.1444, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.72% (0.2823 => 0.2928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2792 => 0.2895, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.66% (0.2729 => 0.2829, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.66% (0.6634 => 0.6877, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.66% (0.3060 => 0.3172, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.3362 => 0.3485, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2803 => 0.2905, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.62% (0.3890 => 0.4031, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.62% (2.7292 => 2.8281, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.62% (0.3096 => 0.3208, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.62% (2.1013 => 2.1773, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.61% (0.2911 => 0.3016, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.55% (0.3348 => 0.3467, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (1.9966 => 2.0675, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.49% (0.3124 => 0.3233, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (1.9694 => 2.0370, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.39% (1.8794 => 1.9431, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3282 => 0.3393, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.36% (0.4139 => 0.4278, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.36% (0.3336 => 0.3448, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.3903 => 0.4034, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.3845 => 0.3974, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.30% (0.3726 => 0.3849, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.3678 => 0.3799, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.29% (0.9697 => 1.0016, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.28% (0.3625 => 0.3744, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3477 => 0.3591, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.3271 => 0.3378, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.21% (4.6177 => 4.7658, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 3.17% (2.1653 => 2.2340, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 3.13% (0.4251 => 0.4384, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.09% (0.7875 => 0.8118, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3690 => 0.3801, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4146 => 0.4268, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (4.4195 => 4.5488, std. dev.: 0.0074) MultiSource/Applications/lua/lua: 2.85% (1.4269 => 1.4676, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 2.81% (23.5202 => 24.1807, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.69% (0.6435 => 0.6608, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.38% (0.5546 => 0.5678, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.5012 => 0.5129, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.17% (2.0346 => 2.0787, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (0.7426 => 0.7527, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (11.6398 => 11.7636, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.34% (0.2162 => 0.3553, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.06% (0.2122 => 0.2293, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6815, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8953, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1690, std. dev.: 0.0290) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6416, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6448, std. dev.: 0.0427) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2008, std. dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (41.7953 => 42.6166, std. dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5905, std. dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2265, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.71% (50.0626 => 50.9188, std. dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3085, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2839, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.33% (1.0142 => 1.0277, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5755, std. dev.: 0.0147) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7852, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: -7.54% (0.2402 => 0.2221, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8090, std. dev.: 0.0030) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7645, std. dev.: 0.0334) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5830, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9595, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 20:12:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 22:12:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813031215.19C562A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2839?compare_to=2836&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2839, Order: 161742, Start Time: 2012-08-13 01:59:11, End Time: 2012-08-13 03:12:55 To: 2836, Order: 161740, Start Time: 2012-08-12 10:32:58, End Time: 2012-08-12 11:46:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.46% (54.7891 => 56.1352, std. dev.: 0.1783) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.08% (2.1144 => 2.0916, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.78% (2.0176 => 2.2957, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.65% (0.5818 => 0.6321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.05% (0.3578 => 0.3866, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.00% (0.7061 => 0.7626, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions-2: 7.91% (0.3601 => 0.3886, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3650 => 0.3937, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.78% (0.3663 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.66% (0.3914 => 0.4214, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3623 => 0.3899, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.10% (1.3693 => 1.4665, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.99% (3.9660 => 4.2431, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.87% (0.7710 => 0.8240, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.69% (0.7038 => 0.7509, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2781 => 0.2959, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.29% (0.2782 => 0.2957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.4062 => 0.4314, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.16% (1.2193 => 1.2944, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.03% (0.4379 => 0.4643, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.98% (0.3899 => 0.4132, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.94% (0.9199 => 0.9745, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.6959 => 0.7363, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.75% (0.3580 => 0.3786, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.75% (0.2628 => 0.2779, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.66% (0.2966 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.61% (0.2726 => 0.2879, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3246 => 0.3427, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3107 => 0.3279, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.49% (1.9828 => 2.0916, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.2988 => 0.3150, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.14% (1.3819 => 1.4529, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 5.12% (13.8202 => 14.5272, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.10% (1.1364 => 1.1944, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.10% (1.4563 => 1.5306, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (1.3813 => 1.4509, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4390 => 0.4604, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.78% (0.8310 => 0.8707, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.77% (7.2180 => 7.5622, std. dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.69% (3.8646 => 4.0459, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.54% (1.1061 => 1.1563, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (1.3245 => 1.3842, std. dev.: 0.0091) MultiSource/Applications/spiff/spiff: 4.49% (0.7506 => 0.7843, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.0594 => 1.1069, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.33% (1.9270 => 2.0105, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.33% (0.7460 => 0.7783, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2292 => 1.2808, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.00% (2.1791 => 2.2662, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8124, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6150, std. dev.: 0.0111) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 3.84% (16.6129 => 17.2512, std. dev.: 0.0207) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.3801 => 4.5461, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (13.2842 => 13.7794, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.55% (1.1333 => 1.1735, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6135 => 0.6349, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.48% (4.9865 => 5.1601, std. dev.: 0.0148) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.6283 => 0.6484, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (8.4961 => 8.7559, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 3.02% (3.1889 => 3.2851, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.00% (16.2614 => 16.7500, std. dev.: 0.0204) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.8698 => 0.8958, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.99% (14.8535 => 15.2972, std. dev.: 0.0147) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7604, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (3.2742 => 3.3649, std. dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 2.63% (4.6629 => 4.7854, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9053, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.56% (1.5188 => 1.5577, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.10% (2.1007 => 2.1448, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.54% (1.0313 => 1.0472, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7860, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2581, std. dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.38% (1.2998 => 1.4087, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.01% (1.5824 => 1.6617, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7418, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8174, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6002, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.06% (10.7476 => 10.9690, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.54% (2.0200 => 2.0511, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.01% (0.4657 => 0.3958, std. dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1795, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.52% (0.6576 => 0.6476, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1022, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8017, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.00% (20.3410 => 19.7298, std. dev.: 0.0514) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5874, std. dev.: 0.0174) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9283, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9630, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2282, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2150, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: -1.43% (9.3358 => 9.2026, std. dev.: 0.0189) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3758, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8013, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 20:17:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 22:17:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813031716.3DBA02A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2840?compare_to=2837&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2840, Order: 161742, Start Time: 2012-08-13 01:59:19, End Time: 2012-08-13 03:17:56 To: 2837, Order: 161740, Start Time: 2012-08-12 10:37:01, End Time: 2012-08-12 11:55:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (105 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (733 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.29% (13.6348 => 14.0839, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.32% (1.6267 => 1.6053, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.45% (56.6244 => 54.6726, std. dev.: 0.3844) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.85% (10.3673 => 14.0839, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 12.90% (0.3473 => 0.3921, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.48% (0.3543 => 0.3985, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3516 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.36% (0.3561 => 0.4001, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.97% (0.3694 => 0.4136, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3828 => 0.4284, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 8.80% (0.1432 => 0.1558, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.65% (2.2022 => 2.3707, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2065 => 0.2221, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.16% (1.7609 => 1.8869, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.03% (0.5925 => 0.6282, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.87% (0.6030 => 0.6384, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 5.69% (10.4361 => 11.0294, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3282 => 0.3446, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.95% (0.7326 => 0.7689, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (0.7433 => 0.7792, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.56% (7.0540 => 7.3759, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.55% (0.4879 => 0.5101, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.40% (0.2271 => 0.2371, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5569 => 0.5805, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.14% (9.4845 => 9.8774, std. dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4636 => 0.4821, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5860 => 0.6091, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.9449 => 5.1390, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.91% (4.2646 => 4.4313, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1948, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.83% (0.4103 => 0.4260, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.71% (1.3050 => 1.3534, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.70% (0.7835 => 0.8125, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (0.3121 => 0.3235, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.60% (0.2891 => 0.2995, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.49% (0.3098 => 0.3206, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.45% (8.1363 => 8.4173, std. dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 3.45% (5.7591 => 5.9578, std. dev.: 0.0172) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.42% (0.3422 => 0.3539, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3232 => 0.3339, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.25% (0.3441 => 0.3553, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1861 => 1.2243, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.20% (0.3935 => 0.4061, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.13% (2.0665 => 2.1312, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.11% (1.1642 => 1.2004, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.10% (0.3865 => 0.3985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.5415 => 1.5886, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9765 => 1.0063, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.04% (0.8067 => 0.8312, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.96% (0.6456 => 0.6647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.95% (0.4203 => 0.4327, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.94% (2.0273 => 2.0870, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.91% (3.3354 => 3.4325, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.88% (1.5603 => 1.6053, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.74% (0.3684 => 0.3785, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5105 => 0.5244, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (1.5859 => 1.6285, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.68% (0.4620 => 0.4744, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.6450 => 0.6621, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3175, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: 2.54% (0.4048 => 0.4151, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.54% (3.8723 => 3.9705, std. dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.46% (0.6675 => 0.6839, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.43% (2.2969 => 2.3528, std. dev.: 0.0156) MultiSource/Applications/sqlite3/sqlite3: 2.38% (17.1811 => 17.5898, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.5020 => 0.5137, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.4186 => 1.4516, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (14.3668 => 14.6964, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.25% (0.8921 => 0.9122, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.19% (0.5981 => 0.6112, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.2024 => 2.2443, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2050, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.62% (0.7115 => 0.7230, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.46% (1.0722 => 1.0879, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.91% (4.2280 => 4.4354, std. dev.: 0.0132) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7548, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.71% (26.0924 => 26.5386, std. dev.: 0.0191) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8423, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.49% (3.1578 => 3.2050, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.37% (5.2636 => 5.3358, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.51% (0.8651 => 0.1686, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.21% (5.2763 => 3.1545, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6949, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6876, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -15.19% (54.1659 => 45.9354, std. dev.: 0.0398) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.77% (2.9384 => 2.5339, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -12.06% (22.1758 => 19.5007, std. dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4204, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -9.62% (1.5373 => 1.3894, std. dev.: 0.0257) SingleSource/Benchmarks/Misc/richards_benchmark: -7.00% (1.1396 => 1.0598, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8028, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4651, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9833, std. dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4331, std. dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9626, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6823, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3503, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2867, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8130, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 21:42:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 23:42:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120813044236.3747A2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2841?compare_to=2838&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2841, Order: 161742, Start Time: 2012-08-13 01:59:22, End Time: 2012-08-13 04:43:19 To: 2838, Order: 161740, Start Time: 2012-08-12 10:28:02, End Time: 2012-08-12 13:11:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 948 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 2.21% (1.6960 => 1.7335, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.59% (2.1444 => 2.1784, std. dev.: 0.0038) MultiSource/Applications/hbd/hbd: 1.54% (1.0016 => 1.0170, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.0311 => 1.0450, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.25% (1.4676 => 1.4859, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.32% (124.6993 => 130.0812, std. dev.: 0.3655) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3496 => 0.3920, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3446 => 0.3862, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.04% (0.3488 => 0.3908, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.03% (0.3465 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.03% (0.3442 => 0.3856, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.02% (0.3460 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3469 => 0.3885, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.78% (0.3650 => 0.4080, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3643 => 0.4061, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.47% (0.3724 => 0.4151, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.97% (0.1063 => 0.1169, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.81% (1.5932 => 1.7335, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.80% (0.5826 => 0.6222, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 6.67% (0.1619 => 0.1727, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 6.61% (0.5889 => 0.6278, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.37% (0.4994 => 0.5312, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.25% (1.6211 => 1.7224, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.02% (0.2875 => 0.3048, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.85% (1.3152 => 1.3922, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.84% (3.5627 => 3.7707, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (0.5026 => 0.5317, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 5.72% (0.2725 => 0.2881, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.71% (0.4361 => 0.4610, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2738 => 0.2894, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.68% (0.2780 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2729 => 0.2883, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.63% (0.3195 => 0.3375, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (0.3930 => 0.4149, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.56% (0.2750 => 0.2903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7171 => 0.7568, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2823 => 0.2979, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (0.5000 => 0.5276, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.52% (0.2792 => 0.2946, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2811 => 0.2966, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.46% (0.9909 => 1.0450, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 5.46% (0.3004 => 0.3168, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2803 => 0.2956, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.44% (4.2109 => 4.4399, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 5.41% (1.0781 => 1.1364, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.40% (0.3258 => 0.3434, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.38% (0.3845 => 0.4052, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.37% (2.0673 => 2.1784, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 5.37% (0.2813 => 0.2964, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.33% (0.3096 => 0.3261, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.28% (0.3317 => 0.3492, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.23% (0.3267 => 0.3438, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.22% (0.2911 => 0.3063, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 5.16% (0.4146 => 0.4360, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.06% (0.3362 => 0.3532, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.5900 => 0.6196, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.99% (0.3124 => 0.3280, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.97% (0.3060 => 0.3212, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.95% (0.3678 => 0.3860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.94% (0.3726 => 0.3910, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.88% (0.9697 => 1.0170, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.83% (0.3625 => 0.3800, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.78% (0.3282 => 0.3439, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.72% (5.5417 => 5.8034, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 4.69% (0.3477 => 0.3640, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.2736 => 0.2861, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.50% (2.7292 => 2.8519, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.47% (0.3690 => 0.3855, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.42% (0.3890 => 0.4062, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.38% (0.2691 => 0.2809, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 4.33% (0.4251 => 0.4435, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (0.4658 => 0.4857, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (1.9694 => 2.0530, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (2.1013 => 2.1887, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 4.13% (1.4269 => 1.4859, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 4.07% (4.6177 => 4.8055, std. dev.: 0.0144) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.4139 => 0.4307, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.98% (2.1653 => 2.2514, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 3.96% (0.6634 => 0.6897, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (1.9966 => 2.0757, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 3.85% (1.8794 => 1.9517, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.3903 => 0.4049, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.73% (0.5012 => 0.5199, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.64% (4.4195 => 4.5802, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.61% (0.6435 => 0.6667, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.59% (0.7875 => 0.8158, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 3.51% (23.5202 => 24.3452, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.3271 => 0.3385, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.15% (0.3336 => 0.3441, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.90% (0.5546 => 0.5707, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.51% (2.0346 => 2.0857, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.71% (0.7426 => 0.7553, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (11.6398 => 11.8003, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (4.6926 => 4.7474, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.94% (0.2122 => 0.2333, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6671, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1692, std. dev.: 0.0601) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6406, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.12% (105.3826 => 107.6212, std. dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1987, std. dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.90% (41.7953 => 42.5910, std. dev.: 0.0263) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2273, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9130, std. dev.: 0.0156) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3062, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5379, std. dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9779, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7918, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7971, std. dev.: 0.0083) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.40% (0.6293 => 0.6142, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -2.38% (17.2379 => 16.8281, std. dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9597, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 21:54:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 12 Aug 2012 23:54:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813045403.34ADC2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2842?compare_to=2839&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2842, Order: 161745, Start Time: 2012-08-13 03:41:05, End Time: 2012-08-13 04:54:46 To: 2839, Order: 161742, Start Time: 2012-08-13 01:59:11, End Time: 2012-08-13 03:12:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.30% (2.0176 => 2.2860, std. dev.: 0.0194) SingleSource/UnitTests/ObjC++/property-reference-object: 8.63% (0.5818 => 0.6320, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.33% (0.5748 => 0.6227, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7061 => 0.7608, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 7.55% (0.3578 => 0.3848, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.43% (0.3663 => 0.3935, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4328 => 0.4649, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.39% (0.3789 => 0.4069, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.36% (0.3601 => 0.3866, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3646 => 0.3913, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.26% (1.3693 => 1.4687, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.23% (0.3623 => 0.3885, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.16% (0.5265 => 0.5642, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.2781 => 0.2979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.01% (0.3940 => 0.4216, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.98% (0.7710 => 0.8248, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 6.95% (0.7038 => 0.7527, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.92% (3.9660 => 4.2403, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.54% (0.2628 => 0.2800, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.52% (0.3022 => 0.3219, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3899 => 0.4144, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.24% (0.9199 => 0.9773, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.24% (0.2966 => 0.3151, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.23% (0.2761 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.19% (0.3149 => 0.3344, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.18% (1.2193 => 1.2946, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.17% (1.9828 => 2.1052, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.15% (0.3107 => 0.3298, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2696 => 0.2861, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.99% (0.3489 => 0.3698, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.82% (0.2988 => 0.3162, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.5577 => 0.5901, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3192 => 0.3377, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3246 => 0.3430, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.65% (0.3453 => 0.3648, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.53% (0.4016 => 0.4238, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.34% (0.3293 => 0.3469, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3534 => 0.3721, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.28% (0.4390 => 0.4622, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.3756 => 0.3952, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.08% (1.4563 => 1.5303, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 4.93% (13.8202 => 14.5019, std. dev.: 0.0152) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.89% (1.3813 => 1.4489, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (1.1364 => 1.1918, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.83% (1.3819 => 1.4487, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.79% (3.8646 => 4.0497, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.77% (0.5637 => 0.5906, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.73% (0.7506 => 0.7861, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.70% (1.2292 => 1.2870, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.69% (0.8310 => 0.8700, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.68% (1.1061 => 1.1579, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.65% (7.2180 => 7.5538, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.58% (1.3245 => 1.3852, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.34% (1.9270 => 2.0106, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.0594 => 1.1036, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.13% (0.3755 => 0.3910, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.10% (2.1791 => 2.2685, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.02% (16.6129 => 17.2807, std. dev.: 0.0287) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.3801 => 4.5458, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (4.4433 => 4.6085, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.55% (3.6692 => 3.7993, std. dev.: 0.0200) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (13.2842 => 13.7385, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1720, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (4.9865 => 5.1543, std. dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.34% (0.6135 => 0.6340, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.4791 => 0.4951, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (0.8698 => 0.8982, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.6283 => 0.6470, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.87% (16.2614 => 16.7283, std. dev.: 0.0223) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2797, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.83% (8.4961 => 8.7368, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2670, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (3.2742 => 3.3610, std. dev.: 0.0104) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.5754 => 6.7465, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 2.60% (0.4113 => 0.4220, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5568, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.43% (14.5298 => 14.8827, std. dev.: 0.0208) MultiSource/Applications/oggenc/oggenc: 2.26% (4.6629 => 4.7684, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (2.1007 => 2.1455, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6250 => 0.6372, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.50% (0.9108 => 0.9245, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (3.7467 => 3.7858, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 25.76% (1.8175 => 2.2857, std. dev.: 0.0410) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.54% (1.2998 => 1.4108, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7427, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3852, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5964, std. dev.: 0.0094) MultiSource/Applications/SPASS/SPASS: 2.26% (10.7476 => 10.9910, std. dev.: 0.0464) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5158, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.61% (0.4657 => 0.3930, std. dev.: 0.0178) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.5627 => 21.1247, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.32% (1.3780 => 1.3185, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8017, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5925, std. dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.56% (20.3410 => 19.8193, std. dev.: 0.0523) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2224, std. dev.: 0.0109) MultiSource/Applications/spiff/spiff: -2.03% (3.0263 => 2.9648, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2127, std. dev.: 0.0105) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2125, std. dev.: 0.0258) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3779, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8014, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 22:04:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 00:04:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813050421.7E7DB2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2843?compare_to=2840&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2843, Order: 161745, Start Time: 2012-08-13 03:46:13, End Time: 2012-08-13 05:05:04 To: 2840, Order: 161742, Start Time: 2012-08-13 01:59:19, End Time: 2012-08-13 03:17:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (91 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (745 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.96% (14.0839 => 13.8084, std. dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.19% (10.3673 => 13.8084, std. dev.: 0.0090) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.49% (0.3516 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.49% (0.3561 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.47% (2.2022 => 2.3668, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.26% (1.7609 => 1.8887, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.80% (10.4361 => 11.0410, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 5.70% (0.5925 => 0.6263, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.61% (0.6030 => 0.6368, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3830, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 4.65% (0.7433 => 0.7779, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5860 => 0.6113, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (9.4845 => 9.8816, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.04% (0.8172 => 0.8502, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 3.81% (0.3180 => 0.3301, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (4.2646 => 4.4257, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.9449 => 5.1310, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (5.0018 => 5.1885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.63% (1.3050 => 1.3524, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.50% (0.7835 => 0.8109, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.44% (8.1363 => 8.4158, std. dev.: 0.0123) MultiSource/Applications/Burg/burg: 3.28% (1.1642 => 1.2024, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.4103 => 0.4237, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1861 => 1.2239, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.13% (1.5415 => 1.5897, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.08% (5.7591 => 5.9367, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.03% (0.9765 => 1.0061, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.00% (0.4636 => 0.4775, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.98% (0.8067 => 0.8307, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.96% (0.3441 => 0.3543, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.85% (3.3354 => 3.4305, std. dev.: 0.0155) MultiSource/Applications/treecc/treecc: 2.79% (2.0273 => 2.0839, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.69% (0.3826 => 0.3929, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.61% (0.3865 => 0.3966, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5859 => 1.6254, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5988, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 2.45% (3.8723 => 3.9672, std. dev.: 0.0156) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4299 => 0.4402, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.6456 => 0.6608, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.35% (1.4186 => 1.4519, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.4289 => 0.4389, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.6450 => 0.6600, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.29% (2.2969 => 2.3496, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5746, std. dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.26% (0.6675 => 0.6826, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (2.0665 => 2.1122, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.21% (0.5981 => 0.6113, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8921 => 0.9116, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (14.3668 => 14.6724, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2842 => 1.3106, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5020 => 0.5122, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.2024 => 2.2446, std. dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 1.66% (1.1840 => 1.2037, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.30% (1.0722 => 1.0861, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.92% (4.2280 => 4.4362, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 1.79% (26.0924 => 26.5607, std. dev.: 0.0287) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8427, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.39% (5.2636 => 5.3366, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1997, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.25% (5.2763 => 3.1528, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6944, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6873, std. dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -15.13% (54.1659 => 45.9733, std. dev.: 0.0249) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.69% (2.9384 => 2.5360, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -12.08% (22.1758 => 19.4969, std. dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -8.83% (1.5373 => 1.4015, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8031, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4749, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4154, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0102, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.29% (8.1563 => 7.9698, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3503, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2866, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8125, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (19.9488 => 19.7475, std. dev.: 0.0160) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 23:35:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 01:35:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813063557.B67622A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2844?compare_to=2842&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2844, Order: 161746, Start Time: 2012-08-13 05:22:56, End Time: 2012-08-13 06:36:35 To: 2842, Order: 161745, Start Time: 2012-08-13 03:41:05, End Time: 2012-08-13 04:54:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (137 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.96% (78.7051 => 80.2451, std. dev.: 0.5138) SingleSource/Benchmarks/Misc/mandel-2: 1.52% (1.4108 => 1.4323, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.37% (2.0176 => 2.2873, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.63% (0.5818 => 0.6320, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5748 => 0.6234, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7061 => 0.7608, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 7.55% (0.3578 => 0.3848, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1986 => 0.2133, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.39% (0.3601 => 0.3867, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4704, std. dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-4: 7.38% (0.3646 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3623 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3663 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3914 => 0.4198, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.21% (0.3650 => 0.3913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4328 => 0.4639, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7038 => 0.7542, std. dev.: 0.0114) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.2781 => 0.2979, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.09% (0.7710 => 0.8257, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.5265 => 0.5635, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2389, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4062 => 0.4332, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.3022 => 0.3214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.2937 => 0.3121, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.26% (0.3580 => 0.3804, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.21% (0.3899 => 0.4141, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.17% (0.2966 => 0.3149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.09% (1.2193 => 1.2935, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.07% (1.9828 => 2.1031, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.01% (0.2696 => 0.2858, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.00% (0.9199 => 0.9751, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.6959 => 0.7376, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.95% (0.3107 => 0.3292, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.91% (0.3485 => 0.3691, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.85% (0.3489 => 0.3693, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.84% (0.3149 => 0.3333, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3246 => 0.3431, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5577 => 0.5893, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 5.53% (0.3453 => 0.3644, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4390 => 0.4623, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.18% (0.4016 => 0.4224, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.04% (1.3819 => 1.4516, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (1.3813 => 1.4501, std. dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 4.96% (13.8202 => 14.5051, std. dev.: 0.0289) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.94% (1.4563 => 1.5283, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.1364 => 1.1924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.91% (0.3868 => 0.4058, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.77% (0.5637 => 0.5906, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.77% (3.8646 => 4.0490, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.8310 => 0.8704, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.74% (1.1061 => 1.1585, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.70% (7.2180 => 7.5573, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2292 => 1.2861, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3855, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.33% (1.0594 => 1.1053, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.32% (1.9270 => 2.0102, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.22% (0.7460 => 0.7775, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.16% (2.1791 => 2.2698, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.02% (0.3755 => 0.3906, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.02% (16.6129 => 17.2800, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.77% (3.6692 => 3.8077, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (4.4433 => 4.6096, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.3801 => 4.5396, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.59% (1.1333 => 1.1740, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6135 => 0.6349, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.42% (0.4791 => 0.4955, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (13.2842 => 13.7383, std. dev.: 0.0067) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.27% (4.9865 => 5.1494, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.94% (16.2614 => 16.7395, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.90% (0.6283 => 0.6465, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.87% (3.1889 => 3.2804, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 2.85% (8.4961 => 8.7384, std. dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: 2.80% (14.8535 => 15.2691, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 2.63% (0.4113 => 0.4221, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.50% (3.2742 => 3.3560, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5188 => 1.5566, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.44% (14.5298 => 14.8849, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.1007 => 2.1446, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.68% (0.6250 => 0.6355, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.46% (1.0313 => 1.0464, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.9108 => 0.9241, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7868, std. dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.19% (1.2998 => 1.4323, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7438, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.37% (2.8606 => 2.9569, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9841, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4271 => 7.6135, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5119, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.42% (0.4657 => 0.3939, std. dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1393, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.6576 => 0.6473, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.60% (1.1560 => 1.1028, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.45% (1.3780 => 1.3167, std. dev.: 0.0135) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8018, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5925, std. dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.63% (20.3410 => 19.8067, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9285, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9640, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2287, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.65% (7.3305 => 7.2098, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4935, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2185, std. dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3807, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8687, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8015, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.07% (1.0310 => 1.0200, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 6.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 12 23:51:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 01:51:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813065151.B6F192A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2845?compare_to=2843&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2845, Order: 161746, Start Time: 2012-08-13 05:33:30, End Time: 2012-08-13 06:52:32 To: 2843, Order: 161745, Start Time: 2012-08-13 03:46:13, End Time: 2012-08-13 05:05:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (87 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (748 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.27% (10.3673 => 13.8166, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.41% (1.1194 => 1.2471, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.50% (0.3886 => 0.4294, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.50% (2.2022 => 2.3673, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.26% (1.7609 => 1.8887, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.71% (10.4361 => 11.0321, std. dev.: 0.0054) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.59% (0.6030 => 0.6367, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.65% (0.7326 => 0.7667, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.52% (7.0540 => 7.3731, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 4.41% (0.7433 => 0.7761, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.23% (0.3121 => 0.3253, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 4.14% (9.4845 => 9.8767, std. dev.: 0.0155) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5860 => 0.6084, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (4.2646 => 4.4273, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.9449 => 5.1324, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (5.0018 => 5.1886, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.66% (1.3050 => 1.3527, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.54% (0.7835 => 0.8112, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (8.1363 => 8.4146, std. dev.: 0.0111) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1861 => 1.2239, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.10% (5.7591 => 5.9374, std. dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.4636 => 0.4779, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.5415 => 1.5889, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.9765 => 1.0058, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.99% (1.1642 => 1.1990, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.96% (0.8067 => 0.8306, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0853, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.73% (3.3354 => 3.4263, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.49% (0.5105 => 0.5232, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5859 => 1.6248, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.45% (0.5020 => 0.5143, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 2.44% (3.8723 => 3.9669, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.6450 => 0.6607, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 2.35% (0.4289 => 0.4390, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.35% (1.5603 => 1.5969, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.27% (17.1811 => 17.5703, std. dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.6456 => 0.6599, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (2.0665 => 2.1121, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.19% (2.2969 => 2.3471, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.19% (1.4186 => 1.4496, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (14.3668 => 14.6744, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8921 => 0.9112, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6675 => 0.6817, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (2.2024 => 2.2422, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.64% (1.1840 => 1.2034, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: 1.55% (0.7115 => 0.7225, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.30% (1.0722 => 1.0861, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.43% (2.6778 => 2.9572, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.05% (4.2280 => 4.4416, std. dev.: 0.0122) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7524, std. dev.: 0.0150) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5658, std. dev.: 0.0253) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8425, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.34% (5.2636 => 5.3340, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1998, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6824, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5747, std. dev.: 0.0132) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.21% (5.2763 => 3.1546, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6951, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.09% (5.3526 => 3.6886, std. dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -15.10% (54.1659 => 45.9854, std. dev.: 0.0231) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5389, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -12.14% (22.1758 => 19.4847, std. dev.: 0.0301) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -7.84% (1.5373 => 1.4168, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8029, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5107, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4620, std. dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4281, std. dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0116, std. dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9589, std. dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3436, std. dev.: 0.0085) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.25% (19.9488 => 19.6993, std. dev.: 0.0807) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2867, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.14% (1.8329 => 1.8120, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 00:57:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 02:57:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120813075759.9F2FB2A6C075@llvm.org> http://llvm.org/perf/db_default/v4/nts/2846?compare_to=2841&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2846, Order: 161746, Start Time: 2012-08-13 05:11:38, End Time: 2012-08-13 07:58:41 To: 2841, Order: 161742, Start Time: 2012-08-13 01:59:22, End Time: 2012-08-13 04:43:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 3 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (774 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -2.23% (1.7335 => 1.6949, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: -1.20% (1.0170 => 1.0048, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -6.04% (0.2333 => 0.2192, std. dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 31.07% (0.3792 => 0.4970, std. dev.: 0.0328) SingleSource/UnitTests/ObjC/for-in: 12.41% (0.3496 => 0.3930, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3460 => 0.3889, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions-2: 12.28% (0.3446 => 0.3869, std. dev.: 0.0128) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.24% (0.3488 => 0.3915, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3469 => 0.3891, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/property: 11.95% (0.3650 => 0.4086, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3643 => 0.4072, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/parameter-passing: 11.52% (0.3724 => 0.4153, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.38% (1.5932 => 1.6949, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 6.06% (0.5889 => 0.6246, std. dev.: 0.0103) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.02% (1.6211 => 1.7187, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.77% (0.5026 => 0.5316, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.72% (3.5627 => 3.7664, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.57% (0.4994 => 0.5272, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.50% (1.3152 => 1.3876, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.42% (0.5900 => 0.6220, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.27% (0.4361 => 0.4591, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.22% (0.3930 => 0.4135, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 5.20% (0.9909 => 1.0424, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 5.09% (4.2109 => 4.4254, std. dev.: 0.0050) MultiSource/Applications/d/make_dparser: 4.80% (1.0781 => 1.1298, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (0.5000 => 0.5236, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.70% (0.2875 => 0.3010, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.57% (5.5417 => 5.7950, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.51% (0.2729 => 0.2852, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2792 => 0.2917, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 4.46% (0.2714 => 0.2835, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 4.40% (0.2566 => 0.2679, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.39% (2.0673 => 2.1581, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.2780 => 0.2902, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 4.34% (0.2813 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2750 => 0.2869, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.31% (2.7292 => 2.8469, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 4.30% (0.3096 => 0.3229, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.26% (0.3195 => 0.3331, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.25% (2.1013 => 2.1906, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.2823 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.18% (0.3348 => 0.3488, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (0.3890 => 0.4051, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3362 => 0.3501, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.94% (2.1653 => 2.2507, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.91% (0.4658 => 0.4840, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.89% (0.3625 => 0.3766, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.89% (0.3060 => 0.3179, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (1.9694 => 2.0459, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 3.84% (0.3726 => 0.3869, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.80% (0.3477 => 0.3609, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (1.9966 => 2.0718, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4146 => 0.4299, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.69% (0.3690 => 0.3826, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 3.67% (4.6177 => 4.7872, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.62% (0.9697 => 1.0048, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.60% (0.4251 => 0.4404, std. dev.: 0.0049) MultiSource/Applications/treecc/treecc: 3.59% (0.7875 => 0.8158, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.3903 => 0.4043, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 3.50% (1.4269 => 1.4768, std. dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 3.45% (1.8794 => 1.9443, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.39% (0.6634 => 0.6859, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.3981 => 0.4115, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (4.4195 => 4.5673, std. dev.: 0.0439) MultiSource/Applications/Burg/burg: 3.28% (0.5546 => 0.5728, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 3.26% (23.5202 => 24.2877, std. dev.: 0.0173) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.4139 => 0.4271, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.15% (0.3336 => 0.3441, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.6435 => 0.6632, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 2.95% (0.5012 => 0.5160, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.33% (2.0346 => 2.0820, std. dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.36% (11.6398 => 11.7981, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.6926 => 4.7420, std. dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8966, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6392, std. dev.: 0.0782) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (41.7953 => 42.6362, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 1.77% (15.8721 => 16.1525, std. dev.: 0.0237) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5897, std. dev.: 0.0268) MultiSource/Applications/lua/lua: 1.68% (50.0626 => 50.9015, std. dev.: 0.0117) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std. dev.: 0.0076) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3145, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2834, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5674, std. dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8066, std. dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9569, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7997, std. dev.: 0.0945) SingleSource/Benchmarks/Dhrystone/fldry: -3.17% (17.2379 => 16.6907, std. dev.: 0.2037) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5706, std. dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9641, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 03:56:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 05:56:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813105655.EC1EE2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2847?compare_to=2844&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2847, Order: 161748, Start Time: 2012-08-13 09:43:49, End Time: 2012-08-13 10:57:39 To: 2844, Order: 161746, Start Time: 2012-08-13 05:22:56, End Time: 2012-08-13 06:36:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (142 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.58% (27.7010 => 29.5237, std. dev.: 0.0636) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.96% (54.4319 => 56.5875, std. dev.: 0.0461) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.90% (2.0176 => 2.2981, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.85% (0.5818 => 0.6333, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5748 => 0.6238, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.93% (0.7061 => 0.7621, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3578 => 0.3857, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 7.66% (0.3601 => 0.3877, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3646 => 0.3925, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.53% (0.3663 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.52% (0.3789 => 0.4074, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3623 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.40% (0.3650 => 0.3920, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.27% (3.9660 => 4.2544, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.19% (0.7038 => 0.7544, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 7.03% (1.3693 => 1.4655, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4328 => 0.4628, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.7710 => 0.8239, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 6.65% (0.2781 => 0.2966, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2782 => 0.2964, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.41% (1.2193 => 1.2975, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.25% (0.4062 => 0.4316, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.17% (0.9199 => 0.9767, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.15% (0.6959 => 0.7387, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2690 => 0.2854, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.06% (0.2607 => 0.2765, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2761 => 0.2928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.99% (0.3022 => 0.3203, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.98% (0.3580 => 0.3794, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2655 => 0.2813, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.91% (0.3246 => 0.3438, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.5577 => 0.5901, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.2966 => 0.3138, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.73% (0.3489 => 0.3689, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.66% (1.9828 => 2.0950, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.64% (0.2696 => 0.2848, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.2988 => 0.3155, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3192 => 0.3364, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.35% (0.4390 => 0.4625, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.31% (1.4563 => 1.5336, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 5.23% (13.8202 => 14.5434, std. dev.: 0.0161) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.23% (1.1364 => 1.1958, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.16% (0.3293 => 0.3463, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.13% (1.3813 => 1.4522, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.05% (1.3819 => 1.4517, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (0.3756 => 0.3943, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5713, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.86% (0.8310 => 0.8714, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.5637 => 0.5911, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.83% (0.3868 => 0.4055, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.82% (1.1061 => 1.1594, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.81% (3.8646 => 4.0503, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 4.71% (1.0594 => 1.1093, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.66% (0.7506 => 0.7856, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.66% (1.3245 => 1.3862, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.7460 => 0.7801, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.2292 => 1.2849, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.53% (1.9270 => 2.0143, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.34% (2.1791 => 2.2737, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 4.27% (16.6129 => 17.3223, std. dev.: 0.0139) MultiSource/Benchmarks/McCat/18-imp/imp: 4.16% (0.3220 => 0.3354, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.11% (0.4791 => 0.4988, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6184, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.89% (3.6692 => 3.8121, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.3801 => 4.5504, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1333 => 1.1752, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.68% (0.6135 => 0.6361, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.65% (4.9865 => 5.1684, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (13.2842 => 13.7663, std. dev.: 0.0155) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.37% (0.8698 => 0.8991, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.28% (16.2614 => 16.7951, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (8.4961 => 8.7616, std. dev.: 0.0132) MultiSource/Applications/d/make_dparser: 3.11% (3.1889 => 3.2880, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 2.95% (14.8535 => 15.2922, std. dev.: 0.0138) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (6.5754 => 6.7656, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.88% (1.5188 => 1.5625, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 2.87% (0.4113 => 0.4231, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (3.2742 => 3.3681, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 2.71% (4.6629 => 4.7893, std. dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9093, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.44% (2.1007 => 2.1519, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.75% (0.9108 => 0.9267, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.71% (1.0313 => 1.0489, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.71% (0.6744 => 0.6859, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 1.60% (0.6250 => 0.6350, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.29% (3.7467 => 3.7949, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.85% (1.2998 => 1.4278, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0058, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7439, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8164, std. dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5940, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 1.95% (10.7476 => 10.9567, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0085) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (22.5627 => 21.1924, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3184, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.28% (5.0168 => 4.8022, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0006) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.66% (20.3410 => 19.8005, std. dev.: 0.0274) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5914, std. dev.: 0.0199) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -1.99% (3.0263 => 2.9661, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2391, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2131, std. dev.: 0.0242) MultiSource/Applications/minisat/minisat: -1.35% (9.3358 => 9.2097, std. dev.: 0.0295) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3761, std. dev.: 0.0113) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8030, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8732, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 04:02:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 06:02:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813110233.D4F1C2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2848?compare_to=2845&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2848, Order: 161748, Start Time: 2012-08-13 09:43:52, End Time: 2012-08-13 11:03:17 To: 2845, Order: 161746, Start Time: 2012-08-13 05:33:30, End Time: 2012-08-13 06:52:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (83 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.84% (78.9848 => 80.4393, std. dev.: 0.1091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.69% (10.3673 => 13.7564, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.45% (1.1194 => 1.2476, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.86% (0.3516 => 0.3898, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3561 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.27% (2.2022 => 2.3624, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.78% (1.7609 => 1.8803, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.47% (10.4361 => 11.0071, std. dev.: 0.0167) SingleSource/UnitTests/ObjC++/Hello: 5.45% (0.5925 => 0.6248, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.36% (0.6030 => 0.6353, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.09% (0.7326 => 0.7699, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.72% (0.4615 => 0.4833, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.70% (0.5569 => 0.5831, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.35% (0.4879 => 0.5091, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (7.0540 => 7.3547, std. dev.: 0.0176) MultiSource/Applications/lambda-0_1_3/lambda: 4.25% (0.7433 => 0.7749, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.17% (0.2758 => 0.2873, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.08% (0.5860 => 0.6099, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (9.4845 => 9.8595, std. dev.: 0.0100) MultiSource/Applications/spiff/spiff: 3.88% (0.7835 => 0.8139, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.77% (0.8172 => 0.8480, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (4.9449 => 5.1234, std. dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.59% (4.2646 => 4.4177, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.3050 => 1.3498, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (5.0018 => 5.1734, std. dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 3.19% (5.7591 => 5.9429, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.19% (8.1363 => 8.3958, std. dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.5415 => 1.5904, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.02% (0.3441 => 0.3545, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.93% (0.9765 => 1.0051, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 2.90% (1.1642 => 1.1980, std. dev.: 0.0087) MultiSource/Applications/treecc/treecc: 2.85% (2.0273 => 2.0850, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.71% (0.4103 => 0.4214, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 2.68% (3.3354 => 3.4247, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.42% (3.8723 => 3.9661, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.4289 => 0.4389, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 2.26% (1.5603 => 1.5956, std. dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 2.23% (17.1811 => 17.5643, std. dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.23% (1.4186 => 1.4502, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.20% (1.5859 => 1.6208, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.6456 => 0.6588, std. dev.: 0.0050) MultiSource/Applications/siod/siod: 2.04% (2.2969 => 2.3437, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (14.3668 => 14.6549, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/football/football: 1.98% (0.8921 => 0.9098, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.82% (2.0665 => 2.1042, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.72% (2.2024 => 2.2403, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.61% (1.2842 => 1.3049, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2011, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: 1.43% (0.7115 => 0.7217, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.25% (1.0722 => 1.0856, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (4.2280 => 4.4371, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std. dev.: 0.0091) MultiSource/Applications/lua/lua: 1.94% (26.0924 => 26.5978, std. dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8428, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.32% (5.2636 => 5.3330, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1578 => 3.1994, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.14% (2.2771 => 2.3030, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6815, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.38% (5.2763 => 3.1457, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6904, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.20% (5.3526 => 3.6826, std. dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -15.11% (54.1659 => 45.9821, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.62% (2.9384 => 2.5381, std. dev.: 0.0217) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4900, std. dev.: 0.0451) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -7.36% (1.5373 => 1.4241, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8031, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.14% (4.8142 => 4.6147, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4694, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4209, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9962, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.48% (8.1563 => 7.9537, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5130, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3487, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2867, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.8329 => 1.8144, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.00% (19.9488 => 19.7489, std. dev.: 0.0277) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 05:26:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 07:26:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120813122629.1698C352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2849?compare_to=2846&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2849, Order: 161748, Start Time: 2012-08-13 09:43:39, End Time: 2012-08-13 12:27:11 To: 2846, Order: 161746, Start Time: 2012-08-13 05:11:38, End Time: 2012-08-13 07:58:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (115 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 2.36% (14.3054 => 14.6432, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.25% (54.1602 => 54.8376, std. dev.: 0.0676) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.04% (1.0424 => 1.0316, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.50% (0.3496 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3488 => 0.3918, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3446 => 0.3870, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.78% (0.3650 => 0.4080, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3643 => 0.4072, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.55% (0.3724 => 0.4154, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.67% (0.1619 => 0.1727, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.18% (1.5932 => 1.6916, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5826 => 0.6185, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5889 => 0.6241, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7158, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.74% (1.3152 => 1.3907, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (3.5627 => 3.7649, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (0.5026 => 0.5292, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.24% (0.5900 => 0.6209, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.22% (0.3930 => 0.4135, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.15% (0.4994 => 0.5251, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.01% (0.4029 => 0.4231, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 4.93% (4.2109 => 4.4184, std. dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (0.5000 => 0.5246, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 4.69% (0.7171 => 0.7507, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 4.64% (1.0781 => 1.1281, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.2866 => 0.2992, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.38% (0.2875 => 0.3001, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 4.22% (5.5417 => 5.7753, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: 4.17% (0.2780 => 0.2896, std. dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.3004 => 0.3128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.11% (0.9909 => 1.0316, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2811 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (2.7292 => 2.8405, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.05% (0.2566 => 0.2670, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.05% (0.2792 => 0.2905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2823 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3195 => 0.3324, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (0.4658 => 0.4845, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.01% (0.3890 => 0.4046, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3317 => 0.3448, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.94% (0.3348 => 0.3480, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 3.92% (0.2803 => 0.2913, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.91% (2.0673 => 2.1481, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (1.9694 => 2.0463, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (1.9966 => 2.0740, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.3845 => 0.3994, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 3.87% (0.2813 => 0.2922, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.87% (0.6634 => 0.6891, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.87% (0.3362 => 0.3492, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.85% (2.1013 => 2.1823, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 3.83% (0.3267 => 0.3392, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.81% (0.2911 => 0.3022, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.79% (0.3060 => 0.3176, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.78% (0.3726 => 0.3867, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 3.78% (0.3096 => 0.3213, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.71% (0.3124 => 0.3240, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.3903 => 0.4045, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.3678 => 0.3808, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.53% (0.3282 => 0.3398, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.53% (0.3625 => 0.3753, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.51% (2.1653 => 2.2412, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 3.44% (4.6177 => 4.7765, std. dev.: 0.0140) MultiSource/Applications/hbd/hbd: 3.42% (0.9697 => 1.0029, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4146 => 0.4287, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.36% (0.4251 => 0.4394, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.35% (1.8794 => 1.9423, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 3.34% (0.7875 => 0.8138, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3477 => 0.3592, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (4.4195 => 4.5621, std. dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 3.22% (23.5202 => 24.2773, std. dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.20% (0.3690 => 0.3808, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.15% (1.4269 => 1.4718, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.3981 => 0.4106, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (0.4139 => 0.4265, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.03% (0.6435 => 0.6630, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.00% (0.3336 => 0.3436, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 2.87% (0.5012 => 0.5156, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 2.87% (0.5546 => 0.5705, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.21% (2.0346 => 2.0796, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (0.7426 => 0.7549, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.30% (11.6398 => 11.7913, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6804, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std. dev.: 0.0449) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6432, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6394, std. dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1948, std. dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.91% (41.7953 => 42.5921, std. dev.: 0.0217) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5905, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9130, std. dev.: 0.0174) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2210, std. dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3078, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.11% (1.0927 => 1.1048, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5821, std. dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8096, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7983, std. dev.: 0.0047) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/fldry: -2.38% (17.2379 => 16.8283, std. dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9656, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 05:38:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 07:38:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813123850.E457E352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2850?compare_to=2847&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2850, Order: 161752, Start Time: 2012-08-13 11:25:51, End Time: 2012-08-13 12:39:33 To: 2847, Order: 161748, Start Time: 2012-08-13 09:43:49, End Time: 2012-08-13 10:57:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.16% (78.2624 => 80.7334, std. dev.: 0.3437) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3040, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.21% (0.5818 => 0.6354, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.82% (0.5748 => 0.6255, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.24% (0.7061 => 0.7643, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 8.13% (0.3578 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.97% (0.3601 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.94% (0.3663 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.79% (0.3914 => 0.4219, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.78% (0.3650 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.56% (0.3940 => 0.4238, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.37% (0.5265 => 0.5653, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.30% (3.9660 => 4.2555, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 7.26% (0.7038 => 0.7549, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.15% (1.3693 => 1.4672, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.2781 => 0.2969, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.65% (0.2782 => 0.2967, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.47% (0.4062 => 0.4325, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.41% (1.2193 => 1.2975, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.32% (0.6959 => 0.7399, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.31% (0.9199 => 0.9779, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.3899 => 0.4143, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.18% (0.2655 => 0.2819, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3489 => 0.3704, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.15% (0.3107 => 0.3298, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.13% (0.3149 => 0.3342, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.12% (0.3022 => 0.3207, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2761 => 0.2929, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.2937 => 0.3114, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (1.9828 => 2.1015, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.95% (0.3246 => 0.3439, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.5577 => 0.5901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.68% (0.3453 => 0.3649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.64% (0.3192 => 0.3372, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (1.3813 => 1.4587, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.54% (1.3819 => 1.4585, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.50% (13.8202 => 14.5810, std. dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.42% (0.4390 => 0.4628, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.40% (0.4016 => 0.4233, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3756 => 0.3955, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.27% (1.1364 => 1.1963, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (1.4563 => 1.5330, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.3534 => 0.3720, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.25% (0.3293 => 0.3466, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.06% (0.5637 => 0.5922, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.04% (0.8310 => 0.8729, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.00% (3.8646 => 4.0579, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (7.2180 => 7.5755, std. dev.: 0.0097) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.77% (1.0594 => 1.1099, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.74% (1.1061 => 1.1585, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.73% (1.3245 => 1.3871, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.64% (1.2292 => 1.2862, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.60% (0.7460 => 0.7803, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.57% (1.9270 => 2.0150, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 4.40% (2.1791 => 2.2749, std. dev.: 0.0087) MultiSource/Applications/kimwitu++/kc: 4.37% (16.6129 => 17.3387, std. dev.: 0.0246) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.07% (3.6692 => 3.8187, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (4.4433 => 4.6236, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1871, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.01% (0.4791 => 0.4983, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.97% (13.2842 => 13.8120, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.3801 => 4.5523, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (1.1333 => 1.1763, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.70% (0.6135 => 0.6362, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.68% (0.6283 => 0.6514, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.61% (0.3131 => 0.3244, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.45% (0.8698 => 0.8998, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (8.4961 => 8.7819, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 3.28% (3.1889 => 3.2935, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 3.24% (16.2614 => 16.7884, std. dev.: 0.0159) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.18% (14.8535 => 15.3259, std. dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (6.5754 => 6.7801, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.05% (3.2742 => 3.3741, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 3.00% (4.6629 => 4.8026, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 2.75% (14.5298 => 14.9296, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.70% (1.5188 => 1.5598, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.44% (2.1007 => 2.1520, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.92% (0.6250 => 0.6370, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.87% (0.9108 => 0.9278, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.79% (1.0313 => 1.0498, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: 1.78% (0.6744 => 0.6864, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.29% (3.7467 => 3.7950, std. dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.10% (33.2944 => 33.6594, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5213, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0473) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.44% (1.2998 => 1.4225, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.33% (11.2619 => 11.7492, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4271 => 7.6100, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3841, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9782, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.00% (1.5089 => 1.5240, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.60% (0.4657 => 0.3977, std. dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.80% (22.5627 => 21.2545, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.42% (0.2670 => 0.2552, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3187, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8018, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5734, std. dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.72% (20.3410 => 19.7877, std. dev.: 0.0328) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2250, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.98% (3.0263 => 2.9664, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.64% (7.3305 => 7.2101, std. dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3826, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2212, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8035, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.10% (3.9173 => 3.8741, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 05:50:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 07:50:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813125014.ADEDE352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2851?compare_to=2848&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2851, Order: 161753, Start Time: 2012-08-13 11:31:44, End Time: 2012-08-13 12:50:57 To: 2848, Order: 161748, Start Time: 2012-08-13 09:43:52, End Time: 2012-08-13 11:03:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (2.1042 => 2.1278, std. dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.68% (10.3673 => 13.8591, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.55% (0.3516 => 0.3922, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.20% (2.2022 => 2.3607, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.17% (1.7609 => 1.8871, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.92% (0.4615 => 0.4888, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.80% (10.4361 => 11.0417, std. dev.: 0.0112) SingleSource/UnitTests/ObjC++/Hello: 5.79% (0.5925 => 0.6268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.67% (0.6030 => 0.6372, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7326 => 0.7678, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 4.78% (0.7433 => 0.7788, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.8172 => 0.8533, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.40% (0.2271 => 0.2371, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.40% (7.0540 => 7.3646, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 4.27% (0.3282 => 0.3422, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (9.4845 => 9.8760, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.9449 => 5.1435, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.5860 => 0.6089, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (4.2646 => 4.4271, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (5.0018 => 5.1875, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.4103 => 0.4249, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (1.3050 => 1.3511, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.50% (0.7835 => 0.8109, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (0.4636 => 0.4796, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (8.1363 => 8.4147, std. dev.: 0.0060) MultiSource/Applications/hbd/hbd: 3.41% (1.5603 => 1.6135, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.5415 => 1.5940, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 3.26% (1.1642 => 1.2022, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 3.25% (5.7591 => 5.9465, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.18% (1.1861 => 1.2238, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.15% (0.3650 => 0.3765, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.13% (0.3865 => 0.3986, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.11% (0.9765 => 1.0069, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.8067 => 0.8314, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: 3.04% (0.3422 => 0.3526, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.01% (0.3826 => 0.3941, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.99% (0.3441 => 0.3544, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.97% (2.0665 => 2.1278, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.95% (0.3935 => 0.4051, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.91% (0.4289 => 0.4414, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.80% (2.0273 => 2.0840, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 2.79% (3.3354 => 3.4284, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (0.4064 => 0.4174, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4620 => 0.4745, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.64% (3.8723 => 3.9745, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.61% (0.5105 => 0.5238, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.54% (0.6456 => 0.6620, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.52% (0.4203 => 0.4309, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3165, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.5859 => 1.6246, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.40% (0.6450 => 0.6605, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.35% (1.4186 => 1.4520, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 2.32% (17.1811 => 17.5793, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.26% (2.2969 => 2.3487, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (0.6675 => 0.6822, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5020 => 0.5128, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (14.3668 => 14.6682, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.00% (2.2024 => 2.2464, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.72% (1.1840 => 1.2044, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.59% (0.7115 => 0.7228, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.64% (4.2280 => 4.4240, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5642, std. dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8426, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (5.2636 => 5.3384, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1998, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5788, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1304, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.50% (0.8651 => 0.1687, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.12% (5.2763 => 3.1597, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6903, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.18% (5.3526 => 3.6834, std. dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -15.17% (54.1659 => 45.9480, std. dev.: 0.0369) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.71% (2.9384 => 2.5356, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -11.95% (22.1758 => 19.5252, std. dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -6.89% (1.5373 => 1.4314, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8031, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (4.8142 => 4.6141, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4730, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4183, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9916, std. dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (8.1563 => 7.9674, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3490, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.25% (19.9488 => 19.6991, std. dev.: 0.0397) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2867, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.16% (1.8329 => 1.8117, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 07:20:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 09:20:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813142039.93F66352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2852?compare_to=2850&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2852, Order: 161753, Start Time: 2012-08-13 13:07:39, End Time: 2012-08-13 14:21:21 To: 2850, Order: 161752, Start Time: 2012-08-13 11:25:51, End Time: 2012-08-13 12:39:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.19% (2.0176 => 2.3039, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 9.11% (0.5818 => 0.6348, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5748 => 0.6256, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.3130 => 0.3404, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.24% (0.7061 => 0.7643, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.22% (0.3578 => 0.3872, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.03% (0.3601 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.00% (0.3650 => 0.3942, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 7.98% (0.3646 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.4003 => 0.4319, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.87% (0.3623 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.84% (0.3663 => 0.3950, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 7.81% (0.3789 => 0.4085, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.71% (0.1413 => 0.1522, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.56% (0.3940 => 0.4238, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.20% (0.5265 => 0.5644, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (3.9660 => 4.2504, std. dev.: 0.0129) MultiSource/Applications/hbd/hbd: 7.09% (1.3693 => 1.4664, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 6.93% (0.7038 => 0.7526, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.65% (0.2782 => 0.2967, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.43% (0.4062 => 0.4323, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.31% (1.2193 => 1.2962, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2628 => 0.2792, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.18% (0.3899 => 0.4140, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.15% (0.2765 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.15% (0.3107 => 0.3298, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.14% (0.9199 => 0.9764, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.2937 => 0.3117, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: 6.09% (0.2760 => 0.2928, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.08% (0.3489 => 0.3701, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.6959 => 0.7380, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3149 => 0.3339, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.94% (0.3485 => 0.3692, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.92% (1.9828 => 2.1001, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5577 => 0.5892, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.64% (0.3192 => 0.3372, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.63% (1.3813 => 1.4590, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.2988 => 0.3156, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.52% (1.3819 => 1.4582, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3453 => 0.3643, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.38% (0.4390 => 0.4626, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 5.37% (13.8202 => 14.5618, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.4563 => 1.5344, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.29% (1.1364 => 1.1965, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 5.21% (0.3534 => 0.3718, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4016 => 0.4225, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 4.99% (0.8310 => 0.8725, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.91% (7.2180 => 7.5725, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.76% (3.8646 => 4.0485, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (1.3245 => 1.3868, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.70% (1.0594 => 1.1092, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.68% (1.1061 => 1.1579, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 4.60% (1.2292 => 1.2857, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.7460 => 0.7795, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 4.42% (1.9270 => 2.0122, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 4.27% (16.6129 => 17.3231, std. dev.: 0.0218) MultiSource/Applications/siod/siod: 4.18% (2.1791 => 2.2702, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.05% (0.3755 => 0.3907, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1865, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8163, std. dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (4.4433 => 4.6200, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.97% (0.4791 => 0.4981, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.3801 => 4.5519, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.83% (1.1333 => 1.1767, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (13.2842 => 13.7872, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.68% (0.6135 => 0.6361, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.47% (0.8698 => 0.9000, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.47% (0.6283 => 0.6501, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7848, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (8.4961 => 8.7670, std. dev.: 0.0059) MultiSource/Applications/d/make_dparser: 3.18% (3.1889 => 3.2903, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.15% (14.8535 => 15.3208, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (6.5754 => 6.7732, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3724, std. dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 2.91% (4.6629 => 4.7987, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9261, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.71% (1.5188 => 1.5599, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.1007 => 2.1500, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.86% (0.9108 => 0.9277, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6250 => 0.6363, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.73% (1.0313 => 1.0491, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.12% (3.7467 => 3.7888, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 1.07% (33.2944 => 33.6493, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2564, std. dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.84% (1.2998 => 1.4017, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.01% (1.5824 => 1.6617, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7430, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6010, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.11% (10.7476 => 10.9741, std. dev.: 0.0404) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.05% (0.4657 => 0.3956, std. dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.87% (22.5627 => 21.2390, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.61% (0.2670 => 0.2547, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3114, std. dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.60% (1.1560 => 1.1028, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8017, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0220, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.93% (20.3410 => 19.7449, std. dev.: 0.0460) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5741, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9630, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2260, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2125, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0145) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3757, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2229, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8021, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 08:38:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 10:38:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120813153809.41737352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2853?compare_to=2849&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2853, Order: 161753, Start Time: 2012-08-13 12:55:26, End Time: 2012-08-13 15:38:51 To: 2849, Order: 161748, Start Time: 2012-08-13 09:43:39, End Time: 2012-08-13 12:27:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (116 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 5.95% (0.3919 => 0.4152, std. dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 1.00% (1.6916 => 1.7086, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.2255 => 0.2139, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.16% (0.3496 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.98% (0.3465 => 0.3880, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.91% (0.3442 => 0.3852, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.90% (0.3488 => 0.3903, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3446 => 0.3855, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3469 => 0.3880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.76% (0.3460 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.48% (0.3650 => 0.4069, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3643 => 0.4058, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/parameter-passing: 11.14% (0.3724 => 0.4139, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.49% (0.3792 => 0.4152, std. dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 7.24% (1.5932 => 1.7086, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5826 => 0.6193, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.16% (0.5889 => 0.6252, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (1.6211 => 1.7153, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.55% (3.5627 => 3.7604, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (1.3152 => 1.3870, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (0.5000 => 0.5264, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.27% (0.4994 => 0.5257, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.19% (0.4029 => 0.4238, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (0.5026 => 0.5283, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 5.05% (4.2109 => 4.4236, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.00% (0.5900 => 0.6195, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 4.86% (1.0781 => 1.1305, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7171 => 0.7519, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.38% (0.2875 => 0.3001, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.32% (5.5417 => 5.7809, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.2866 => 0.2988, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.16% (0.3195 => 0.3328, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.16% (0.3004 => 0.3129, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.15% (0.9909 => 1.0320, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (2.7292 => 2.8419, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.13% (0.2738 => 0.2851, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2792 => 0.2907, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (0.3890 => 0.4050, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.09% (0.2566 => 0.2671, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2750 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (2.1013 => 2.1868, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.2780 => 0.2892, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2811 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.99% (0.2729 => 0.2838, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (1.9966 => 2.0760, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3348 => 0.3481, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.96% (2.0673 => 2.1492, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3258 => 0.3384, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (0.4658 => 0.4838, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.85% (0.2911 => 0.3023, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.84% (0.3096 => 0.3215, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.83% (2.1653 => 2.2483, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: 3.83% (0.3317 => 0.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.83% (0.3267 => 0.3392, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.82% (4.6177 => 4.7943, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.81% (0.3362 => 0.3490, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.80% (0.2813 => 0.2920, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.3903 => 0.4051, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.79% (0.2823 => 0.2930, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (1.9694 => 2.0436, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.72% (0.7875 => 0.8168, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.69% (0.3060 => 0.3173, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.68% (0.9697 => 1.0054, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 3.60% (0.3726 => 0.3860, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 3.56% (0.3678 => 0.3809, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.53% (0.3625 => 0.3753, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3477 => 0.3597, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4146 => 0.4287, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3690 => 0.3814, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (4.4195 => 4.5662, std. dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 3.30% (23.5202 => 24.2952, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (0.4251 => 0.4391, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.29% (0.3981 => 0.4112, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (1.8794 => 1.9402, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 3.22% (1.4269 => 1.4729, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.3271 => 0.3373, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.4139 => 0.4266, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.6435 => 0.6631, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.3845 => 0.3956, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 2.81% (0.5546 => 0.5702, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.5012 => 0.5147, std. dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 2.48% (2.0346 => 2.0850, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.67% (0.7426 => 0.7550, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.20% (11.6398 => 11.7797, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 9.75% (0.2122 => 0.2329, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.28% (12.0509 => 12.6874, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.41% (1.8057 => 1.8854, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6344, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6560, std. dev.: 0.0704) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2084, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (41.7953 => 42.6410, std. dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2275, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9124, std. dev.: 0.0243) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3073, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2833, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5480, std. dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/ary2: -10.95% (0.2402 => 0.2139, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8053, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7922, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.73% (0.6293 => 0.6121, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -2.14% (17.2379 => 16.8692, std. dev.: 0.0238) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5793, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9588, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 09:01:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 11:01:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813160146.ACFAB352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2854?compare_to=2851&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2854, Order: 161757, Start Time: 2012-08-13 14:43:29, End Time: 2012-08-13 16:02:28 To: 2851, Order: 161753, Start Time: 2012-08-13 11:31:44, End Time: 2012-08-13 12:50:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (85 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.42% (41.9461 => 42.5427, std. dev.: 0.0242) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.11% (13.8591 => 13.5664, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.08% (2.1278 => 2.1048, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.86% (10.3673 => 13.5664, std. dev.: 0.0118) SingleSource/UnitTests/ObjC/block-byref-aggr: 12.00% (0.3817 => 0.4275, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.38% (1.1194 => 1.2468, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3694 => 0.4080, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.93% (0.3927 => 0.4317, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.74% (2.2022 => 2.3727, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.09% (1.7609 => 1.8858, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.63% (10.4361 => 11.0235, std. dev.: 0.0155) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4615 => 0.4871, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1906 => 0.2009, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.38% (0.5925 => 0.6244, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.6030 => 0.6347, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7326 => 0.7686, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.76% (0.4879 => 0.5111, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.75% (0.2758 => 0.2889, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.39% (7.0540 => 7.3636, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5860 => 0.6113, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 4.18% (0.7433 => 0.7744, std. dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (9.4845 => 9.8696, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.5569 => 0.5779, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (0.3121 => 0.3235, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (5.0018 => 5.1836, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (4.9449 => 5.1246, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.63% (0.9765 => 1.0119, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (4.2646 => 4.4147, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (1.3050 => 1.3485, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.16% (8.1363 => 8.3932, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.15% (1.5415 => 1.5900, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.06% (0.7835 => 0.8075, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 3.04% (5.7591 => 5.9344, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 2.98% (1.5603 => 1.6068, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.8067 => 0.8300, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.88% (1.1861 => 1.2203, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.66% (0.4103 => 0.4212, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.63% (1.1642 => 1.1948, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.61% (0.4636 => 0.4757, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4195, std. dev.: 0.0090) MultiSource/Applications/treecc/treecc: 2.35% (2.0273 => 2.0749, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 2.32% (17.1811 => 17.5801, std. dev.: 0.0133) MultiSource/Applications/lua/lua: 2.20% (3.8723 => 3.9576, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.12% (1.5859 => 1.6195, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.08% (0.5105 => 0.5211, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.4186 => 1.4480, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5020 => 0.5124, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.5981 => 0.6096, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.91% (2.2969 => 2.3407, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.85% (2.0665 => 2.1048, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 1.80% (0.6456 => 0.6572, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (14.3668 => 14.6214, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/football/football: 1.77% (0.8921 => 0.9079, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.77% (0.6675 => 0.6793, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.2842 => 1.3053, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (2.2024 => 2.2341, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (4.2280 => 4.4252, std. dev.: 0.0162) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7608, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.86% (26.0924 => 26.5772, std. dev.: 0.0174) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8428, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 1.41% (5.2636 => 5.3377, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1578 => 3.1995, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5831, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.06% (2.6546 => 2.6828, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1509, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.00% (5.3855 => 3.7161, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.71% (5.3526 => 3.7090, std. dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -15.12% (54.1659 => 45.9772, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5392, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -12.36% (22.1758 => 19.4349, std. dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -6.62% (1.5373 => 1.4356, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std. dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8030, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (4.8142 => 4.6141, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4737, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.6802 => 8.4342, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9964, std. dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3299, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9612, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3461, std. dev.: 0.0064) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2866, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (19.9488 => 19.7474, std. dev.: 0.0086) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 09:02:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 11:02:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813160229.CFE82352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2855?compare_to=2852&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2855, Order: 161757, Start Time: 2012-08-13 14:49:31, End Time: 2012-08-13 16:03:11 To: 2852, Order: 161753, Start Time: 2012-08-13 13:07:39, End Time: 2012-08-13 14:21:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.82% (54.8523 => 56.3989, std. dev.: 0.0396) SingleSource/Benchmarks/Misc/mandel-2: 2.07% (1.4017 => 1.4307, std. dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.73% (2.0176 => 2.2947, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: 8.70% (0.5818 => 0.6324, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.33% (0.5748 => 0.6227, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.05% (0.3578 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.82% (0.3646 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.73% (0.3623 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.4003 => 0.4312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.72% (0.7061 => 0.7606, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.67% (0.3650 => 0.3930, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5265 => 0.5648, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (3.9660 => 4.2509, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.12% (0.7038 => 0.7539, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.98% (1.3693 => 1.4649, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.7710 => 0.8246, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.36% (1.2193 => 1.2968, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.26% (0.9199 => 0.9775, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.15% (0.6959 => 0.7387, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.91% (0.3246 => 0.3438, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.87% (0.3580 => 0.3790, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.86% (0.3022 => 0.3199, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.80% (0.2690 => 0.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.76% (0.5577 => 0.5898, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.61% (0.2761 => 0.2916, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.52% (0.2988 => 0.3153, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.48% (1.9828 => 2.0914, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3107 => 0.3274, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.30% (13.8202 => 14.5522, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.3813 => 1.4535, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.22% (1.4563 => 1.5323, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.20% (1.1364 => 1.1955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.20% (0.3192 => 0.3358, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.14% (0.5637 => 0.5927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.05% (1.3819 => 1.4517, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.98% (3.8646 => 4.0570, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 4.93% (0.8310 => 0.8720, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.87% (1.3245 => 1.3890, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (7.2180 => 7.5664, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 4.79% (1.1061 => 1.1591, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3868 => 0.4048, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.60% (1.0594 => 1.1081, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.55% (1.9270 => 2.0146, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.7460 => 0.7788, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 4.36% (2.1791 => 2.2742, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2292 => 1.2818, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 4.25% (0.3220 => 0.3357, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.23% (16.6129 => 17.3159, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.01% (0.4791 => 0.4983, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8124, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6145, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.3801 => 4.5484, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (13.2842 => 13.7933, std. dev.: 0.0133) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.81% (4.9865 => 5.1765, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.81% (0.3755 => 0.3898, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1333 => 1.1752, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.52% (0.6135 => 0.6351, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.21% (8.4961 => 8.7685, std. dev.: 0.0057) MultiSource/Applications/d/make_dparser: 3.18% (3.1889 => 3.2903, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8698 => 0.8974, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.17% (0.6283 => 0.6482, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.14% (16.2614 => 16.7720, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (3.2742 => 3.3715, std. dev.: 0.0132) MultiSource/Applications/JM/ldecod/ldecod: 2.97% (6.5754 => 6.7708, std. dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 2.95% (14.8535 => 15.2913, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5188 => 1.5612, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.75% (4.6629 => 4.7909, std. dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9244, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (2.1007 => 2.1531, std. dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.70% (1.0313 => 1.0488, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6250 => 0.6356, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.21% (3.7467 => 3.7921, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0469) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 10.07% (1.2998 => 1.4307, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7449, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.57% (1.9199 => 1.9884, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5941, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.98% (10.7476 => 10.9607, std. dev.: 0.0570) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.09% (1.5089 => 1.5254, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.10% (0.4657 => 0.3954, std. dev.: 0.0089) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.00% (22.5627 => 21.2090, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8016, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.23% (1.3780 => 1.3197, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.78% (20.3410 => 19.7754, std. dev.: 0.0292) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6000, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: -2.45% (1.9762 => 1.9277, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9636, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2322, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9920, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.64% (7.3305 => 7.2100, std. dev.: 0.0108) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3768, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8018, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8721, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.02% (5.5401 => 5.4838, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 10:44:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 12:44:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813174433.3D6B1352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2856?compare_to=2855&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2856, Order: 161759, Start Time: 2012-08-13 16:31:27, End Time: 2012-08-13 17:45:14 To: 2855, Order: 161757, Start Time: 2012-08-13 14:49:31, End Time: 2012-08-13 16:03:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.10% (77.6640 => 80.0741, std. dev.: 0.6455) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.75% (2.0176 => 2.2951, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.85% (0.3130 => 0.3407, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.68% (0.5818 => 0.6323, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5748 => 0.6232, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.94% (0.3578 => 0.3862, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.89% (0.3650 => 0.3938, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3601 => 0.3884, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7061 => 0.7605, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.69% (0.3914 => 0.4215, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.67% (0.3623 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.5265 => 0.5649, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.18% (3.9660 => 4.2507, std. dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 7.15% (0.7038 => 0.7541, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.13% (0.2721 => 0.2915, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 6.98% (1.3693 => 1.4649, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.7710 => 0.8238, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.77% (0.4328 => 0.4621, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.32% (0.9199 => 0.9780, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.30% (1.2193 => 1.2961, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.25% (0.6959 => 0.7394, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.19% (0.3022 => 0.3209, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.08% (0.3899 => 0.4136, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.4379 => 0.4642, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.85% (0.3246 => 0.3436, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.76% (0.5577 => 0.5898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2726 => 0.2880, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.54% (0.2761 => 0.2914, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.3489 => 0.3682, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.2988 => 0.3152, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (1.9828 => 2.0913, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.45% (0.2696 => 0.2843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3107 => 0.3275, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.37% (13.8202 => 14.5620, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (1.4563 => 1.5330, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.24% (0.4390 => 0.4620, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.1364 => 1.1952, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.17% (1.3819 => 1.4533, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.16% (1.3813 => 1.4526, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.8310 => 0.8726, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.94% (3.8646 => 4.0556, std. dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.86% (1.1061 => 1.1599, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.83% (0.4016 => 0.4210, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.82% (7.2180 => 7.5660, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.3245 => 1.3879, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.76% (0.7506 => 0.7863, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 4.65% (0.3868 => 0.4048, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.62% (1.9270 => 2.0161, std. dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: 4.57% (1.0594 => 1.1078, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 4.48% (2.1791 => 2.2768, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.44% (0.7460 => 0.7791, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.29% (1.2292 => 1.2819, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 4.26% (16.6129 => 17.3203, std. dev.: 0.0156) MultiSource/Applications/sgefa/sgefa: 4.21% (0.2995 => 0.3121, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6184, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.87% (3.6692 => 3.8111, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.84% (4.9865 => 5.1780, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5476, std. dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (1.1333 => 1.1762, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.75% (0.3755 => 0.3896, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (13.2842 => 13.7817, std. dev.: 0.0150) MultiSource/Benchmarks/sim/sim: 3.67% (0.3131 => 0.3246, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.62% (0.6135 => 0.6357, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.8698 => 0.8988, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.24% (16.2614 => 16.7883, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (8.4961 => 8.7666, std. dev.: 0.0068) MultiSource/Applications/d/make_dparser: 3.09% (3.1889 => 3.2873, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 2.98% (14.8535 => 15.2965, std. dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 2.94% (6.5754 => 6.7688, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.90% (3.2742 => 3.3691, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.87% (0.4113 => 0.4231, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.80% (1.5188 => 1.5613, std. dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 2.76% (4.6629 => 4.7918, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9180, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.1007 => 2.1525, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.79% (1.0313 => 1.0498, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 1.76% (0.6250 => 0.6360, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5140, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/fbench: 27.15% (1.8175 => 2.3109, std. dev.: 0.0262) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.77% (1.2998 => 1.4138, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7422, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.36% (2.8606 => 2.9568, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3832, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5976, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.05% (10.7476 => 10.9684, std. dev.: 0.0641) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.96% (22.5627 => 21.2177, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.54% (1.1560 => 1.1035, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3180, std. dev.: 0.0068) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8017, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.65% (20.3410 => 19.8014, std. dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6032, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.04% (3.0263 => 2.9647, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2284, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2123, std. dev.: 0.0187) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8665, std. dev.: 0.0163) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3791, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8029, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 10:49:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 12:49:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813174903.3F550352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2857?compare_to=2854&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2857, Order: 161759, Start Time: 2012-08-13 16:30:52, End Time: 2012-08-13 17:49:45 To: 2854, Order: 161757, Start Time: 2012-08-13 14:43:29, End Time: 2012-08-13 16:02:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (77 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.91% (10.3673 => 13.5722, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2454, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.92% (0.3543 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (2.2022 => 2.3734, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.07% (1.7609 => 1.8854, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.61% (10.4361 => 11.0215, std. dev.: 0.0225) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.59% (0.4615 => 0.4873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.36% (0.6030 => 0.6353, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.32% (0.5925 => 0.6240, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.48% (0.7326 => 0.7654, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.39% (7.0540 => 7.3634, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (9.4845 => 9.8666, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.83% (0.8172 => 0.8485, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.9449 => 5.1220, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.53% (0.5860 => 0.6067, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (5.0018 => 5.1784, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.52% (4.2646 => 4.4146, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.3050 => 1.3476, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3924, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.08% (1.5415 => 1.5890, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 3.06% (0.7835 => 0.8075, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 3.04% (0.3423 => 0.3527, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.03% (5.7591 => 5.9336, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 2.89% (1.5603 => 1.6054, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2196, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.68% (0.4103 => 0.4213, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.67% (0.9765 => 1.0026, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 2.62% (1.1642 => 1.1947, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.61% (0.4636 => 0.4757, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4196, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.39% (2.0273 => 2.0757, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.21% (3.8723 => 3.9577, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.08% (0.5105 => 0.5211, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (1.5859 => 1.6181, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.00% (2.0665 => 2.1078, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.4186 => 1.4466, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6450 => 0.6575, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 1.80% (0.6456 => 0.6572, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.78% (2.2969 => 2.3378, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (14.3668 => 14.6207, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (0.6675 => 0.6791, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.53% (1.2842 => 1.3039, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (2.2024 => 2.2344, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.26% (1.1840 => 1.1989, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.23% (4.2280 => 4.4490, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7520, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 1.88% (26.0924 => 26.5830, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8421, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.37% (5.2636 => 5.3356, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1997, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5830, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2121, std. dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1305, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1534, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7127, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7093, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -15.19% (54.1659 => 45.9391, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.78% (2.9384 => 2.5336, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.40% (22.1758 => 19.4266, std. dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -6.67% (1.5373 => 1.4348, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8030, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4731, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.14% (8.6802 => 8.4078, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/salsa20: -2.92% (10.2830 => 9.9830, std. dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3315, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9654, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3449, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.17% (2.3135 => 2.2865, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 11:51:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 13:51:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120813185147.C2A24352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2858?compare_to=2853&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2858, Order: 161758, Start Time: 2012-08-13 16:09:21, End Time: 2012-08-13 18:52:29 To: 2853, Order: 161753, Start Time: 2012-08-13 12:55:26, End Time: 2012-08-13 15:38:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (81 on baseline) Performance Improvements: 3 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (797 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.25% (1.0054 => 0.9928, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.09% (11.7797 => 11.6515, std. dev.: 0.0203) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.05% (4.7382 => 4.6885, std. dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3460 => 0.3881, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.16% (0.3496 => 0.3921, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3465 => 0.3886, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.13% (0.3446 => 0.3864, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3442 => 0.3859, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.07% (0.3488 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3469 => 0.3885, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.64% (0.3643 => 0.4067, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.53% (0.3650 => 0.4071, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.80% (1.5932 => 1.7015, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.48% (0.1620 => 0.1725, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.85% (0.5826 => 0.6167, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.5889 => 0.6221, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.42% (1.6211 => 1.7090, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.39% (3.5627 => 3.7546, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.33% (1.3152 => 1.3853, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.27% (0.4994 => 0.5257, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (0.4361 => 0.4585, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (0.5000 => 0.5253, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (0.5026 => 0.5272, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (0.3930 => 0.4115, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.60% (4.2109 => 4.4048, std. dev.: 0.0100) MultiSource/Applications/d/make_dparser: 4.52% (1.0781 => 1.1268, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.5900 => 0.6160, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 4.39% (0.7171 => 0.7486, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (0.4658 => 0.4845, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.96% (2.7292 => 2.8373, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.78% (0.3890 => 0.4037, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 3.74% (2.1013 => 2.1799, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 3.63% (5.5417 => 5.7427, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.55% (0.2875 => 0.2977, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (1.9694 => 2.0381, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (1.9966 => 2.0639, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 3.26% (4.6177 => 4.7683, std. dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 3.22% (0.9909 => 1.0228, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 3.21% (2.1653 => 2.2348, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (2.0673 => 2.1326, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (4.4195 => 4.5580, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.3903 => 0.4024, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.10% (0.3258 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (1.8794 => 1.9362, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 3.01% (0.3317 => 0.3417, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.00% (0.7875 => 0.8111, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.4139 => 0.4258, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.71% (0.6634 => 0.6814, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.43% (1.4269 => 1.4616, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.38% (0.9697 => 0.9928, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 2.37% (23.5202 => 24.0782, std. dev.: 0.0067) MultiSource/Applications/Burg/burg: 2.36% (0.5546 => 0.5677, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.95% (2.0346 => 2.0742, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.88% (0.6435 => 0.6556, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.77% (0.2122 => 0.2308, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6769, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1650, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6409, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6789, std. dev.: 0.0539) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std. dev.: 0.0453) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5915, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9152, std. dev.: 0.0139) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std. dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3098, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.47% (41.7953 => 42.4092, std. dev.: 0.1137) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2791, std. dev.: 0.0057) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.45% (11.9555 => 11.7824, std. dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5652, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary2: -8.28% (0.2402 => 0.2203, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8078, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8053, std. dev.: 0.0011) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8285, std. dev.: 0.0481) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.70% (0.6293 => 0.6186, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9582, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 12:27:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 14:27:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813192708.52361352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2859?compare_to=2856&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2859, Order: 161763, Start Time: 2012-08-13 18:13:32, End Time: 2012-08-13 19:27:48 To: 2856, Order: 161759, Start Time: 2012-08-13 16:31:27, End Time: 2012-08-13 17:45:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.93% (2.0176 => 2.2987, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.65% (0.5818 => 0.6321, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5748 => 0.6236, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.37% (0.7061 => 0.7652, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.24% (0.3578 => 0.3873, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.92% (0.3650 => 0.3939, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3601 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.84% (0.3914 => 0.4221, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.81% (0.3789 => 0.4085, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.39% (0.5265 => 0.5654, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.29% (0.7038 => 0.7551, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.23% (3.9660 => 4.2528, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.7710 => 0.8261, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.13% (0.2596 => 0.2781, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.11% (1.3693 => 1.4666, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.31% (0.9199 => 0.9779, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.29% (0.6959 => 0.7397, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.27% (1.2193 => 1.2958, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4062 => 0.4312, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.91% (0.3246 => 0.3438, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.89% (0.3580 => 0.3791, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.84% (0.2690 => 0.2847, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.83% (0.5577 => 0.5902, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.76% (0.2655 => 0.2808, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.72% (0.2937 => 0.3105, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3485 => 0.3680, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2127 => 0.2246, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0934, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.2988 => 0.3150, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1865 => 0.1965, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.35% (1.4563 => 1.5342, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 5.33% (13.8202 => 14.5567, std. dev.: 0.0161) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.2914 => 0.3069, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.30% (0.2925 => 0.3080, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (1.3819 => 1.4544, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.21% (1.1364 => 1.1956, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.18% (1.3813 => 1.4528, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.5637 => 0.5925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 5.06% (3.8646 => 4.0603, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.97% (0.7506 => 0.7879, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.97% (1.3245 => 1.3903, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.96% (7.2180 => 7.5763, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 4.93% (0.8310 => 0.8720, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.87% (1.1061 => 1.1600, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.3756 => 0.3937, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.66% (1.0594 => 1.1088, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.62% (1.9270 => 2.0161, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.53% (0.7460 => 0.7798, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.46% (2.1791 => 2.2762, std. dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 4.38% (1.2292 => 1.2830, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 4.37% (16.6129 => 17.3397, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/18-imp/imp: 4.16% (0.3220 => 0.3354, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.03% (0.4791 => 0.4984, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (3.6692 => 3.8126, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.4433 => 4.6154, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5492, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.80% (13.2842 => 13.7892, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6135 => 0.6366, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.71% (1.1333 => 1.1753, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3755 => 0.3894, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.70% (4.9865 => 5.1709, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 3.19% (16.2614 => 16.7797, std. dev.: 0.0199) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.17% (0.6283 => 0.6482, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (8.4961 => 8.7636, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 3.11% (3.1889 => 3.2882, std. dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 3.04% (14.8535 => 15.3056, std. dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (6.5754 => 6.7739, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.91% (3.2742 => 3.3696, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.5298 => 14.9279, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5188 => 1.5594, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.62% (4.6629 => 4.7853, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.1007 => 2.1537, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.76% (1.0313 => 1.0494, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.73% (0.9108 => 0.9266, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.65% (0.6250 => 0.6353, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.33% (3.7467 => 3.7965, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.41% (5.7573 => 7.5082, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2571, std. dev.: 0.0566) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 9.80% (1.2998 => 1.4272, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.32% (11.2619 => 11.7483, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9574, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3852, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5990, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.10% (10.7476 => 10.9735, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.27% (1.0895 => 1.1033, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.10% (1.5089 => 1.5255, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1984, std. dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.66% (1.1560 => 1.1021, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3173, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.28% (5.0168 => 4.8019, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5851, std. dev.: 0.0204) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.54% (20.3410 => 19.8250, std. dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: -2.45% (1.9762 => 1.9277, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2301, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: -1.97% (3.0263 => 2.9667, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3305 => 7.2112, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2142, std. dev.: 0.0206) MultiSource/Benchmarks/PAQ8p/paq8p: -1.23% (84.4286 => 83.3869, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8016, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 12:36:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 14:36:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813193624.0D612352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2860?compare_to=2857&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2860, Order: 161763, Start Time: 2012-08-13 18:18:09, End Time: 2012-08-13 19:37:05 To: 2857, Order: 161759, Start Time: 2012-08-13 16:30:52, End Time: 2012-08-13 17:49:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (85 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.64% (1.4348 => 1.3969, std. dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.32% (10.3673 => 13.6144, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.53% (0.0798 => 0.0906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.39% (1.1194 => 1.2469, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 11.15% (0.3497 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.01% (2.2022 => 2.3787, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.14% (1.7609 => 1.8867, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (10.4361 => 11.0352, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.55% (0.5925 => 0.6254, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4615 => 0.4871, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.42% (0.6030 => 0.6357, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.89% (0.2758 => 0.2893, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.75% (7.0540 => 7.3889, std. dev.: 0.0132) SingleSource/UnitTests/ObjC++/property-reference: 4.56% (0.7326 => 0.7660, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.7433 => 0.7752, std. dev.: 0.0122) MultiSource/Benchmarks/mafft/pairlocalalign: 4.01% (9.4845 => 9.8649, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.92% (0.5860 => 0.6090, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.9449 => 5.1367, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.76% (0.8172 => 0.8479, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9765 => 1.0120, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.0018 => 5.1815, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (4.2646 => 4.4139, std. dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.36% (0.7835 => 0.8098, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.21% (8.1363 => 8.3973, std. dev.: 0.0126) MultiSource/Applications/oggenc/oggenc: 3.18% (5.7591 => 5.9421, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.8067 => 0.8321, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.12% (1.5603 => 1.6090, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.12% (1.3050 => 1.3457, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.5415 => 1.5891, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 3.04% (0.3423 => 0.3527, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.88% (1.1861 => 1.2203, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.85% (0.4636 => 0.4768, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.54% (1.1642 => 1.1938, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4194, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.33% (2.0273 => 2.0746, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.25% (17.1811 => 17.5671, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 2.07% (3.8723 => 3.9523, std. dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.04% (0.5105 => 0.5209, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.01% (2.0665 => 2.1080, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6456 => 0.6582, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4186 => 1.4458, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (1.5859 => 1.6163, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.89% (0.5981 => 0.6094, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.85% (2.2969 => 2.3393, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (14.3668 => 14.6208, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.74% (0.6675 => 0.6791, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.62% (1.2842 => 1.3050, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 1.60% (0.8921 => 0.9064, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.2024 => 2.2317, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 1.20% (1.1840 => 1.1982, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.05% (4.2280 => 4.4415, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7594, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.85% (26.0924 => 26.5764, std. dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 1.72% (11.6436 => 11.8433, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (5.2636 => 5.3417, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1578 => 3.1996, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.11% (9.1159 => 9.2169, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6820, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1581, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7222, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.60% (5.3526 => 3.7149, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -15.17% (54.1659 => 45.9498, std. dev.: 0.0318) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.46% (2.9384 => 2.5429, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.33% (22.1758 => 19.4415, std. dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -9.13% (1.5373 => 1.3969, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8031, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5119, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4628, std. dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.6802 => 8.4303, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9892, std. dev.: 0.0280) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (8.1563 => 7.9565, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3490, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2868, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8133, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 14:09:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 16:09:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813210931.1ABEE352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2861?compare_to=2859&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2861, Order: 161776, Start Time: 2012-08-13 19:56:27, End Time: 2012-08-13 21:10:10 To: 2859, Order: 161763, Start Time: 2012-08-13 18:13:32, End Time: 2012-08-13 19:27:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.56% (2.0176 => 2.2912, std. dev.: 0.0133) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.17% (0.1072 => 0.1181, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.75% (0.5748 => 0.6251, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.00% (0.3601 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.97% (0.7061 => 0.7624, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 7.95% (0.3646 => 0.3936, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 7.84% (0.3663 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3914 => 0.4217, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.31% (0.5265 => 0.5650, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.30% (0.7038 => 0.7552, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.24% (3.9660 => 4.2530, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.11% (0.7710 => 0.8258, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.92% (1.3693 => 1.4640, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4328 => 0.4623, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.30% (1.2193 => 1.2961, std. dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.24% (0.9199 => 0.9773, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.19% (0.6959 => 0.7390, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.4379 => 0.4640, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.84% (0.3580 => 0.3789, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.82% (0.3246 => 0.3435, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.79% (0.2607 => 0.2758, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.74% (0.5577 => 0.5897, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2127 => 0.2246, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3485 => 0.3677, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.42% (0.1865 => 0.1966, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.40% (13.8202 => 14.5669, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.39% (1.9828 => 2.0897, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.38% (1.4563 => 1.5346, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.22% (1.3819 => 1.4541, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.20% (1.1364 => 1.1955, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.19% (3.8646 => 4.0652, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.3813 => 1.4524, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.04% (1.1061 => 1.1619, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.01% (0.4390 => 0.4610, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.90% (0.8310 => 0.8717, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (7.2180 => 7.5695, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.83% (1.3245 => 1.3885, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.81% (0.7506 => 0.7867, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.66% (1.0594 => 1.1088, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.7460 => 0.7801, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 4.54% (1.9270 => 2.0144, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 4.37% (2.1791 => 2.2743, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.36% (16.6129 => 17.3369, std. dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.2292 => 1.2816, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6174, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5512, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.89% (3.6692 => 3.8121, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.4791 => 0.4977, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.84% (4.9865 => 5.1780, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (13.2842 => 13.7853, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.71% (1.1333 => 1.1753, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.65% (0.6135 => 0.6359, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.8698 => 0.8986, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.14% (8.4961 => 8.7625, std. dev.: 0.0101) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2883, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.09% (16.2614 => 16.7637, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 2.96% (14.8535 => 15.2933, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (6.5754 => 6.7666, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.89% (3.2742 => 3.3689, std. dev.: 0.0168) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5188 => 1.5612, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.5298 => 14.9220, std. dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 2.61% (4.6629 => 4.7844, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.53% (2.1007 => 2.1538, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.65% (1.0313 => 1.0483, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.64% (0.9108 => 0.9257, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.60% (0.6250 => 0.6350, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.35% (3.7467 => 3.7974, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2644, std. dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.25% (1.2998 => 1.3941, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.34% (11.2619 => 11.7507, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.30% (1.9199 => 1.9833, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6037, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.19% (10.7476 => 10.9829, std. dev.: 0.0436) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5162, std. dev.: 0.0061) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5744, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.06% (22.5627 => 21.1951, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.97% (1.3780 => 1.3095, std. dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8016, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5803, std. dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.71% (20.3410 => 19.7902, std. dev.: 0.0607) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -1.96% (3.0263 => 2.9671, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2331, std. dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: -1.90% (7.3305 => 7.1914, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3735, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8036, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 14:24:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 16:24:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813212401.F07FC352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2862?compare_to=2860&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2862, Order: 161776, Start Time: 2012-08-13 20:05:34, End Time: 2012-08-13 21:24:44 To: 2860, Order: 161763, Start Time: 2012-08-13 18:18:09, End Time: 2012-08-13 19:37:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (86 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.22% (0.8479 => 0.8667, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.30% (1.3969 => 1.4290, std. dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.54% (10.3673 => 13.5338, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.35% (0.3543 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.32% (0.3516 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.79% (2.2022 => 2.3737, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.23% (1.7609 => 1.8882, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.06% (0.8172 => 0.8667, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 5.90% (0.6030 => 0.6386, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.86% (0.3121 => 0.3304, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 5.77% (10.4361 => 11.0384, std. dev.: 0.0151) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.58% (0.2758 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.35% (0.4615 => 0.4862, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.09% (0.7326 => 0.7699, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3282 => 0.3446, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (7.0540 => 7.3833, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5569 => 0.5808, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.20% (9.4845 => 9.8830, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (5.0018 => 5.2049, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1432, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5860 => 0.6081, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.72% (4.2646 => 4.4233, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.50% (8.1363 => 8.4211, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.36% (1.3050 => 1.3488, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.22% (1.5415 => 1.5912, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9414, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.03% (1.1642 => 1.1995, std. dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (1.1861 => 1.2217, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.93% (0.9765 => 1.0051, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4636 => 0.4770, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.84% (2.0273 => 2.0848, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4276, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.73% (0.4103 => 0.4215, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.72% (1.5603 => 1.6027, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5749, std. dev.: 0.0227) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9608, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.25% (0.5105 => 0.5220, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.21% (0.5981 => 0.6113, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.19% (2.0665 => 2.1117, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.16% (1.4186 => 1.4492, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.12% (1.5859 => 1.6196, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (14.3668 => 14.6688, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5020 => 0.5123, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.01% (0.6675 => 0.6809, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6456 => 0.6581, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.93% (2.2969 => 2.3413, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 1.86% (0.8921 => 0.9087, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.2024 => 2.2388, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.60% (1.2842 => 1.3048, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2010, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.16% (1.0722 => 1.0846, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.16% (4.2280 => 4.4461, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7479, std. dev.: 0.0045) MultiSource/Applications/lua/lua: 1.74% (26.0924 => 26.5477, std. dev.: 0.0371) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8420, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (5.2636 => 5.3386, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 1.34% (3.1578 => 3.2001, std. dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5802, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6826, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.07% (5.2763 => 3.1619, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7039, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7042, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9956, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.58% (2.9384 => 2.5394, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.20% (22.1758 => 19.4702, std. dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -7.04% (1.5373 => 1.4290, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5570, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8030, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4713, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4223, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.59% (10.2830 => 10.0171, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (8.1563 => 7.9566, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3383, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4225, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2868, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (19.9488 => 19.7391, std. dev.: 0.0318) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 15:03:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 17:03:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120813220327.E1F68352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2863?compare_to=2858&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2863, Order: 161769, Start Time: 2012-08-13 19:20:46, End Time: 2012-08-13 22:04:09 To: 2858, Order: 161758, Start Time: 2012-08-13 16:09:21, End Time: 2012-08-13 18:52:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (779 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.12% (54.2266 => 54.8333, std. dev.: 0.1173) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3488 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.73% (0.3496 => 0.3941, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3442 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.68% (0.3446 => 0.3883, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3460 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.51% (0.3469 => 0.3903, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3643 => 0.4087, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.00% (0.3650 => 0.4088, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.84% (0.3724 => 0.4165, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.78% (0.3792 => 0.4125, std. dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 6.61% (0.5826 => 0.6211, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.30% (1.5932 => 1.6936, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.16% (0.5889 => 0.6252, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.03% (1.6211 => 1.7189, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.95% (3.5627 => 3.7748, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.87% (1.3152 => 1.3924, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.87% (0.4994 => 0.5287, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.69% (0.5026 => 0.5312, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.69% (0.4361 => 0.4609, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (0.5000 => 0.5267, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 5.01% (4.2109 => 4.4217, std. dev.: 0.0122) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 4.87% (0.7171 => 0.7520, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.5900 => 0.6186, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 4.66% (1.0781 => 1.1283, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (2.7292 => 2.8475, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 4.25% (2.1013 => 2.1907, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.21% (0.2566 => 0.2674, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.14% (0.2875 => 0.2994, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.09% (0.3890 => 0.4049, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.04% (0.4658 => 0.4846, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (1.9966 => 2.0762, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (1.9694 => 2.0478, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.76% (5.5417 => 5.7500, std. dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 3.69% (4.6177 => 4.7880, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.61% (0.3625 => 0.3756, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.59% (0.9909 => 1.0265, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.56% (0.3903 => 0.4042, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.56% (2.1653 => 2.2424, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (4.4195 => 4.5757, std. dev.: 0.0068) SingleSource/Regression/C++/ofstream_ctor: 3.50% (0.3004 => 0.3109, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.47% (0.3195 => 0.3306, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.43% (2.0673 => 2.1382, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.37% (1.8794 => 1.9428, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.23% (0.7875 => 0.8129, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.18% (0.3362 => 0.3469, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3258 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.3271 => 0.3373, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.4139 => 0.4264, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.01% (0.6634 => 0.6834, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3726 => 0.3838, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.00% (1.4269 => 1.4697, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 2.99% (0.3348 => 0.3448, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.96% (0.3845 => 0.3959, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 2.85% (0.3678 => 0.3783, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.83% (0.5546 => 0.5703, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.78% (23.5202 => 24.1746, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4146 => 0.4259, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.3981 => 0.4086, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.61% (0.4251 => 0.4362, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.61% (0.9697 => 0.9950, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.6435 => 0.6582, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.07% (2.0346 => 2.0768, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 2.04% (0.5012 => 0.5114, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.20% (0.2162 => 0.3550, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 10.18% (0.2122 => 0.2338, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6825, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1703, std. dev.: 0.0391) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6380, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6842, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2002, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5915, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9222, std. dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std. dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3119, std. dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (41.7953 => 42.3713, std. dev.: 0.1305) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2814, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.26% (11.9555 => 11.8046, std. dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5355, std. dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9735, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8015, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8013, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std. dev.: 0.0057) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7879, std. dev.: 0.0440) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5766, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (16.2163 => 15.9725, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 15:53:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 17:53:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120813225301.969E3352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2864?compare_to=2861&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2864, Order: 161783, Start Time: 2012-08-13 21:39:44, End Time: 2012-08-13 22:53:26 To: 2861, Order: 161776, Start Time: 2012-08-13 19:56:27, End Time: 2012-08-13 21:10:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (136 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.38% (1.3941 => 1.4273, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.35% (78.1591 => 79.9987, std. dev.: 0.3166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.74% (29.2104 => 29.7198, std. dev.: 0.0473) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.75% (2.0176 => 2.2950, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.58% (0.5818 => 0.6317, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 8.33% (0.5748 => 0.6227, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.12% (0.3646 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.09% (0.3623 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.08% (0.3663 => 0.3959, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.05% (0.3789 => 0.4094, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3914 => 0.4229, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.77% (0.3940 => 0.4246, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.52% (0.7061 => 0.7592, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.01% (0.5265 => 0.5634, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (3.9660 => 4.2409, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.79% (0.7038 => 0.7516, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.7710 => 0.8233, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.77% (1.3693 => 1.4620, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4328 => 0.4592, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.2193 => 1.2925, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.6959 => 0.7373, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.88% (0.9199 => 0.9740, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.83% (0.2781 => 0.2943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.75% (0.2782 => 0.2942, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4379 => 0.4627, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.5577 => 0.5889, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 5.54% (0.4062 => 0.4287, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.51% (0.3246 => 0.3425, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.43% (1.3819 => 1.4570, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.37% (0.2607 => 0.2747, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (1.3813 => 1.4551, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.27% (0.2127 => 0.2239, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.20% (0.2655 => 0.2793, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.18% (1.4563 => 1.5317, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.2937 => 0.3089, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.17% (0.2765 => 0.2908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2628 => 0.2763, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.09% (0.2966 => 0.3117, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.9828 => 2.0835, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.05% (0.3485 => 0.3661, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.02% (13.8202 => 14.5142, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3107 => 0.3260, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.92% (0.3149 => 0.3304, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (1.1364 => 1.1919, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.74% (0.5637 => 0.5904, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.71% (7.2180 => 7.5580, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8310 => 0.8701, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3192 => 0.3342, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.69% (0.3453 => 0.3615, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.62% (3.8646 => 4.0433, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.59% (1.3245 => 1.3853, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.53% (1.1061 => 1.1562, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.0594 => 1.1069, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.48% (0.4016 => 0.4196, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.46% (0.3293 => 0.3440, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 4.33% (1.9270 => 2.0105, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.31% (0.3756 => 0.3918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.3868 => 0.4028, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.92% (1.2292 => 1.2774, std. dev.: 0.0100) MultiSource/Applications/siod/siod: 3.88% (2.1791 => 2.2637, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6145, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.3801 => 4.5456, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.2945 => 0.3055, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (3.6692 => 3.8052, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 3.67% (16.6129 => 17.2226, std. dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.60% (13.2842 => 13.7624, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.47% (1.1333 => 1.1726, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9865 => 5.1557, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3755 => 0.3873, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.06% (3.1889 => 3.2865, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 2.86% (8.4961 => 8.7392, std. dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7221, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.83% (0.6283 => 0.6461, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.77% (14.8535 => 15.2643, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.72% (0.8698 => 0.8935, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.5754 => 6.7525, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (3.2742 => 3.3605, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.51% (14.5298 => 14.8941, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.5188 => 1.5558, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.42% (4.6629 => 4.7758, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.1007 => 2.1436, std. dev.: 0.0074) MultiSource/Applications/lemon/lemon: 1.41% (1.0313 => 1.0458, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9108 => 0.9227, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 26.56% (1.8175 => 2.3003, std. dev.: 0.0325) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 9.81% (1.2998 => 1.4273, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7445, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9572, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3855, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6026, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.91% (10.7476 => 10.9533, std. dev.: 0.0680) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.77% (0.4657 => 0.3969, std. dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.5627 => 21.1119, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.83% (0.2670 => 0.2541, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.61% (0.6576 => 0.6470, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.50% (1.3780 => 1.3160, std. dev.: 0.0050) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8017, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.78% (20.3410 => 19.7756, std. dev.: 0.0370) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5920, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2284, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.90% (7.3305 => 7.1913, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3697, std. dev.: 0.0129) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2223, std. dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8012, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 16:11:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 18:11:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120813231144.695DB352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2865?compare_to=2862&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2865, Order: 161786, Start Time: 2012-08-13 21:53:28, End Time: 2012-08-13 23:12:23 To: 2862, Order: 161776, Start Time: 2012-08-13 20:05:34, End Time: 2012-08-13 21:24:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (89 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (746 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.11% (13.5338 => 13.8190, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.20% (0.5404 => 0.5523, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.68% (0.8667 => 0.8521, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.29% (10.3673 => 13.8190, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0119) SingleSource/UnitTests/ObjC/trivial-interface: 10.83% (0.3473 => 0.3849, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3497 => 0.3873, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3516 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.47% (0.3561 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.95% (0.3828 => 0.4209, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.70% (0.3927 => 0.4308, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.83% (0.1892 => 0.2059, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.06% (2.2022 => 2.3796, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.26% (1.7609 => 1.8887, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1906 => 0.2020, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 5.70% (0.5925 => 0.6263, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.70% (0.4615 => 0.4878, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 5.66% (10.4361 => 11.0267, std. dev.: 0.0149) SingleSource/UnitTests/ObjC++/property-reference-object: 5.57% (0.6030 => 0.6366, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.13% (0.3177 => 0.3340, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.81% (0.3282 => 0.3440, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.76% (0.7326 => 0.7675, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3824, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.39% (0.4879 => 0.5093, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (0.7433 => 0.7754, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.27% (0.8172 => 0.8521, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (9.4845 => 9.8666, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.9449 => 5.1356, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (5.0018 => 5.1928, std. dev.: 0.0119) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.71% (4.2646 => 4.4228, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.45% (0.7835 => 0.8105, std. dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (1.3050 => 1.3493, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.26% (5.7591 => 5.9471, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.5415 => 1.5917, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3930, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.10% (0.4103 => 0.4230, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.06% (0.4636 => 0.4778, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1861 => 1.2223, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9765 => 1.0038, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.78% (0.8067 => 0.8291, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.77% (1.1642 => 1.1964, std. dev.: 0.0083) MultiSource/Applications/hbd/hbd: 2.74% (1.5603 => 1.6030, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.66% (2.0273 => 2.0812, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.4289 => 0.4402, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.61% (0.3826 => 0.3926, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.50% (3.3354 => 3.4187, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.5105 => 0.5231, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.28% (0.6450 => 0.6597, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (1.5859 => 1.6220, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 2.26% (0.6456 => 0.6602, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.24% (3.8723 => 3.9589, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (2.0665 => 2.1123, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.4186 => 1.4486, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6675 => 0.6816, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.10% (17.1811 => 17.5425, std. dev.: 0.0258) MultiSource/Applications/siod/siod: 2.10% (2.2969 => 2.3451, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5981 => 0.6106, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8921 => 0.9104, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.91% (1.2842 => 1.3087, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (14.3668 => 14.6392, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.2024 => 2.2436, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.49% (1.1840 => 1.2017, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0849, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4596, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.87% (0.2944 => 0.3058, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 2.03% (0.5413 => 0.5523, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.91% (26.0924 => 26.5898, std. dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8430, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 1.38% (5.2636 => 5.3364, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.32% (0.9540 => 0.9666, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.30% (3.1578 => 3.1988, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.07% (9.1159 => 9.2130, std. dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.53% (5.2763 => 3.1380, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7222, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7196, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -15.05% (54.1659 => 46.0119, std. dev.: 0.0223) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.75% (2.9384 => 2.5343, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4556, std. dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -7.37% (1.5373 => 1.4240, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8029, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4740, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9840, std. dev.: 0.0199) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4288, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9573, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5134, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.45% (12.5348 => 12.3533, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (19.9488 => 19.6918, std. dev.: 0.0413) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2868, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.13% (1.8329 => 1.8122, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 17:35:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 19:35:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814003535.D4E2B352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2866?compare_to=2864&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2866, Order: 161800, Start Time: 2012-08-13 23:22:35, End Time: 2012-08-14 00:36:17 To: 2864, Order: 161783, Start Time: 2012-08-13 21:39:44, End Time: 2012-08-13 22:53:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (146 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.6470 => 0.6581, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.36% (79.9987 => 81.0833, std. dev.: 0.3375) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.01% (1.2939 => 1.3070, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.33% (0.5452 => 0.5325, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3060, std. dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.44% (0.5818 => 0.6367, std. dev.: 0.0072) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5748 => 0.6277, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.45% (0.3623 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.42% (0.3789 => 0.4108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.40% (0.7061 => 0.7654, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.09% (0.4003 => 0.4327, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.32% (1.3693 => 1.4696, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.5265 => 0.5649, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (3.9660 => 4.2535, std. dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: 7.23% (0.7038 => 0.7547, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.7710 => 0.8266, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (0.4328 => 0.4632, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/except: 6.59% (0.2760 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4062 => 0.4329, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.52% (0.6959 => 0.7413, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.34% (0.9199 => 0.9782, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.33% (0.3899 => 0.4146, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.32% (1.2193 => 1.2964, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.29% (0.2765 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.19% (0.3022 => 0.3209, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.12% (0.2988 => 0.3171, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.12% (1.9828 => 2.1041, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.12% (0.3107 => 0.3297, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.10% (0.3489 => 0.3702, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3246 => 0.3442, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.04% (0.2966 => 0.3145, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3192 => 0.3379, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.79% (0.5577 => 0.5900, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2127 => 0.2247, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.58% (0.4390 => 0.4635, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.49% (0.3534 => 0.3728, std. dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 5.39% (13.8202 => 14.5653, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 5.38% (0.3293 => 0.3470, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.34% (1.4563 => 1.5340, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.30% (0.4016 => 0.4229, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.25% (1.1364 => 1.1961, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.5637 => 0.5925, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.02% (1.3819 => 1.4513, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.8310 => 0.8726, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.99% (3.8646 => 4.0576, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.96% (1.1061 => 1.1610, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (1.3813 => 1.4492, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5709, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.3245 => 1.3877, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2292 => 1.2877, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.61% (1.0594 => 1.1082, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.60% (0.7460 => 0.7803, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.58% (1.9270 => 2.0153, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.44% (16.6129 => 17.3509, std. dev.: 0.0202) MultiSource/Applications/siod/siod: 4.32% (2.1791 => 2.2732, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.21% (0.3755 => 0.3913, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6243, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (4.3801 => 4.5579, std. dev.: 0.0095) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (3.6692 => 3.8150, std. dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.95% (4.9865 => 5.1833, std. dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.82% (13.2842 => 13.7912, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.75% (1.1333 => 1.1758, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.65% (0.6135 => 0.6359, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.46% (0.8698 => 0.8999, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.28% (0.6283 => 0.6489, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.26% (3.1889 => 3.2928, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.23% (16.2614 => 16.7862, std. dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (8.4961 => 8.7611, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.05% (14.8535 => 15.3072, std. dev.: 0.0126) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (6.5754 => 6.7761, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 3.00% (4.6629 => 4.8029, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.93% (3.2742 => 3.3702, std. dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9420, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5188 => 1.5593, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (2.1007 => 2.1502, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.80% (0.9108 => 0.9272, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 1.76% (0.6250 => 0.6360, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.68% (1.0313 => 1.0486, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.36% (3.7467 => 3.7977, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2558, std. dev.: 0.0446) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.16% (1.2998 => 1.4319, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7425, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (2.8606 => 2.9573, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9836, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.35% (10.7476 => 11.0003, std. dev.: 0.0244) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5952, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.84% (3.7731 => 3.8427, std. dev.: 0.0263) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2067, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.73% (0.4657 => 0.3971, std. dev.: 0.0132) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1974, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.59% (1.1560 => 1.1029, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.29% (5.0168 => 4.8018, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.11% (1.3780 => 1.3213, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.86% (20.3410 => 19.7602, std. dev.: 0.0226) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5962, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std. dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -2.28% (0.5449 => 0.5325, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2232, std. dev.: 0.0110) MultiSource/Applications/spiff/spiff: -2.01% (3.0263 => 2.9655, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3305 => 7.2082, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3701, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8011, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2406, std. dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 18:02:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 20:02:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814010235.1BEEA352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2867?compare_to=2865&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2867, Order: 161803, Start Time: 2012-08-13 23:44:15, End Time: 2012-08-14 01:03:12 To: 2865, Order: 161786, Start Time: 2012-08-13 21:53:28, End Time: 2012-08-13 23:12:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (96 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.39% (1.8887 => 1.9150, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.46% (13.8190 => 13.4795, std. dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.02% (10.3673 => 13.4795, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.3927 => 0.4329, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.89% (2.2022 => 2.3980, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.87% (0.1432 => 0.1559, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.83% (0.1892 => 0.2059, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.75% (1.7609 => 1.9150, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5925 => 0.6298, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.09% (10.4361 => 11.0717, std. dev.: 0.0128) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.88% (0.1906 => 0.2018, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.74% (0.4615 => 0.4880, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.32% (0.7326 => 0.7716, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.21% (0.4879 => 0.5133, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.17% (7.0540 => 7.4188, std. dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (0.7433 => 0.7794, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.49% (9.4845 => 9.9105, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.20% (4.9449 => 5.1528, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.11% (0.5569 => 0.5798, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.98% (0.8172 => 0.8497, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (5.0018 => 5.1995, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.95% (5.7591 => 5.9864, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (4.2646 => 4.4225, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.59% (1.3050 => 1.3518, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.4103 => 0.4249, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (0.4636 => 0.4796, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4079, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 3.34% (0.3387 => 0.3500, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.1861 => 1.2249, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 3.27% (0.7835 => 0.8091, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.5415 => 1.5917, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9765 => 1.0073, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 3.13% (0.3422 => 0.3529, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.03% (1.1642 => 1.1995, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.96% (0.4289 => 0.4416, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.95% (0.3826 => 0.3939, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3865 => 0.3979, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (2.0665 => 2.1272, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.94% (0.3441 => 0.3542, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.89% (3.3354 => 3.4319, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.89% (2.0273 => 2.0858, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.81% (0.6450 => 0.6631, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.79% (0.8067 => 0.8292, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (0.4064 => 0.4174, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.68% (0.5105 => 0.5242, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.68% (1.5603 => 1.6021, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.4203 => 0.4314, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 2.63% (0.6456 => 0.6626, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.59% (1.5859 => 1.6269, std. dev.: 0.0068) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9711, std. dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3165, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4620 => 0.4734, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.45% (17.1811 => 17.6023, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.6675 => 0.6835, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.38% (2.2969 => 2.3516, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8921 => 0.9133, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (1.4186 => 1.4505, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (14.3668 => 14.6786, std. dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.2024 => 2.2480, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.82% (1.1840 => 1.2055, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.48% (1.0722 => 1.0881, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (4.2280 => 4.4565, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.83% (26.0924 => 26.5705, std. dev.: 0.0124) MultiSource/Benchmarks/nbench/nbench: 1.71% (11.6436 => 11.8431, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.38% (5.2636 => 5.3361, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1999, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5759, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1294, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.01% (5.2763 => 3.1652, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.58% (5.3855 => 3.7387, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.25% (5.3526 => 3.7333, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -15.02% (54.1659 => 46.0294, std. dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5392, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -11.92% (22.1758 => 19.5322, std. dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4193, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -8.36% (1.5373 => 1.4088, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.86% (5.0483 => 4.8029, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4690, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.14% (8.6802 => 8.4073, std. dev.: 0.0112) SingleSource/Benchmarks/Misc/salsa20: -2.92% (10.2830 => 9.9830, std. dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9649, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3511, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2867, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.15% (19.9488 => 19.7195, std. dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8124, std. dev.: 0.0068) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 18:15:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 20:15:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120814011517.DACF7352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2868?compare_to=2863&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2868, Order: 161794, Start Time: 2012-08-13 22:32:35, End Time: 2012-08-14 01:15:58 To: 2863, Order: 161769, Start Time: 2012-08-13 19:20:46, End Time: 2012-08-13 22:04:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (114 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (11.6778 => 11.8210, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (4.6973 => 4.7500, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.04% (3.7748 => 3.7357, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.17% (0.3465 => 0.3852, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3488 => 0.3877, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 11.13% (0.3442 => 0.3825, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3496 => 0.3885, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3469 => 0.3852, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.03% (0.3446 => 0.3826, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3460 => 0.3840, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.66% (0.3650 => 0.4039, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.65% (0.3643 => 0.4031, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3724 => 0.4112, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.87% (1.5932 => 1.7027, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.27% (0.5826 => 0.6191, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.03% (0.5889 => 0.6244, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.57% (1.6211 => 1.7114, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (0.4994 => 0.5271, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (1.3152 => 1.3821, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.07% (0.4361 => 0.4582, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.86% (3.5627 => 3.7357, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (0.5026 => 0.5268, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.79% (0.2566 => 0.2689, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.77% (0.7171 => 0.7513, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (0.3930 => 0.4115, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.67% (1.0781 => 1.1285, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 4.63% (4.2109 => 4.4059, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.56% (0.5900 => 0.6169, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.54% (0.5000 => 0.5227, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.53% (0.2738 => 0.2862, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.39% (0.4029 => 0.4206, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.05% (5.5417 => 5.7663, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.03% (0.2875 => 0.2991, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (0.4658 => 0.4844, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2792 => 0.2903, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.97% (0.3195 => 0.3322, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.2866 => 0.2978, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 3.85% (0.2780 => 0.2887, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.82% (0.9909 => 1.0288, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.3845 => 0.3992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3625 => 0.3763, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.80% (0.2714 => 0.2817, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 3.75% (0.2750 => 0.2853, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (0.3348 => 0.3473, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (1.9966 => 2.0709, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2911 => 0.3019, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.67% (2.0673 => 2.1431, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.66% (0.2729 => 0.2829, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.66% (0.2811 => 0.2914, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2803 => 0.2905, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.63% (0.2813 => 0.2915, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.60% (0.6634 => 0.6873, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3258 => 0.3374, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.55% (2.7292 => 2.8262, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.54% (0.7875 => 0.8154, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.52% (0.3124 => 0.3234, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.52% (0.3096 => 0.3205, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3362 => 0.3480, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 3.51% (23.5202 => 24.3448, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: 3.49% (0.3726 => 0.3856, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (1.8794 => 1.9448, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.45% (1.9694 => 2.0374, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.43% (0.3060 => 0.3165, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3317 => 0.3430, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.37% (0.3678 => 0.3802, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (2.1013 => 2.1720, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.3271 => 0.3380, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3282 => 0.3391, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.26% (0.9697 => 1.0013, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 3.23% (2.1653 => 2.2353, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.21% (0.3336 => 0.3443, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.19% (0.3477 => 0.3588, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.18% (4.6177 => 4.7645, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 3.15% (0.4251 => 0.4385, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (4.4195 => 4.5571, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 3.11% (0.4146 => 0.4275, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.3903 => 0.4024, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3690 => 0.3804, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.95% (1.4269 => 1.4690, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.94% (0.3981 => 0.4098, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.4139 => 0.4260, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.6435 => 0.6611, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.65% (0.5546 => 0.5693, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.61% (0.5012 => 0.5143, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.47% (2.0346 => 2.0849, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (0.7426 => 0.7577, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (0.5361 => 0.5465, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (11.6398 => 11.8210, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.22% (4.6926 => 4.7500, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 9.28% (0.2122 => 0.2319, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6733, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8959, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1710, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6548, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6593, std. dev.: 0.0489) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2095, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (41.7953 => 42.6314, std. dev.: 0.0153) MultiSource/Applications/lua/lua: 1.73% (50.0626 => 50.9293, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5917, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2211, std. dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3092, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2814, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5458, std. dev.: 0.0308) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7998, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8079, std. dev.: 0.0074) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.24% (17.2379 => 16.8510, std. dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5752, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9592, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7152, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 19:17:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 21:17:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814021734.CDC18352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2869?compare_to=2866&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2869, Order: 161811, Start Time: 2012-08-14 01:04:29, End Time: 2012-08-14 02:18:15 To: 2866, Order: 161800, Start Time: 2012-08-13 23:22:35, End Time: 2012-08-14 00:36:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.67% (2.0176 => 2.3135, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.37% (0.5818 => 0.6363, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.04% (0.3130 => 0.3413, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5748 => 0.6267, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.37% (0.7061 => 0.7652, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 8.36% (0.3578 => 0.3877, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.22% (0.3601 => 0.3897, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.13% (0.3789 => 0.4097, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.00% (0.3623 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.00% (0.3914 => 0.4227, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.4003 => 0.4319, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.86% (0.1413 => 0.1524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.66% (1.3693 => 1.4742, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (0.4328 => 0.4655, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.45% (0.5265 => 0.5657, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.39% (0.7038 => 0.7558, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.34% (3.9660 => 4.2573, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.08% (0.2781 => 0.2978, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.57% (0.3899 => 0.4155, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.53% (1.2193 => 1.2989, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.51% (0.2628 => 0.2799, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.47% (0.2937 => 0.3127, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.42% (0.9199 => 0.9790, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.41% (0.6959 => 0.7405, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3022 => 0.3215, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.34% (0.3485 => 0.3706, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2760 => 0.2935, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.33% (0.2765 => 0.2940, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.27% (0.2761 => 0.2934, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4379 => 0.4653, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (0.3149 => 0.3345, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.20% (0.2726 => 0.2895, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.17% (0.2966 => 0.3149, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.11% (1.9828 => 2.1040, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3246 => 0.3443, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.99% (0.5577 => 0.5911, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.2988 => 0.3166, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.81% (0.4390 => 0.4645, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3192 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.74% (0.2127 => 0.2249, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.73% (0.3453 => 0.3651, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.3868 => 0.4083, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.51% (13.8202 => 14.5818, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (1.4563 => 1.5359, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4016 => 0.4235, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.42% (0.1865 => 0.1966, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.3293 => 0.3471, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.38% (0.3534 => 0.3724, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.37% (1.1364 => 1.1974, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.34% (0.2023 => 0.2131, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.33% (0.8310 => 0.8753, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.30% (0.2925 => 0.3080, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.27% (0.5637 => 0.5934, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.18% (1.3819 => 1.4535, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.13% (3.8646 => 4.0629, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.0594 => 1.1129, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.04% (1.1061 => 1.1619, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.02% (1.3245 => 1.3910, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (1.3813 => 1.4503, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.98% (7.2180 => 7.5772, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.92% (0.7506 => 0.7875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.81% (1.2292 => 1.2883, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.72% (1.9270 => 2.0179, std. dev.: 0.0090) MultiSource/Applications/siod/siod: 4.65% (2.1791 => 2.2805, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.7460 => 0.7801, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 4.54% (0.2995 => 0.3131, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.40% (16.6129 => 17.3433, std. dev.: 0.0148) MultiSource/Benchmarks/McCat/18-imp/imp: 4.38% (0.3220 => 0.3361, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3755 => 0.3917, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.27% (4.4433 => 4.6332, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.24% (0.4791 => 0.4994, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.3801 => 4.5653, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (13.2842 => 13.8338, std. dev.: 0.0153) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.10% (4.9865 => 5.1911, std. dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (3.6692 => 3.8197, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.99% (0.6135 => 0.6380, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.97% (1.1333 => 1.1783, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.86% (0.3131 => 0.3252, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.8698 => 0.9022, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.68% (0.6283 => 0.6514, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.48% (16.2614 => 16.8272, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 3.42% (3.1889 => 3.2981, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.41% (8.4961 => 8.7861, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 3.34% (14.8535 => 15.3492, std. dev.: 0.0169) MultiSource/Applications/JM/ldecod/ldecod: 3.29% (6.5754 => 6.7919, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.23% (3.2742 => 3.3799, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4113 => 0.4240, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.5188 => 1.5654, std. dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 2.95% (14.5298 => 14.9585, std. dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 2.77% (4.6629 => 4.7921, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.1007 => 2.1585, std. dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6250 => 0.6389, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 2.04% (1.0313 => 1.0523, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.98% (0.9108 => 0.9288, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.90% (0.6744 => 0.6872, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.57% (3.7467 => 3.8054, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.05% (33.2944 => 33.6453, std. dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (6.2785 => 6.3431, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.87% (1.2998 => 1.4151, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.42% (11.2619 => 11.7601, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std. dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 2.80% (3.7731 => 3.8786, std. dev.: 0.0140) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0173) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5957, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.10% (10.7476 => 10.9737, std. dev.: 0.0463) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1838, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6857, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.99% (0.4657 => 0.3959, std. dev.: 0.0181) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.63% (22.5627 => 21.2930, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3136, std. dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.59% (1.1560 => 1.1029, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.74% (20.3410 => 19.7834, std. dev.: 0.0404) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5968, std. dev.: 0.0138) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.29% (0.6589 => 0.6438, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (0.8342 => 0.8163, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9633, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2242, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2325, std. dev.: 0.0196) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3772, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8020, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2378, std. dev.: 0.0302) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 19:52:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 21:52:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814025214.3734B352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2870?compare_to=2867&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2870, Order: 161825, Start Time: 2012-08-14 01:34:06, End Time: 2012-08-14 02:52:54 To: 2867, Order: 161803, Start Time: 2012-08-13 23:44:15, End Time: 2012-08-14 01:03:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (91 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (744 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.92% (1.4088 => 1.4358, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.05% (4.6632 => 4.6142, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.89% (10.3673 => 13.5699, std. dev.: 0.0103) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.17% (1.1194 => 1.2444, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.75% (0.3886 => 0.4265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.70% (0.3927 => 0.4308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.15% (1.7609 => 1.9044, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.97% (2.2022 => 2.3777, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.74% (10.4361 => 11.1395, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.81% (0.2065 => 0.2185, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 5.33% (0.5925 => 0.6241, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.24% (0.3282 => 0.3454, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.17% (0.6030 => 0.6342, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.98% (0.4879 => 0.5122, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (7.0540 => 7.4041, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (0.7433 => 0.7775, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.56% (9.4845 => 9.9166, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.45% (0.2271 => 0.2372, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 4.37% (0.7326 => 0.7646, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.9449 => 5.1487, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (5.0018 => 5.2015, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5860 => 0.6091, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (4.2646 => 4.4256, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.73% (1.3050 => 1.3537, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.71% (0.8172 => 0.8475, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 3.54% (5.7591 => 5.9630, std. dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.1363 => 8.4156, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.5415 => 1.5940, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.28% (1.1861 => 1.2250, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.28% (0.3387 => 0.3498, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.09% (1.1642 => 1.2002, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.08% (3.3354 => 3.4381, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.06% (0.9765 => 1.0064, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.04% (0.5105 => 0.5260, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.4636 => 0.4776, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 2.94% (2.0273 => 2.0869, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.86% (1.5859 => 1.6312, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.83% (17.1811 => 17.6675, std. dev.: 0.0383) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.76% (0.8067 => 0.8290, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6450 => 0.6620, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (0.6675 => 0.6849, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.59% (0.5020 => 0.5150, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.57% (0.6456 => 0.6622, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.56% (1.5603 => 1.6002, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.49% (3.8723 => 3.9688, std. dev.: 0.0106) MultiSource/Applications/siod/siod: 2.41% (2.2969 => 2.3522, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.2024 => 2.2548, std. dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (14.3668 => 14.7048, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 2.34% (0.8921 => 0.9130, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.31% (1.4186 => 1.4513, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (0.4620 => 0.4722, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5981 => 0.6107, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.04% (2.0665 => 2.1087, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.93% (1.1840 => 1.2069, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.81% (1.2842 => 1.3075, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.74% (0.7115 => 0.7239, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.68% (1.0722 => 1.0902, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8964, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (4.2280 => 4.4236, std. dev.: 0.0118) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7557, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.78% (26.0924 => 26.5581, std. dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8415, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.60% (9.1159 => 9.2620, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (5.2636 => 5.3381, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.06% (2.6546 => 2.6827, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1522, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.84% (5.3855 => 3.7247, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7167, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0196, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.72% (2.9384 => 2.5352, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -11.91% (22.1758 => 19.5339, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.60% (1.5373 => 1.4358, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7609, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8067, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4725, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4216, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9933, std. dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9597, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (12.5348 => 12.3446, std. dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (19.9488 => 19.6883, std. dev.: 0.0802) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2868, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8123, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std. dev.: 0.0149) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 20:59:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 22:59:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814035935.02A03352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2871?compare_to=2869&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2871, Order: 161828, Start Time: 2012-08-14 02:46:27, End Time: 2012-08-14 04:00:13 To: 2869, Order: 161811, Start Time: 2012-08-14 01:04:29, End Time: 2012-08-14 02:18:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.16% (0.5364 => 0.5480, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.54% (2.0176 => 2.3110, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.11% (0.3130 => 0.3415, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5748 => 0.6269, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.66% (0.3578 => 0.3888, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 8.35% (0.3663 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.34% (0.7061 => 0.7650, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.29% (0.3789 => 0.4103, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.4003 => 0.4333, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (0.1413 => 0.1525, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.73% (0.2781 => 0.2996, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.61% (1.3693 => 1.4735, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.54% (0.5265 => 0.5662, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.50% (3.9660 => 4.2634, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.2721 => 0.2925, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.49% (0.7038 => 0.7565, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.46% (0.7710 => 0.8285, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4328 => 0.4648, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.2596 => 0.2787, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.97% (0.4062 => 0.4345, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.74% (0.2760 => 0.2946, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.73% (0.2690 => 0.2871, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.70% (0.2655 => 0.2833, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.63% (0.3485 => 0.3716, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.59% (1.2193 => 1.2997, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2765 => 0.2947, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.49% (0.9199 => 0.9796, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.48% (1.9828 => 2.1113, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.48% (0.3580 => 0.3812, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.46% (0.3899 => 0.4151, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.39% (0.6959 => 0.7404, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3107 => 0.3305, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4379 => 0.4656, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.19% (0.2988 => 0.3173, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.11% (0.3192 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.10% (0.5577 => 0.5917, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.97% (0.2127 => 0.2254, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.80% (0.4016 => 0.4249, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 5.77% (0.3293 => 0.3483, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.69% (0.3534 => 0.3735, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.68% (13.8202 => 14.6055, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.56% (1.4563 => 1.5373, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.3756 => 0.3964, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.46% (1.1364 => 1.1985, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.44% (0.2023 => 0.2133, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (7.2180 => 7.6097, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 5.40% (0.3868 => 0.4077, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.39% (0.5637 => 0.5941, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.2914 => 0.3071, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 5.37% (0.2925 => 0.3082, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.17% (0.8310 => 0.8740, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.12% (1.3819 => 1.4526, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.11% (1.1061 => 1.1626, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.09% (3.8646 => 4.0615, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (1.3245 => 1.3916, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.02% (0.7506 => 0.7883, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.00% (1.2292 => 1.2907, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (1.3813 => 1.4503, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 4.91% (1.0594 => 1.1114, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.89% (0.7460 => 0.7825, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.87% (1.9270 => 2.0209, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.47% (0.2995 => 0.3129, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.47% (0.3755 => 0.3923, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.43% (2.1791 => 2.2756, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.41% (4.3801 => 4.5733, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 4.41% (0.3220 => 0.3362, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.31% (16.6129 => 17.3286, std. dev.: 0.0140) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.31% (4.4433 => 4.6346, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.25% (3.6692 => 3.8253, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.23% (13.2842 => 13.8459, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.13% (0.4791 => 0.4989, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.08% (1.1333 => 1.1795, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.07% (0.6135 => 0.6385, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.93% (0.3131 => 0.3254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.91% (4.9865 => 5.1813, std. dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.83% (0.8698 => 0.9031, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.68% (0.6283 => 0.6514, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (8.4961 => 8.7987, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 3.54% (3.1889 => 3.3017, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 3.53% (14.8535 => 15.3785, std. dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 3.51% (6.5754 => 6.8060, std. dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 3.40% (16.2614 => 16.8139, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (3.2742 => 3.3805, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.05% (14.5298 => 14.9727, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.95% (1.5188 => 1.5636, std. dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: 2.92% (4.6629 => 4.7992, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (2.1007 => 2.1546, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6250 => 0.6396, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.08% (0.9108 => 0.9297, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.97% (1.0313 => 1.0516, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.81% (0.6744 => 0.6866, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.54% (3.7467 => 3.8043, std. dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (6.2785 => 6.3661, std. dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 1.24% (33.2944 => 33.7082, std. dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5205, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.71% (1.2998 => 1.4130, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7437, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8172, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3853, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6049, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.07% (10.7476 => 10.9701, std. dev.: 0.0527) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.56% (0.4657 => 0.3979, std. dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.73% (22.5627 => 21.2709, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.61% (1.3780 => 1.3145, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5845, std. dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.73% (20.3410 => 19.7848, std. dev.: 0.0146) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2236, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9640, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2290, std. dev.: 0.0240) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3782, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8027, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.11% (3.9173 => 3.8739, std. dev.: 0.0147) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 6.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 21:26:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 23:26:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120814042639.C77BE352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2872?compare_to=2868&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2872, Order: 161826, Start Time: 2012-08-14 01:44:15, End Time: 2012-08-14 04:27:20 To: 2868, Order: 161794, Start Time: 2012-08-13 22:32:35, End Time: 2012-08-14 01:15:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (115 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.77% (0.4116 => 0.4724, std. dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.20% (54.1618 => 54.8143, std. dev.: 0.0665) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 24.58% (0.3792 => 0.4724, std. dev.: 0.0126) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3496 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3446 => 0.3847, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3465 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.56% (0.3442 => 0.3840, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.53% (0.3488 => 0.3890, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.50% (0.3460 => 0.3858, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.42% (0.3469 => 0.3865, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.18% (0.3650 => 0.4058, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.14% (0.3643 => 0.4049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3724 => 0.4130, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.42% (0.1620 => 0.1724, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.28% (1.5932 => 1.6933, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (0.5026 => 0.5317, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 5.75% (0.5826 => 0.6161, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.69% (1.6211 => 1.7133, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 5.60% (0.5889 => 0.6219, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.52% (1.3152 => 1.3878, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.34% (0.4361 => 0.4594, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.26% (0.4029 => 0.4241, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.16% (3.5627 => 3.7466, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.97% (0.4994 => 0.5242, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 4.92% (4.2109 => 4.4181, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2738 => 0.2866, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (0.5000 => 0.5232, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.5900 => 0.6173, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 4.61% (1.0781 => 1.1278, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (0.3890 => 0.4059, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2750 => 0.2869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.32% (0.7171 => 0.7481, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2875 => 0.2999, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3258 => 0.3397, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.25% (0.4658 => 0.4856, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.17% (0.9909 => 1.0322, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3362 => 0.3501, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.01% (0.2566 => 0.2669, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 4.01% (0.3267 => 0.3398, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.97% (0.3195 => 0.3322, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.94% (5.5417 => 5.7599, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.91% (2.0673 => 2.1482, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.86% (2.1013 => 2.1825, std. dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.3004 => 0.3120, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.83% (2.7292 => 2.8338, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.2823 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.81% (0.2729 => 0.2833, std. dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (0.2691 => 0.2793, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.75% (0.3096 => 0.3212, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.74% (0.2811 => 0.2916, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.73% (0.3271 => 0.3393, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 3.70% (0.2813 => 0.2917, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.68% (0.2911 => 0.3018, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3625 => 0.3758, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.65% (0.2792 => 0.2894, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.65% (0.9697 => 1.0051, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.59% (0.3124 => 0.3236, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.55% (1.8794 => 1.9461, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 3.55% (4.6177 => 4.7815, std. dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (1.9694 => 2.0390, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.53% (0.3060 => 0.3168, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3726 => 0.3857, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.50% (0.3317 => 0.3433, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.3903 => 0.4039, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.3845 => 0.3978, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (1.9966 => 2.0653, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 3.42% (0.6634 => 0.6861, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 3.41% (0.3348 => 0.3462, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.40% (0.3678 => 0.3803, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 3.36% (2.1653 => 2.2380, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (4.4195 => 4.5667, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3477 => 0.3590, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4146 => 0.4280, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.19% (0.7875 => 0.8126, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 3.13% (0.4251 => 0.4384, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.11% (1.4269 => 1.4713, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 3.10% (23.5202 => 24.2490, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3690 => 0.3803, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.4139 => 0.4264, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 2.83% (0.5012 => 0.5154, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.80% (0.6435 => 0.6615, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3981 => 0.4091, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.67% (0.5546 => 0.5694, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.56% (2.0346 => 2.0867, std. dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.80% (0.7426 => 0.7560, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (11.6398 => 11.7586, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.45% (0.2122 => 0.2280, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6707, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1713, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 4.07% (14.0481 => 14.6198, std. dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6908, std. dev.: 0.0296) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (41.7953 => 42.6510, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1937, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.71% (50.0626 => 50.9185, std. dev.: 0.0139) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std. dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3041, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2831, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.00% (2.4764 => 2.4516, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5707, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: -9.03% (0.2402 => 0.2185, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7975, std. dev.: 0.0095) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7766, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.80% (0.6293 => 0.6117, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/fldry: -2.12% (17.2379 => 16.8731, std. dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5718, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9657, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 21:39:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 13 Aug 2012 23:39:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814043938.3BEFA352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2873?compare_to=2870&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2873, Order: 161828, Start Time: 2012-08-14 03:21:24, End Time: 2012-08-14 04:40:20 To: 2870, Order: 161825, Start Time: 2012-08-14 01:34:06, End Time: 2012-08-14 02:52:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (95 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.73% (13.5699 => 13.9398, std. dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.36% (55.6228 => 56.3801, std. dev.: 0.1317) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.46% (10.3673 => 13.9398, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.14% (0.3543 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.75% (0.3473 => 0.3881, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.49% (0.3543 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.37% (0.3561 => 0.3966, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2455, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.50% (0.3886 => 0.4294, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.87% (0.1432 => 0.1559, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.69% (2.2022 => 2.3716, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.66% (1.7609 => 1.8957, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 6.10% (10.4361 => 11.0726, std. dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.46% (0.6030 => 0.6359, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.3282 => 0.3450, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.70% (7.0540 => 7.3858, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 4.63% (0.7326 => 0.7665, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.43% (9.4845 => 9.9047, std. dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.01% (0.5860 => 0.6095, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (5.0018 => 5.2002, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.9449 => 5.1401, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (4.2646 => 4.4297, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.75% (1.3050 => 1.3539, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.71% (0.3180 => 0.3298, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.64% (0.7835 => 0.8120, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.59% (8.1363 => 8.4285, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (1.1861 => 1.2256, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.29% (1.5415 => 1.5922, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 3.29% (5.7591 => 5.9483, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4636 => 0.4783, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.13% (0.5105 => 0.5265, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.12% (1.1642 => 1.2005, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.08% (0.9765 => 1.0066, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.07% (0.4103 => 0.4229, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.94% (0.3441 => 0.3542, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.89% (3.3354 => 3.4318, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.85% (2.0273 => 2.0850, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.69% (0.8067 => 0.8284, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.68% (1.5603 => 1.6021, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5859 => 1.6279, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.62% (0.6450 => 0.6619, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.60% (0.6456 => 0.6624, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.50% (3.8723 => 3.9690, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.49% (2.0665 => 2.1180, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6675 => 0.6840, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.41% (17.1811 => 17.5950, std. dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.38% (1.4186 => 1.4523, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.31% (0.5020 => 0.5136, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (0.4620 => 0.4726, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8921 => 0.9125, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (14.3668 => 14.6945, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5981 => 0.6114, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.12% (2.2969 => 2.3455, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.2024 => 2.2475, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 1.93% (1.2842 => 1.3090, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.80% (1.1840 => 1.2053, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.66% (0.7115 => 0.7233, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.55% (1.0722 => 1.0888, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.21% (4.2280 => 4.4484, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7474, std. dev.: 0.0087) MultiSource/Applications/lua/lua: 2.02% (26.0924 => 26.6192, std. dev.: 0.0144) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8419, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.58% (9.1159 => 9.2598, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.37% (5.2636 => 5.3359, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1998, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6816, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.11% (5.2763 => 3.1598, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6952, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.05% (5.3526 => 3.6908, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0185, std. dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.39% (2.9384 => 2.5450, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4896, std. dev.: 0.0267) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.1396 => 1.0596, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -6.39% (1.5373 => 1.4390, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8069, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4732, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4129, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9878, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9640, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3510, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.15% (2.3135 => 2.2869, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7068, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 22:41:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 00:41:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814054129.22EE0352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2874?compare_to=2871&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2874, Order: 161830, Start Time: 2012-08-14 04:28:30, End Time: 2012-08-14 05:42:12 To: 2871, Order: 161828, Start Time: 2012-08-14 02:46:27, End Time: 2012-08-14 04:00:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (142 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (718 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.89% (2.0176 => 2.3181, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.58% (0.5818 => 0.6317, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5748 => 0.6234, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.10% (0.7061 => 0.7633, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.86% (0.1413 => 0.1524, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.71% (0.3578 => 0.3854, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3601 => 0.3875, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.49% (0.3646 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.44% (0.3789 => 0.4071, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.40% (0.3663 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3650 => 0.3919, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.32% (3.9660 => 4.2565, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.31% (0.2721 => 0.2920, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.5265 => 0.5649, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.26% (0.7710 => 0.8270, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.23% (0.7038 => 0.7547, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.20% (1.3693 => 1.4679, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.54% (1.2193 => 1.2991, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2782 => 0.2959, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.35% (0.9199 => 0.9783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.34% (0.6959 => 0.7400, std. dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.12% (0.4379 => 0.4647, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3246 => 0.3442, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.97% (0.5577 => 0.5910, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 5.96% (0.4062 => 0.4304, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.91% (0.2607 => 0.2761, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.3899 => 0.4127, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.78% (0.2127 => 0.2250, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.67% (0.2628 => 0.2777, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.61% (0.3580 => 0.3781, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.49% (0.2696 => 0.2844, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.49% (1.9828 => 2.0916, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.40% (13.8202 => 14.5658, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (1.4563 => 1.5348, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.35% (1.1364 => 1.1972, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3192 => 0.3360, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.20% (0.5637 => 0.5930, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.16% (1.3819 => 1.4532, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.08% (0.8310 => 0.8732, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (7.2180 => 7.5801, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (1.3813 => 1.4501, std. dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 4.95% (3.8646 => 4.0560, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.92% (1.1061 => 1.1605, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.92% (0.7506 => 0.7875, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.91% (1.3245 => 1.3895, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.69% (0.7460 => 0.7810, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.63% (1.9270 => 2.0163, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.36% (2.1791 => 2.2741, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2292 => 1.2818, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.24% (0.2945 => 0.3070, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (3.6692 => 3.8244, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.19% (4.4433 => 4.6295, std. dev.: 0.0482) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.3801 => 4.5635, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (13.2842 => 13.8267, std. dev.: 0.0277) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 3.98% (16.6129 => 17.2734, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.89% (1.1333 => 1.1774, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.80% (0.6135 => 0.6368, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3755 => 0.3894, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.61% (0.3131 => 0.3244, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.45% (16.2614 => 16.8226, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (4.9865 => 5.1544, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.34% (14.8535 => 15.3493, std. dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.4961 => 8.7794, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.27% (3.1889 => 3.2931, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.21% (0.8698 => 0.8977, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (6.5754 => 6.7853, std. dev.: 0.0152) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3725, std. dev.: 0.0164) MultiSource/Applications/ClamAV/clamscan: 2.94% (14.5298 => 14.9564, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.77% (1.5188 => 1.5608, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.68% (4.6629 => 4.7879, std. dev.: 0.0199) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.01% (0.9108 => 0.9291, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.40% (3.7467 => 3.7990, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.2785 => 6.3470, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 1.03% (33.2944 => 33.6364, std. dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5131, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 25.10% (1.8175 => 2.2737, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.44% (1.2998 => 1.4095, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7447, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3851, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5899, std. dev.: 0.0153) MultiSource/Applications/SPASS/SPASS: 2.05% (10.7476 => 10.9679, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1981, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.61% (0.2670 => 0.2547, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.87% (1.0460 => 0.8486, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5105, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8059, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.10% (1.3780 => 1.3215, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.80% (0.4867 => 0.4682, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.73% (20.3410 => 19.7866, std. dev.: 0.0353) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5897, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -2.48% (1.9762 => 1.9272, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.16% (0.8342 => 0.8162, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.04% (3.0263 => 2.9647, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2396, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2350, std. dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3767, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8027, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 13 23:27:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 01:27:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814062700.3B375352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2875?compare_to=2873&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2875, Order: 161831, Start Time: 2012-08-14 05:08:47, End Time: 2012-08-14 06:27:43 To: 2873, Order: 161828, Start Time: 2012-08-14 03:21:24, End Time: 2012-08-14 04:40:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (81 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.46% (13.9398 => 14.1433, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.00% (27.9687 => 27.6877, std. dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.42% (10.3673 => 14.1433, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3497 => 0.3917, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (1.1194 => 1.2496, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.80% (0.1432 => 0.1558, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.68% (2.2022 => 2.3714, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.43% (1.7609 => 1.8917, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.72% (10.4361 => 11.0335, std. dev.: 0.0131) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5925 => 0.6257, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.42% (0.6030 => 0.6357, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.11% (7.0540 => 7.4145, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.4879 => 0.5123, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.75% (0.4615 => 0.4834, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 4.42% (0.7326 => 0.7650, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (9.4845 => 9.8845, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 4.13% (0.7433 => 0.7740, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.8172 => 0.8499, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.9449 => 5.1353, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (5.0018 => 5.1927, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.70% (0.5860 => 0.6077, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.63% (4.2646 => 4.4196, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.48% (8.1363 => 8.4195, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.48% (1.3050 => 1.3504, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.37% (0.7835 => 0.8099, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.15% (1.5415 => 1.5900, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1861 => 1.2218, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.9765 => 1.0054, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.67% (5.7591 => 5.9127, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.4289 => 0.4403, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1951, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.63% (2.0273 => 2.0807, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.57% (1.5603 => 1.6004, std. dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.52% (0.4636 => 0.4753, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6450 => 0.6612, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.46% (3.3354 => 3.4175, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.35% (0.5105 => 0.5225, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.4186 => 1.4480, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (14.3668 => 14.6614, std. dev.: 0.0092) MultiSource/Applications/lua/lua: 2.04% (3.8723 => 3.9514, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 1.97% (0.8921 => 0.9097, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6456 => 0.6581, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.90% (1.5859 => 1.6161, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.76% (2.0665 => 2.1029, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.72% (17.1811 => 17.4758, std. dev.: 0.0154) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.1840 => 1.2029, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.57% (1.2842 => 1.3044, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (2.2024 => 2.2349, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.33% (4.2280 => 4.4533, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 1.86% (26.0924 => 26.5766, std. dev.: 0.0087) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2813, std. dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 1.70% (11.6436 => 11.8417, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (0.9540 => 0.9683, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (5.2636 => 5.3404, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.11% (2.6546 => 2.6840, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5759, std. dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1617, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6985, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6872, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -15.09% (54.1659 => 45.9897, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.68% (2.9384 => 2.5365, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4908, std. dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.65% (1.6925 => 1.4277, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -7.08% (1.5373 => 1.4284, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8069, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4704, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4160, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.58% (10.2830 => 10.0180, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (8.1563 => 7.9670, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.46% (12.5348 => 12.3514, std. dev.: 0.0188) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.16% (2.3135 => 2.2866, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.03% (19.9488 => 19.7437, std. dev.: 0.0188) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 00:26:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 02:26:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814072601.736D8352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2876?compare_to=2874&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2876, Order: 161854, Start Time: 2012-08-14 06:10:26, End Time: 2012-08-14 07:26:45 To: 2874, Order: 161830, Start Time: 2012-08-14 04:28:30, End Time: 2012-08-14 05:42:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (117 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.90% (78.6477 => 80.9273, std. dev.: 0.2166) MultiSource/Benchmarks/llubenchmark/llu: 1.55% (3.7791 => 3.8376, std. dev.: 0.0111) MultiSource/Applications/siod/siod: 1.05% (3.2909 => 3.3256, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3042, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.30% (0.3130 => 0.3421, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5818 => 0.6322, std. dev.: 0.0148) SingleSource/UnitTests/ObjC++/property-reference: 8.47% (0.7061 => 0.7659, std. dev.: 0.0196) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5748 => 0.6234, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.02% (0.3578 => 0.3865, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.82% (0.3646 => 0.3931, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/for-in: 7.71% (0.3789 => 0.4081, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.64% (0.3650 => 0.3929, std. dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions: 7.64% (0.3914 => 0.4213, std. dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 7.59% (0.7038 => 0.7572, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.51% (3.9660 => 4.2640, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 7.49% (1.3693 => 1.4718, std. dev.: 0.0217) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.46% (0.2721 => 0.2924, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.7710 => 0.8268, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.61% (0.9199 => 0.9807, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.56% (1.2193 => 1.2993, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.39% (0.4379 => 0.4659, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.6959 => 0.7403, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.19% (0.3246 => 0.3447, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.76% (0.5577 => 0.5898, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.74% (0.2127 => 0.2249, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.73% (13.8202 => 14.6124, std. dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.73% (0.3580 => 0.3785, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2023 => 0.2134, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (1.4563 => 1.5354, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 5.40% (0.2925 => 0.3083, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.39% (1.1364 => 1.1976, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.38% (0.2696 => 0.2841, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.32% (1.9828 => 2.0882, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.31% (7.2180 => 7.6012, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.22% (1.3819 => 1.4540, std. dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.2914 => 0.3066, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.20% (0.5637 => 0.5930, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 5.17% (0.8310 => 0.8740, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.14% (3.8646 => 4.0631, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (1.3813 => 1.4509, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.04% (1.3245 => 1.3912, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.86% (1.1061 => 1.1599, std. dev.: 0.0056) MultiSource/Applications/spiff/spiff: 4.80% (0.7506 => 0.7866, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.77% (1.0594 => 1.1099, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.72% (1.9270 => 2.0179, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.65% (0.7460 => 0.7807, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 4.61% (2.1791 => 2.2796, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.50% (0.2243 => 0.2344, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.40% (1.2292 => 1.2833, std. dev.: 0.0198) MultiSource/Benchmarks/McCat/18-imp/imp: 4.38% (0.3220 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.29% (13.2842 => 13.8547, std. dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 4.28% (16.6129 => 17.3239, std. dev.: 0.0208) MultiSource/Applications/sgefa/sgefa: 4.27% (0.2995 => 0.3123, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.3801 => 4.5652, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (4.4433 => 4.6303, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2945 => 0.3068, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.15% (3.6692 => 3.8215, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.00% (1.1333 => 1.1786, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.93% (0.6135 => 0.6376, std. dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 3.86% (0.3131 => 0.3252, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.45% (3.1889 => 3.2989, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.35% (8.4961 => 8.7805, std. dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 3.32% (16.2614 => 16.8014, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.21% (6.5754 => 6.7867, std. dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 3.21% (14.8535 => 15.3302, std. dev.: 0.0110) MultiSource/Applications/ClamAV/clamscan: 2.98% (14.5298 => 14.9630, std. dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: 2.47% (4.6629 => 4.7780, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.03% (0.9108 => 0.9293, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.85% (0.6744 => 0.6869, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.62% (3.7467 => 3.8075, std. dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.33% (6.2785 => 6.3623, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 1.10% (33.2944 => 33.6613, std. dev.: 0.0333) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5141, std. dev.: 0.0375) SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2543, std. dev.: 0.0500) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7435, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9836, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8170, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.4271 => 7.6223, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.07% (10.7476 => 10.9698, std. dev.: 0.0076) MultiSource/Benchmarks/llubenchmark/llu: 1.71% (3.7731 => 3.8376, std. dev.: 0.0111) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3256, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0059) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5740, std. dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.5928 => 4.6420, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.87% (22.5627 => 21.2378, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.06% (0.2670 => 0.2535, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0234) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0075) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0154) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.22% (1.3780 => 1.3199, std. dev.: 0.0164) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8059, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.71% (20.3410 => 19.7903, std. dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5933, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9605, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2308, std. dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.91% (0.8342 => 0.8183, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2313, std. dev.: 0.0283) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3744, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8026, std. dev.: 0.0272) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.8996, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 00:40:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 02:40:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120814074020.8F998352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2877?compare_to=2872&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2877, Order: 161831, Start Time: 2012-08-14 04:55:38, End Time: 2012-08-14 07:41:04 To: 2872, Order: 161826, Start Time: 2012-08-14 01:44:15, End Time: 2012-08-14 04:27:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (95 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (783 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 31.29% (57.0596 => 74.9164, std. dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.03% (124.7437 => 128.5207, std. dev.: 0.5933) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.03% (1.0051 => 0.9947, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 11.70% (0.3469 => 0.3875, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.70% (0.3496 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.67% (0.3488 => 0.3895, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3446 => 0.3848, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3465 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.62% (0.3442 => 0.3842, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 11.17% (0.3643 => 0.4050, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.15% (0.3650 => 0.4057, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.79% (0.3724 => 0.4126, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.01% (0.5826 => 0.6176, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.93% (0.5889 => 0.6238, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.67% (1.3152 => 1.3898, std. dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 5.63% (1.5932 => 1.6829, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (1.6211 => 1.7118, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.39% (0.4994 => 0.5263, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.27% (3.5627 => 3.7505, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.25% (0.5026 => 0.5290, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.02% (0.4361 => 0.4580, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.99% (0.4029 => 0.4230, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.5900 => 0.6192, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (0.5000 => 0.5239, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 4.65% (1.0781 => 1.1282, std. dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 4.62% (4.2109 => 4.4056, std. dev.: 0.0127) SingleSource/UnitTests/ObjC++/property-reference: 4.43% (0.7171 => 0.7489, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.2736 => 0.2847, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.05% (0.2866 => 0.2982, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.05% (2.7292 => 2.8396, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 3.94% (0.2566 => 0.2667, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.86% (5.5417 => 5.7555, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3362 => 0.3491, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (0.3890 => 0.4035, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.71% (4.6177 => 4.7890, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.70% (2.1013 => 2.1790, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.69% (0.2875 => 0.2981, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (1.9694 => 2.0411, std. dev.: 0.0066) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.56% (1.9966 => 2.0676, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.55% (1.8794 => 1.9461, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 3.51% (0.6634 => 0.6867, std. dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 3.43% (2.1653 => 2.2395, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (4.4195 => 4.5698, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 3.39% (0.9909 => 1.0245, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.31% (0.4139 => 0.4276, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (2.0673 => 2.1353, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.25% (0.3845 => 0.3970, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.3903 => 0.4029, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 3.19% (0.3258 => 0.3362, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.16% (0.7875 => 0.8124, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3317 => 0.3421, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.12% (23.5202 => 24.2539, std. dev.: 0.0126) MultiSource/Applications/lua/lua: 3.11% (1.4269 => 1.4713, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.3271 => 0.3372, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 2.99% (0.3348 => 0.3448, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.88% (0.3678 => 0.3784, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.87% (0.3690 => 0.3796, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 2.87% (0.3726 => 0.3833, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (0.3625 => 0.3726, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4146 => 0.4260, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4251 => 0.4366, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.58% (0.9697 => 0.9947, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.56% (0.3981 => 0.4083, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (0.6435 => 0.6581, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.5012 => 0.5120, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.03% (2.0346 => 2.0760, std. dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6641, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1726, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.47% (1.8057 => 1.8865, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6331, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7166, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1980, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (41.7953 => 42.6502, std. dev.: 0.0063) MultiSource/Applications/lua/lua: 1.75% (50.0626 => 50.9391, std. dev.: 0.1091) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std. dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3102, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.43% (1.0927 => 1.1083, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2805, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.19% (11.9555 => 11.8129, std. dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5328, std. dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/ary2: -9.03% (0.2402 => 0.2185, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7899, std. dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7999, std. dev.: 0.0032) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.80% (0.6293 => 0.6117, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -2.62% (17.2379 => 16.7856, std. dev.: 0.0625) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5775, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9626, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 01:16:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 03:16:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814081628.65364352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2878?compare_to=2875&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2878, Order: 161854, Start Time: 2012-08-14 06:56:07, End Time: 2012-08-14 08:17:11 To: 2875, Order: 161831, Start Time: 2012-08-14 05:08:47, End Time: 2012-08-14 06:27:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (73 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.71% (14.1433 => 13.9020, std. dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -1.07% (11.0335 => 10.9159, std. dev.: 0.0165) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.09% (10.3673 => 13.9020, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.64% (1.1194 => 1.2497, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.80% (0.3473 => 0.3848, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.58% (0.3543 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3543 => 0.3918, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.68% (0.3927 => 0.4307, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.18% (1.7609 => 1.8874, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.80% (2.2022 => 2.3520, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.69% (0.1584 => 0.1690, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 5.40% (0.5925 => 0.6245, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 5.26% (0.6030 => 0.6347, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.60% (10.4361 => 10.9159, std. dev.: 0.0165) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3121 => 0.3263, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.4879 => 0.5096, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.41% (7.0540 => 7.3653, std. dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.33% (0.4615 => 0.4815, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 4.26% (0.7326 => 0.7638, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5569 => 0.5802, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.01% (0.8172 => 0.8500, std. dev.: 0.0096) MultiSource/Applications/lambda-0_1_3/lambda: 3.85% (0.7433 => 0.7719, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (9.4845 => 9.8345, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5860 => 0.6070, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.42% (0.7835 => 0.8103, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (4.2646 => 4.4072, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.23% (5.0018 => 5.1636, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.20% (4.9449 => 5.1030, std. dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.06% (8.1363 => 8.3850, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.01% (1.3050 => 1.3443, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1861 => 1.2216, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.70% (1.1642 => 1.1956, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.57% (0.9765 => 1.0016, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5803, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 2.48% (5.7591 => 5.9018, std. dev.: 0.0086) MultiSource/Applications/hbd/hbd: 2.40% (1.5603 => 1.5977, std. dev.: 0.0097) MultiSource/Applications/treecc/treecc: 2.35% (2.0273 => 2.0750, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.22% (0.4636 => 0.4739, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.13% (3.3354 => 3.4065, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 2.03% (3.8723 => 3.9509, std. dev.: 0.0082) MultiSource/Benchmarks/nbench/nbench: 1.93% (1.1840 => 1.2068, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (14.3668 => 14.6214, std. dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.4186 => 1.4437, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.73% (2.0665 => 2.1023, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.62% (2.2969 => 2.3340, std. dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 1.61% (17.1811 => 17.4583, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (4.2280 => 4.4537, std. dev.: 0.0143) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7597, std. dev.: 0.0177) MultiSource/Applications/lua/lua: 2.20% (26.0924 => 26.6674, std. dev.: 0.0095) MultiSource/Applications/minisat/minisat: 1.61% (9.1159 => 9.2626, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8232, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.40% (5.2636 => 5.3373, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1998, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.28% (3.2827 => 3.3247, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5762, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.21% (5.2763 => 3.1548, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6877, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.21% (5.3526 => 3.6821, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -15.14% (54.1659 => 45.9677, std. dev.: 0.0293) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.50% (2.9384 => 2.5416, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: -12.42% (22.1758 => 19.4207, std. dev.: 0.0402) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.00% (0.0400 => 0.0208, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.65% (1.6925 => 1.4276, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std. dev.: 0.0280) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8072, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (4.8142 => 4.6141, std. dev.: 0.0013) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4675, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.6802 => 8.4294, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9998, std. dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9639, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -1.44% (12.5348 => 12.3543, std. dev.: 0.0307) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.19% (19.9488 => 19.7123, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8128, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2894, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 02:08:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 04:08:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814090837.8476A352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2879?compare_to=2876&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2879, Order: 161855, Start Time: 2012-08-14 07:55:33, End Time: 2012-08-14 09:09:20 To: 2876, Order: 161854, Start Time: 2012-08-14 06:10:26, End Time: 2012-08-14 07:26:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (150 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 4.06% (1.3679 => 1.4234, std. dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.75% (55.5654 => 56.5375, std. dev.: 0.0941) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.24% (2.0176 => 2.3050, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.59% (0.5818 => 0.6318, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5748 => 0.6235, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.97% (0.3578 => 0.3863, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3601 => 0.3881, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.73% (0.3789 => 0.4082, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7061 => 0.7607, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-3: 7.67% (0.3623 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3663 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.59% (0.3650 => 0.3927, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 7.59% (0.3914 => 0.4211, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.53% (0.7038 => 0.7568, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.46% (0.3940 => 0.4234, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.43% (3.9660 => 4.2608, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.39% (0.5265 => 0.5654, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.35% (0.7710 => 0.8277, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 7.26% (1.3693 => 1.4687, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.09% (0.2596 => 0.2780, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.62% (0.9199 => 0.9808, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.61% (1.2193 => 1.2999, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4328 => 0.4611, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.49% (0.4379 => 0.4663, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.47% (0.6959 => 0.7409, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.19% (0.3246 => 0.3447, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.5577 => 0.5903, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.83% (0.2127 => 0.2251, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.3899 => 0.4125, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.77% (13.8202 => 14.6173, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.61% (0.3580 => 0.3781, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.46% (0.2914 => 0.3073, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.44% (0.2023 => 0.2133, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.42% (1.1364 => 1.1980, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.42% (0.1865 => 0.1966, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.41% (1.4563 => 1.5351, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.41% (1.9828 => 2.0900, std. dev.: 0.0119) MultiSource/Benchmarks/McCat/09-vor/vor: 5.40% (0.2925 => 0.3083, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.39% (0.2726 => 0.2873, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.39% (0.2765 => 0.2914, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.34% (0.5637 => 0.5938, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.32% (7.2180 => 7.6020, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.20% (1.3245 => 1.3934, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.8310 => 0.8739, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (1.3819 => 1.4520, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.07% (1.3813 => 1.4513, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.4390 => 0.4612, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 5.01% (3.8646 => 4.0584, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 4.94% (1.1061 => 1.1607, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.84% (1.0594 => 1.1107, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.78% (0.7506 => 0.7865, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.75% (1.9270 => 2.0185, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.69% (0.7460 => 0.7810, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.63% (2.1791 => 2.2800, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.50% (0.2243 => 0.2344, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.35% (0.3220 => 0.3360, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.29% (16.6129 => 17.3259, std. dev.: 0.0253) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.27% (4.3801 => 4.5670, std. dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: 4.26% (1.2292 => 1.2816, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.23% (4.4433 => 4.6311, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (13.2842 => 13.8436, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.17% (3.6692 => 3.8223, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.07% (0.6135 => 0.6385, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.07% (0.4791 => 0.4986, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (1.1333 => 1.1792, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.90% (0.3131 => 0.3253, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.9865 => 5.1785, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.6283 => 0.6505, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.53% (3.1889 => 3.3014, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.35% (0.8698 => 0.8989, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.34% (16.2614 => 16.8052, std. dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (8.4961 => 8.7775, std. dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 3.24% (14.8535 => 15.3342, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.19% (3.2742 => 3.3787, std. dev.: 0.0183) MultiSource/Benchmarks/McCat/05-eks/eks: 3.19% (0.4113 => 0.4244, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 3.18% (6.5754 => 6.7845, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.93% (14.5298 => 14.9560, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (1.5188 => 1.5618, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.1007 => 2.1541, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.50% (4.6629 => 4.7795, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 2.05% (1.0313 => 1.0524, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.94% (0.6744 => 0.6875, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.6250 => 0.6359, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.55% (3.7467 => 3.8048, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.28% (6.2785 => 6.3586, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.13% (33.2944 => 33.6714, std. dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std. dev.: 0.0324) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.51% (1.2998 => 1.4234, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7422, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8174, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3854, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5985, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.99% (10.7476 => 10.9616, std. dev.: 0.0486) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std. dev.: 0.0070) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.45% (1.4298 => 1.4506, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.12% (4.5928 => 4.6442, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6856, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 1.04% (5.5130 => 5.5704, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.95% (22.5627 => 21.2206, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.87% (1.0460 => 0.8486, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.92% (1.3780 => 1.3102, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.52% (1.1560 => 1.1037, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.62% (0.4867 => 0.4691, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.61% (20.3410 => 19.8111, std. dev.: 0.0442) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6014, std. dev.: 0.0158) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2295, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.94% (0.8342 => 0.8180, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2293, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3764, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8025, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8982, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 03:04:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 05:04:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814100406.8211D352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2880?compare_to=2878&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2880, Order: 161859, Start Time: 2012-08-14 08:45:49, End Time: 2012-08-14 10:04:48 To: 2878, Order: 161854, Start Time: 2012-08-14 06:56:07, End Time: 2012-08-14 08:17:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (78 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.08% (0.5375 => 0.5487, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.38% (10.3673 => 13.8280, std. dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.03% (1.7609 => 1.8847, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.99% (2.2022 => 2.3561, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 5.46% (0.6030 => 0.6359, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.43% (0.5925 => 0.6247, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.07% (10.4361 => 10.9647, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.55% (0.4879 => 0.5101, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (7.0540 => 7.3748, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.53% (0.4615 => 0.4824, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.49% (0.7326 => 0.7655, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.8172 => 0.8510, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 4.11% (0.3282 => 0.3417, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.7433 => 0.7734, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (9.4845 => 9.8514, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.9449 => 5.1251, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.46% (4.2646 => 4.4123, std. dev.: 0.0135) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.46% (5.0018 => 5.1747, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.45% (0.5569 => 0.5761, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.24% (1.3050 => 1.3473, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (8.1363 => 8.3842, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.85% (0.9765 => 1.0043, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (1.5415 => 1.5850, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.1861 => 1.2186, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.72% (5.7591 => 5.9156, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.71% (0.4103 => 0.4214, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.62% (3.3354 => 3.4227, std. dev.: 0.0135) MultiSource/Applications/Burg/burg: 2.58% (1.1642 => 1.1942, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5105 => 0.5230, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.42% (0.8067 => 0.8262, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 2.23% (2.0273 => 2.0725, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 2.12% (1.5603 => 1.5934, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.02% (17.1811 => 17.5277, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5981 => 0.6100, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.93% (3.8723 => 3.9472, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/football/football: 1.92% (0.8921 => 0.9092, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.88% (14.3668 => 14.6375, std. dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6456 => 0.6577, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (0.6675 => 0.6800, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.84% (2.0665 => 2.1046, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.77% (1.5859 => 1.6139, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.4186 => 1.4427, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.58% (2.2969 => 2.3333, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.52% (1.2842 => 1.3037, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.46% (2.2024 => 2.2345, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.25% (1.1840 => 1.1988, std. dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (4.2280 => 4.4296, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7564, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.09% (26.0924 => 26.6387, std. dev.: 0.0161) MultiSource/Applications/minisat/minisat: 1.63% (9.1159 => 9.2646, std. dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 1.53% (11.6436 => 11.8221, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.40% (5.2636 => 5.3371, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1578 => 3.1994, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.27% (3.2827 => 3.3244, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1582, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.63% (5.3855 => 3.6823, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.21% (5.3526 => 3.6818, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0496, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5415, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -12.22% (22.1758 => 19.4655, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.06% (3.8922 => 3.8511, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -7.95% (1.5373 => 1.4151, std. dev.: 0.0183) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8068, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4677, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4172, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0035, std. dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (8.1563 => 7.9663, std. dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5081, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3369, std. dev.: 0.0075) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8129, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.02% (2.3135 => 2.2898, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 03:50:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 05:50:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814105033.A0F4B352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2881?compare_to=2879&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2881, Order: 161861, Start Time: 2012-08-14 09:37:26, End Time: 2012-08-14 10:51:18 To: 2879, Order: 161855, Start Time: 2012-08-14 07:55:33, End Time: 2012-08-14 09:09:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.02% (78.9155 => 80.5107, std. dev.: 0.3874) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.11% (2.0176 => 2.3023, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.5818 => 0.6328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5748 => 0.6234, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3578 => 0.3860, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.76% (0.7061 => 0.7609, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.73% (1.3693 => 1.4752, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3601 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3663 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3623 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.56% (0.3650 => 0.3926, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 7.47% (0.7038 => 0.7564, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.43% (3.9660 => 4.2605, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.4328 => 0.4643, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.7710 => 0.8261, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.5265 => 0.5635, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.98% (0.2781 => 0.2975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.97% (0.2782 => 0.2976, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.34% (1.2193 => 1.2966, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.31% (0.9199 => 0.9779, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.29% (0.2655 => 0.2822, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.27% (0.2966 => 0.3152, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4379 => 0.4653, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2628 => 0.2792, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.24% (0.6959 => 0.7393, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.2937 => 0.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.06% (0.3580 => 0.3797, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.03% (1.9828 => 2.1024, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.01% (0.2696 => 0.2858, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.94% (0.2726 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.94% (0.3485 => 0.3692, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3107 => 0.3291, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.87% (0.3149 => 0.3334, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3192 => 0.3375, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.53% (0.3453 => 0.3644, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.5577 => 0.5885, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.44% (0.4390 => 0.4629, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.34% (13.8202 => 14.5582, std. dev.: 0.0242) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.1364 => 1.1962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.25% (0.3293 => 0.3466, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.3756 => 0.3953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.20% (0.3868 => 0.4069, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.18% (1.4563 => 1.5318, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3534 => 0.3717, std. dev.: 0.0061) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.15% (0.4016 => 0.4223, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.5637 => 0.5925, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.06% (7.2180 => 7.5834, std. dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.97% (0.8310 => 0.8723, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.85% (3.8646 => 4.0519, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.83% (1.3245 => 1.3885, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.80% (1.1061 => 1.1592, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.3813 => 1.4465, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.66% (0.7460 => 0.7808, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.65% (0.7506 => 0.7855, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2292 => 1.2863, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.3819 => 1.4458, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.55% (1.0594 => 1.1076, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.45% (1.9270 => 2.0127, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.30% (2.1791 => 2.2728, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 4.20% (16.6129 => 17.3107, std. dev.: 0.0149) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (4.4433 => 4.6222, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.3801 => 4.5558, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.99% (0.3755 => 0.3905, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (3.6692 => 3.8155, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.90% (0.6135 => 0.6374, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.89% (1.1333 => 1.1774, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.85% (13.2842 => 13.7961, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.70% (0.3131 => 0.3247, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (4.9865 => 5.1656, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.8698 => 0.9002, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.29% (0.6283 => 0.6490, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.17% (3.1889 => 3.2900, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (8.4961 => 8.7640, std. dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 3.14% (16.2614 => 16.7723, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (6.5754 => 6.7737, std. dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 2.95% (14.8535 => 15.2915, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.90% (3.2742 => 3.3693, std. dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.5298 => 14.9404, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (1.5188 => 1.5601, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.56% (4.6629 => 4.7825, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.1007 => 2.1521, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.89% (0.6250 => 0.6368, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.78% (1.0313 => 1.0497, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.76% (0.6744 => 0.6863, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.39% (3.7467 => 3.7986, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3508, std. dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 1.13% (33.2944 => 33.6707, std. dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2689, std. dev.: 0.0460) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.76% (1.2998 => 1.4137, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7420, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8170, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3841, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5990, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.99% (10.7476 => 10.9617, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3256, std. dev.: 0.0077) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6423, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.31% (0.4657 => 0.3944, std. dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.04% (22.5627 => 21.2009, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3079, std. dev.: 0.0087) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8059, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5866, std. dev.: 0.0198) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.64% (20.3410 => 19.8039, std. dev.: 0.0397) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9624, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2242, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.91% (0.8342 => 0.8183, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3305 => 7.2275, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std. dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3761, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8023, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8993, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 03:52:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 05:52:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120814105229.BDF7C352404C@llvm.org> http://llvm.org/perf/db_default/v4/nts/2882?compare_to=2877&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2882, Order: 161857, Start Time: 2012-08-14 08:09:42, End Time: 2012-08-14 10:53:14 To: 2877, Order: 161831, Start Time: 2012-08-14 04:55:38, End Time: 2012-08-14 07:41:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (91 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (787 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.61% (0.2128 => 0.2290, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 1.34% (2.7824 => 2.8197, std. dev.: 0.0095) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3496 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.12% (0.3465 => 0.3885, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.10% (0.3488 => 0.3910, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3446 => 0.3862, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.03% (0.3442 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.02% (0.3460 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3469 => 0.3881, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.62% (0.3650 => 0.4074, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 11.58% (0.3643 => 0.4065, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 6.20% (0.5826 => 0.6187, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.89% (1.5932 => 1.6871, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 5.88% (0.5889 => 0.6235, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.52% (1.6211 => 1.7106, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (3.5627 => 3.7589, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.28% (1.3152 => 1.3847, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.16% (0.5000 => 0.5258, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.97% (0.2014 => 0.2114, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (0.4994 => 0.5240, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 4.75% (4.2109 => 4.4108, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.66% (0.5900 => 0.6175, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 4.60% (1.0781 => 1.1277, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.50% (0.7171 => 0.7494, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.33% (0.2866 => 0.2990, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.22% (2.7292 => 2.8443, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.92% (5.5417 => 5.7590, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 3.79% (2.1013 => 2.1810, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (1.9694 => 2.0431, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (0.4658 => 0.4831, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.62% (0.2875 => 0.2979, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (0.3195 => 0.3310, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0671, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 3.46% (0.9909 => 1.0252, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.44% (4.6177 => 4.7766, std. dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 3.37% (2.1653 => 2.2382, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.35% (23.5202 => 24.3093, std. dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (4.4195 => 4.5675, std. dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (1.8794 => 1.9420, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.26% (2.0673 => 2.1347, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.26% (0.6634 => 0.6850, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.3362 => 0.3471, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.23% (0.3096 => 0.3196, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.18% (0.3903 => 0.4027, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.12% (0.3267 => 0.3369, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.11% (0.4146 => 0.4275, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.10% (0.7875 => 0.8119, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 3.07% (0.3258 => 0.3358, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.04% (0.9697 => 0.9992, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3726 => 0.3839, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.01% (1.4269 => 1.4698, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.4139 => 0.4258, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (0.3625 => 0.3728, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4251 => 0.4367, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 2.70% (0.5546 => 0.5696, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.53% (2.0346 => 2.0860, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.6435 => 0.6580, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.5012 => 0.5119, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0293, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.2122 => 0.2290, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.94% (1.8057 => 1.8949, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1739, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6461, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6516, std. dev.: 0.0576) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1963, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (41.7953 => 42.6086, std. dev.: 0.0244) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5914, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9139, std. dev.: 0.0064) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3148, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2842, std. dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5111, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.17% (11.9555 => 11.8154, std. dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5686, std. dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8028, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.54% (0.2402 => 0.2269, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7981, std. dev.: 0.0028) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -2.94% (17.2379 => 16.7314, std. dev.: 0.0606) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.81% (0.6293 => 0.6116, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5777, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9569, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 04:51:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 06:51:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814115128.9F2742A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2883?compare_to=2880&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2883, Order: 161861, Start Time: 2012-08-14 10:33:05, End Time: 2012-08-14 11:52:12 To: 2880, Order: 161859, Start Time: 2012-08-14 08:45:49, End Time: 2012-08-14 10:04:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (78 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.45% (55.0830 => 56.4342, std. dev.: 0.1269) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.37% (10.3673 => 13.9304, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.39% (1.1194 => 1.2469, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 11.23% (0.3473 => 0.3863, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std. dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.89% (0.3543 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.32% (2.2022 => 2.3634, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.85% (1.7609 => 1.8816, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.71% (0.2065 => 0.2183, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.33% (0.5925 => 0.6241, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.30% (10.4361 => 10.9892, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 5.29% (0.6030 => 0.6349, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 4.71% (0.7326 => 0.7671, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.57% (0.4615 => 0.4826, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.44% (7.0540 => 7.3672, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/oourafft: 4.36% (0.3282 => 0.3425, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.06% (0.8172 => 0.8504, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 4.01% (0.7433 => 0.7731, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 3.66% (9.4845 => 9.8319, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.52% (4.9449 => 5.1190, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (5.0018 => 5.1711, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (4.2646 => 4.4079, std. dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5569 => 0.5753, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.05% (8.1363 => 8.3844, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 2.92% (0.7835 => 0.8064, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.71% (0.9765 => 1.0030, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.1861 => 1.2182, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.66% (5.7591 => 5.9121, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.58% (1.1642 => 1.1942, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.46% (0.4103 => 0.4204, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.44% (0.8067 => 0.8264, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.41% (1.5415 => 1.5787, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.31% (3.3354 => 3.4123, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.22% (2.0273 => 2.0724, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.13% (1.5603 => 1.5936, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.09% (3.8723 => 3.9533, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.97% (0.5981 => 0.6099, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.90% (1.5859 => 1.6160, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 1.86% (0.8921 => 0.9087, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.86% (0.6675 => 0.6799, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (14.3668 => 14.6247, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4436, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.75% (0.6456 => 0.6569, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.66% (17.1811 => 17.4658, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.63% (2.0665 => 2.1002, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.60% (2.2969 => 2.3337, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 1.47% (1.2842 => 1.3031, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (2.2024 => 2.2332, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (4.2280 => 4.4227, std. dev.: 0.0170) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7587, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.10% (26.0924 => 26.6398, std. dev.: 0.0200) MultiSource/Applications/minisat/minisat: 1.56% (9.1159 => 9.2582, std. dev.: 0.0166) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8226, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (5.2636 => 5.3382, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.31% (1.3045 => 1.3216, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 1.27% (3.2827 => 3.3244, std. dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5769, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1236, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.25% (5.2763 => 3.1528, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.57% (5.3855 => 3.6853, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.23% (5.3526 => 3.6812, std. dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9977, std. dev.: 0.0267) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.51% (2.9384 => 2.5414, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -12.38% (22.1758 => 19.4295, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4206, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -8.54% (1.5373 => 1.4060, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8069, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6146, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4719, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4196, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0138, std. dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9600, std. dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5081, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3464, std. dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8130, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.06% (1.7254 => 1.7071, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.3135 => 2.2897, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.02% (19.9488 => 19.7450, std. dev.: 0.0611) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 07:03:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 09:03:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120814140340.1F44D2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2884?compare_to=2882&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2884, Order: 161861, Start Time: 2012-08-14 11:21:09, End Time: 2012-08-14 14:04:24 To: 2882, Order: 161857, Start Time: 2012-08-14 08:09:42, End Time: 2012-08-14 10:53:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (83 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (795 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.78% (125.5203 => 129.0137, std. dev.: 0.6471) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3496 => 0.3918, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3446 => 0.3860, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 12.01% (0.3465 => 0.3881, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3460 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.93% (0.3488 => 0.3904, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3442 => 0.3851, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3469 => 0.3879, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3643 => 0.4061, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.40% (0.3650 => 0.4066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.12% (0.3724 => 0.4138, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.37% (0.5826 => 0.6197, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.36% (0.2014 => 0.2142, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.18% (0.5889 => 0.6253, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.96% (1.5932 => 1.6882, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.59% (3.5627 => 3.7620, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.58% (1.6211 => 1.7116, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (1.3152 => 1.3858, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.37% (0.4361 => 0.4595, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.91% (0.4994 => 0.5239, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 4.88% (4.2109 => 4.4165, std. dev.: 0.0108) MultiSource/Applications/spiff/spiff: 4.82% (0.4029 => 0.4223, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.77% (1.0781 => 1.1295, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.72% (0.5026 => 0.5263, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.70% (0.5000 => 0.5235, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 4.70% (0.7171 => 0.7508, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.5900 => 0.6173, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.19% (2.7292 => 2.8435, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.2866 => 0.2985, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (1.9694 => 2.0461, std. dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (2.1013 => 2.1829, std. dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 3.88% (5.5417 => 5.7565, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.80% (0.3890 => 0.4038, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (4.4195 => 4.5832, std. dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 3.67% (4.6177 => 4.7870, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (0.4658 => 0.4823, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.54% (1.9966 => 2.0672, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.53% (2.1653 => 2.2417, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.3903 => 0.4037, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3195 => 0.3302, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.31% (1.8794 => 1.9417, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.3362 => 0.3471, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.15% (0.6634 => 0.6843, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.14% (0.7875 => 0.8122, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.09% (0.9909 => 1.0215, std. dev.: 0.0086) MultiSource/Applications/lua/lua: 3.06% (1.4269 => 1.4705, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.98% (0.3792 => 0.3905, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (2.0673 => 2.1267, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.4139 => 0.4256, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.78% (0.5546 => 0.5700, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 2.73% (0.9697 => 0.9962, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4146 => 0.4258, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 2.69% (23.5202 => 24.1521, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4251 => 0.4359, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.29% (2.0346 => 2.0811, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.6435 => 0.6575, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.16% (0.2122 => 0.2274, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6744, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8923, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6389, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6796, std. dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2075, std. dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.84% (41.7953 => 42.5662, std. dev.: 0.0413) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9080, std. dev.: 0.0213) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2225, std. dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.21% (11.9555 => 11.8106, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5835, std. dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9779, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7983, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: -5.29% (0.2402 => 0.2275, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8109, std. dev.: 0.0084) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7877, std. dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5741, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9654, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 08:00:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 10:00:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814150007.5A65D2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2885?compare_to=2881&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2885, Order: 161863, Start Time: 2012-08-14 13:47:06, End Time: 2012-08-14 15:00:48 To: 2881, Order: 161861, Start Time: 2012-08-14 09:37:26, End Time: 2012-08-14 10:51:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (149 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.29% (7.9568 => 8.0597, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.04% (1.4777 => 1.4930, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.43% (2.0176 => 2.3088, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 12.23% (0.0826 => 0.0927, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.5818 => 0.6328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5748 => 0.6240, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (0.1413 => 0.1525, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.83% (0.7061 => 0.7614, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3578 => 0.3858, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.69% (0.3914 => 0.4215, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.60% (0.3646 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.58% (0.3601 => 0.3874, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3789 => 0.4075, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3623 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.51% (0.3663 => 0.3938, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.49% (0.7038 => 0.7565, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.46% (3.9660 => 4.2618, std. dev.: 0.0121) MultiSource/Applications/hbd/hbd: 7.43% (1.3693 => 1.4711, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.31% (0.5265 => 0.5650, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.08% (0.7710 => 0.8256, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.51% (1.2193 => 1.2987, std. dev.: 0.0091) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.42% (0.9199 => 0.9790, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.42% (0.6959 => 0.7406, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.21% (0.4379 => 0.4651, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.14% (0.2607 => 0.2767, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.12% (0.3022 => 0.3207, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3580 => 0.3799, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.10% (0.3899 => 0.4137, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2690 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.99% (0.2937 => 0.3113, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.95% (0.3246 => 0.3439, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2760 => 0.2924, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.88% (0.3489 => 0.3694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.2966 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2696 => 0.2852, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.77% (0.3485 => 0.3686, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.75% (1.9828 => 2.0969, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.70% (0.3192 => 0.3374, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.68% (0.5577 => 0.5894, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.67% (13.8202 => 14.6040, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.65% (0.3149 => 0.3327, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2127 => 0.2247, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.52% (1.4563 => 1.5367, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2988 => 0.3151, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.38% (0.4390 => 0.4626, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.37% (1.1364 => 1.1974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.3453 => 0.3636, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.29% (0.2023 => 0.2130, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 5.26% (0.2925 => 0.3079, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.3813 => 1.4535, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.18% (0.5637 => 0.5929, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.17% (7.2180 => 7.5913, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.15% (1.3819 => 1.4530, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.10% (0.4016 => 0.4221, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.08% (0.8310 => 0.8732, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 5.04% (0.3868 => 0.4063, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.04% (0.3534 => 0.3712, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (1.3245 => 1.3905, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.94% (1.0594 => 1.1117, std. dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: 4.93% (3.8646 => 4.0552, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 4.93% (1.1061 => 1.1606, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.77% (0.7460 => 0.7816, std. dev.: 0.0050) MultiSource/Applications/treecc/treecc: 4.72% (1.9270 => 2.0180, std. dev.: 0.0124) MultiSource/Applications/spiff/spiff: 4.70% (0.7506 => 0.7859, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.60% (1.2292 => 1.2857, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.42% (2.1791 => 2.2754, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.32% (16.6129 => 17.3310, std. dev.: 0.0081) MultiSource/Benchmarks/McCat/18-imp/imp: 4.32% (0.3220 => 0.3359, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.3801 => 4.5638, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (4.4433 => 4.6281, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.11% (0.4791 => 0.4988, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.09% (13.2842 => 13.8272, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (3.6692 => 3.8190, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.05% (0.3755 => 0.3907, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.97% (1.1333 => 1.1783, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.93% (0.6135 => 0.6376, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.92% (4.9865 => 5.1821, std. dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 3.70% (0.3131 => 0.3247, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.68% (0.6283 => 0.6514, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.8698 => 0.9002, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.47% (3.1889 => 3.2995, std. dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 3.31% (16.2614 => 16.7991, std. dev.: 0.0238) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (8.4961 => 8.7743, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 3.11% (14.8535 => 15.3150, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.11% (3.2742 => 3.3759, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (6.5754 => 6.7733, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5188 => 1.5640, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.91% (14.5298 => 14.9532, std. dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 2.78% (4.6629 => 4.7927, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.76% (2.1007 => 2.1586, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.10% (0.6250 => 0.6381, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.07% (1.0313 => 1.0526, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.89% (0.9108 => 0.9280, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.84% (0.6744 => 0.6868, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.55% (3.7467 => 3.8048, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 1.22% (33.2944 => 33.7016, std. dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3506, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std. dev.: 0.0486) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.73% (1.2998 => 1.4133, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.34% (11.2619 => 11.7511, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5994, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.06% (10.7476 => 10.9689, std. dev.: 0.0522) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2066, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5745, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6414, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.40% (0.4657 => 0.3940, std. dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.70% (22.5627 => 21.2758, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8060, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5858, std. dev.: 0.0174) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.65% (20.3410 => 19.8027, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9636, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2279, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2307, std. dev.: 0.0228) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0149) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3825, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8016, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.8999, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2342, std. dev.: 0.0227) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 08:05:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 10:05:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814150541.B5CDD2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2886?compare_to=2883&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2886, Order: 161863, Start Time: 2012-08-14 13:47:24, End Time: 2012-08-14 15:06:26 To: 2883, Order: 161861, Start Time: 2012-08-14 10:33:05, End Time: 2012-08-14 11:52:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (78 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.13% (1.4060 => 1.4360, std. dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.91% (10.3673 => 13.8824, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.41% (1.1194 => 1.2471, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 11.20% (0.3473 => 0.3862, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 11.01% (0.3497 => 0.3882, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std. dev.: 0.0085) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.08% (1.7609 => 1.8856, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (2.2022 => 2.3572, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.23% (0.5925 => 0.6235, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.09% (0.6030 => 0.6337, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (10.4361 => 10.9548, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.53% (7.0540 => 7.3732, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.49% (0.4615 => 0.4822, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.35% (0.4879 => 0.5091, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 4.14% (0.3282 => 0.3418, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.12% (0.7326 => 0.7628, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.11% (0.5860 => 0.6101, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 3.97% (0.7433 => 0.7728, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 3.67% (9.4845 => 9.8326, std. dev.: 0.0155) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.62% (0.8172 => 0.8468, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (5.0018 => 5.1792, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (4.9449 => 5.1194, std. dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (4.2646 => 4.4064, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.3050 => 1.3475, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.15% (8.1363 => 8.3923, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.81% (0.7835 => 0.8055, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.5415 => 1.5845, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.9765 => 1.0033, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.58% (0.4103 => 0.4209, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.52% (5.7591 => 5.9045, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4196, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 2.49% (1.1642 => 1.1932, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 2.26% (2.0273 => 2.0732, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.18% (1.5603 => 1.5943, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8921 => 0.9111, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5105 => 0.5213, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.03% (0.6450 => 0.6581, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4462, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 1.92% (3.8723 => 3.9468, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 1.88% (17.1811 => 17.5034, std. dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.79% (1.5859 => 1.6143, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.79% (14.3668 => 14.6234, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6675 => 0.6788, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.63% (0.6456 => 0.6561, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.52% (2.2969 => 2.3318, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.49% (2.0665 => 2.0973, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (2.2024 => 2.2323, std. dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2842 => 1.3010, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.12% (1.1840 => 1.1973, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (4.2280 => 4.4428, std. dev.: 0.0112) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7498, std. dev.: 0.0045) MultiSource/Applications/lua/lua: 2.10% (26.0924 => 26.6398, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: 1.63% (9.1159 => 9.2643, std. dev.: 0.0137) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.35% (5.2636 => 5.3344, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1998, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.31% (3.2827 => 3.3258, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5771, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.51% (0.8651 => 0.1686, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.09% (5.2763 => 3.1608, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.61% (5.3855 => 3.6829, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.28% (5.3526 => 3.6781, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0507, std. dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.56% (2.9384 => 2.5400, std. dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: -12.32% (22.1758 => 19.4445, std. dev.: 0.0314) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (3.8922 => 3.8466, std. dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -6.59% (1.5373 => 1.4360, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std. dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8068, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4631, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4265, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -2.88% (10.2830 => 9.9868, std. dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9617, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3468, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.02% (2.3135 => 2.2899, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 09:41:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 11:41:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814164155.1806E2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2887?compare_to=2885&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2887, Order: 161872, Start Time: 2012-08-14 15:28:59, End Time: 2012-08-14 16:42:37 To: 2885, Order: 161863, Start Time: 2012-08-14 13:47:06, End Time: 2012-08-14 15:00:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (144 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.82% (2.0969 => 2.1350, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 1.79% (1.4711 => 1.4975, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.21% (1.2857 => 1.3013, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.55% (0.5325 => 0.5461, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.07% (1.4930 => 1.4770, std. dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.99% (2.0176 => 2.2998, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 9.36% (1.3693 => 1.4975, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2781 => 0.3030, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.5818 => 0.6334, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5748 => 0.6238, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.52% (0.2782 => 0.3019, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.34% (0.4328 => 0.4689, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.25% (0.2607 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.17% (0.2937 => 0.3177, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.14% (0.2655 => 0.2871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2628 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 8.03% (0.2690 => 0.2906, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.97% (0.2760 => 0.2980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.93% (0.7061 => 0.7621, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3022 => 0.3260, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.85% (0.2765 => 0.2982, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.82% (0.2966 => 0.3198, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2726 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2761 => 0.2976, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.72% (0.3149 => 0.3392, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.72% (0.2696 => 0.2904, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.70% (0.7038 => 0.7580, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.68% (1.9828 => 2.1350, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.66% (0.3107 => 0.3345, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.64% (0.3192 => 0.3436, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.46% (0.2988 => 0.3211, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3580 => 0.3845, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.39% (0.3899 => 0.4187, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.32% (0.3578 => 0.3840, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.16% (0.3601 => 0.3859, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.10% (0.3453 => 0.3698, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.03% (3.9660 => 4.2448, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3914 => 0.4189, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.01% (0.3650 => 0.3906, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.97% (0.4003 => 0.4282, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.93% (0.7710 => 0.8244, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 6.90% (0.3940 => 0.4212, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3534 => 0.3775, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.58% (0.4390 => 0.4679, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.58% (0.3756 => 0.4003, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.52% (0.2945 => 0.3137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.47% (0.4016 => 0.4276, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.46% (0.3868 => 0.4118, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.21% (0.9199 => 0.9770, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.19% (1.2193 => 1.2948, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.16% (0.6959 => 0.7388, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.87% (1.2292 => 1.3013, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.72% (0.5577 => 0.5896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.54% (0.3755 => 0.3963, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.19% (13.8202 => 14.5379, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.12% (1.4563 => 1.5308, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.94% (1.1364 => 1.1925, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.83% (3.8646 => 4.0511, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.81% (7.2180 => 7.5650, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 4.75% (0.8310 => 0.8705, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.75% (1.3245 => 1.3874, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.61% (1.1061 => 1.1571, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4434, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (1.3819 => 1.4434, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.45% (0.7506 => 0.7840, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.0594 => 1.1060, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.38% (0.7460 => 0.7787, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0113, std. dev.: 0.0129) MultiSource/Applications/kimwitu++/kc: 4.25% (16.6129 => 17.3189, std. dev.: 0.0081) MultiSource/Applications/siod/siod: 4.17% (2.1791 => 2.2699, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.06% (0.8698 => 0.9051, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.3801 => 4.5501, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6149, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.86% (0.4791 => 0.4976, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (13.2842 => 13.7882, std. dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.74% (3.6692 => 3.8064, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.67% (0.6135 => 0.6360, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (4.9865 => 5.1676, std. dev.: 0.0127) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1333 => 1.1737, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6283 => 0.6491, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.09% (3.1889 => 3.2875, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.04% (16.2614 => 16.7559, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 2.86% (8.4961 => 8.7390, std. dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/bigfib: 2.82% (0.6250 => 0.6426, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.76% (14.8535 => 15.2640, std. dev.: 0.0214) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7563, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.73% (3.2742 => 3.3635, std. dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9096, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5567, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.29% (4.6629 => 4.7695, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.24% (2.1007 => 2.1477, std. dev.: 0.0171) MultiSource/Applications/lemon/lemon: 1.74% (1.0313 => 1.0492, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.66% (0.9108 => 0.9259, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.56% (0.6744 => 0.6849, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.17% (3.7467 => 3.7907, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5202, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 8.09% (1.2998 => 1.4049, std. dev.: 0.0204) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.02% (1.5824 => 1.6618, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7413, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (2.8606 => 2.9627, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8152, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3833, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.5999, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.01% (10.7476 => 10.9635, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5738, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.03% (4.5928 => 4.6399, std. dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.63% (0.4657 => 0.3929, std. dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.09% (22.5627 => 21.1894, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.99% (0.2670 => 0.2510, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.22% (0.3511 => 0.3398, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.52% (1.1560 => 1.1037, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8059, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0219, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5822, std. dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.52% (20.3410 => 19.8289, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9617, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2288, std. dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2300, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std. dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3829, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8019, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.8994, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 09:53:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 11:53:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814165307.3F0BB2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2888?compare_to=2886&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2888, Order: 161872, Start Time: 2012-08-14 15:34:53, End Time: 2012-08-14 16:53:49 To: 2886, Order: 161863, Start Time: 2012-08-14 13:47:24, End Time: 2012-08-14 15:06:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (85 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.11% (10.3673 => 14.0070, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.33% (1.1194 => 1.2462, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3543 => 0.3912, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.13% (0.3516 => 0.3872, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.11% (0.3561 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.85% (0.3694 => 0.4058, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.51% (0.3828 => 0.4192, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.32% (0.3927 => 0.4293, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.29% (0.3886 => 0.4247, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.50% (2.2022 => 2.3673, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.64% (1.7609 => 1.8778, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.2065 => 0.2187, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.32% (0.3177 => 0.3346, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 5.28% (0.5925 => 0.6238, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.21% (0.6030 => 0.6344, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (7.0540 => 7.3795, std. dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 4.47% (10.4361 => 10.9025, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 4.42% (0.7326 => 0.7650, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.38% (0.4615 => 0.4817, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.4879 => 0.5092, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.8172 => 0.8528, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.7433 => 0.7739, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (4.9449 => 5.1193, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.52% (9.4845 => 9.8182, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.35% (5.0018 => 5.1696, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.33% (4.2646 => 4.4068, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5569 => 0.5754, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.16% (0.5860 => 0.6045, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.4103 => 0.4231, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.02% (8.1363 => 8.3818, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.3050 => 1.3428, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.78% (0.8067 => 0.8291, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 2.68% (0.7835 => 0.8045, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.61% (1.5603 => 1.6011, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9765 => 1.0019, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.59% (1.1861 => 1.2168, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.55% (5.7591 => 5.9062, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.50% (2.0665 => 2.1182, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.44% (1.1642 => 1.1926, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5415 => 1.5785, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.37% (0.4636 => 0.4746, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.31% (3.3354 => 3.4124, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.29% (2.0273 => 2.0737, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (0.4620 => 0.4724, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.20% (0.6450 => 0.6592, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6456 => 0.6595, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.98% (0.5105 => 0.5206, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (1.5859 => 1.6166, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 1.92% (1.2842 => 1.3089, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (14.3668 => 14.6336, std. dev.: 0.0100) MultiSource/Applications/lua/lua: 1.83% (3.8723 => 3.9431, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 1.83% (0.8921 => 0.9084, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5981 => 0.6089, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6675 => 0.6788, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.66% (1.4186 => 1.4422, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.65% (2.2969 => 2.3347, std. dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 1.64% (17.1811 => 17.4636, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.37% (2.2024 => 2.2326, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.17% (1.1840 => 1.1978, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (4.2280 => 4.4432, std. dev.: 0.0131) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7552, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.13% (26.0924 => 26.6492, std. dev.: 0.0207) MultiSource/Applications/minisat/minisat: 1.79% (9.1159 => 9.2789, std. dev.: 0.0219) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8228, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (1.3045 => 1.3228, std. dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 1.39% (5.2636 => 5.3369, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.34% (3.1578 => 3.2001, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.27% (3.2827 => 3.3243, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5816, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6814, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1514, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6933, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.08% (5.3526 => 3.6892, std. dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -15.05% (54.1659 => 46.0153, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5387, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -12.44% (22.1758 => 19.4175, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (3.8922 => 3.8468, std. dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -9.51% (1.5373 => 1.3911, std. dev.: 0.0288) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5570, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8070, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4684, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4284, std. dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.57% (10.2830 => 10.0188, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9573, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3414, std. dev.: 0.0072) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8127, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2895, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 10:14:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 12:14:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120814171438.73FB82A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2889?compare_to=2884&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2889, Order: 161865, Start Time: 2012-08-14 14:32:22, End Time: 2012-08-14 17:15:21 To: 2884, Order: 161861, Start Time: 2012-08-14 11:21:09, End Time: 2012-08-14 14:04:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 11.62% (0.3442 => 0.3842, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3496 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3465 => 0.3866, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.55% (0.3488 => 0.3891, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3446 => 0.3843, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: 11.47% (0.3460 => 0.3857, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.44% (0.3469 => 0.3866, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.18% (0.3650 => 0.4058, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3643 => 0.4047, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3724 => 0.4127, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.1619 => 0.1737, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5826 => 0.6188, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.99% (1.5932 => 1.6887, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 5.94% (0.5889 => 0.6239, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (1.6211 => 1.7117, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (3.5627 => 3.7560, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (1.3152 => 1.3849, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (0.4361 => 0.4585, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (0.5026 => 0.5279, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (0.3930 => 0.4120, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.80% (1.0781 => 1.1299, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.79% (4.2109 => 4.4127, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (0.4994 => 0.5230, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.67% (0.4029 => 0.4217, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.59% (0.7171 => 0.7500, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (0.5000 => 0.5228, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.46% (0.5900 => 0.6163, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.19% (2.7292 => 2.8435, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.05% (0.2866 => 0.2982, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 4.02% (0.9909 => 1.0307, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.01% (0.3195 => 0.3323, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.94% (0.2738 => 0.2846, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.88% (0.2811 => 0.2920, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.87% (0.2813 => 0.2922, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.86% (5.5417 => 5.7556, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2792 => 0.2899, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.83% (0.3004 => 0.3119, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.81% (0.2911 => 0.3022, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.3096 => 0.3214, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.80% (2.0673 => 2.1458, std. dev.: 0.0142) MultiSource/Benchmarks/mafft/pairlocalalign: 3.76% (2.1013 => 2.1804, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: 3.72% (0.2823 => 0.2928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3362 => 0.3486, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.68% (0.3124 => 0.3239, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.68% (0.3317 => 0.3439, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 3.67% (0.2803 => 0.2906, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.67% (0.4658 => 0.4829, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.59% (0.3060 => 0.3170, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3348 => 0.3468, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3258 => 0.3374, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (1.9694 => 2.0393, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3726 => 0.3857, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (2.1653 => 2.2402, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4146 => 0.4289, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.44% (0.3282 => 0.3395, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (1.9966 => 2.0650, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 3.42% (4.6177 => 4.7758, std. dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (0.3625 => 0.3749, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.38% (0.7875 => 0.8141, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (4.4195 => 4.5677, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.18% (23.5202 => 24.2692, std. dev.: 0.0138) MultiSource/Applications/siod/siod: 3.18% (0.6634 => 0.6845, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3690 => 0.3807, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.17% (1.8794 => 1.9389, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 3.16% (0.9697 => 1.0003, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.3903 => 0.4025, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.08% (0.4251 => 0.4382, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.06% (1.4269 => 1.4706, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.81% (0.3845 => 0.3953, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.70% (0.5546 => 0.5696, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (0.4139 => 0.4249, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.6435 => 0.6604, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.53% (0.5012 => 0.5139, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.34% (2.0346 => 2.0822, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.54% (0.2122 => 0.2282, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-2: 5.31% (1.8057 => 1.9016, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6671, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1721, std. dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6472, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7067, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2104, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.87% (41.7953 => 42.5783, std. dev.: 0.0379) MultiSource/Applications/lua/lua: 1.76% (50.0626 => 50.9457, std. dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (2.0820 => 2.1156, std. dev.: 0.0097) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std. dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3106, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2901, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.12% (1.0927 => 1.1049, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.13% (11.9555 => 11.8206, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5716, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7911, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.41% (0.2402 => 0.2248, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8025, std. dev.: 0.0058) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.56% (17.2379 => 16.7963, std. dev.: 0.0300) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.34% (0.6293 => 0.6146, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5747, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9591, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 11:24:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 13:24:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814182405.72AD52A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2890?compare_to=2887&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2890, Order: 161876, Start Time: 2012-08-14 17:10:52, End Time: 2012-08-14 18:24:40 To: 2887, Order: 161872, Start Time: 2012-08-14 15:28:59, End Time: 2012-08-14 16:42:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.47% (1.4049 => 1.4256, std. dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.94% (2.0176 => 2.2989, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 9.39% (1.3693 => 1.4979, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 9.03% (0.2781 => 0.3032, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.89% (0.5818 => 0.6335, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 8.63% (0.5748 => 0.6244, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.63% (0.2782 => 0.3022, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.43% (0.4328 => 0.4693, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2607 => 0.2825, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.29% (0.2690 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.26% (0.2966 => 0.3211, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.21% (0.2655 => 0.2873, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2628 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.17% (0.2937 => 0.3177, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 8.12% (0.4062 => 0.4392, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.97% (0.2760 => 0.2980, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.90% (0.2696 => 0.2909, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.87% (0.7061 => 0.7617, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.82% (1.9828 => 2.1379, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2726 => 0.2939, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.79% (0.3107 => 0.3349, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2761 => 0.2976, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.72% (0.3899 => 0.4200, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3149 => 0.3391, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.60% (0.3580 => 0.3852, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.55% (0.3192 => 0.3433, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 7.52% (0.7038 => 0.7567, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 7.46% (0.3578 => 0.3845, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 7.43% (0.2988 => 0.3210, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3489 => 0.3748, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3453 => 0.3703, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.21% (0.3646 => 0.3909, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 7.14% (0.3601 => 0.3858, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.09% (0.7710 => 0.8257, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (3.9660 => 4.2457, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 7.05% (0.3914 => 0.4190, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 6.99% (0.4003 => 0.4283, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 6.96% (0.3623 => 0.3875, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.88% (0.5265 => 0.5627, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 6.77% (0.3293 => 0.3516, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4390 => 0.4687, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3534 => 0.3772, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.52% (0.3756 => 0.4001, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 6.51% (0.3868 => 0.4120, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.50% (0.4016 => 0.4277, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.42% (0.2945 => 0.3134, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.23% (1.2193 => 1.2953, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.13% (0.9199 => 0.9763, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.6959 => 0.7380, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.87% (1.2292 => 1.3014, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.40% (0.5577 => 0.5878, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.20% (1.4563 => 1.5321, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.12% (13.8202 => 14.5275, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.07% (0.5637 => 0.5923, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (1.1364 => 1.1931, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.92% (0.8310 => 0.8719, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.81% (7.2180 => 7.5652, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.75% (1.3245 => 1.3874, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.71% (3.8646 => 4.0466, std. dev.: 0.0114) MultiSource/Applications/Burg/burg: 4.63% (1.1061 => 1.1573, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.50% (0.7460 => 0.7796, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.47% (1.3819 => 1.4437, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.47% (1.3813 => 1.4430, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.44% (0.7506 => 0.7839, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.0594 => 1.1060, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0115, std. dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 4.22% (16.6129 => 17.3143, std. dev.: 0.0074) MultiSource/Applications/siod/siod: 4.19% (2.1791 => 2.2705, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.14% (0.8698 => 0.9058, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3220 => 0.3349, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6149, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.3801 => 4.5492, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.83% (13.2842 => 13.7924, std. dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.4791 => 0.4970, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.70% (3.6692 => 3.8050, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.68% (0.6135 => 0.6361, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.66% (4.9865 => 5.1688, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1333 => 1.1747, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.45% (0.6283 => 0.6500, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.06% (3.1889 => 3.2866, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 3.01% (16.2614 => 16.7501, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7470, std. dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: 2.88% (0.6250 => 0.6430, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2772, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.70% (3.2742 => 3.3625, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.5754 => 6.7526, std. dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4113 => 0.4222, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9102, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.5188 => 1.5574, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.24% (4.6629 => 4.7672, std. dev.: 0.0183) MultiSource/Applications/lemon/lemon: 1.72% (1.0313 => 1.0490, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.9108 => 0.9256, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.12% (3.7467 => 3.7885, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2551, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.68% (1.2998 => 1.4256, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.33% (11.2619 => 11.7492, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5937, std. dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9787, std. dev.: 0.0194) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std. dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6435, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.11% (0.4657 => 0.4000, std. dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1798, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8059, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.19% (1.3780 => 1.3202, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5818, std. dev.: 0.0157) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.73% (20.3410 => 19.7848, std. dev.: 0.0260) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9636, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2252, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.89% (0.8342 => 0.8184, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: -1.31% (7.3305 => 7.2342, std. dev.: 0.0178) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3740, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8029, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.9002, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.02% (5.5401 => 5.4838, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 11:40:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 13:40:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814184033.2EEF92A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/2891?compare_to=2888&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2891, Order: 161877, Start Time: 2012-08-14 17:22:12, End Time: 2012-08-14 18:41:12 To: 2888, Order: 161872, Start Time: 2012-08-14 15:34:53, End Time: 2012-08-14 16:53:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (79 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.30% (7.9647 => 8.0679, std. dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.02% (10.3673 => 13.9982, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2473, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.13% (0.3543 => 0.3902, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3694 => 0.4055, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3828 => 0.4199, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.45% (0.3927 => 0.4298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.32% (0.3886 => 0.4248, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.24% (0.1432 => 0.1550, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.50% (2.2022 => 2.3673, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.64% (1.7609 => 1.8779, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2065 => 0.2180, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.38% (0.3177 => 0.3348, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 5.32% (0.5925 => 0.6240, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.19% (0.6030 => 0.6343, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (7.0540 => 7.3800, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 4.53% (10.4361 => 10.9089, std. dev.: 0.0187) SingleSource/UnitTests/ObjC++/property-reference: 4.42% (0.7326 => 0.7650, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.36% (0.4615 => 0.4816, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.28% (0.4879 => 0.5088, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.75% (0.5569 => 0.5778, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.59% (0.8172 => 0.8465, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (9.4845 => 9.8176, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.50% (0.5860 => 0.6065, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (4.9449 => 5.1148, std. dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.32% (4.2646 => 4.4063, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.32% (5.0018 => 5.1677, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.8067 => 0.8331, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.4103 => 0.4231, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.10% (0.7835 => 0.8078, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.3050 => 1.3431, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.90% (8.1363 => 8.3726, std. dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1861 => 1.2181, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.64% (1.5603 => 1.6015, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.58% (2.0665 => 2.1199, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (0.9765 => 1.0015, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4636 => 0.4754, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.53% (1.1642 => 1.1936, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.5415 => 1.5801, std. dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 2.48% (5.7591 => 5.9018, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.41% (2.0273 => 2.0761, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 2.29% (3.3354 => 3.4119, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 2.17% (0.6456 => 0.6596, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.16% (1.2842 => 1.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8921 => 0.9109, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.06% (0.6450 => 0.6583, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.91% (1.5859 => 1.6162, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (14.3668 => 14.6320, std. dev.: 0.0097) MultiSource/Applications/lua/lua: 1.82% (3.8723 => 3.9427, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.80% (0.6675 => 0.6795, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.79% (1.4186 => 1.4440, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.63% (2.2969 => 2.3343, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.58% (17.1811 => 17.4531, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.2024 => 2.2339, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (4.2280 => 4.4252, std. dev.: 0.0114) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7527, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.06% (26.0924 => 26.6300, std. dev.: 0.1595) MultiSource/Applications/minisat/minisat: 1.56% (9.1159 => 9.2578, std. dev.: 0.0147) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8231, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.38% (5.2636 => 5.3364, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 1.34% (3.1578 => 3.2000, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 1.30% (3.2827 => 3.3255, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (1.3045 => 1.3190, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5811, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1494, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.41% (5.3855 => 3.6938, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.12% (5.3526 => 3.6870, std. dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0022, std. dev.: 0.0378) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.59% (2.9384 => 2.5391, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.40% (22.1758 => 19.4269, std. dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.20% (3.8922 => 3.8454, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -7.96% (1.5373 => 1.4149, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8068, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.26% (32.5116 => 31.4532, std. dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4128, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0140, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9569, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5134, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3464, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.3135 => 2.2897, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 13:06:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 15:06:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814200658.5DF0D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2892?compare_to=2890&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2892, Order: 161881, Start Time: 2012-08-14 18:53:58, End Time: 2012-08-14 20:07:40 To: 2890, Order: 161876, Start Time: 2012-08-14 17:10:52, End Time: 2012-08-14 18:24:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (150 on baseline) Performance Improvements: 2 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.80% (1.4979 => 1.4709, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.21% (2.1379 => 2.1120, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.08% (2.0176 => 2.3016, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.76% (0.5818 => 0.6386, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.41% (0.5748 => 0.6289, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.67% (0.7061 => 0.7673, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.11% (0.3578 => 0.3868, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.94% (0.3601 => 0.3887, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3663 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.84% (0.3914 => 0.4221, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.78% (0.3650 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.61% (0.3940 => 0.4240, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.46% (0.7038 => 0.7563, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.42% (1.3693 => 1.4709, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4328 => 0.4649, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.41% (0.2781 => 0.2987, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.29% (3.9660 => 4.2550, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.22% (0.7710 => 0.8267, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2690 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.16% (0.5265 => 0.5642, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2628 => 0.2815, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4062 => 0.4346, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.2937 => 0.3142, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.85% (0.3022 => 0.3229, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.3899 => 0.4166, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.79% (0.2726 => 0.2911, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3580 => 0.3816, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.52% (1.9828 => 2.1120, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (0.3485 => 0.3712, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.31% (0.6959 => 0.7398, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.27% (0.9199 => 0.9776, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.27% (1.2193 => 1.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4379 => 0.4653, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.95% (0.4390 => 0.4651, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.4016 => 0.4247, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (0.3756 => 0.3971, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.66% (0.3534 => 0.3734, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5577 => 0.5892, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.50% (13.8202 => 14.5809, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 5.43% (0.3868 => 0.4078, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.32% (1.4563 => 1.5338, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.20% (0.2925 => 0.3077, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.16% (1.2292 => 1.2926, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.12% (1.1364 => 1.1946, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.5637 => 0.5925, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 5.05% (3.8646 => 4.0598, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.03% (7.2180 => 7.5809, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 5.02% (0.8310 => 0.8727, std. dev.: 0.0051) MultiSource/Applications/Burg/burg: 4.98% (1.1061 => 1.1612, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.93% (1.3245 => 1.3898, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.84% (1.3813 => 1.4481, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.68% (1.3819 => 1.4466, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.68% (16.6129 => 17.3898, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 4.67% (1.9270 => 2.0169, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.63% (0.3755 => 0.3929, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.59% (1.0594 => 1.1080, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (0.7460 => 0.7800, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.54% (2.1791 => 2.2781, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (4.4433 => 4.6223, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.3801 => 4.5559, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.94% (13.2842 => 13.8072, std. dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.86% (4.9865 => 5.1788, std. dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (3.6692 => 3.8102, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6135 => 0.6367, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.78% (1.1333 => 1.1761, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.75% (0.8698 => 0.9024, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.50% (0.6283 => 0.6503, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.23% (3.1889 => 3.2919, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 3.03% (16.2614 => 16.7547, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7513, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3725, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.00% (1.5188 => 1.5643, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2764, std. dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.5754 => 6.7587, std. dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.5298 => 14.9312, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.1007 => 2.1542, std. dev.: 0.0172) MultiSource/Applications/oggenc/oggenc: 2.43% (4.6629 => 4.7764, std. dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6250 => 0.6386, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.86% (1.0313 => 1.0505, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.9108 => 0.9265, std. dev.: 0.0052) MultiSource/Applications/minisat/minisat: 1.69% (0.6744 => 0.6858, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.47% (3.7467 => 3.8016, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 1.27% (33.2944 => 33.7182, std. dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5134, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2610, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std. dev.: 0.0282) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7399, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3835, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5909, std. dev.: 0.0087) MultiSource/Applications/SPASS/SPASS: 1.97% (10.7476 => 10.9597, std. dev.: 0.0327) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3254, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.09% (4.5928 => 4.6428, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1753, std. dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8060, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.65% (20.3410 => 19.8015, std. dev.: 0.0213) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6051, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2317, std. dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2331, std. dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3719, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8695, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8018, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8985, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2411, std. dev.: 0.0321) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 13:26:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 15:26:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120814202601.2C5E22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2893?compare_to=2889&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2893, Order: 161877, Start Time: 2012-08-14 17:43:34, End Time: 2012-08-14 20:26:45 To: 2889, Order: 161865, Start Time: 2012-08-14 14:32:22, End Time: 2012-08-14 17:15:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (773 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 15.53% (102.6076 => 118.5474, std. dev.: 0.0538) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 10.98% (0.3496 => 0.3880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.88% (0.3446 => 0.3821, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.88% (0.3465 => 0.3842, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3488 => 0.3866, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.81% (0.3442 => 0.3814, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.75% (0.3469 => 0.3842, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3460 => 0.3832, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.49% (0.3650 => 0.4033, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.35% (0.3643 => 0.4020, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 10.15% (0.3724 => 0.4102, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.85% (1.5932 => 1.7023, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.94% (0.5826 => 0.6172, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.71% (0.5889 => 0.6225, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.23% (1.6211 => 1.7059, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.07% (0.4361 => 0.4582, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.06% (1.3152 => 1.3817, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.98% (3.5627 => 3.7401, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.95% (0.4994 => 0.5241, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 4.76% (1.0781 => 1.1294, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (0.5026 => 0.5261, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.55% (0.3930 => 0.4109, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.55% (4.2109 => 4.4026, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (0.5000 => 0.5224, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 4.45% (0.7171 => 0.7490, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.39% (0.4029 => 0.4206, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.5900 => 0.6158, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2792 => 0.2907, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.11% (0.9909 => 1.0316, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.05% (0.2738 => 0.2849, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.2780 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.98% (0.2811 => 0.2923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (2.0673 => 2.1496, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.97% (0.3195 => 0.3322, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.3004 => 0.3123, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.95% (0.3317 => 0.3448, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.95% (0.2813 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.92% (0.2803 => 0.2913, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.2736 => 0.2843, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.3096 => 0.3216, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.82% (5.5417 => 5.7536, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3258 => 0.3382, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 3.76% (0.3267 => 0.3390, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.72% (0.3362 => 0.3487, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.71% (0.2911 => 0.3019, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (0.3890 => 0.4034, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3726 => 0.3861, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.62% (2.7292 => 2.8279, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (0.4658 => 0.4825, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.59% (0.3124 => 0.3236, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.56% (0.3678 => 0.3809, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.51% (1.8794 => 1.9453, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.50% (0.3060 => 0.3167, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 3.46% (0.9697 => 1.0033, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3348 => 0.3464, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (2.1013 => 2.1739, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.45% (0.3625 => 0.3750, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3690 => 0.3817, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (1.9694 => 2.0368, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 3.37% (4.6177 => 4.7735, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (4.4195 => 4.5684, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 3.36% (0.3477 => 0.3594, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.3903 => 0.4033, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4146 => 0.4281, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.19% (1.9966 => 2.0602, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 3.17% (0.6634 => 0.6844, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (2.1653 => 2.2332, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.3845 => 0.3965, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.02% (0.7875 => 0.8113, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.91% (0.3981 => 0.4097, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.86% (1.4269 => 1.4677, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 2.76% (23.5202 => 24.1698, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.71% (0.4139 => 0.4251, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.5012 => 0.5146, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.6435 => 0.6606, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.42% (0.5546 => 0.5680, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.30% (2.0346 => 2.0814, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.52% (0.7426 => 0.7539, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std. dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6440, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6325, std. dev.: 0.0574) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1975, std. dev.: 0.0093) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.73% (41.7953 => 42.5201, std. dev.: 0.0617) MultiSource/Applications/lua/lua: 1.73% (50.0626 => 50.9291, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5914, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std. dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3064, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5542, std. dev.: 0.0209) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8058, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.82% (11.2080 => 10.7796, std. dev.: 0.0164) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.38% (0.6293 => 0.6143, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -2.16% (17.2379 => 16.8650, std. dev.: 0.0549) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5717, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9568, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 13:27:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 15:27:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814202759.B0EA32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2894?compare_to=2891&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2894, Order: 161883, Start Time: 2012-08-14 19:09:56, End Time: 2012-08-14 20:28:42 To: 2891, Order: 161877, Start Time: 2012-08-14 17:22:12, End Time: 2012-08-14 18:41:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (78 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (0.8465 => 0.8569, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (10.9089 => 11.0311, std. dev.: 0.0169) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.14% (13.9982 => 13.5590, std. dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.79% (10.3673 => 13.5590, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3497 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3561 => 0.3981, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2493, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 7.96% (0.1432 => 0.1546, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.39% (2.2022 => 2.3650, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.29% (1.7609 => 1.8893, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1892 => 0.2014, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 6.09% (0.6030 => 0.6397, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5925 => 0.6285, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 5.70% (10.4361 => 11.0311, std. dev.: 0.0169) SingleSource/UnitTests/ObjC++/property-reference: 5.15% (0.7326 => 0.7703, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.8172 => 0.8569, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.64% (7.0540 => 7.3813, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.53% (0.4615 => 0.4824, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.45% (0.4879 => 0.5096, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.20% (0.3282 => 0.3420, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 3.81% (0.7433 => 0.7716, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5569 => 0.5771, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.57% (4.9449 => 5.1214, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.50% (5.0018 => 5.1767, std. dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.49% (9.4845 => 9.8151, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.38% (4.2646 => 4.4088, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.19% (0.5860 => 0.6047, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.18% (8.1363 => 8.3952, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.3050 => 1.3434, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.85% (0.7835 => 0.8058, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.70% (1.1861 => 1.2181, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.63% (0.4103 => 0.4211, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.62% (0.9765 => 1.0021, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.35% (1.1642 => 1.1916, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.30% (1.5415 => 1.5770, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.27% (5.7591 => 5.8901, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.25% (2.0273 => 2.0730, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.24% (0.8067 => 0.8248, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (2.0665 => 2.1125, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.21% (3.3354 => 3.4092, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.08% (0.6450 => 0.6584, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.06% (1.5603 => 1.5924, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.00% (0.5105 => 0.5207, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5981 => 0.6089, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.78% (1.2842 => 1.3071, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.76% (3.8723 => 3.9404, std. dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 1.75% (0.6456 => 0.6569, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.74% (0.8921 => 0.9076, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.71% (14.3668 => 14.6120, std. dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.4186 => 1.4428, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.64% (17.1811 => 17.4625, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.62% (1.5859 => 1.6116, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.22% (2.2024 => 2.2293, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (4.2280 => 4.4476, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 2.03% (26.0924 => 26.6217, std. dev.: 0.0480) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.99% (1.3045 => 1.3304, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2507, std. dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 1.39% (5.2636 => 5.3368, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.34% (3.1578 => 3.2001, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.33% (0.9540 => 0.9667, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.28% (3.2827 => 3.3247, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5774, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6819, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.47% (5.2763 => 3.1411, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6968, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6922, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -15.17% (54.1659 => 45.9472, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.98% (2.9384 => 2.5277, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -12.31% (22.1758 => 19.4459, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.31% (3.8922 => 3.8413, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4199, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -7.22% (1.5373 => 1.4263, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5034, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8068, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -3.46% (3.1595 => 3.0503, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4721, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4123, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0020, std. dev.: 0.0209) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9605, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3385, std. dev.: 0.0081) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.02% (2.3135 => 2.2898, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 14:48:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 16:48:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814214814.E43F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2895?compare_to=2892&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2895, Order: 161890, Start Time: 2012-08-14 20:34:57, End Time: 2012-08-14 21:48:41 To: 2892, Order: 161881, Start Time: 2012-08-14 18:53:58, End Time: 2012-08-14 20:07:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.13% (2.0176 => 2.3026, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.97% (0.5818 => 0.6398, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.64% (0.5748 => 0.6302, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.85% (0.7061 => 0.7686, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.19% (0.3578 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.92% (0.3650 => 0.3939, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.91% (0.3601 => 0.3886, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 7.87% (0.3646 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.41% (1.3693 => 1.4708, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (3.9660 => 4.2511, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 7.18% (0.7038 => 0.7543, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4328 => 0.4637, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.2781 => 0.2979, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.97% (0.2782 => 0.2976, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2607 => 0.2782, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4062 => 0.4334, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.62% (0.2628 => 0.2802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.62% (0.2690 => 0.2868, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.61% (0.2937 => 0.3131, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3899 => 0.4153, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.45% (0.2760 => 0.2938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.38% (0.2696 => 0.2868, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.28% (1.2193 => 1.2959, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3489 => 0.3707, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.24% (0.2966 => 0.3151, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.21% (0.9199 => 0.9770, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 6.18% (0.3107 => 0.3299, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.12% (1.9828 => 2.1041, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.11% (0.3485 => 0.3698, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.10% (0.3149 => 0.3341, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.6959 => 0.7383, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.02% (0.2988 => 0.3168, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.4379 => 0.4640, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3192 => 0.3382, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.73% (0.3453 => 0.3651, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.58% (0.4390 => 0.4635, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5577 => 0.5887, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 5.50% (0.3293 => 0.3474, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.43% (13.8202 => 14.5700, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.40% (0.4016 => 0.4233, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (0.3756 => 0.3958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.27% (0.2127 => 0.2239, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3868 => 0.4070, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (1.1364 => 1.1942, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.07% (1.4563 => 1.5302, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.96% (0.8310 => 0.8722, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.90% (1.2292 => 1.2894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.90% (7.2180 => 7.5715, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (1.3819 => 1.4475, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (1.3813 => 1.4465, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.71% (1.3245 => 1.3869, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.68% (1.1061 => 1.1579, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.68% (3.8646 => 4.0453, std. dev.: 0.0130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (0.7460 => 0.7800, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.55% (1.0594 => 1.1076, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.49% (0.7506 => 0.7843, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.38% (1.9270 => 2.0114, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.37% (0.3755 => 0.3919, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.27% (16.6129 => 17.3223, std. dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.05% (2.1791 => 2.2673, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5527, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.4791 => 0.4977, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6143, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.83% (3.6692 => 3.8098, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.80% (13.2842 => 13.7892, std. dev.: 0.0163) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.79% (4.9865 => 5.1756, std. dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.68% (0.6135 => 0.6361, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (1.1333 => 1.1748, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.8698 => 0.9010, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.41% (0.6283 => 0.6497, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.11% (8.4961 => 8.7600, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.05% (3.1889 => 3.2862, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (3.2742 => 3.3715, std. dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 2.96% (16.2614 => 16.7426, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.77% (14.8535 => 15.2655, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.74% (1.5188 => 1.5604, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.5754 => 6.7552, std. dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9173, std. dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 2.48% (4.6629 => 4.7787, std. dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.1007 => 2.1522, std. dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/bigfib: 2.05% (0.6250 => 0.6378, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.75% (0.6744 => 0.6862, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.71% (1.0313 => 1.0489, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.24% (3.7467 => 3.7933, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 1.09% (33.2944 => 33.6581, std. dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2635, std. dev.: 0.0461) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3972, std. dev.: 0.0199) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.94% (1.5824 => 1.6605, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7411, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8183, std. dev.: 0.0169) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3852, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5972, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.06% (10.7476 => 10.9690, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3263, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0083) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2067, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.27% (1.0895 => 1.1033, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1835, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6416, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.56% (0.4657 => 0.3979, std. dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1690, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.6576 => 0.6468, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5103, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3173, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5805, std. dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.69% (20.3410 => 19.7932, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2234, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9640, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.94% (0.8342 => 0.8180, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2070, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3795, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8712, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8031, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8983, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5653, std. dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 15:14:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 17:14:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120814221453.D06AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2896?compare_to=2894&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2896, Order: 161891, Start Time: 2012-08-14 20:56:22, End Time: 2012-08-14 22:15:35 To: 2894, Order: 161883, Start Time: 2012-08-14 19:09:56, End Time: 2012-08-14 20:28:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (84 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (752 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.09% (13.5590 => 13.9779, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.46% (54.5712 => 55.9146, std. dev.: 0.3511) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.73% (79.3502 => 80.7243, std. dev.: 0.4131) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.83% (10.3673 => 13.9779, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.76% (1.1194 => 1.2510, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.60% (0.3543 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.26% (0.3694 => 0.4110, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.61% (2.2022 => 2.3697, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.79% (1.7609 => 1.8804, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.92% (0.5925 => 0.6276, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.6030 => 0.6382, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 5.79% (10.4361 => 11.0405, std. dev.: 0.0208) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.95% (7.0540 => 7.4034, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.65% (0.8172 => 0.8552, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.59% (0.4615 => 0.4827, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 3.89% (0.7433 => 0.7722, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.81% (0.2758 => 0.2863, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.72% (0.5860 => 0.6078, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 3.66% (9.4845 => 9.8312, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.59% (5.0018 => 5.1816, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.5569 => 0.5767, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (4.9449 => 5.1204, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.37% (4.2646 => 4.4084, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.20% (0.3121 => 0.3221, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.17% (8.1363 => 8.3945, std. dev.: 0.0091) MultiSource/Applications/spiff/spiff: 3.14% (0.7835 => 0.8081, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.3050 => 1.3454, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1978, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.79% (1.5415 => 1.5845, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.1861 => 1.2190, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.71% (0.8067 => 0.8286, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9765 => 1.0028, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.4103 => 0.4210, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.60% (5.7591 => 5.9091, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.53% (3.3354 => 3.4197, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.38% (0.4289 => 0.4391, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 2.28% (2.0273 => 2.0735, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 2.24% (1.5603 => 1.5953, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (0.5105 => 0.5215, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.07% (2.0665 => 2.1093, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8921 => 0.9102, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.90% (1.5859 => 1.6161, std. dev.: 0.0074) MultiSource/Applications/lua/lua: 1.89% (3.8723 => 3.9456, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (14.3668 => 14.6355, std. dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.84% (0.5981 => 0.6091, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.77% (17.1811 => 17.4859, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.75% (0.6675 => 0.6792, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.4186 => 1.4434, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 1.73% (2.2969 => 2.3367, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.2842 => 1.3060, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.29% (1.1840 => 1.1993, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (4.2280 => 4.4543, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7463, std. dev.: 0.0059) MultiSource/Applications/lua/lua: 2.07% (26.0924 => 26.6330, std. dev.: 0.0307) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8226, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2504, std. dev.: 0.0440) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.35% (5.2636 => 5.3345, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 1.30% (3.1578 => 3.1990, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.29% (3.2827 => 3.3250, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5805, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.09% (1.5086 => 1.5251, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1239, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.49% (5.2763 => 3.1401, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6936, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.09% (5.3526 => 3.6883, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0431, std. dev.: 0.0327) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.43% (2.9384 => 2.5438, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -12.25% (22.1758 => 19.4590, std. dev.: 0.0422) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (3.8922 => 3.8473, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -8.40% (1.5373 => 1.4081, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.02% (1.5835 => 1.5040, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8070, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (4.8142 => 4.6141, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4680, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4256, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0024, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9624, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3492, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2894, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8140, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 16:29:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 18:29:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120814232944.8DF952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2897?compare_to=2895&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2897, Order: 161894, Start Time: 2012-08-14 22:16:39, End Time: 2012-08-14 23:30:24 To: 2895, Order: 161890, Start Time: 2012-08-14 20:34:57, End Time: 2012-08-14 21:48:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (148 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5108 => 56.4389, std. dev.: 0.0627) SingleSource/Benchmarks/Misc/mandel-2: 2.81% (1.3972 => 1.4364, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.61% (80.7793 => 79.4781, std. dev.: 0.3997) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.88% (2.0176 => 2.3179, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.13% (0.5818 => 0.6349, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.77% (0.5748 => 0.6252, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.19% (0.3578 => 0.3871, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.05% (0.3663 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.03% (0.7061 => 0.7628, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-4: 8.01% (0.3646 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.97% (0.3601 => 0.3888, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (0.1413 => 0.1525, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.87% (0.3623 => 0.3908, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/for-in: 7.86% (0.3789 => 0.4087, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.84% (0.3914 => 0.4221, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.84% (0.3650 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.56% (0.3940 => 0.4238, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.46% (3.9660 => 4.2617, std. dev.: 0.0059) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4704, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.31% (0.2721 => 0.2920, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.7710 => 0.8263, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.12% (0.5265 => 0.5640, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.10% (0.7038 => 0.7538, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (0.4328 => 0.4619, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.58% (1.2193 => 1.2995, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.39% (0.9199 => 0.9787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.31% (0.6959 => 0.7398, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.3899 => 0.4143, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.21% (0.4379 => 0.4651, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.10% (0.3246 => 0.3444, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4062 => 0.4308, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.83% (0.2607 => 0.2759, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (1.3813 => 1.4600, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.5577 => 0.5893, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (1.3819 => 1.4602, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 5.59% (0.2628 => 0.2775, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.54% (0.2655 => 0.2802, std. dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 5.53% (13.8202 => 14.5839, std. dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.47% (0.3489 => 0.3680, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.2914 => 0.3072, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.40% (1.4563 => 1.5350, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.39% (0.2765 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2760 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.33% (1.1364 => 1.1970, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3485 => 0.3670, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.19% (0.8310 => 0.8741, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.17% (1.9828 => 2.0853, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4390 => 0.4616, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.2925 => 0.3075, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.13% (0.5637 => 0.5926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 5.07% (3.8646 => 4.0605, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.06% (1.3245 => 1.3915, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.05% (7.2180 => 7.5825, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 5.02% (0.2988 => 0.3138, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.99% (1.0594 => 1.1123, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.92% (0.7506 => 0.7875, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.85% (1.1061 => 1.1597, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.62% (0.7460 => 0.7805, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.58% (1.9270 => 2.0153, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 4.41% (16.6129 => 17.3461, std. dev.: 0.0155) MultiSource/Applications/siod/siod: 4.41% (2.1791 => 2.2752, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 4.41% (0.2995 => 0.3127, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.34% (4.3801 => 4.5701, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (4.4433 => 4.6360, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.26% (0.4791 => 0.4995, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2814, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.13% (3.6692 => 3.8208, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (13.2842 => 13.8318, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.91% (1.1333 => 1.1776, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.89% (4.9865 => 5.1806, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.88% (0.6135 => 0.6373, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 3.87% (0.2945 => 0.3059, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.80% (0.3131 => 0.3250, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.65% (0.3755 => 0.3892, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.64% (0.6283 => 0.6512, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.45% (3.1889 => 3.2990, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (8.4961 => 8.7821, std. dev.: 0.0113) MultiSource/Benchmarks/McCat/05-eks/eks: 3.36% (0.4113 => 0.4251, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.35% (16.2614 => 16.8056, std. dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.35% (0.8698 => 0.8989, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.30% (3.2742 => 3.3824, std. dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 3.24% (14.8535 => 15.3353, std. dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 3.20% (6.5754 => 6.7856, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.04% (1.5188 => 1.5650, std. dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 2.98% (14.5298 => 14.9623, std. dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1571, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.67% (4.6629 => 4.7872, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.17% (0.9108 => 0.9306, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.07% (1.0313 => 1.0526, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.81% (0.6744 => 0.6866, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6250 => 0.6363, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.48% (3.7467 => 3.8022, std. dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3506, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5199, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std. dev.: 0.0359) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 10.51% (1.2998 => 1.4364, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7401, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0017) MultiSource/Benchmarks/llubenchmark/llu: 2.55% (3.7731 => 3.8695, std. dev.: 0.0187) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6002, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.14% (10.7476 => 10.9776, std. dev.: 0.0548) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6425, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.39% (0.4657 => 0.3987, std. dev.: 0.0193) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.73% (22.5627 => 21.2691, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.83% (0.2670 => 0.2541, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.87% (1.0460 => 0.8486, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.57% (1.1560 => 1.1032, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.36% (1.3780 => 1.3179, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5970, std. dev.: 0.0161) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.51% (20.3410 => 19.8307, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: -2.45% (1.9762 => 1.9277, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9612, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2221, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2261, std. dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3707, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8021, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8969, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: -1.08% (3.9173 => 3.8751, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.01% (5.5401 => 5.4843, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 16:36:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 18:36:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120814233652.98ED82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2898?compare_to=2893&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2898, Order: 161891, Start Time: 2012-08-14 20:54:05, End Time: 2012-08-14 23:37:36 To: 2893, Order: 161877, Start Time: 2012-08-14 17:43:34, End Time: 2012-08-14 20:26:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (89 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (788 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.2173 => 0.2312, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.90% (125.1380 => 128.7666, std. dev.: 1.2421) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.58% (0.3465 => 0.3901, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3442 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.53% (0.3496 => 0.3934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3460 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3488 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.34% (0.3469 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.19% (0.3643 => 0.4087, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 12.16% (0.3650 => 0.4094, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3724 => 0.4164, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.52% (0.5826 => 0.6206, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 6.18% (0.5889 => 0.6253, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.89% (1.5932 => 1.6871, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.59% (1.6211 => 1.7118, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.59% (1.3152 => 1.3887, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.46% (3.5627 => 3.7574, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.07% (0.5026 => 0.5281, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (0.5000 => 0.5252, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (0.3930 => 0.4128, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.01% (4.2109 => 4.4217, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (0.4361 => 0.4578, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (0.4994 => 0.5240, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7171 => 0.7519, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.74% (0.4029 => 0.4220, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.71% (0.5900 => 0.6178, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 4.68% (1.0781 => 1.1286, std. dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.58% (2.7292 => 2.8542, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.2866 => 0.2988, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.2736 => 0.2846, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.96% (5.5417 => 5.7611, std. dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (0.4658 => 0.4842, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (2.1013 => 2.1827, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (1.9694 => 2.0444, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3195 => 0.3316, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.65% (0.2875 => 0.2980, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (0.3890 => 0.4030, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (1.9966 => 2.0675, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 3.49% (0.9909 => 1.0255, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 3.42% (2.1653 => 2.2393, std. dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 3.33% (4.6177 => 4.7715, std. dev.: 0.0127) SingleSource/Regression/C++/ofstream_ctor: 3.33% (0.3004 => 0.3104, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (1.8794 => 1.9407, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.23% (0.7875 => 0.8129, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (4.4195 => 4.5618, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.20% (2.0673 => 2.1335, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.20% (0.3124 => 0.3224, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.3903 => 0.4022, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3726 => 0.3838, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.4139 => 0.4263, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.3625 => 0.3733, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.98% (1.4269 => 1.4694, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.3362 => 0.3462, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.92% (0.6634 => 0.6828, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.85% (0.3678 => 0.3783, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.74% (0.5546 => 0.5698, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.73% (0.9697 => 0.9962, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4146 => 0.4257, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.4251 => 0.4363, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.3981 => 0.4082, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.48% (23.5202 => 24.1046, std. dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.22% (0.6435 => 0.6578, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.02% (2.0346 => 2.0756, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 8.95% (0.2122 => 0.2312, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6678, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-2: 5.04% (1.8057 => 1.8967, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1711, std. dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6315, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.07% (105.3826 => 107.5665, std. dev.: 0.0834) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1974, std. dev.: 0.0452) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (41.7953 => 42.6329, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5919, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.71% (50.0626 => 50.9208, std. dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2208, std. dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3048, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2821, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.35% (0.4253 => 0.4153, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -1.15% (11.9555 => 11.8186, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5491, std. dev.: 0.0288) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7935, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7928, std. dev.: 0.0133) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -1.92% (17.2379 => 16.9070, std. dev.: 0.0333) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.81% (0.6293 => 0.6179, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9650, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 17:01:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 19:01:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815000139.319A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2899?compare_to=2896&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2899, Order: 161897, Start Time: 2012-08-14 22:43:17, End Time: 2012-08-15 00:02:11 To: 2896, Order: 161891, Start Time: 2012-08-14 20:56:22, End Time: 2012-08-14 22:15:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (84 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.40% (1.4081 => 1.4278, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.88% (10.3673 => 13.9837, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.75% (1.1194 => 1.2509, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 11.23% (0.3543 => 0.3941, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.23% (0.3561 => 0.3961, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.61% (0.3828 => 0.4234, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.78% (2.2022 => 2.3736, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (1.7609 => 1.8951, std. dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 6.23% (10.4361 => 11.0867, std. dev.: 0.0249) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.90% (0.6030 => 0.6386, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.04% (0.4879 => 0.5125, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (7.0540 => 7.4026, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 4.93% (0.7326 => 0.7687, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.70% (0.4615 => 0.4832, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.21% (0.7433 => 0.7746, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.90% (0.8172 => 0.8491, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.86% (9.4845 => 9.8510, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (4.9449 => 5.1311, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (5.0018 => 5.1890, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.52% (0.5569 => 0.5765, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.43% (4.2646 => 4.4107, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (8.1363 => 8.4085, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.34% (0.5860 => 0.6056, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.21% (1.3050 => 1.3469, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.4103 => 0.4231, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1861 => 1.2214, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 2.92% (0.3423 => 0.3523, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.91% (0.7835 => 0.8063, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9765 => 1.0036, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.76% (1.5603 => 1.6033, std. dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 2.73% (5.7591 => 5.9161, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.8067 => 0.8280, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.64% (1.1642 => 1.1949, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 2.60% (3.3354 => 3.4222, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.5415 => 1.5815, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.57% (0.4636 => 0.4755, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4289 => 0.4399, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1162, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (14.3668 => 14.6992, std. dev.: 0.0050) MultiSource/Applications/treecc/treecc: 2.30% (2.0273 => 2.0740, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6450 => 0.6596, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.4186 => 1.4485, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.05% (3.8723 => 3.9517, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6675 => 0.6810, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5859 => 1.6177, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.00% (1.2842 => 1.3099, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.95% (17.1811 => 17.5153, std. dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.94% (0.5981 => 0.6097, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.81% (2.2969 => 2.3384, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.38% (1.1840 => 1.2003, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.04% (1.0722 => 1.0834, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (4.2280 => 4.4516, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7583, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.15% (26.0924 => 26.6540, std. dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.49% (9.1159 => 9.2516, std. dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 1.34% (5.2636 => 5.3341, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1999, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 1.29% (3.2827 => 3.3250, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5790, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1244, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1519, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7057, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6985, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -15.16% (54.1659 => 45.9523, std. dev.: 0.0449) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.63% (2.9384 => 2.5379, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -12.16% (22.1758 => 19.4793, std. dev.: 0.0411) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.01% (3.8922 => 3.8528, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -7.12% (1.5373 => 1.4278, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -6.96% (1.1396 => 1.0603, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8067, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4727, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.13% (8.6802 => 8.4088, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0012, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9647, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (12.5348 => 12.3441, std. dev.: 0.0071) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.26% (19.9488 => 19.6966, std. dev.: 0.0339) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8123, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2894, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 18:10:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 20:10:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815011053.DD0E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2900?compare_to=2897&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2900, Order: 161904, Start Time: 2012-08-14 23:57:52, End Time: 2012-08-15 01:11:33 To: 2897, Order: 161894, Start Time: 2012-08-14 22:16:39, End Time: 2012-08-14 23:30:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.01% (2.0176 => 2.3002, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.73% (0.5818 => 0.6326, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5748 => 0.6238, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3578 => 0.3879, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7061 => 0.7655, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 8.16% (0.3601 => 0.3895, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.00% (0.3789 => 0.4092, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.98% (0.3646 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.94% (0.3663 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.89% (0.3650 => 0.3938, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 7.82% (0.3914 => 0.4220, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.81% (0.3623 => 0.3906, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.56% (0.3940 => 0.4238, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.7710 => 0.8266, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (3.9660 => 4.2480, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0082) MultiSource/Applications/hbd/hbd: 6.97% (1.3693 => 1.4647, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.93% (0.5265 => 0.5630, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.81% (0.7038 => 0.7517, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.69% (0.2781 => 0.2967, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.47% (0.4062 => 0.4325, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.32% (0.3022 => 0.3213, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.29% (1.2193 => 1.2960, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3899 => 0.4144, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.25% (0.9199 => 0.9774, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wc: 6.20% (0.2937 => 0.3119, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.14% (0.2607 => 0.2767, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.14% (0.2966 => 0.3148, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.6959 => 0.7385, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.12% (0.4379 => 0.4647, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3580 => 0.3798, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2761 => 0.2929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.02% (0.3489 => 0.3699, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.97% (1.9828 => 2.1012, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.95% (0.3107 => 0.3292, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.82% (0.2696 => 0.2853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.81% (0.3149 => 0.3332, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.73% (0.3246 => 0.3432, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.69% (0.2988 => 0.3158, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.5577 => 0.5880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3534 => 0.3721, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.28% (0.3293 => 0.3467, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.25% (13.8202 => 14.5451, std. dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.02% (1.3819 => 1.4513, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (1.3813 => 1.4504, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 4.99% (0.3868 => 0.4061, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (1.1364 => 1.1931, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.99% (7.2180 => 7.5781, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5637 => 0.5915, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.4563 => 1.5275, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.77% (0.8310 => 0.8706, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.74% (1.1061 => 1.1585, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0448, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3859, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.52% (1.0594 => 1.1073, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.48% (1.2292 => 1.2843, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.7460 => 0.7790, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.42% (0.7506 => 0.7838, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0095, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 4.12% (2.1791 => 2.2688, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.03% (16.6129 => 17.2820, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (4.4433 => 4.6213, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5545, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.97% (0.3755 => 0.3904, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.78% (3.6692 => 3.8078, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4791 => 0.4966, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (0.6135 => 0.6354, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1333 => 1.1736, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (13.2842 => 13.7545, std. dev.: 0.0107) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.8698 => 0.8983, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.26% (4.9865 => 5.1493, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.01% (8.4961 => 8.7520, std. dev.: 0.0159) MultiSource/Applications/d/make_dparser: 2.89% (3.1889 => 3.2810, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.82% (3.2742 => 3.3664, std. dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7592, std. dev.: 0.0178) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2603, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6849, std. dev.: 0.0166) MultiSource/Applications/ClamAV/clamscan: 2.50% (14.5298 => 14.8936, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.24% (2.1007 => 2.1477, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.19% (4.6629 => 4.7650, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.9108 => 0.9256, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.36% (1.0313 => 1.0453, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5201, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 26.05% (1.8175 => 2.2910, std. dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.84% (1.2998 => 1.4277, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7435, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8183, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6025, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.99% (10.7476 => 10.9615, std. dev.: 0.0344) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0044) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3267, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6448, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.5627 => 21.0898, std. dev.: 0.0236) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5111, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.71% (1.3780 => 1.3131, std. dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8059, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5824, std. dev.: 0.0117) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.63% (20.3410 => 19.8065, std. dev.: 0.0265) MultiSource/Benchmarks/Olden/bh/bh: -2.45% (1.9762 => 1.9278, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9623, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2283, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.3305 => 7.2319, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3697, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8033, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.8998, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 18:48:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 20:48:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815014827.DA0022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2901?compare_to=2899&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2901, Order: 161909, Start Time: 2012-08-15 00:30:06, End Time: 2012-08-15 01:49:08 To: 2899, Order: 161897, Start Time: 2012-08-14 22:43:17, End Time: 2012-08-15 00:02:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (89 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (746 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.34% (13.9837 => 14.4507, std. dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.25% (55.1183 => 56.3595, std. dev.: 0.1303) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.88% (11.0867 => 10.8783, std. dev.: 0.0183) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.39% (10.3673 => 14.4507, std. dev.: 0.0130) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.35% (0.3497 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3561 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.19% (0.3543 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.97% (0.3694 => 0.4136, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.56% (1.1194 => 1.2488, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.94% (0.1432 => 0.1560, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.40% (2.2022 => 2.3651, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.89% (1.7609 => 1.8823, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.6030 => 0.6400, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.17% (0.7326 => 0.7705, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.4615 => 0.4839, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.73% (7.0540 => 7.3877, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.49% (0.4879 => 0.5098, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.43% (0.8172 => 0.8534, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.24% (10.4361 => 10.8783, std. dev.: 0.0183) MultiSource/Applications/lambda-0_1_3/lambda: 4.21% (0.7433 => 0.7746, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.78% (9.4845 => 9.8434, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (4.9449 => 5.1302, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (5.0018 => 5.1892, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (4.2646 => 4.4205, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5569 => 0.5771, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.41% (0.5860 => 0.6060, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.39% (8.1363 => 8.4120, std. dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.20% (0.3121 => 0.3221, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.3050 => 1.3463, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.14% (1.5415 => 1.5899, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.13% (0.7835 => 0.8080, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: 3.09% (0.3232 => 0.3332, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.92% (1.1861 => 1.2207, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.91% (0.3441 => 0.3541, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.85% (0.4636 => 0.4768, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.8067 => 0.8295, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.80% (0.9765 => 1.0038, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.74% (1.1642 => 1.1961, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.59% (2.0273 => 2.0799, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.4289 => 0.4398, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4195, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.52% (2.0665 => 2.1185, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.50% (5.7591 => 5.9033, std. dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.29% (0.6450 => 0.6598, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.27% (1.5603 => 1.5957, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.09% (3.8723 => 3.9533, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.07% (1.2842 => 1.3108, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/football/football: 2.02% (0.8921 => 0.9101, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (14.3668 => 14.6529, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4468, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6456 => 0.6584, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.97% (1.5859 => 1.6172, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.86% (2.2969 => 2.3396, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (0.6675 => 0.6796, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.68% (2.2024 => 2.2395, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4551, std. dev.: 0.0113) MultiSource/Benchmarks/nbench/nbench: 1.32% (1.1840 => 1.1996, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.04% (1.0722 => 1.0833, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (4.2280 => 4.4497, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.97% (26.0924 => 26.6061, std. dev.: 0.0322) MultiSource/Applications/minisat/minisat: 1.55% (9.1159 => 9.2573, std. dev.: 0.0252) MultiSource/Benchmarks/nbench/nbench: 1.55% (11.6436 => 11.8235, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.37% (5.2636 => 5.3356, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 1.33% (3.1578 => 3.1997, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.31% (3.2827 => 3.3256, std. dev.: 0.0054) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5773, std. dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1297, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.33% (5.2763 => 3.1483, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.54% (5.3855 => 3.6868, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.16% (5.3526 => 3.6849, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -15.06% (54.1659 => 46.0079, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5436, std. dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: -12.39% (22.1758 => 19.4291, std. dev.: 0.0399) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (3.8922 => 3.8499, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -6.60% (1.5373 => 1.4359, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8067, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4718, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.6802 => 8.4363, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.59% (10.2830 => 10.0164, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9625, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3482, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4228, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.21% (19.9488 => 19.7069, std. dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.3135 => 2.2896, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 19:47:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 21:47:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120815024717.B6FA52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2902?compare_to=2898&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2902, Order: 161904, Start Time: 2012-08-15 00:04:45, End Time: 2012-08-15 02:48:00 To: 2898, Order: 161891, Start Time: 2012-08-14 20:54:05, End Time: 2012-08-14 23:37:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.11% (16.9070 => 16.7188, std. dev.: 0.0579) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.44% (0.3465 => 0.3896, std. dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-2: 12.42% (0.3446 => 0.3874, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.30% (0.3488 => 0.3917, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.28% (0.3469 => 0.3895, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.27% (0.3496 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.95% (0.3650 => 0.4086, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3643 => 0.4074, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.55% (0.3724 => 0.4154, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.65% (0.3792 => 0.4082, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.02% (0.5026 => 0.5379, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.1619 => 0.1730, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.52% (1.5932 => 1.6971, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.45% (3.5627 => 3.7925, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.33% (1.3152 => 1.3985, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 6.25% (0.5826 => 0.6190, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (1.6211 => 1.7197, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.01% (0.4361 => 0.4623, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 5.99% (0.5889 => 0.6242, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.54% (0.1968 => 0.2077, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.2014 => 0.2124, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.5900 => 0.6219, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.33% (4.2109 => 4.4352, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (0.4994 => 0.5260, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.31% (0.4029 => 0.4243, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.24% (1.0781 => 1.1346, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (0.5000 => 0.5255, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.85% (5.5417 => 5.8107, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 4.78% (0.7171 => 0.7514, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.62% (0.4658 => 0.4873, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.58% (2.7292 => 2.8543, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.2736 => 0.2861, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.52% (1.9694 => 2.0585, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 4.48% (0.2566 => 0.2681, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.42% (1.9966 => 2.0848, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 4.40% (2.1013 => 2.1938, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.37% (0.3890 => 0.4060, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 4.35% (4.6177 => 4.8187, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (2.1653 => 2.2566, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.07% (0.2875 => 0.2992, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.07% (4.4195 => 4.5992, std. dev.: 0.0094) MultiSource/Benchmarks/MallocBench/gs/gs: 3.93% (1.8794 => 1.9532, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.83% (0.6634 => 0.6888, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.3903 => 0.4050, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 3.76% (0.7875 => 0.8171, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.72% (2.0673 => 2.1443, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.68% (0.9909 => 1.0274, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 3.65% (0.2823 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2803 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.63% (0.2813 => 0.2915, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3004 => 0.3112, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.58% (0.2792 => 0.2892, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4146 => 0.4294, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3267 => 0.3382, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.51% (1.4269 => 1.4770, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.50% (0.2911 => 0.3013, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.50% (0.3317 => 0.3433, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.46% (0.5546 => 0.5738, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.44% (0.3258 => 0.3370, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.3678 => 0.3804, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.41% (0.3348 => 0.3462, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3124 => 0.3227, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.28% (0.3625 => 0.3744, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.27% (0.3726 => 0.3848, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.27% (0.3060 => 0.3160, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3477 => 0.3590, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4251 => 0.4389, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.18% (0.3336 => 0.3442, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3690 => 0.3806, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.4139 => 0.4268, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.92% (23.5202 => 24.2075, std. dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 2.74% (2.0346 => 2.0904, std. dev.: 0.0089) MultiSource/Applications/hbd/hbd: 2.73% (0.9697 => 0.9962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.3981 => 0.4089, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.5012 => 0.5134, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (0.7426 => 0.7599, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.88% (0.5361 => 0.5462, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.32% (11.6398 => 11.7934, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (4.6926 => 4.7436, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6692, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8918, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6312, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6626, std. dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std. dev.: 0.0380) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.89% (41.7953 => 42.5849, std. dev.: 0.0323) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9121, std. dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2252, std. dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3061, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5532, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -7.55% (35.5013 => 32.8219, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8001, std. dev.: 0.0033) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -3.01% (17.2379 => 16.7188, std. dev.: 0.0579) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9616, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.43% (5.5810 => 5.5013, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 19:52:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 21:52:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815025220.0AD4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2903?compare_to=2900&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2903, Order: 161917, Start Time: 2012-08-15 01:39:15, End Time: 2012-08-15 02:53:01 To: 2900, Order: 161904, Start Time: 2012-08-14 23:57:52, End Time: 2012-08-15 01:11:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.22% (2.0176 => 2.2843, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 9.30% (0.7061 => 0.7718, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.26% (0.5818 => 0.6357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5748 => 0.6275, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.53% (0.3601 => 0.3908, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3623 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.41% (0.3914 => 0.4243, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.39% (0.3789 => 0.4107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.38% (0.3663 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 8.10% (0.3940 => 0.4259, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.37% (0.7710 => 0.8278, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.22% (1.3693 => 1.4682, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.05% (0.5265 => 0.5636, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.88% (0.7038 => 0.7522, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.84% (3.9660 => 4.2373, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (0.4328 => 0.4619, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 6.10% (0.2607 => 0.2766, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.08% (1.2193 => 1.2934, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.07% (0.9199 => 0.9757, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.2937 => 0.3114, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.03% (0.2655 => 0.2815, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.02% (0.2690 => 0.2852, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.96% (0.6959 => 0.7374, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.87% (0.2726 => 0.2886, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.87% (0.3580 => 0.3790, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.73% (0.3107 => 0.3285, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.72% (1.9828 => 2.0962, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.69% (0.4379 => 0.4628, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.68% (0.2696 => 0.2849, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3246 => 0.3430, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.65% (0.3149 => 0.3327, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.2988 => 0.3156, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.51% (0.3192 => 0.3368, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 5.27% (0.3453 => 0.3635, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.02% (13.8202 => 14.5146, std. dev.: 0.0172) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.98% (0.4016 => 0.4216, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.90% (1.4563 => 1.5276, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3868 => 0.4054, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.80% (1.1364 => 1.1910, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (1.3813 => 1.4473, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 4.73% (0.8310 => 0.8703, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.70% (7.2180 => 7.5571, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.69% (1.3819 => 1.4467, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3859, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (3.8646 => 4.0401, std. dev.: 0.0059) MultiSource/Applications/Burg/burg: 4.48% (1.1061 => 1.1557, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2292 => 1.2835, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.21% (1.0594 => 1.1040, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.16% (1.9270 => 2.0072, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.94% (0.3755 => 0.3903, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.86% (2.1791 => 2.2632, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (4.4433 => 4.6125, std. dev.: 0.0119) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 3.78% (16.6129 => 17.2402, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (4.3801 => 4.5454, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.68% (3.6692 => 3.8042, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (0.4791 => 0.4965, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.49% (4.9865 => 5.1605, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.48% (1.1333 => 1.1727, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (13.2842 => 13.7433, std. dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.42% (0.6135 => 0.6345, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.15% (0.8698 => 0.8972, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.6283 => 0.6470, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.87% (3.1889 => 3.2803, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (8.4961 => 8.7344, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.2742 => 3.3599, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 2.59% (6.5754 => 6.7454, std. dev.: 0.0167) MultiSource/Applications/JM/lencod/lencod: 2.55% (14.8535 => 15.2329, std. dev.: 0.0173) MultiSource/Applications/sqlite3/sqlite3: 2.46% (16.2614 => 16.6618, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5188 => 1.5552, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.35% (4.6629 => 4.7725, std. dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: 2.35% (14.5298 => 14.8709, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.1007 => 2.1430, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.35% (0.9108 => 0.9231, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.31% (1.0313 => 1.0448, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5136, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 24.76% (1.8175 => 2.2675, std. dev.: 0.0503) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: 9.66% (1.2998 => 1.4254, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7413, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8183, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3850, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6032, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.14% (10.7476 => 10.9771, std. dev.: 0.0084) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3265, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std. dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5928 => 4.6410, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1227, std. dev.: 0.0231) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -4.57% (1.1560 => 1.1032, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.66% (20.3410 => 19.7995, std. dev.: 0.0177) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5985, std. dev.: 0.0164) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2203, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9627, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2350, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3786, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8013, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8718, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.8999, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5636, std. dev.: 0.0081) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 20:37:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 22:37:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815033720.A56C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2904?compare_to=2901&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2904, Order: 161920, Start Time: 2012-08-15 02:19:00, End Time: 2012-08-15 03:38:03 To: 2901, Order: 161909, Start Time: 2012-08-15 00:30:06, End Time: 2012-08-15 01:49:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (81 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.72% (14.4507 => 14.0577, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.60% (10.3673 => 14.0577, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.79% (1.1194 => 1.2514, std. dev.: 0.0126) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3561 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3694 => 0.4083, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.88% (0.3927 => 0.4315, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.71% (1.7609 => 1.8966, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.41% (2.2022 => 2.3653, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.76% (0.2065 => 0.2184, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.40% (0.5925 => 0.6245, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.24% (0.6030 => 0.6346, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.47% (7.0540 => 7.3694, std. dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.44% (0.4615 => 0.4820, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.25% (0.7326 => 0.7637, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 3.94% (0.7433 => 0.7726, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.90% (10.4361 => 10.8428, std. dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 3.89% (9.4845 => 9.8539, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.68% (0.8172 => 0.8473, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.48% (4.9449 => 5.1170, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (5.0018 => 5.1736, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5569 => 0.5757, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.28% (4.2646 => 4.4045, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.3050 => 1.3468, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5860 => 0.6043, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.01% (8.1363 => 8.3815, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.1861 => 1.2192, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.78% (0.7835 => 0.8053, std. dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 2.73% (5.7591 => 5.9162, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.5415 => 1.5835, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.59% (0.9765 => 1.0018, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.49% (0.8067 => 0.8268, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.44% (0.4103 => 0.4203, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.31% (0.5105 => 0.5223, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.31% (3.3354 => 3.4123, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.29% (1.5603 => 1.5960, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 2.27% (2.0273 => 2.0734, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.25% (0.5020 => 0.5133, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.23% (1.1642 => 1.1902, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6450 => 0.6588, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.01% (1.4186 => 1.4471, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.89% (3.8723 => 3.9454, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.6675 => 0.6801, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6456 => 0.6575, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8921 => 0.9085, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (2.0665 => 2.1030, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.77% (1.5859 => 1.6139, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.73% (14.3668 => 14.6160, std. dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4435, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.2024 => 2.2357, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.46% (2.2969 => 2.3304, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 1.34% (1.2842 => 1.3014, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.16% (1.1840 => 1.1977, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (4.2280 => 4.4181, std. dev.: 0.0176) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7569, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.00% (26.0924 => 26.6130, std. dev.: 0.0309) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8227, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2472, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.38% (5.2636 => 5.3361, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 1.35% (3.1578 => 3.2004, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.30% (3.2827 => 3.3253, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5857, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.14% (5.2763 => 3.1585, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.57% (5.3855 => 3.6854, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.23% (5.3526 => 3.6811, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0169, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.49% (2.9384 => 2.5421, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -12.48% (22.1758 => 19.4077, std. dev.: 0.0219) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -7.00% (1.5373 => 1.4297, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -6.98% (1.1396 => 1.0601, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8068, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5114, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.24% (32.5116 => 31.4580, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4287, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0115, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.64% (1.3677 => 1.3316, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9647, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (12.5348 => 12.3335, std. dev.: 0.0124) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.18% (1.8329 => 1.8112, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2894, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 21:33:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 14 Aug 2012 23:33:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815043357.3A9BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2905?compare_to=2903&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2905, Order: 161921, Start Time: 2012-08-15 03:20:32, End Time: 2012-08-15 04:34:40 To: 2903, Order: 161917, Start Time: 2012-08-15 01:39:15, End Time: 2012-08-15 02:53:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.46% (79.1431 => 81.0890, std. dev.: 0.0873) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.96% (2.0176 => 2.2993, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.94% (0.5818 => 0.6338, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7061 => 0.7679, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.63% (0.5748 => 0.6244, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.77% (0.3578 => 0.3856, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.57% (0.3789 => 0.4076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.53% (0.3601 => 0.3872, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.49% (0.3646 => 0.3919, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: 7.45% (0.3663 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.45% (0.3623 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3650 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.28% (0.3940 => 0.4227, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.25% (0.7710 => 0.8269, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 7.22% (0.4003 => 0.4292, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.98% (0.7038 => 0.7529, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.93% (0.5265 => 0.5630, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.92% (1.3693 => 1.4641, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (3.9660 => 4.2402, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.29% (0.2781 => 0.2956, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.13% (0.9199 => 0.9763, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.12% (1.2193 => 1.2939, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.93% (0.6959 => 0.7372, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.64% (0.3899 => 0.4119, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.62% (0.4379 => 0.4625, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.50% (0.3580 => 0.3777, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.46% (1.9828 => 2.0910, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3489 => 0.3678, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2966 => 0.3125, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.5577 => 0.5875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.24% (13.8202 => 14.5444, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2696 => 0.2837, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.22% (0.3485 => 0.3667, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.05% (1.1364 => 1.1938, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (1.4563 => 1.5287, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.73% (1.3813 => 1.4467, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.73% (0.8310 => 0.8703, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.62% (0.7460 => 0.7805, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5516, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.62% (1.3245 => 1.3857, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.3819 => 1.4457, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.2925 => 0.3060, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (3.8646 => 4.0420, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 4.50% (1.0594 => 1.1071, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.40% (1.1061 => 1.1548, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.33% (0.7506 => 0.7831, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.18% (1.9270 => 2.0076, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.12% (1.2292 => 1.2798, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 4.01% (2.1791 => 2.2665, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/objinst: 3.97% (0.2945 => 0.3062, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6176, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 3.87% (16.6129 => 17.2561, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.3801 => 4.5472, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (0.4791 => 0.4968, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.69% (4.9865 => 5.1705, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (3.6692 => 3.8045, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6135 => 0.6358, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.61% (13.2842 => 13.7634, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3755 => 0.3887, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.50% (1.1333 => 1.1730, std. dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6283 => 0.6483, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.08% (0.8698 => 0.8966, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.89% (3.1889 => 3.2810, std. dev.: 0.0074) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.4961 => 8.7357, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7571, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.74% (3.2742 => 3.3640, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2566, std. dev.: 0.0167) MultiSource/Applications/sqlite3/sqlite3: 2.69% (16.2614 => 16.6983, std. dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 2.67% (4.6629 => 4.7874, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5188 => 1.5588, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 2.47% (14.5298 => 14.8883, std. dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1471, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.59% (0.9108 => 0.9253, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.37% (1.0313 => 1.0454, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2545, std. dev.: 0.0561) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.20% (1.2998 => 1.4194, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7420, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8176, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4271 => 7.6174, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3849, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.22% (10.7476 => 10.9866, std. dev.: 0.0572) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3249, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5744, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6872, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6431, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.02% (1.5089 => 1.5243, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1476, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: -4.61% (1.1560 => 1.1027, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8060, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.84% (20.3410 => 19.7629, std. dev.: 0.0622) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5962, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9632, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2287, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.36% (7.3305 => 7.2311, std. dev.: 0.0293) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3697, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8022, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.9011, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 22:23:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 00:23:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815052349.100CD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2906?compare_to=2904&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2906, Order: 161921, Start Time: 2012-08-15 04:05:36, End Time: 2012-08-15 05:24:31 To: 2904, Order: 161920, Start Time: 2012-08-15 02:19:00, End Time: 2012-08-15 03:38:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (85 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.10% (1.3133 => 1.3277, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (14.0577 => 13.7279, std. dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.59% (1.4297 => 1.4069, std. dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.42% (10.3673 => 13.7279, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.55% (0.0834 => 0.0947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.54% (1.1194 => 1.2486, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3543 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.43% (0.1432 => 0.1567, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.85% (1.7609 => 1.8991, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.40% (2.2022 => 2.3651, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.70% (0.5925 => 0.6263, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.6030 => 0.6370, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.81% (0.4615 => 0.4837, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.63% (0.7326 => 0.7665, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (7.0540 => 7.3795, std. dev.: 0.0261) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (10.4361 => 10.8938, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 4.18% (9.4845 => 9.8813, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.06% (0.8172 => 0.8504, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.93% (0.7433 => 0.7725, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.9449 => 5.1327, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (5.0018 => 5.1875, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.66% (0.5569 => 0.5773, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.54% (4.2646 => 4.4155, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.5860 => 0.6059, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.35% (1.3050 => 1.3487, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.21% (8.1363 => 8.3974, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1861 => 1.2213, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.91% (0.7835 => 0.8063, std. dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 2.91% (5.7591 => 5.9265, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.90% (1.5415 => 1.5862, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9765 => 1.0029, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.63% (0.8067 => 0.8279, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.4103 => 0.4210, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.5105 => 0.5231, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.44% (1.1642 => 1.1926, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.40% (3.3354 => 3.4154, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.36% (1.5603 => 1.5971, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.36% (2.0273 => 2.0751, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.31% (0.6450 => 0.6599, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.29% (0.4636 => 0.4742, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.4186 => 1.4481, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (1.5859 => 1.6181, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.00% (0.8921 => 0.9099, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.91% (0.5981 => 0.6095, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6456 => 0.6579, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.87% (3.8723 => 3.9449, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.85% (2.0665 => 2.1048, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.75% (14.3668 => 14.6178, std. dev.: 0.0146) MultiSource/Applications/siod/siod: 1.68% (2.2969 => 2.3355, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4675, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.2024 => 2.2388, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.2842 => 1.3035, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.42% (1.1840 => 1.2008, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.06% (1.0722 => 1.0836, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.11% (4.2280 => 4.4442, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.04% (26.0924 => 26.6254, std. dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.78% (1.3045 => 1.3277, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: 1.60% (9.1159 => 9.2615, std. dev.: 0.0486) MultiSource/Benchmarks/nbench/nbench: 1.53% (11.6436 => 11.8221, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (5.2636 => 5.3403, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.35% (3.1578 => 3.2004, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 1.27% (3.2827 => 3.3243, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5800, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1631, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.57% (5.3855 => 3.6854, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.22% (5.3526 => 3.6814, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0415, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.42% (2.9384 => 2.5442, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.40% (22.1758 => 19.4249, std. dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -8.48% (1.5373 => 1.4069, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -6.97% (1.1396 => 1.0602, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.77% (5.0483 => 4.8073, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4707, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4149, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9922, std. dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9590, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5114, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3470, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.12% (19.9488 => 19.7251, std. dev.: 0.0824) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2894, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 22:57:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 00:57:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120815055757.21FBB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2907?compare_to=2902&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2907, Order: 161921, Start Time: 2012-08-15 03:15:13, End Time: 2012-08-15 05:58:42 To: 2902, Order: 161904, Start Time: 2012-08-15 00:04:45, End Time: 2012-08-15 02:48:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (82 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (796 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.03% (3.7925 => 3.7535, std. dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.04% (0.3446 => 0.3861, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.03% (0.3465 => 0.3882, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3469 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.93% (0.3496 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.91% (0.3442 => 0.3852, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.91% (0.3460 => 0.3872, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.87% (0.3488 => 0.3902, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 11.53% (0.3650 => 0.4071, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3643 => 0.4061, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.17% (0.3724 => 0.4140, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.27% (0.5826 => 0.6191, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 6.21% (1.5932 => 1.6921, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.11% (0.5889 => 0.6249, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (0.5026 => 0.5324, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (1.6211 => 1.7103, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.36% (3.5627 => 3.7535, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.28% (1.3152 => 1.3847, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.27% (0.4361 => 0.4591, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.5000 => 0.5250, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.99% (0.4994 => 0.5243, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (0.3930 => 0.4120, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.78% (4.2109 => 4.4121, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 4.72% (0.4029 => 0.4219, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.62% (0.7171 => 0.7502, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.54% (0.5900 => 0.6168, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 4.54% (1.0781 => 1.1270, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.2866 => 0.2980, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.98% (0.2566 => 0.2668, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.93% (5.5417 => 5.7593, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.75% (0.3890 => 0.4036, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.71% (0.4658 => 0.4831, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0424, std. dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (2.7292 => 2.8283, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 3.55% (2.1013 => 2.1759, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0670, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 3.41% (23.5202 => 24.3215, std. dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (2.1653 => 2.2388, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.39% (4.4195 => 4.5695, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3195 => 0.3303, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.36% (4.6177 => 4.7728, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 3.25% (0.7875 => 0.8131, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.3903 => 0.4029, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.20% (0.9909 => 1.0226, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.11% (2.0673 => 2.1315, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (1.8794 => 1.9362, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.4139 => 0.4259, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 2.87% (0.3726 => 0.3833, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.84% (1.4269 => 1.4674, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.3678 => 0.3780, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 2.60% (0.4146 => 0.4254, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4251 => 0.4359, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.42% (0.5546 => 0.5680, std. dev.: 0.0024) MultiSource/Applications/hbd/hbd: 2.37% (0.9697 => 0.9927, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.28% (2.0346 => 2.0809, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.6435 => 0.6580, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.54% (0.7426 => 0.7540, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0301, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6131, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6758, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std. dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6394, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7141, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2066, std. dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (41.7953 => 42.6323, std. dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5914, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9158, std. dev.: 0.0199) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2229, std. dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3090, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2825, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.16% (11.9555 => 11.8174, std. dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5531, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/ary2: -9.91% (0.2402 => 0.2164, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7986, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.85% (11.2080 => 10.7763, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0062) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7757, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.73% (17.2379 => 16.7673, std. dev.: 0.0841) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5822, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (16.2163 => 15.9765, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: -1.42% (5.5810 => 5.5018, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 14 23:15:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 01:15:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815061523.A22722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2908?compare_to=2905&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2908, Order: 161927, Start Time: 2012-08-15 05:02:23, End Time: 2012-08-15 06:16:09 To: 2905, Order: 161921, Start Time: 2012-08-15 03:20:32, End Time: 2012-08-15 04:34:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 1.25% (2.2545 => 2.2826, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.66% (81.0890 => 78.9357, std. dev.: 0.8121) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3042, std. dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7061 => 0.7697, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.92% (0.5818 => 0.6337, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.65% (0.5748 => 0.6245, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3578 => 0.3857, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3646 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.64% (0.3601 => 0.3876, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.56% (0.3663 => 0.3940, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.52% (0.3789 => 0.4074, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 7.45% (0.3623 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 7.37% (0.4003 => 0.4298, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7038 => 0.7542, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (3.9660 => 4.2471, std. dev.: 0.0148) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4651, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (0.4328 => 0.4619, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.25% (1.2193 => 1.2955, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.22% (0.9199 => 0.9771, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3246 => 0.3442, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.04% (0.6959 => 0.7379, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.87% (0.3899 => 0.4128, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4379 => 0.4627, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.63% (0.5577 => 0.5891, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.60% (0.4390 => 0.4636, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3485 => 0.3677, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.40% (13.8202 => 14.5671, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.38% (1.9828 => 2.0895, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3107 => 0.3274, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.20% (1.1364 => 1.1955, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.18% (1.4563 => 1.5318, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.88% (0.4016 => 0.4212, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (0.8310 => 0.8715, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.84% (0.5637 => 0.5910, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.71% (1.3245 => 1.3869, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.70% (3.8646 => 4.0462, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.69% (1.3813 => 1.4461, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.63% (1.0594 => 1.1085, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (1.3819 => 1.4458, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.61% (7.2180 => 7.5509, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.56% (1.1061 => 1.1565, std. dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.7460 => 0.7795, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 4.33% (0.7506 => 0.7831, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 4.31% (1.9270 => 2.0100, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 4.21% (0.2995 => 0.3121, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.19% (2.1791 => 2.2703, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 4.09% (16.6129 => 17.2929, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.01% (0.4791 => 0.4983, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.3801 => 4.5521, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (4.4433 => 4.6169, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.86% (4.9865 => 5.1790, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8089, std. dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.72% (0.6135 => 0.6363, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1333 => 1.1752, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (13.2842 => 13.7748, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.41% (0.6283 => 0.6497, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.8698 => 0.8984, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2885, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.01% (8.4961 => 8.7521, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.99% (3.2742 => 3.3721, std. dev.: 0.0218) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7638, std. dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 2.86% (14.8535 => 15.2789, std. dev.: 0.0130) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.76% (16.2614 => 16.7099, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 2.71% (4.6629 => 4.7893, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.5298 => 14.9075, std. dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.1007 => 2.1498, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.9108 => 0.9265, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.62% (0.6250 => 0.6351, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.60% (1.0313 => 1.0478, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.14% (3.7467 => 3.7895, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/fbench: 25.59% (1.8175 => 2.2826, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.08% (1.2998 => 1.3918, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.2093 => 0.2209, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7437, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8174, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4271 => 7.6068, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.36% (10.7476 => 11.0013, std. dev.: 0.0300) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3262, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5171, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.04% (4.5928 => 4.6405, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1901, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.84% (1.0460 => 0.8489, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.18% (1.3780 => 1.3066, std. dev.: 0.0114) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.52% (1.1560 => 1.1038, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6003, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.39% (20.3410 => 19.8557, std. dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.35% (0.6589 => 0.6434, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9604, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2345, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2295, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8634, std. dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (84.4286 => 83.3835, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8030, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8991, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 00:13:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 02:13:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815071309.408562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2909?compare_to=2906&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2909, Order: 161927, Start Time: 2012-08-15 05:52:06, End Time: 2012-08-15 07:13:53 To: 2906, Order: 161921, Start Time: 2012-08-15 04:05:36, End Time: 2012-08-15 05:24:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (56 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (782 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.47% (1.4069 => 1.4417, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.03% (10.3673 => 13.6883, std. dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.15% (0.0834 => 0.0952, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 11.47% (0.3497 => 0.3898, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.34% (1.1194 => 1.2463, std. dev.: 0.0296) SingleSource/UnitTests/ObjC/exceptions-3: 11.32% (0.3516 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.3927 => 0.4337, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.56% (0.3817 => 0.4182, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.75% (1.7609 => 1.8973, std. dev.: 0.0213) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (2.2022 => 2.3724, std. dev.: 0.0439) SingleSource/UnitTests/ObjC++/property-reference-object: 5.87% (0.6030 => 0.6384, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.84% (0.5925 => 0.6271, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (0.4615 => 0.4838, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 4.79% (0.7326 => 0.7677, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.43% (10.4361 => 10.8984, std. dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 4.38% (9.4845 => 9.8999, std. dev.: 0.0224) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.61% (0.8172 => 0.8467, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9417, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.97% (0.7835 => 0.8068, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4636 => 0.4770, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.60% (3.3354 => 3.4221, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.51% (0.4103 => 0.4206, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.46% (1.1642 => 1.1928, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 2.41% (2.0273 => 2.0761, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.35% (0.6675 => 0.6832, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5859 => 1.6215, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.12% (0.6456 => 0.6593, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.02% (17.1811 => 17.5281, std. dev.: 0.0442) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (2.0665 => 2.1058, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.2024 => 2.2437, std. dev.: 0.0074) MultiSource/Applications/siod/siod: 1.76% (2.2969 => 2.3374, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.96% (4.2280 => 4.4378, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7459, std. dev.: 0.0198) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8224, std. dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 1.38% (5.2636 => 5.3365, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 1.31% (3.1578 => 3.1992, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.26% (3.2827 => 3.3239, std. dev.: 0.0058) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6819, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -80.57% (0.8651 => 0.1681, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.31% (5.2763 => 3.1495, std. dev.: 0.0395) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.63% (5.3855 => 3.6821, std. dev.: 0.0510) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.28% (5.3526 => 3.6783, std. dev.: 0.0613) SingleSource/UnitTests/Vector/constpool: -15.12% (54.1659 => 45.9746, std. dev.: 0.0253) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5374, std. dev.: 0.0477) MultiSource/Applications/ClamAV/clamscan: -12.33% (22.1758 => 19.4419, std. dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -6.22% (1.5373 => 1.4417, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8069, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4652, std. dev.: 0.0164) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4193, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9924, std. dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.31% (8.1563 => 7.9676, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5130, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (12.5348 => 12.3440, std. dev.: 0.0081) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std. dev.: 0.0230) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (19.9488 => 19.7341, std. dev.: 0.0330) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7070, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.01% (2.3135 => 2.2901, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 00:59:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 02:59:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815075915.C13DE2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/2910?compare_to=2908&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2910, Order: 161929, Start Time: 2012-08-15 06:43:26, End Time: 2012-08-15 07:59:59 To: 2908, Order: 161927, Start Time: 2012-08-15 05:02:23, End Time: 2012-08-15 06:16:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (99 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 3.00% (0.5336 => 0.5496, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 1.82% (1.3918 => 1.4172, std. dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.58% (2.0176 => 2.2915, std. dev.: 0.0576) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.5818 => 0.6328, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5748 => 0.6240, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.51% (0.7061 => 0.7662, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3578 => 0.3847, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.36% (0.3601 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3789 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3914 => 0.4198, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.23% (0.3623 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.21% (0.3650 => 0.3913, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 7.20% (1.3693 => 1.4679, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 7.09% (0.4003 => 0.4287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (0.4328 => 0.4622, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.79% (0.7038 => 0.7516, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 6.23% (0.4062 => 0.4315, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.76% (0.4390 => 0.4643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2937 => 0.3103, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2726 => 0.2878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3149 => 0.3320, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3192 => 0.3362, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5337, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.92% (0.3293 => 0.3455, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.88% (0.4016 => 0.4212, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.79% (0.3756 => 0.3936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.63% (1.1061 => 1.1573, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.38% (2.1791 => 2.2746, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.36% (0.7506 => 0.7833, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2815, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.09% (1.9270 => 2.0059, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 3.86% (16.6129 => 17.2547, std. dev.: 0.0312) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.68% (4.9865 => 5.1701, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (0.8698 => 0.8982, std. dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7495, std. dev.: 0.0105) MultiSource/Applications/d/make_dparser: 2.94% (3.1889 => 3.2828, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7592, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3641, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2605, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 2.73% (16.2614 => 16.7047, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (1.5188 => 1.5586, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.39% (14.5298 => 14.8769, std. dev.: 0.0154) MultiSource/Applications/oggenc/oggenc: 2.22% (4.6629 => 4.7664, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.1007 => 2.1469, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.41% (1.0313 => 1.0458, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.08% (3.7467 => 3.7873, std. dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5207, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.89% (1.8175 => 2.2699, std. dev.: 0.0436) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.03% (1.2998 => 1.4172, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.60% (1.9144 => 2.0024, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7404, std. dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.61% (2.8606 => 2.9639, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3857, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5948, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.10% (10.7476 => 10.9737, std. dev.: 0.0353) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3255, std. dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0422) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.5928 => 4.6419, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1614, std. dev.: 0.3033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.63% (0.4366 => 0.4164, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0052) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.73% (20.3410 => 19.7848, std. dev.: 0.0316) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std. dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.32% (0.6589 => 0.6436, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2223, std. dev.: 0.0117) MultiSource/Applications/spiff/spiff: -2.05% (3.0263 => 2.9643, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2322, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4929, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0153) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8023, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.9001, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 02:00:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 04:00:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815090020.D930C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2911?compare_to=2909&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2911, Order: 161931, Start Time: 2012-08-15 07:41:39, End Time: 2012-08-15 09:01:05 To: 2909, Order: 161927, Start Time: 2012-08-15 05:52:06, End Time: 2012-08-15 07:13:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (87 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (750 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.02% (13.6883 => 13.8277, std. dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.01% (7.9717 => 8.0526, std. dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.23% (1.4417 => 1.4096, std. dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.38% (10.3673 => 13.8277, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3516 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3561 => 0.3994, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (1.7609 => 1.9072, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.53% (2.2022 => 2.3680, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 6.19% (0.5925 => 0.6292, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 6.17% (0.6030 => 0.6402, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.60% (0.4879 => 0.5152, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.22% (0.4615 => 0.4856, std. dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7326 => 0.7696, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.77% (7.0540 => 7.3904, std. dev.: 0.0124) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.8172 => 0.8542, std. dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 4.45% (0.7433 => 0.7764, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (10.4361 => 10.8943, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.29% (9.4845 => 9.8917, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.23% (0.5860 => 0.6108, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.9449 => 5.1408, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (5.0018 => 5.1953, std. dev.: 0.0224) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (4.2646 => 4.4276, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (1.3050 => 1.3511, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 3.45% (0.7835 => 0.8105, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (1.5415 => 1.5946, std. dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.38% (8.1363 => 8.4112, std. dev.: 0.0093) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.25% (0.3387 => 0.3497, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.08% (5.7591 => 5.9365, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.4103 => 0.4228, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.8067 => 0.8308, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.98% (0.9765 => 1.0056, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6450 => 0.6635, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.78% (1.1642 => 1.1966, std. dev.: 0.0096) MultiSource/Applications/treecc/treecc: 2.70% (2.0273 => 2.0821, std. dev.: 0.0061) MultiSource/Applications/d/make_dparser: 2.68% (3.3354 => 3.4247, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.61% (0.4636 => 0.4757, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.5105 => 0.5236, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6226, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.30% (3.8723 => 3.9615, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6675 => 0.6820, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.17% (1.4186 => 1.4494, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 2.11% (0.6456 => 0.6592, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.09% (0.5981 => 0.6106, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 2.08% (2.2969 => 2.3446, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.06% (2.0665 => 2.1090, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8921 => 0.9104, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.2024 => 2.2454, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.87% (14.3668 => 14.6353, std. dev.: 0.0195) MultiSource/Applications/sqlite3/sqlite3: 1.84% (17.1811 => 17.4967, std. dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2842 => 1.3065, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 1.58% (1.1840 => 1.2027, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: 1.48% (0.7115 => 0.7220, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.19% (1.0722 => 1.0850, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (4.2280 => 4.4421, std. dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 2.08% (26.0924 => 26.6359, std. dev.: 0.0329) MultiSource/Applications/minisat/minisat: 1.64% (9.1159 => 9.2656, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.38% (5.2636 => 5.3360, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 1.30% (3.1578 => 3.1989, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.29% (3.2827 => 3.3252, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5762, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.94% (5.2763 => 3.1689, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7029, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6986, std. dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0859, std. dev.: 0.0225) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5476, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -12.08% (22.1758 => 19.4959, std. dev.: 0.0448) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -8.31% (1.5373 => 1.4096, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5570, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8067, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4757, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4169, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.52% (10.2830 => 10.0235, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9598, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6781, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3387, std. dev.: 0.0091) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4232, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.16% (1.8329 => 1.8116, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2895, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 02:11:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 04:11:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120815091137.931442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2912?compare_to=2907&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2912, Order: 161929, Start Time: 2012-08-15 06:25:54, End Time: 2012-08-15 09:12:22 To: 2907, Order: 161921, Start Time: 2012-08-15 03:15:13, End Time: 2012-08-15 05:58:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (72 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (808 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.00% (0.2116 => 0.2243, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.47% (2.0475 => 2.1185, std. dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.76% (116.4674 => 118.5224, std. dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.22% (0.3446 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3465 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3442 => 0.3857, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 12.02% (0.3460 => 0.3876, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3496 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3469 => 0.3884, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.93% (0.3488 => 0.3904, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 11.70% (0.3650 => 0.4077, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.61% (0.3643 => 0.4066, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.43% (1.5932 => 1.6956, std. dev.: 0.0170) SingleSource/UnitTests/ObjC++/Hello: 6.27% (0.5826 => 0.6191, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.08% (0.5889 => 0.6247, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.83% (1.3152 => 1.3919, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (0.4994 => 0.5279, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (0.5026 => 0.5302, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.36% (0.5900 => 0.6216, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.30% (0.5000 => 0.5265, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.21% (0.4361 => 0.4588, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.92% (0.7171 => 0.7524, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.2866 => 0.3003, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.75% (0.2566 => 0.2688, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (0.4658 => 0.4851, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (1.9694 => 2.0453, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (1.9966 => 2.0733, std. dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.75% (0.3890 => 0.4036, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (2.7292 => 2.8310, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.65% (0.2875 => 0.2980, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.63% (0.3362 => 0.3484, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (2.1013 => 2.1762, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 3.49% (23.5202 => 24.3419, std. dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.39% (0.3271 => 0.3382, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.35% (0.4146 => 0.4285, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.29% (0.3195 => 0.3300, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.3903 => 0.4030, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (2.0673 => 2.1341, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (4.4195 => 4.5619, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (0.3625 => 0.3729, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 2.79% (0.3726 => 0.3830, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.60% (0.5546 => 0.5690, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.54% (0.3981 => 0.4082, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.36% (0.6435 => 0.6587, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.5012 => 0.5113, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (0.7426 => 0.7552, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2122 => 0.2243, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6628, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8946, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1730, std. dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6260, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6664, std. dev.: 0.0272) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2018, std. dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.94% (41.7953 => 42.6078, std. dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.75% (2.0820 => 2.1185, std. dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5904, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2248, std. dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 1.43% (46.6247 => 47.2911, std. dev.: 0.0096) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5772, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ary2: -8.53% (0.2402 => 0.2197, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std. dev.: 0.0394) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7896, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std. dev.: 0.0152) SingleSource/UnitTests/Vector/build2: -3.78% (11.2080 => 10.7844, std. dev.: 0.0141) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0038) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std. dev.: 0.0333) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.80% (0.6293 => 0.6117, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7956, std. dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.65% (10.7630 => 10.5859, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9648, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 02:41:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 04:41:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815094118.D5B412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2913?compare_to=2910&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2913, Order: 161934, Start Time: 2012-08-15 08:27:56, End Time: 2012-08-15 09:42:02 To: 2910, Order: 161929, Start Time: 2012-08-15 06:43:26, End Time: 2012-08-15 07:59:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (146 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.76% (78.1134 => 80.2712, std. dev.: 0.2400) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.67% (55.0907 => 56.5595, std. dev.: 0.0374) SingleSource/Benchmarks/Misc/mandel-2: 1.34% (1.4172 => 1.4362, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: 1.06% (7.9720 => 8.0568, std. dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.44% (2.0176 => 2.2888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.72% (0.7061 => 0.7677, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5818 => 0.6322, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5748 => 0.6232, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.12% (0.7710 => 0.8336, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.92% (0.3789 => 0.4089, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.91% (0.3601 => 0.3886, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.84% (0.3663 => 0.3950, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.75% (0.3650 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.72% (0.3914 => 0.4216, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.25% (1.3693 => 1.4686, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.16% (0.5265 => 0.5642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.09% (0.4328 => 0.4635, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.00% (3.9660 => 4.2436, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.79% (0.4062 => 0.4338, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (0.7038 => 0.7512, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.6959 => 0.7424, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.65% (0.2781 => 0.2966, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.63% (0.4390 => 0.4681, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3022 => 0.3212, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.28% (0.9199 => 0.9777, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.2937 => 0.3120, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2655 => 0.2818, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2628 => 0.2789, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.12% (0.2760 => 0.2929, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.12% (1.9828 => 2.1042, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.12% (1.2193 => 1.2939, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.10% (0.3489 => 0.3702, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2761 => 0.2929, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.08% (0.3899 => 0.4136, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.07% (0.2966 => 0.3146, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3149 => 0.3336, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.91% (0.3485 => 0.3691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3192 => 0.3375, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.66% (0.2988 => 0.3157, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 5.34% (0.3293 => 0.3469, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 5.23% (13.8202 => 14.5429, std. dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.3756 => 0.3952, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.21% (0.3534 => 0.3718, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4016 => 0.4225, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.20% (1.4563 => 1.5320, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.97% (1.1364 => 1.1929, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.96% (0.8310 => 0.8722, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.90% (1.3245 => 1.3894, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.5637 => 0.5911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.82% (7.2180 => 7.5657, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.75% (1.1061 => 1.1586, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.65% (0.2945 => 0.3082, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.64% (3.8646 => 4.0440, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.50% (1.0594 => 1.1071, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 4.48% (1.2292 => 1.2843, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.43% (1.3813 => 1.4425, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (1.3819 => 1.4427, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.32% (1.9270 => 2.0103, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 4.14% (2.1791 => 2.2694, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.97% (0.3755 => 0.3904, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.3801 => 4.5539, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.93% (0.6135 => 0.6376, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (4.4433 => 4.6157, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 3.84% (16.6129 => 17.2516, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.82% (0.4791 => 0.4974, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8090, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.72% (1.1333 => 1.1755, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (13.2842 => 13.7666, std. dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.48% (4.9865 => 5.1599, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.41% (0.8698 => 0.8995, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.97% (3.1889 => 3.2836, std. dev.: 0.0277) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7471, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (1.5188 => 1.5607, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2561, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.5754 => 6.7520, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (3.2742 => 3.3621, std. dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.5298 => 14.9018, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.54% (16.2614 => 16.6747, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.27% (2.1007 => 2.1484, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.26% (4.6629 => 4.7681, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.71% (0.6250 => 0.6357, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (0.9108 => 0.9238, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.14% (33.2944 => 33.6747, std. dev.: 0.0237) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7862, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2599, std. dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 10.49% (1.2998 => 1.4362, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.01% (1.5824 => 1.6616, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.39% (11.2619 => 11.7566, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8174, std. dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5956, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.07% (10.7476 => 10.9706, std. dev.: 0.0518) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3249, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5171, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.04% (4.5928 => 4.6405, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.19% (22.5627 => 21.1658, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1031, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.18% (1.3780 => 1.3204, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.58% (20.3410 => 19.8152, std. dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.58% (8.8259 => 8.5986, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9607, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2364, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.33% (7.3305 => 7.2328, std. dev.: 0.0241) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3685, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8706, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8026, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8993, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 03:47:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 05:47:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815104713.B558B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2914?compare_to=2911&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2914, Order: 161934, Start Time: 2012-08-15 09:28:41, End Time: 2012-08-15 10:47:58 To: 2911, Order: 161931, Start Time: 2012-08-15 07:41:39, End Time: 2012-08-15 09:01:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.52% (0.5325 => 0.5459, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.52% (10.3673 => 13.7391, std. dev.: 0.0114) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3543 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.58% (0.3516 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (1.1194 => 1.2436, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.33% (1.7609 => 1.8899, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.08% (2.2022 => 2.3582, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 5.87% (0.6030 => 0.6384, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.3177 => 0.3361, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5925 => 0.6265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7326 => 0.7709, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (7.0540 => 7.3832, std. dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7433 => 0.7772, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.17% (0.8172 => 0.8513, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.17% (4.9449 => 5.1512, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (9.4845 => 9.8784, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.4361 => 10.8646, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.06% (0.5569 => 0.5795, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (5.0018 => 5.1976, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.86% (4.2646 => 4.4292, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.60% (1.3050 => 1.3520, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.56% (8.1363 => 8.4263, std. dev.: 0.0071) MultiSource/Applications/spiff/spiff: 3.48% (0.7835 => 0.8108, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4636 => 0.4789, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1861 => 1.2246, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (1.5415 => 1.5915, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.4103 => 0.4236, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.16% (0.9765 => 1.0074, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.05% (1.1642 => 1.1997, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.00% (5.7591 => 5.9321, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.83% (1.5603 => 1.6045, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (0.5105 => 0.5248, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.77% (3.3354 => 3.4278, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.76% (2.0273 => 2.0832, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4289 => 0.4405, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6450 => 0.6620, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.58% (2.0665 => 2.1198, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.55% (0.6675 => 0.6845, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.54% (0.6456 => 0.6620, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (0.4064 => 0.4166, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5859 => 1.6248, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.36% (3.8723 => 3.9638, std. dev.: 0.0105) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.5020 => 0.5134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (0.4620 => 0.4724, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.4186 => 1.4500, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 2.13% (0.8921 => 0.9111, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3110, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 2.08% (2.2969 => 2.3447, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.01% (17.1811 => 17.5264, std. dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.2024 => 2.2466, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (14.3668 => 14.6537, std. dev.: 0.0078) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.40% (1.1840 => 1.2006, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.25% (1.0722 => 1.0856, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.96% (4.2280 => 4.4377, std. dev.: 0.0114) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7593, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.12% (26.0924 => 26.6449, std. dev.: 0.0215) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8228, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.51% (9.1159 => 9.2533, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (5.2636 => 5.3406, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1578 => 3.1994, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.29% (3.2827 => 3.3252, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5828, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1242, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1464, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.79% (5.3855 => 3.6732, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6745, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0178, std. dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.82% (2.9384 => 2.5324, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -12.30% (22.1758 => 19.4479, std. dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -7.79% (1.5373 => 1.4176, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7609, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8068, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4702, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4172, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0023, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9635, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3478, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2895, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 04:23:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 06:23:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815112305.787162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2915?compare_to=2913&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2915, Order: 161937, Start Time: 2012-08-15 10:09:38, End Time: 2012-08-15 11:23:49 To: 2913, Order: 161934, Start Time: 2012-08-15 08:27:56, End Time: 2012-08-15 09:42:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (151 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.35% (1.4362 => 1.4168, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.05% (2.0176 => 2.3011, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.59% (0.5818 => 0.6318, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.44% (0.7061 => 0.7657, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 8.24% (0.3578 => 0.3873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.23% (0.5748 => 0.6221, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.14% (0.3601 => 0.3894, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.95% (0.3650 => 0.3940, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.87% (0.3623 => 0.3908, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.4003 => 0.4312, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.68% (0.7710 => 0.8302, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 7.62% (1.3693 => 1.4737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.61% (0.3940 => 0.4240, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.60% (0.7038 => 0.7573, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.43% (0.4062 => 0.4364, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.36% (3.9660 => 4.2577, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4328 => 0.4641, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5265 => 0.5645, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.65% (0.2782 => 0.2967, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.62% (0.3899 => 0.4157, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.59% (0.3022 => 0.3221, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4390 => 0.4677, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.48% (0.6959 => 0.7410, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.43% (1.2193 => 1.2977, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.33% (0.9199 => 0.9781, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.29% (0.2765 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2760 => 0.2932, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.21% (0.4379 => 0.4651, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.20% (0.2726 => 0.2895, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.17% (1.9828 => 2.1052, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.3107 => 0.3296, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.08% (0.3489 => 0.3701, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.07% (0.3149 => 0.3340, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.89% (0.2988 => 0.3164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3192 => 0.3380, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 5.79% (0.3453 => 0.3653, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.74% (0.5577 => 0.5897, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (1.4563 => 1.5380, std. dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2127 => 0.2246, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 5.56% (13.8202 => 14.5891, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/lists1: 5.52% (0.3534 => 0.3729, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.49% (0.2914 => 0.3074, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4016 => 0.4235, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3756 => 0.3956, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.29% (0.2023 => 0.2130, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.1364 => 1.1952, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.11% (1.0594 => 1.1135, std. dev.: 0.0112) MultiSource/Applications/Burg/burg: 5.07% (1.1061 => 1.1622, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.04% (0.5637 => 0.5921, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.04% (1.3245 => 1.3912, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (7.2180 => 7.5802, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.99% (0.8310 => 0.8725, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.93% (3.8646 => 4.0553, std. dev.: 0.0077) MultiSource/Applications/spiff/spiff: 4.85% (0.7506 => 0.7870, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.78% (1.2292 => 1.2880, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (1.3813 => 1.4470, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.67% (1.3819 => 1.4464, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.57% (1.9270 => 2.0150, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.57% (2.1791 => 2.2786, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.53% (0.7460 => 0.7798, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 4.47% (0.2995 => 0.3129, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.31% (16.6129 => 17.3295, std. dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.24% (0.4791 => 0.4994, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3755 => 0.3914, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.19% (0.6135 => 0.6392, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.3801 => 4.5609, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (4.4433 => 4.6257, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (3.6692 => 3.8188, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.99% (4.9865 => 5.1856, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (13.2842 => 13.8012, std. dev.: 0.0211) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.76% (0.8698 => 0.9025, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.72% (0.6283 => 0.6517, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.69% (1.1333 => 1.1751, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.61% (0.3131 => 0.3244, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.48% (0.4113 => 0.4256, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (8.4961 => 8.7825, std. dev.: 0.0122) MultiSource/Applications/d/make_dparser: 3.25% (3.1889 => 3.2926, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.11% (3.2742 => 3.3761, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.5188 => 1.5655, std. dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (6.5754 => 6.7761, std. dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 3.00% (14.8535 => 15.2995, std. dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 2.94% (16.2614 => 16.7402, std. dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9196, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (2.1007 => 2.1565, std. dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 2.39% (4.6629 => 4.7743, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.05% (0.6744 => 0.6882, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.75% (1.0313 => 1.0493, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7635, std. dev.: 0.0142) MultiSource/Applications/lua/lua: 1.40% (3.7467 => 3.7990, std. dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (6.2785 => 6.3417, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.33% (1.8175 => 2.2597, std. dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.00% (1.2998 => 1.4168, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.64% (0.2093 => 0.2211, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9637, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8179, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5970, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.10% (10.7476 => 10.9731, std. dev.: 0.0106) MultiSource/Benchmarks/llubenchmark/llu: 1.99% (3.7731 => 3.8483, std. dev.: 0.0175) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3265, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5174, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9662, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6414, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.78% (22.5627 => 21.2589, std. dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5103, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.28% (1.3780 => 1.3190, std. dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5816, std. dev.: 0.0199) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.77% (20.3410 => 19.7785, std. dev.: 0.0449) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9613, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2273, std. dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3305 => 7.2288, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3729, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8027, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8987, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.06% (6.6320 => 6.5616, std. dev.: 0.0139) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 05:22:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 07:22:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120815122224.9C98E2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/2916?compare_to=2912&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2916, Order: 161937, Start Time: 2012-08-15 09:39:54, End Time: 2012-08-15 12:23:09 To: 2912, Order: 161929, Start Time: 2012-08-15 06:25:54, End Time: 2012-08-15 09:12:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.10% (1.6956 => 1.7143, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.44% (0.3465 => 0.3896, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3442 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.28% (0.3460 => 0.3885, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.27% (0.3488 => 0.3916, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3496 => 0.3922, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.55% (0.3724 => 0.4154, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.1620 => 0.1758, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.60% (1.5932 => 1.7143, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5826 => 0.6218, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.54% (0.5889 => 0.6274, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.36% (0.2014 => 0.2142, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.10% (1.3152 => 1.3954, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.09% (1.6211 => 1.7199, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (0.5026 => 0.5324, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (0.3930 => 0.4163, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (3.5627 => 3.7720, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (0.4361 => 0.4612, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (0.5000 => 0.5282, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.61% (0.4994 => 0.5274, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.42% (0.5900 => 0.6220, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 5.27% (4.2109 => 4.4327, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 5.26% (1.0781 => 1.1348, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 5.17% (0.7171 => 0.7542, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.16% (0.4029 => 0.4237, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.2866 => 0.3006, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.2736 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.60% (0.3195 => 0.3342, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.53% (1.9694 => 2.0586, std. dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (2.7292 => 2.8527, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.51% (0.2792 => 0.2918, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.2823 => 0.2950, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.50% (2.1013 => 2.1958, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 4.44% (0.9909 => 1.0349, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 4.39% (5.5417 => 5.7851, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.38% (0.2875 => 0.3001, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (0.4658 => 0.4860, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.29% (1.9966 => 2.0822, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.26% (0.3004 => 0.3132, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.25% (0.2803 => 0.2922, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (0.3890 => 0.4055, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 4.15% (0.2725 => 0.2838, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2750 => 0.2864, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.10% (2.0673 => 2.1521, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2911 => 0.3029, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.03% (2.1653 => 2.2525, std. dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 4.02% (4.6177 => 4.8033, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3317 => 0.3449, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.3271 => 0.3401, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.96% (0.2780 => 0.2890, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2811 => 0.2921, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.89% (0.3678 => 0.3821, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.86% (0.3267 => 0.3393, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3258 => 0.3383, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.84% (1.8794 => 1.9515, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3282 => 0.3406, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.76% (0.7875 => 0.8171, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (4.4195 => 4.5854, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.3903 => 0.4049, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.74% (0.3690 => 0.3828, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3477 => 0.3607, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.74% (0.4146 => 0.4301, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3625 => 0.3759, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3726 => 0.3863, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.3362 => 0.3485, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 3.64% (0.3348 => 0.3470, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.63% (0.3060 => 0.3171, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.62% (0.3124 => 0.3237, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.61% (23.5202 => 24.3697, std. dev.: 0.0145) MultiSource/Applications/lua/lua: 3.49% (1.4269 => 1.4767, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.48% (0.4251 => 0.4399, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.3981 => 0.4115, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.36% (0.4139 => 0.4278, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 3.35% (0.9697 => 1.0022, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 3.27% (0.3336 => 0.3445, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.14% (0.5546 => 0.5720, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.09% (0.3845 => 0.3964, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.6435 => 0.6629, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.87% (0.5012 => 0.5156, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.61% (2.0346 => 2.0877, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.25% (0.4847 => 0.4956, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (0.5361 => 0.5477, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (0.7426 => 0.7573, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.32% (11.6398 => 11.7940, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.07% (4.6926 => 4.7426, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.54% (0.2122 => 0.2282, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6733, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-2: 4.82% (1.8057 => 1.8928, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1657, std. dev.: 0.0442) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6407, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6780, std. dev.: 0.0364) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2089, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (41.7953 => 42.6427, std. dev.: 0.0129) MultiSource/Applications/lua/lua: 1.73% (50.0626 => 50.9302, std. dev.: 0.0262) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5917, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2213, std. dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3094, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2824, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5493, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7912, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8005, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std. dev.: 0.0050) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.30% (17.2379 => 16.8421, std. dev.: 0.0377) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5683, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9580, std. dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 05:33:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 07:33:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815123348.52D502A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/2917?compare_to=2914&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2917, Order: 161940, Start Time: 2012-08-15 11:15:28, End Time: 2012-08-15 12:34:32 To: 2914, Order: 161934, Start Time: 2012-08-15 09:28:41, End Time: 2012-08-15 10:47:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (98 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (738 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.62% (78.3914 => 80.4422, std. dev.: 0.2562) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.96% (10.3673 => 13.6811, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: 11.95% (0.3473 => 0.3888, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 11.72% (0.3516 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (1.1194 => 1.2433, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.20% (1.7609 => 1.8876, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.05% (2.2022 => 2.3575, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 5.75% (0.6030 => 0.6377, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.62% (0.5925 => 0.6258, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.70% (0.7326 => 0.7670, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.41% (7.0540 => 7.3654, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8786, std. dev.: 0.0181) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.01% (0.8172 => 0.8500, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 3.87% (10.4361 => 10.8401, std. dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (4.9449 => 5.1289, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (5.0018 => 5.1862, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.66% (4.2646 => 4.4205, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.55% (1.3050 => 1.3513, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.4636 => 0.4795, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.1363 => 8.4106, std. dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3441 => 0.3552, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.4064 => 0.4195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.17% (0.7835 => 0.8083, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.4103 => 0.4231, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.4289 => 0.4422, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9765 => 1.0063, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3283 => 0.3383, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2222, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.5415 => 1.5884, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.88% (0.3650 => 0.3755, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.86% (5.7591 => 5.9238, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3865 => 0.3974, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.80% (0.3826 => 0.3933, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (2.0665 => 2.1240, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.73% (1.1642 => 1.1960, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.71% (3.3354 => 3.4258, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 2.60% (0.6456 => 0.6624, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.58% (0.8067 => 0.8275, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 2.53% (2.0273 => 2.0785, std. dev.: 0.0094) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5988, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4620 => 0.4733, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.34% (0.6450 => 0.6601, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 2.33% (0.4299 => 0.4399, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.29% (0.6675 => 0.6828, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2842 => 1.3125, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.18% (3.8723 => 3.9568, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.18% (17.1811 => 17.5558, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.12% (1.5859 => 1.6195, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5981 => 0.6107, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5020 => 0.5123, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.4186 => 1.4477, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (14.3668 => 14.6524, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/football/football: 1.98% (0.8921 => 0.9098, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.86% (2.2969 => 2.3396, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.2024 => 2.2388, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.41% (1.1840 => 1.2007, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.07% (1.0722 => 1.0837, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.45% (4.2280 => 4.4586, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 2.02% (26.0924 => 26.6187, std. dev.: 0.0314) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.50% (9.1159 => 9.2528, std. dev.: 0.0370) MultiSource/Applications/lambda-0_1_3/lambda: 1.41% (5.2636 => 5.3376, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.32% (3.1578 => 3.1995, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.30% (3.2827 => 3.3254, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.07% (1.3045 => 1.3184, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1241, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1536, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.83% (5.3855 => 3.6714, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.33% (5.3526 => 3.6754, std. dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: -15.26% (54.1659 => 45.8999, std. dev.: 0.0321) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.90% (2.9384 => 2.5300, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.33% (22.1758 => 19.4426, std. dev.: 0.0396) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -8.29% (1.5373 => 1.4098, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.13% (1.5835 => 1.5023, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8065, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6142, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4704, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4284, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0033, std. dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9591, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6773, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3485, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.3135 => 2.2896, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 06:04:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 08:04:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815130435.50A602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2918?compare_to=2915&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2918, Order: 161940, Start Time: 2012-08-15 11:51:20, End Time: 2012-08-15 13:05:20 To: 2915, Order: 161937, Start Time: 2012-08-15 10:09:38, End Time: 2012-08-15 11:23:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.61% (78.7132 => 80.7689, std. dev.: 0.0520) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.94% (3.8483 => 3.7736, std. dev.: 0.0126) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.98% (2.0176 => 2.2996, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.04% (0.3130 => 0.3413, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7061 => 0.7666, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.56% (0.5818 => 0.6316, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.21% (0.5748 => 0.6220, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.19% (0.3578 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.05% (0.3663 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.00% (0.3623 => 0.3913, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 8.00% (0.3601 => 0.3889, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.98% (0.3646 => 0.3937, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (0.1413 => 0.1525, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.91% (0.7710 => 0.8320, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.84% (0.3650 => 0.3936, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 7.79% (0.3940 => 0.4247, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.46% (0.7038 => 0.7563, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.36% (3.9660 => 4.2577, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 7.33% (1.3693 => 1.4697, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4328 => 0.4641, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.10% (0.5265 => 0.5639, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.76% (0.3580 => 0.3822, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 6.65% (0.2781 => 0.2966, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2782 => 0.2966, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.49% (0.3899 => 0.4152, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.34% (1.2193 => 1.2966, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.31% (0.6959 => 0.7398, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.2937 => 0.3121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.25% (0.9199 => 0.9774, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.21% (0.3107 => 0.3300, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.13% (0.4390 => 0.4659, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.10% (0.4379 => 0.4646, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.09% (0.2726 => 0.2892, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.08% (1.9828 => 2.1034, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.08% (0.3489 => 0.3701, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2761 => 0.2928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3149 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.03% (0.3485 => 0.3695, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.97% (0.5577 => 0.5910, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.74% (0.1865 => 0.1972, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3192 => 0.3375, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.64% (1.4563 => 1.5385, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.64% (0.2023 => 0.2137, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 5.62% (0.3453 => 0.3647, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.59% (0.2914 => 0.3077, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.53% (13.8202 => 14.5842, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.3293 => 0.3471, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 5.38% (0.3534 => 0.3724, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.37% (0.8310 => 0.8756, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.35% (0.4016 => 0.4231, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (1.1364 => 1.1964, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.2925 => 0.3075, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.06% (0.5637 => 0.5922, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.02% (0.3868 => 0.4062, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.01% (7.2180 => 7.5794, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.94% (1.3245 => 1.3899, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.93% (1.1061 => 1.1606, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 4.91% (3.8646 => 4.0544, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: 4.80% (0.7506 => 0.7866, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.80% (1.0594 => 1.1102, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 4.80% (1.9270 => 2.0194, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2292 => 1.2877, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (1.3819 => 1.4472, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.69% (0.7460 => 0.7810, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 4.57% (0.2995 => 0.3132, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.48% (16.6129 => 17.3576, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.47% (1.3813 => 1.4430, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 4.39% (2.1791 => 2.2747, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.24% (0.6135 => 0.6395, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.3801 => 4.5653, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.22% (0.4791 => 0.4993, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.14% (4.4433 => 4.6271, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (3.6692 => 3.8189, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.95% (1.1333 => 1.1781, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.94% (4.9865 => 5.1829, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (13.2842 => 13.7901, std. dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.72% (0.6283 => 0.6517, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.61% (0.8698 => 0.9012, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 3.57% (0.4113 => 0.4260, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (8.4961 => 8.7733, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 3.24% (3.1889 => 3.2923, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.19% (3.2742 => 3.3788, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.5188 => 1.5654, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.04% (14.8535 => 15.3052, std. dev.: 0.0185) MultiSource/Applications/sqlite3/sqlite3: 3.02% (16.2614 => 16.7518, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (6.5754 => 6.7716, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.80% (2.1007 => 2.1595, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.69% (14.5298 => 14.9211, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 2.45% (4.6629 => 4.7770, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.6250 => 0.6379, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.81% (1.0313 => 1.0500, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.79% (0.6744 => 0.6865, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.43% (3.7467 => 3.8003, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 1.30% (33.2944 => 33.7284, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5165, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2720, std. dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.30% (1.2998 => 1.4207, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7411, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3855, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5985, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.07% (10.7476 => 10.9697, std. dev.: 0.0559) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3267, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0068) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std. dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.14% (4.5928 => 4.6452, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.86% (22.5627 => 21.2395, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.67% (0.6576 => 0.6466, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1022, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0221, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.51% (20.3410 => 19.8299, std. dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6074, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9618, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2367, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3305 => 7.2301, std. dev.: 0.0088) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3722, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8022, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8989, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 07:20:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 09:20:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815142019.18C842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2919?compare_to=2917&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2919, Order: 161944, Start Time: 2012-08-15 13:02:03, End Time: 2012-08-15 14:21:02 To: 2917, Order: 161940, Start Time: 2012-08-15 11:15:28, End Time: 2012-08-15 12:34:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (95 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.57% (13.6811 => 13.8963, std. dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.67% (1.4098 => 1.4333, std. dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.04% (10.3673 => 13.8963, std. dev.: 0.0160) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.91% (1.1194 => 1.2415, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (2.2022 => 2.3573, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.75% (1.7609 => 1.8798, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 5.95% (0.6030 => 0.6389, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 5.87% (0.5925 => 0.6273, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.29% (0.3177 => 0.3345, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 4.93% (0.7326 => 0.7687, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.75% (0.4615 => 0.4834, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7433 => 0.7772, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.32% (0.4879 => 0.5090, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.30% (7.0540 => 7.3576, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.86% (9.4845 => 9.8509, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.9449 => 5.1248, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (5.0018 => 5.1836, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 3.62% (10.4361 => 10.8141, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.52% (0.4636 => 0.4799, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.51% (4.2646 => 4.4141, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.4103 => 0.4239, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.30% (0.3121 => 0.3224, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.29% (8.1363 => 8.4039, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary: 3.28% (0.3232 => 0.3338, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.28% (1.3050 => 1.3478, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.25% (0.3136 => 0.3238, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.14% (0.3283 => 0.3386, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.08% (0.7835 => 0.8076, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.06% (1.5415 => 1.5886, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 3.05% (0.4289 => 0.4420, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.04% (0.3423 => 0.3527, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.01% (0.3826 => 0.3941, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.99% (0.3650 => 0.3759, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.98% (0.9765 => 1.0056, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1861 => 1.2213, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.92% (0.3865 => 0.3978, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.89% (2.0665 => 2.1262, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.89% (0.3603 => 0.3707, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (0.4064 => 0.4180, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.75% (5.7591 => 5.9174, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 2.71% (0.6456 => 0.6631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.64% (0.4620 => 0.4742, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 2.63% (1.1642 => 1.1948, std. dev.: 0.0082) MultiSource/Applications/d/make_dparser: 2.60% (3.3354 => 3.4222, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.57% (0.4048 => 0.4152, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.52% (0.4203 => 0.4309, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.51% (0.5105 => 0.5233, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.51% (2.0273 => 2.0781, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.49% (1.5603 => 1.5991, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.40% (0.8067 => 0.8261, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.31% (1.2842 => 1.3139, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6675 => 0.6824, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 2.21% (3.8723 => 3.9579, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5859 => 1.6202, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.11% (17.1811 => 17.5444, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.4186 => 1.4476, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (14.3668 => 14.6570, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 1.87% (0.8921 => 0.9088, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.81% (2.2969 => 2.3385, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.2024 => 2.2388, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.22% (1.1840 => 1.1985, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.05% (1.0722 => 1.0835, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (4.2280 => 4.4516, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 1.99% (26.0924 => 26.6112, std. dev.: 0.0321) SingleSource/Benchmarks/Shootout-C++/hash2: 1.88% (3.1578 => 3.2172, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.83% (9.1159 => 9.2823, std. dev.: 0.0213) MultiSource/Benchmarks/nbench/nbench: 1.53% (11.6436 => 11.8222, std. dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 1.47% (5.2636 => 5.3410, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.28% (3.2827 => 3.3247, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.3045 => 1.3193, std. dev.: 0.0051) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5766, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1238, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.58% (0.8651 => 0.1680, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.50% (5.2763 => 3.1395, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.96% (5.3855 => 3.6644, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.61% (5.3526 => 3.6607, std. dev.: 0.0068) SingleSource/UnitTests/Vector/constpool: -15.17% (54.1659 => 45.9513, std. dev.: 0.0288) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -14.05% (2.9384 => 2.5255, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -12.39% (22.1758 => 19.4279, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.05% (3.8922 => 3.8512, std. dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -6.77% (1.5373 => 1.4333, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5566, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8070, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4726, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4234, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.56% (10.2830 => 10.0198, std. dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9627, std. dev.: 0.0046) SingleSource/UnitTests/Vector/multiplies: -1.84% (2.5528 => 2.5059, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4196, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3481, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.09% (19.9488 => 19.7312, std. dev.: 0.0287) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.05% (1.8329 => 1.8137, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.05% (2.3135 => 2.2893, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 07:46:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 09:46:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815144608.D0D0F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2920?compare_to=2918&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2920, Order: 161944, Start Time: 2012-08-15 13:32:50, End Time: 2012-08-15 14:46:54 To: 2918, Order: 161940, Start Time: 2012-08-15 11:51:20, End Time: 2012-08-15 13:05:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.20% (2.0176 => 2.3042, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 9.43% (0.7061 => 0.7727, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.07% (0.3130 => 0.3414, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5748 => 0.6265, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.27% (0.3578 => 0.3874, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.03% (1.3693 => 1.4792, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4062 => 0.4388, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 7.98% (0.3646 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.94% (0.7710 => 0.8322, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.92% (0.3789 => 0.4089, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3663 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.70% (0.7038 => 0.7580, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 7.66% (0.3940 => 0.4242, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (0.4328 => 0.4659, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.43% (3.9660 => 4.2608, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2782 => 0.2987, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2781 => 0.2984, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.21% (0.3899 => 0.4180, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.11% (0.3022 => 0.3237, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.2937 => 0.3142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2655 => 0.2838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.68% (0.3580 => 0.3819, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.66% (1.9828 => 2.1148, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.58% (0.4390 => 0.4679, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: 6.58% (0.3192 => 0.3402, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.54% (1.2193 => 1.2991, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.48% (0.9199 => 0.9795, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.46% (0.3485 => 0.3710, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.34% (0.6959 => 0.7400, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.4379 => 0.4654, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3246 => 0.3449, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.23% (0.3453 => 0.3668, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.08% (0.5577 => 0.5916, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 6.07% (0.3293 => 0.3493, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.90% (0.4016 => 0.4253, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.3756 => 0.3975, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.69% (0.2127 => 0.2248, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.65% (13.8202 => 14.6008, std. dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/moments: 5.64% (0.3868 => 0.4086, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.63% (0.1865 => 0.1970, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.56% (0.2914 => 0.3076, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (1.4563 => 1.5360, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.44% (0.2023 => 0.2133, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.36% (1.1364 => 1.1973, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.27% (1.1061 => 1.1644, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 5.23% (0.2925 => 0.3078, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 5.22% (3.8646 => 4.0664, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 5.20% (0.8310 => 0.8742, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.14% (0.5637 => 0.5927, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.08% (1.3245 => 1.3918, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 5.08% (1.2292 => 1.2916, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.07% (7.2180 => 7.5842, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.96% (1.3819 => 1.4504, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 4.96% (0.7506 => 0.7878, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (1.3813 => 1.4485, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.81% (1.0594 => 1.1104, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.78% (1.9270 => 2.0192, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.71% (0.7460 => 0.7811, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 4.68% (16.6129 => 17.3905, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3755 => 0.3930, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.57% (0.2995 => 0.3132, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 4.54% (2.1791 => 2.2781, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.40% (0.4791 => 0.5002, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.39% (4.3801 => 4.5725, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.29% (4.4433 => 4.6341, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.21% (3.6692 => 3.8236, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.21% (4.9865 => 5.1962, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.99% (0.8698 => 0.9045, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.92% (13.2842 => 13.8052, std. dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.83% (0.6135 => 0.6370, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (1.1333 => 1.1763, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 3.62% (0.4113 => 0.4262, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.36% (3.1889 => 3.2960, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (8.4961 => 8.7796, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.22% (3.2742 => 3.3795, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.05% (1.5188 => 1.5651, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.05% (14.8535 => 15.3062, std. dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (6.5754 => 6.7741, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 3.02% (16.2614 => 16.7526, std. dev.: 0.0159) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.5298 => 14.9403, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.77% (2.1007 => 2.1588, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.53% (0.6250 => 0.6408, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.38% (4.6629 => 4.7740, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: 1.97% (0.6744 => 0.6877, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.81% (1.0313 => 1.0500, std. dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 1.57% (33.2944 => 33.8158, std. dev.: 0.0057) MultiSource/Applications/lua/lua: 1.53% (3.7467 => 3.8040, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0502) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.78% (1.2998 => 1.4009, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7422, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8170, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3840, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5954, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.02% (10.7476 => 10.9646, std. dev.: 0.0420) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3268, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5158, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1838, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5742, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.5928 => 4.6419, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.77% (22.5627 => 21.2611, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.54% (0.6576 => 0.6475, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.59% (1.1560 => 1.1029, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.28% (1.3780 => 1.3190, std. dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.96% (20.3410 => 19.7397, std. dev.: 0.0536) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5807, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9630, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2267, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.94% (0.8342 => 0.8180, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2179, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3616, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8029, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8991, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 08:33:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 10:33:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120815153303.506A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2921?compare_to=2916&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2921, Order: 161940, Start Time: 2012-08-15 12:50:24, End Time: 2012-08-15 15:33:49 To: 2916, Order: 161937, Start Time: 2012-08-15 09:39:54, End Time: 2012-08-15 12:23:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (760 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.17% (109.6550 => 118.6084, std. dev.: 0.0290) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.25% (125.5356 => 130.8730, std. dev.: 0.4795) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.20% (1.3537 => 1.3699, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.42% (0.3446 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.35% (0.3465 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.28% (0.3460 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.28% (0.3469 => 0.3895, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3496 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.21% (0.3488 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.92% (0.3650 => 0.4085, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.57% (0.3724 => 0.4155, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.68% (1.5932 => 1.7156, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.1619 => 0.1728, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.69% (0.5826 => 0.6216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.47% (0.5889 => 0.6270, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (1.6211 => 1.7204, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.86% (0.2014 => 0.2132, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.83% (1.3152 => 1.3919, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (3.5627 => 3.7704, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (0.4361 => 0.4607, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (0.5026 => 0.5308, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.61% (0.4994 => 0.5274, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.31% (0.4029 => 0.4243, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.27% (0.3930 => 0.4137, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (0.5000 => 0.5263, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.25% (0.5900 => 0.6210, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 5.18% (4.2109 => 4.4292, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 5.17% (1.0781 => 1.1338, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 5.13% (0.7171 => 0.7539, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.53% (0.2736 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3195 => 0.3339, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.48% (2.1013 => 2.1954, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.46% (0.2823 => 0.2949, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.46% (5.5417 => 5.7886, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2875 => 0.3002, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (2.7292 => 2.8497, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.36% (0.2566 => 0.2678, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.28% (1.9694 => 2.0537, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.24% (1.9966 => 2.0813, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2803 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.15% (0.2792 => 0.2908, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (0.4658 => 0.4850, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.11% (0.3890 => 0.4050, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.09% (0.2738 => 0.2850, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.06% (0.9909 => 1.0311, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.04% (2.0673 => 2.1509, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/strcat: 4.04% (0.2750 => 0.2861, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.99% (4.6177 => 4.8019, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (2.1653 => 2.2516, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.98% (0.2911 => 0.3027, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.98% (0.3317 => 0.3449, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.96% (0.2780 => 0.2890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2811 => 0.2921, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.88% (0.2729 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.3096 => 0.3216, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.86% (0.3267 => 0.3393, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3258 => 0.3383, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (1.8794 => 1.9512, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.78% (0.3124 => 0.3242, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.77% (0.7875 => 0.8172, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.75% (0.3678 => 0.3816, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (4.4195 => 4.5846, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.73% (0.3060 => 0.3174, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.72% (0.3362 => 0.3487, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.3903 => 0.4047, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.65% (0.4139 => 0.4290, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3348 => 0.3469, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.61% (0.3625 => 0.3756, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.60% (0.3282 => 0.3400, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.60% (0.3477 => 0.3602, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4146 => 0.4295, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.57% (0.6634 => 0.6871, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.57% (0.3726 => 0.3859, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.54% (23.5202 => 24.3527, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4251 => 0.4401, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.3845 => 0.3978, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3690 => 0.3816, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 3.41% (1.4269 => 1.4756, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 3.24% (0.9697 => 1.0011, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.21% (0.3271 => 0.3376, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.21% (0.3336 => 0.3443, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.11% (0.3981 => 0.4105, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.10% (0.5546 => 0.5718, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.03% (0.6435 => 0.6630, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.01% (0.5012 => 0.5163, std. dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 2.59% (2.0346 => 2.0873, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (0.4847 => 0.4950, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (0.5361 => 0.5473, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (0.7426 => 0.7575, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (11.6398 => 11.7941, std. dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.10% (4.6926 => 4.7444, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.44% (0.2122 => 0.2301, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6720, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8948, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1629, std. dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6543, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2094, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (105.3826 => 107.6097, std. dev.: 0.0344) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (41.7953 => 42.6412, std. dev.: 0.0093) MultiSource/Applications/lua/lua: 1.76% (50.0626 => 50.9436, std. dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5913, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std. dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3098, std. dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.29% (7.1849 => 7.2773, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5753, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9779, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7981, std. dev.: 0.0223) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7988, std. dev.: 0.0016) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.50% (17.2379 => 16.8072, std. dev.: 0.0532) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.91% (0.6293 => 0.6173, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9607, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 11:06:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 13:06:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815180625.563D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2922?compare_to=2920&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2922, Order: 161955, Start Time: 2012-08-15 16:52:59, End Time: 2012-08-15 18:07:09 To: 2920, Order: 161944, Start Time: 2012-08-15 13:32:50, End Time: 2012-08-15 14:46:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (151 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.51% (2.0176 => 2.3104, std. dev.: 0.0125) SingleSource/UnitTests/ObjC++/property-reference: 9.15% (0.7061 => 0.7707, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.78% (0.5818 => 0.6329, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.59% (0.5748 => 0.6242, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (0.1413 => 0.1525, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.85% (0.7710 => 0.8315, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.84% (0.3650 => 0.3936, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.75% (0.3601 => 0.3880, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.74% (0.7038 => 0.7583, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 7.70% (0.3663 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.65% (0.3623 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.46% (0.5265 => 0.5658, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (3.9660 => 4.2561, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.4328 => 0.4643, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 7.22% (1.3693 => 1.4681, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.76% (0.2782 => 0.2970, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.3899 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: 6.65% (0.2781 => 0.2966, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.52% (0.2023 => 0.2155, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 6.45% (0.2760 => 0.2938, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2607 => 0.2774, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.6959 => 0.7403, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.36% (1.2193 => 1.2968, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.29% (0.3293 => 0.3500, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.2937 => 0.3121, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.26% (0.9199 => 0.9775, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2690 => 0.2857, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (0.4379 => 0.4650, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2761 => 0.2929, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.07% (0.2966 => 0.3146, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.04% (1.9828 => 2.1026, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.02% (0.3489 => 0.3699, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.01% (0.4390 => 0.4654, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.88% (0.5577 => 0.5905, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.87% (0.3149 => 0.3334, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3192 => 0.3378, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.68% (0.1865 => 0.1971, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.65% (0.3453 => 0.3648, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.56% (1.4563 => 1.5372, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.53% (13.8202 => 14.5843, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.2914 => 0.3069, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.28% (0.4016 => 0.4228, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.26% (1.1364 => 1.1962, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.3756 => 0.3953, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.20% (0.5637 => 0.5930, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.06% (3.8646 => 4.0603, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.06% (1.3245 => 1.3915, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.05% (1.3813 => 1.4510, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 5.02% (0.8310 => 0.8727, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.99% (7.2180 => 7.5782, std. dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.88% (0.7506 => 0.7872, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.87% (1.1061 => 1.1600, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.87% (1.0594 => 1.1110, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.86% (2.1791 => 2.2849, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.72% (1.3819 => 1.4471, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.65% (1.9270 => 2.0167, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 4.60% (1.2292 => 1.2858, std. dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 4.48% (16.6129 => 17.3568, std. dev.: 0.0171) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2995 => 0.3126, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3755 => 0.3914, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.3801 => 4.5624, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.15% (0.4791 => 0.4990, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (3.6692 => 3.8199, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.10% (4.9865 => 5.1907, std. dev.: 0.0145) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6241, std. dev.: 0.0615) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (13.2842 => 13.7940, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6135 => 0.6366, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (1.1333 => 1.1757, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.71% (0.6283 => 0.6516, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.8698 => 0.9015, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.4113 => 0.4254, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.32% (3.1889 => 3.2947, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (8.4961 => 8.7735, std. dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 2.99% (16.2614 => 16.7482, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5188 => 1.5640, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (3.2742 => 3.3710, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.5754 => 6.7672, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.91% (14.8535 => 15.2863, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1571, std. dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.5298 => 14.9122, std. dev.: 0.0182) MultiSource/Applications/oggenc/oggenc: 2.22% (4.6629 => 4.7663, std. dev.: 0.0139) MultiSource/Applications/minisat/minisat: 2.18% (0.6744 => 0.6891, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.10% (0.6250 => 0.6381, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.69% (1.0313 => 1.0487, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (0.9108 => 0.9260, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.55% (3.7467 => 3.8047, std. dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 1.35% (33.2944 => 33.7433, std. dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std. dev.: 0.0516) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 8.42% (1.2998 => 1.4092, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.2093 => 0.2195, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7419, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0136) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3859, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5974, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.01% (10.7476 => 10.9639, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0042) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3260, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 1.20% (3.6975 => 3.7420, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6413, std. dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.86% (22.5627 => 21.2411, std. dev.: 0.0138) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.52% (0.6576 => 0.6476, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.57% (1.1560 => 1.1032, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.31% (1.3780 => 1.3186, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8059, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.78% (0.4867 => 0.4683, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5924, std. dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.54% (20.3410 => 19.8244, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9632, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2254, std. dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2208, std. dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3544, std. dev.: 0.0102) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8703, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8029, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.9002, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 11:11:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 13:11:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815181110.C17BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2923?compare_to=2919&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2923, Order: 161955, Start Time: 2012-08-15 16:53:06, End Time: 2012-08-15 18:11:56 To: 2919, Order: 161944, Start Time: 2012-08-15 13:02:03, End Time: 2012-08-15 14:21:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (93 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.07% (3.7325 => 3.6924, std. dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.12% (10.3673 => 13.9046, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/trivial-interface: 11.75% (0.3473 => 0.3881, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.49% (0.3516 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/synchronized: 11.40% (0.3561 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.90% (1.1194 => 1.2414, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 8.10% (0.1432 => 0.1548, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (2.2022 => 2.3573, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.91% (1.7609 => 1.8826, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.91% (0.5925 => 0.6275, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.32% (0.3177 => 0.3346, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 4.97% (0.7326 => 0.7690, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.70% (0.4615 => 0.4832, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.55% (0.7433 => 0.7771, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.40% (7.0540 => 7.3642, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.32% (0.4879 => 0.5090, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.99% (0.5569 => 0.5791, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.92% (0.8172 => 0.8492, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 3.90% (0.3282 => 0.3410, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.89% (9.4845 => 9.8533, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.9449 => 5.1308, std. dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 3.65% (10.4361 => 10.8174, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (5.0018 => 5.1840, std. dev.: 0.0518) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (4.2646 => 4.4173, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.4103 => 0.4249, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3232 => 0.3345, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (0.4636 => 0.4796, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.8067 => 0.8335, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.29% (8.1363 => 8.4043, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.24% (1.3050 => 1.3473, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.06% (0.9765 => 1.0064, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.06% (0.3826 => 0.3943, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.03% (1.5415 => 1.5882, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.01% (0.3422 => 0.3525, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.96% (0.3650 => 0.3758, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4289 => 0.4415, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (2.0665 => 2.1270, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.91% (1.1861 => 1.2206, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3865 => 0.3977, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.89% (0.3603 => 0.3707, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.6456 => 0.6636, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.76% (5.7591 => 5.9181, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (0.4064 => 0.4174, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.69% (1.1642 => 1.1955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.67% (0.4048 => 0.4156, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.64% (3.3354 => 3.4234, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.4203 => 0.4312, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0795, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4620 => 0.4738, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.51% (1.5603 => 1.5995, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.39% (0.5105 => 0.5227, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.32% (1.2842 => 1.3140, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9598, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.15% (17.1811 => 17.5497, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5981 => 0.6107, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5859 => 1.6191, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.09% (1.4186 => 1.4482, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (14.3668 => 14.6586, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8921 => 0.9085, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.83% (2.2969 => 2.3389, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.06% (1.0722 => 1.0836, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.68% (4.2280 => 4.4259, std. dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7479, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 2.09% (26.0924 => 26.6379, std. dev.: 0.0447) SingleSource/Benchmarks/Shootout-C++/hash2: 1.86% (3.1578 => 3.2166, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: 1.77% (9.1159 => 9.2776, std. dev.: 0.0232) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8224, std. dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: 1.38% (5.2636 => 5.3365, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.30% (3.2827 => 3.3254, std. dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5791, std. dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.53% (5.2763 => 3.1376, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.96% (5.3855 => 3.6645, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.55% (5.3526 => 3.6636, std. dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -15.13% (54.1659 => 45.9730, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.92% (2.9384 => 2.5295, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -12.33% (22.1758 => 19.4410, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (3.8922 => 3.8489, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -9.14% (1.5373 => 1.3968, std. dev.: 0.0238) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8069, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.14% (4.8142 => 4.6147, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4656, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4066, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9934, std. dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9658, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3502, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.3135 => 2.2896, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (19.9488 => 19.7475, std. dev.: 0.0348) MultiSource/Applications/sqlite3/sqlite3: -1.01% (4.6441 => 4.5974, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 11:43:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 13:43:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120815184353.4F09A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2924?compare_to=2921&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2924, Order: 161944, Start Time: 2012-08-15 16:01:13, End Time: 2012-08-15 18:44:38 To: 2921, Order: 161940, Start Time: 2012-08-15 12:50:24, End Time: 2012-08-15 15:33:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.74% (0.3446 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3442 => 0.3877, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3460 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3488 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.48% (0.3469 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.47% (0.3496 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.14% (0.3650 => 0.4093, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3643 => 0.4081, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.1619 => 0.1730, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.58% (1.5932 => 1.6980, std. dev.: 0.0152) SingleSource/UnitTests/ObjC++/Hello: 6.30% (0.5826 => 0.6193, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.17% (0.4361 => 0.4630, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 6.13% (0.5889 => 0.6250, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (1.3152 => 1.3931, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.89% (3.5627 => 3.7724, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.5900 => 0.6245, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.80% (1.6211 => 1.7152, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.77% (0.5026 => 0.5316, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.2014 => 0.2123, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (0.3930 => 0.4142, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.27% (0.4994 => 0.5257, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 5.18% (4.2109 => 4.4290, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.13% (0.2866 => 0.3013, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (0.5000 => 0.5255, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.86% (1.0781 => 1.1305, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 4.78% (0.7171 => 0.7514, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.68% (2.7292 => 2.8568, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.39% (0.2736 => 0.2856, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.38% (0.2875 => 0.3001, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.36% (0.2823 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.3195 => 0.3333, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.21% (0.2566 => 0.2674, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 4.19% (0.2813 => 0.2931, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.17% (5.5417 => 5.7728, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (2.1013 => 2.1887, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.2780 => 0.2894, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.3004 => 0.3126, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.01% (0.3890 => 0.4046, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.00% (0.9909 => 1.0305, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.98% (0.2738 => 0.2847, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (1.9694 => 2.0476, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2750 => 0.2859, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.95% (0.2911 => 0.3026, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2792 => 0.2902, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3060 => 0.3180, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.91% (0.4658 => 0.4840, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.89% (2.1653 => 2.2496, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.89% (1.9966 => 2.0742, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.88% (2.0673 => 2.1475, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.87% (0.3362 => 0.3492, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.86% (0.3267 => 0.3393, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2803 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3258 => 0.3382, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.79% (4.6177 => 4.7928, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3678 => 0.3815, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.71% (0.3317 => 0.3440, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.70% (0.4139 => 0.4292, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (4.4195 => 4.5827, std. dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 3.67% (1.8794 => 1.9483, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3726 => 0.3861, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.61% (0.3903 => 0.4044, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.59% (0.3124 => 0.3236, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.46% (23.5202 => 24.3333, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 3.45% (1.4269 => 1.4761, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4146 => 0.4287, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3477 => 0.3595, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.38% (0.6634 => 0.6858, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 3.38% (0.3348 => 0.3461, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.31% (0.7875 => 0.8136, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4251 => 0.4390, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3690 => 0.3809, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.00% (0.9697 => 0.9988, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.94% (0.3981 => 0.4098, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.85% (0.5546 => 0.5704, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.83% (0.3845 => 0.3954, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.6435 => 0.6611, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.5012 => 0.5146, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.22% (2.0346 => 2.0798, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (0.7426 => 0.7549, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6776, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.78% (1.8057 => 1.8921, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6410, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (105.3826 => 107.6012, std. dev.: 0.0328) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (41.7953 => 42.6471, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1937, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5912, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.71% (50.0626 => 50.9180, std. dev.: 0.0932) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std. dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5599, std. dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7820, std. dev.: 0.0118) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9567, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8014, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0046) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.58% (17.2379 => 16.7934, std. dev.: 0.0726) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5741, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9636, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 12:48:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 14:48:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815194802.5C9082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2925?compare_to=2922&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2925, Order: 161963, Start Time: 2012-08-15 18:34:44, End Time: 2012-08-15 19:48:46 To: 2922, Order: 161955, Start Time: 2012-08-15 16:52:59, End Time: 2012-08-15 18:07:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (149 on baseline) Performance Improvements: 2 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.4672 => 56.4884, std. dev.: 0.0869) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.43% (79.0619 => 80.1910, std. dev.: 0.1599) SingleSource/Benchmarks/Misc/lowercase: 1.23% (7.9459 => 8.0433, std. dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.89% (3.8393 => 3.7668, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/ary3: -1.53% (3.7420 => 3.6849, std. dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.80% (2.0176 => 2.3162, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: 12.47% (0.0826 => 0.0929, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5818 => 0.6370, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7061 => 0.7730, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 9.19% (0.5748 => 0.6276, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.07% (0.3130 => 0.3414, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.30% (0.3578 => 0.3875, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3646 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.97% (0.3663 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.95% (0.3914 => 0.4225, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.89% (0.3623 => 0.3909, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.72% (0.3940 => 0.4244, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (0.4328 => 0.4659, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.65% (1.3693 => 1.4740, std. dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 7.52% (0.7038 => 0.7567, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.44% (3.9660 => 4.2612, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4062 => 0.4362, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2781 => 0.2984, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.7710 => 0.8263, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.16% (0.2655 => 0.2845, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5265 => 0.5637, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.95% (0.3899 => 0.4170, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.92% (0.3022 => 0.3231, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.86% (0.2596 => 0.2774, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.85% (1.9828 => 2.1186, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.76% (0.2765 => 0.2952, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.74% (0.2760 => 0.2946, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.70% (0.3580 => 0.3820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.56% (0.2761 => 0.2942, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.2966 => 0.3160, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2726 => 0.2904, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (0.3485 => 0.3712, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.51% (0.3489 => 0.3716, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (0.3149 => 0.3351, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3192 => 0.3393, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.29% (0.9199 => 0.9778, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.29% (1.2193 => 1.2960, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.22% (0.4390 => 0.4663, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.19% (0.6959 => 0.7390, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4379 => 0.4645, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.95% (0.3246 => 0.3439, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.86% (0.3293 => 0.3486, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.85% (0.4016 => 0.4251, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5577 => 0.5892, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (0.3756 => 0.3968, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.64% (0.3868 => 0.4086, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 5.55% (13.8202 => 14.5873, std. dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (1.4563 => 1.5363, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.38% (1.1364 => 1.1975, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1865 => 0.1965, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.2945 => 0.3101, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.15% (1.2292 => 1.2925, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.5637 => 0.5920, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (1.3813 => 1.4504, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.98% (0.8310 => 0.8724, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.95% (1.1061 => 1.1608, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.93% (3.8646 => 4.0552, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.93% (7.2180 => 7.5737, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 4.93% (1.0594 => 1.1116, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.92% (1.3819 => 1.4499, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.86% (0.7506 => 0.7871, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.84% (1.3245 => 1.3886, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.63% (16.6129 => 17.3818, std. dev.: 0.0145) MultiSource/Applications/treecc/treecc: 4.62% (1.9270 => 2.0160, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.58% (0.7460 => 0.7802, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 4.47% (0.2995 => 0.3129, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.42% (0.4791 => 0.5003, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.35% (2.1791 => 2.2739, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.26% (4.9865 => 5.1987, std. dev.: 0.0141) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.06% (3.6692 => 3.8180, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (4.4433 => 4.6222, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.99% (4.3801 => 4.5549, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.85% (0.8698 => 0.9033, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.78% (13.2842 => 13.7862, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.6283 => 0.6519, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.72% (1.1333 => 1.1755, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.65% (0.6135 => 0.6359, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.37% (3.1889 => 3.2964, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 3.36% (0.4113 => 0.4251, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.22% (8.4961 => 8.7696, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.16% (3.2742 => 3.3778, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 3.15% (16.2614 => 16.7736, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.13% (1.5188 => 1.5663, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.5754 => 6.7719, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.98% (14.8535 => 15.2959, std. dev.: 0.0126) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.5298 => 14.9284, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.73% (2.1007 => 2.1580, std. dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 2.67% (4.6629 => 4.7876, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6250 => 0.6396, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.88% (0.6744 => 0.6871, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.87% (1.0313 => 1.0506, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.75% (0.9108 => 0.9267, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.37% (3.7467 => 3.7981, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 1.23% (33.2944 => 33.7052, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.87% (1.8175 => 2.2695, std. dev.: 0.0254) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 8.78% (1.2998 => 1.4139, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.40% (11.2619 => 11.7571, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4271 => 7.6071, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.05% (10.7476 => 10.9683, std. dev.: 0.0256) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.73% (3.2729 => 3.3294, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5155, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.10% (4.5928 => 4.6433, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.01% (1.5089 => 1.5241, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.75% (22.5627 => 21.2659, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8061, std. dev.: 0.0010) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0211, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5820, std. dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.55% (20.3410 => 19.8233, std. dev.: 0.0160) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9607, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2235, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3305 => 7.2176, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3583, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8010, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.9004, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2378, std. dev.: 0.0278) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 12:57:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 14:57:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815195754.A3F912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2926?compare_to=2923&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2926, Order: 161964, Start Time: 2012-08-15 18:39:32, End Time: 2012-08-15 19:58:38 To: 2923, Order: 161955, Start Time: 2012-08-15 16:53:06, End Time: 2012-08-15 18:11:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (84 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.51% (1.3968 => 1.4318, std. dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.58% (10.3673 => 13.9521, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.87% (1.1194 => 1.2523, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 11.23% (0.3473 => 0.3863, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.07% (0.3497 => 0.3884, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.01% (0.3886 => 0.4275, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.03% (0.1432 => 0.1547, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.20% (1.7609 => 1.8877, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.93% (2.2022 => 2.3548, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.05% (0.2065 => 0.2190, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 5.92% (0.5925 => 0.6276, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.89% (0.6030 => 0.6385, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.33% (0.4615 => 0.4861, std. dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7326 => 0.7696, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.80% (0.8172 => 0.8564, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.59% (0.4879 => 0.5103, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.39% (0.7433 => 0.7759, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (7.0540 => 7.3489, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 3.66% (0.3282 => 0.3402, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.61% (0.5569 => 0.5770, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 3.60% (10.4361 => 10.8116, std. dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (4.2646 => 4.4164, std. dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (9.4845 => 9.8200, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.51% (4.9449 => 5.1187, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (5.0018 => 5.1703, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.33% (0.5860 => 0.6055, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.14% (8.1363 => 8.3915, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.13% (0.4636 => 0.4781, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.3050 => 1.3454, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 3.07% (5.7591 => 5.9359, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: 2.95% (0.3423 => 0.3524, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.94% (1.5415 => 1.5868, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.1861 => 1.2192, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.76% (2.0665 => 2.1236, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (0.9765 => 1.0034, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 2.67% (1.1642 => 1.1953, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.64% (0.3865 => 0.3967, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6456 => 0.6625, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4289 => 0.4399, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.54% (3.3354 => 3.4200, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.47% (0.8067 => 0.8266, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 2.42% (2.0273 => 2.0764, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.37% (0.5105 => 0.5226, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (0.4620 => 0.4726, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.28% (1.5603 => 1.5958, std. dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 2.10% (1.2842 => 1.3112, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.10% (1.5859 => 1.6192, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.09% (3.8723 => 3.9533, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (14.3668 => 14.6596, std. dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 2.03% (17.1811 => 17.5303, std. dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.98% (0.6675 => 0.6807, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.93% (2.2969 => 2.3412, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 1.85% (0.8921 => 0.9086, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.84% (1.4186 => 1.4447, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.65% (2.2024 => 2.2388, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2010, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.02% (4.2280 => 4.4404, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7538, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 2.12% (26.0924 => 26.6461, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/hash2: 1.93% (3.1578 => 3.2187, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8227, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.53% (9.1159 => 9.2552, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 1.43% (5.2636 => 5.3390, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.28% (3.2827 => 3.3248, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std. dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1520, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.59% (5.3855 => 3.6843, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.26% (5.3526 => 3.6795, std. dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -15.10% (54.1659 => 45.9883, std. dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.49% (2.9384 => 2.5420, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -12.22% (22.1758 => 19.4651, std. dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (3.8922 => 3.8492, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -6.86% (1.5373 => 1.4318, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8066, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6145, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0511, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4704, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4130, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0088, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9626, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3458, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.3135 => 2.2896, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 14:29:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 16:29:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815212930.DB3062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2927?compare_to=2925&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2927, Order: 161979, Start Time: 2012-08-15 20:16:10, End Time: 2012-08-15 21:30:14 To: 2925, Order: 161963, Start Time: 2012-08-15 18:34:44, End Time: 2012-08-15 19:48:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 9.67% (0.7061 => 0.7744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5818 => 0.6380, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5748 => 0.6287, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.11% (0.3130 => 0.3415, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.94% (0.3601 => 0.3887, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.86% (0.1413 => 0.1524, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.84% (0.3650 => 0.3936, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 7.81% (0.3789 => 0.4085, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3914 => 0.4217, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.70% (0.7710 => 0.8304, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.47% (0.7038 => 0.7564, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.29% (1.3693 => 1.4691, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5265 => 0.5648, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4062 => 0.4352, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.13% (3.9660 => 4.2489, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4328 => 0.4628, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2782 => 0.2966, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.54% (0.6959 => 0.7414, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.46% (0.3899 => 0.4151, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3022 => 0.3216, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.22% (0.9199 => 0.9771, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.18% (1.2193 => 1.2947, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.15% (0.2765 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.2937 => 0.3117, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.02% (0.3489 => 0.3699, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.98% (0.3580 => 0.3794, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.98% (1.9828 => 2.1013, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.94% (0.2726 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2761 => 0.2925, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.2966 => 0.3142, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.76% (0.3107 => 0.3286, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3149 => 0.3329, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.68% (0.3453 => 0.3649, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.2988 => 0.3156, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.55% (0.3192 => 0.3369, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.50% (1.4563 => 1.5364, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 5.49% (13.8202 => 14.5786, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4016 => 0.4235, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.43% (0.5577 => 0.5880, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.2914 => 0.3071, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 5.28% (0.3293 => 0.3467, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.11% (0.3756 => 0.3948, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (1.1364 => 1.1942, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 5.02% (0.3868 => 0.4062, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.98% (0.8310 => 0.8724, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (7.2180 => 7.5753, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.91% (3.8646 => 4.0545, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.90% (1.1061 => 1.1603, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (1.3245 => 1.3888, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.84% (0.7506 => 0.7869, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.79% (1.3813 => 1.4475, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.76% (1.3819 => 1.4477, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.73% (1.2292 => 1.2874, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.68% (1.0594 => 1.1090, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.62% (0.7460 => 0.7805, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.61% (1.9270 => 2.0159, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3409, std. dev.: 0.0133) MultiSource/Applications/siod/siod: 4.37% (2.1791 => 2.2744, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.05% (13.2842 => 13.8225, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8165, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6210, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.3801 => 4.5552, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.97% (0.4791 => 0.4981, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (1.1333 => 1.1763, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.9865 => 5.1750, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.50% (0.6135 => 0.6350, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.45% (0.8698 => 0.8998, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.14% (3.1889 => 3.2890, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (6.5754 => 6.7767, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (8.4961 => 8.7559, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.93% (14.8535 => 15.2882, std. dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 2.92% (16.2614 => 16.7361, std. dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (1.5188 => 1.5616, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3641, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9180, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (2.1007 => 2.1489, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.26% (4.6629 => 4.7684, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 2.12% (0.6744 => 0.6887, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6250 => 0.6374, std. dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 1.78% (33.2944 => 33.8862, std. dev.: 0.0043) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.41% (3.7467 => 3.7997, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 24.90% (1.8175 => 2.2700, std. dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.02% (1.2998 => 1.4171, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (0.2093 => 0.2196, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3849, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5996, std. dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9941, std. dev.: 0.0344) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3257, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.00% (1.5089 => 1.5240, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.99% (22.5627 => 21.2109, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3144, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5777, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.73% (20.3410 => 19.7867, std. dev.: 0.0451) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9287, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.16% (3.0263 => 2.9608, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2205, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3305 => 7.2161, std. dev.: 0.0225) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3593, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8021, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.9005, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.03% (5.5401 => 5.4830, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2422, std. dev.: 0.0173) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.00% (6.6320 => 6.5656, std. dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 14:44:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 16:44:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815214443.69F822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2928?compare_to=2926&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2928, Order: 161980, Start Time: 2012-08-15 20:26:26, End Time: 2012-08-15 21:45:28 To: 2926, Order: 161964, Start Time: 2012-08-15 18:39:32, End Time: 2012-08-15 19:58:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (93 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.15% (10.3673 => 14.0110, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.63% (1.1194 => 1.2496, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.68% (2.2022 => 2.3714, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.50% (1.7609 => 1.8929, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 7.27% (0.1622 => 0.1740, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 5.85% (0.6030 => 0.6383, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.82% (0.5925 => 0.6270, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 4.93% (0.7326 => 0.7687, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.8172 => 0.8571, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.71% (0.7433 => 0.7783, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (7.0540 => 7.3831, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.40% (10.4361 => 10.8953, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (9.4845 => 9.8970, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1960, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.9449 => 5.1354, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (4.2646 => 4.4261, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.51% (1.3050 => 1.3508, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.4636 => 0.4795, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.33% (8.1363 => 8.4076, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.4103 => 0.4239, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.18% (0.9765 => 1.0076, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.13% (0.7835 => 0.8080, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.11% (1.1861 => 1.2230, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3441 => 0.3547, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.01% (0.3387 => 0.3489, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.99% (1.1642 => 1.1990, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.93% (5.7591 => 5.9281, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.84% (1.5415 => 1.5853, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 2.81% (1.5603 => 1.6041, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.74% (0.5105 => 0.5245, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.71% (2.0273 => 2.0822, std. dev.: 0.0099) MultiSource/Applications/d/make_dparser: 2.71% (3.3354 => 3.4257, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.67% (0.6450 => 0.6622, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.6456 => 0.6628, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5859 => 1.6276, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.57% (3.8723 => 3.9718, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4620 => 0.4738, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.53% (2.0665 => 2.1188, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (14.3668 => 14.6944, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.28% (0.6675 => 0.6827, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.27% (2.2969 => 2.3491, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.4186 => 1.4499, std. dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 2.20% (17.1811 => 17.5592, std. dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8921 => 0.9112, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (2.2024 => 2.2489, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.08% (1.2842 => 1.3109, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5020 => 0.5123, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.67% (0.7115 => 0.7234, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.44% (1.0722 => 1.0876, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.10% (4.2280 => 4.4437, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std. dev.: 0.0057) MultiSource/Applications/lua/lua: 1.96% (26.0924 => 26.6045, std. dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1578 => 3.2175, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.61% (9.1159 => 9.2623, std. dev.: 0.0273) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8226, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.2636 => 5.3352, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 1.27% (3.2827 => 3.3245, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5808, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.03% (5.2763 => 3.1643, std. dev.: 0.0172) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.54% (5.3855 => 3.6871, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.24% (5.3526 => 3.6807, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -15.21% (54.1659 => 45.9297, std. dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.73% (2.9384 => 2.5349, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.17% (22.1758 => 19.4770, std. dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -7.08% (1.5373 => 1.4284, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8068, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4717, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4118, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.56% (10.2830 => 10.0201, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9633, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3363, std. dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.48% (2.5528 => 2.5149, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.13% (1.8329 => 1.8122, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.10% (19.9488 => 19.7298, std. dev.: 0.0264) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.02% (2.3135 => 2.2898, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 14:54:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 16:54:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120815215436.AAB872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2929?compare_to=2924&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2929, Order: 161969, Start Time: 2012-08-15 19:12:06, End Time: 2012-08-15 21:55:21 To: 2924, Order: 161944, Start Time: 2012-08-15 16:01:13, End Time: 2012-08-15 18:44:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (95 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (782 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.13% (2.4445 => 2.3925, std. dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3446 => 0.3854, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3465 => 0.3875, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 11.74% (0.3442 => 0.3846, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.71% (0.3460 => 0.3865, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.70% (0.3496 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.67% (0.3469 => 0.3874, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.64% (0.3488 => 0.3894, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 11.34% (0.3650 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.28% (0.3643 => 0.4054, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3724 => 0.4130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.89% (0.3792 => 0.4091, std. dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 7.21% (1.5932 => 1.7080, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.51% (0.5826 => 0.6205, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.30% (0.5889 => 0.6260, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.58% (1.6211 => 1.7116, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.54% (1.3152 => 1.3881, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (0.4361 => 0.4600, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.46% (0.5900 => 0.6222, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.45% (0.4994 => 0.5266, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (3.5627 => 3.7563, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (0.5000 => 0.5269, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.31% (0.5026 => 0.5293, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.16% (0.4029 => 0.4237, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 4.92% (0.7171 => 0.7524, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 4.91% (1.0781 => 1.1310, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.89% (4.2109 => 4.4168, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.2736 => 0.2853, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.94% (0.2566 => 0.2667, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.94% (5.5417 => 5.7598, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (0.3890 => 0.4042, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.84% (2.7292 => 2.8340, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (1.9694 => 2.0441, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (0.4658 => 0.4833, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.73% (2.1013 => 2.1797, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 3.69% (0.6634 => 0.6879, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (1.9966 => 2.0703, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.65% (0.2875 => 0.2980, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.56% (0.3903 => 0.4042, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.55% (0.3690 => 0.3821, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (0.3195 => 0.3308, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.52% (0.9909 => 1.0258, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 3.51% (4.6177 => 4.7798, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (4.4195 => 4.5736, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.3271 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.45% (1.8794 => 1.9443, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 3.44% (2.1653 => 2.2397, std. dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 3.36% (0.3004 => 0.3105, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.30% (2.0673 => 2.1356, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.28% (23.5202 => 24.2917, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.24% (0.7875 => 0.8130, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 3.23% (0.3096 => 0.3196, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.4139 => 0.4271, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.15% (0.3362 => 0.3468, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.03% (0.3625 => 0.3735, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.01% (0.3726 => 0.3838, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.3678 => 0.3786, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3477 => 0.3579, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.91% (0.3845 => 0.3957, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 2.88% (1.4269 => 1.4680, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 2.85% (0.5546 => 0.5704, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 2.79% (0.9697 => 0.9968, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.73% (0.4146 => 0.4259, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 2.68% (0.4251 => 0.4365, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.6435 => 0.6583, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (0.4847 => 0.4950, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.09% (2.0346 => 2.0771, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6790, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1753, std. dev.: 0.1096) SingleSource/Benchmarks/Misc/flops-2: 4.31% (1.8057 => 1.8835, std. dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6408, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (105.3826 => 107.7049, std. dev.: 0.0290) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2012, std. dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.86% (41.7953 => 42.5718, std. dev.: 0.0328) MultiSource/Applications/lua/lua: 1.75% (50.0626 => 50.9362, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std. dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3123, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.39% (2.4764 => 2.3925, std. dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: -1.10% (11.9555 => 11.8236, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5776, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary2: -8.24% (0.2402 => 0.2204, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8064, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7887, std. dev.: 0.0112) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.83% (0.6293 => 0.6115, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.8005, std. dev.: 0.0469) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5803, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9692, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 16:11:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 18:11:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120815231117.DA08E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2930?compare_to=2927&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2930, Order: 161990, Start Time: 2012-08-15 21:57:51, End Time: 2012-08-15 23:12:01 To: 2927, Order: 161979, Start Time: 2012-08-15 20:16:10, End Time: 2012-08-15 21:30:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (151 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.33% (54.4886 => 56.3029, std. dev.: 0.1436) MultiSource/Benchmarks/llubenchmark/llu: 2.20% (3.7663 => 3.8493, std. dev.: 0.0234) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.53% (2.0176 => 2.3108, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.5818 => 0.6362, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5748 => 0.6273, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7061 => 0.7699, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.01% (0.3130 => 0.3412, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.50% (0.3578 => 0.3882, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.28% (0.3601 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.26% (0.1986 => 0.2150, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3789 => 0.4100, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.16% (0.3663 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.14% (0.4003 => 0.4329, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.87% (0.7710 => 0.8317, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 7.77% (1.3693 => 1.4757, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.64% (0.7038 => 0.7576, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.45% (0.5265 => 0.5657, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (3.9660 => 4.2569, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2721 => 0.2917, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 6.91% (0.4328 => 0.4627, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.74% (0.6959 => 0.7428, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4062 => 0.4334, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 6.65% (0.2781 => 0.2966, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.52% (0.2760 => 0.2940, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.51% (0.9199 => 0.9798, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.49% (0.3899 => 0.4152, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3022 => 0.3216, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.40% (1.2193 => 1.2973, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.38% (0.3246 => 0.3453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.23% (0.3580 => 0.3803, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.20% (1.9828 => 2.1057, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2690 => 0.2856, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.2937 => 0.3118, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.15% (0.2765 => 0.2935, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.10% (0.4379 => 0.4646, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.10% (0.3149 => 0.3341, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.98% (0.2726 => 0.2889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.82% (0.2696 => 0.2853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3192 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.79% (0.5577 => 0.5900, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.56% (13.8202 => 14.5886, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/sieve: 5.53% (0.3453 => 0.3644, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.51% (0.4390 => 0.4632, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.39% (0.2023 => 0.2132, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.39% (1.1364 => 1.1976, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.37% (0.2925 => 0.3082, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.2914 => 0.3069, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.30% (1.4563 => 1.5335, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.29% (0.5637 => 0.5935, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 5.20% (3.8646 => 4.0654, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.3756 => 0.3950, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.15% (0.4016 => 0.4223, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.15% (1.1061 => 1.1631, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: 5.15% (0.3534 => 0.3716, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.09% (0.8310 => 0.8733, std. dev.: 0.0110) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (1.3819 => 1.4519, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.06% (7.2180 => 7.5834, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 4.97% (0.7506 => 0.7879, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.89% (1.3813 => 1.4489, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.88% (1.9270 => 2.0210, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.3245 => 1.3889, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.82% (1.2292 => 1.2884, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.68% (0.7460 => 0.7809, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.67% (2.1791 => 2.2808, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.56% (1.0594 => 1.1077, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 4.30% (16.6129 => 17.3269, std. dev.: 0.0231) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.08% (4.3801 => 4.5589, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.05% (13.2842 => 13.8228, std. dev.: 0.0164) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.00% (3.6692 => 3.8161, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6209, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.94% (0.3755 => 0.3903, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.80% (1.1333 => 1.1764, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.69% (4.9865 => 5.1707, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (0.6135 => 0.6354, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.48% (0.8698 => 0.9001, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.26% (3.1889 => 3.2928, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.25% (0.6283 => 0.6487, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (8.4961 => 8.7567, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 2.96% (16.2614 => 16.7431, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (6.5754 => 6.7691, std. dev.: 0.0131) MultiSource/Applications/ClamAV/clamscan: 2.86% (14.5298 => 14.9454, std. dev.: 0.0225) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2742, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5188 => 1.5594, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.2742 => 3.3599, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.1007 => 2.1498, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.15% (4.6629 => 4.7631, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.83% (1.0313 => 1.0502, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6250 => 0.6358, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.71% (0.6744 => 0.6859, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.58% (3.7467 => 3.8059, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5116, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fbench: 25.54% (1.8175 => 2.2817, std. dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.84% (1.2998 => 1.4277, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7412, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8170, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5948, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.02% (3.7731 => 3.8493, std. dev.: 0.0234) MultiSource/Applications/SPASS/SPASS: 1.99% (10.7476 => 10.9610, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.56% (3.2729 => 3.3239, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5162, std. dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.27% (1.0895 => 1.1033, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.13% (4.5928 => 4.6447, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5719, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.00% (1.5089 => 1.5240, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.14% (22.5627 => 21.1766, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.84% (1.3780 => 1.3251, std. dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5859, std. dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.65% (20.3410 => 19.8021, std. dev.: 0.0185) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0112) MultiSource/Applications/spiff/spiff: -2.04% (3.0263 => 2.9645, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2206, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3656, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (9.9194 => 9.8031, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.8995, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 16:31:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 18:31:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120815233111.E12292A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2931?compare_to=2928&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2931, Order: 161990, Start Time: 2012-08-15 22:12:55, End Time: 2012-08-15 23:31:56 To: 2928, Order: 161980, Start Time: 2012-08-15 20:26:26, End Time: 2012-08-15 21:45:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (92 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (744 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.20% (3.7884 => 3.8718, std. dev.: 0.0208) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.63% (14.0110 => 13.5020, std. dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.24% (10.3673 => 13.5020, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/block-byref-aggr: 24.34% (0.3817 => 0.4746, std. dev.: 0.0259) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.14% (1.1194 => 1.2553, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3497 => 0.3856, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.72% (0.3828 => 0.4200, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.52% (0.3927 => 0.4301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.52% (0.3886 => 0.4256, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.85% (2.2022 => 2.3751, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.68% (1.7609 => 1.8961, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.3177 => 0.3361, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 5.69% (0.5925 => 0.6262, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 5.66% (0.6030 => 0.6371, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.48% (0.8172 => 0.8620, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2107 => 0.2218, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (0.7433 => 0.7805, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.98% (7.0540 => 7.4053, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 4.65% (0.7326 => 0.7667, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.65% (0.4879 => 0.5106, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.48% (10.4361 => 10.9040, std. dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.94% (9.4845 => 9.8583, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (4.9449 => 5.1376, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.89% (5.0018 => 5.1962, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5860 => 0.6076, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.64% (4.2646 => 4.4200, std. dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.38% (0.7835 => 0.8100, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (8.1363 => 8.4099, std. dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.28% (1.3050 => 1.3478, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9765 => 1.0063, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2221, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.99% (0.3441 => 0.3544, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.94% (0.8067 => 0.8304, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.93% (1.5415 => 1.5867, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1978, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.78% (0.4103 => 0.4217, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.75% (2.0273 => 2.0831, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4636 => 0.4761, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.59% (5.7591 => 5.9080, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 2.58% (3.3354 => 3.4213, std. dev.: 0.0101) MultiSource/Applications/hbd/hbd: 2.52% (1.5603 => 1.5996, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.50% (0.6450 => 0.6611, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.38% (3.8723 => 3.9645, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5981 => 0.6122, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.24% (2.2969 => 2.3484, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.5020 => 0.5132, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (1.5859 => 1.6211, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.08% (0.6675 => 0.6814, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.06% (1.4186 => 1.4478, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.04% (0.8921 => 0.9103, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6456 => 0.6584, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2460, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (14.3668 => 14.6452, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.86% (17.1811 => 17.5002, std. dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.67% (2.0665 => 2.1011, std. dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 1.55% (1.2842 => 1.3041, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2011, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.34% (1.0722 => 1.0866, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (4.2280 => 4.4427, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.87% (0.2944 => 0.3058, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7547, std. dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 2.48% (3.7781 => 3.8718, std. dev.: 0.0208) MultiSource/Applications/lua/lua: 2.08% (26.0924 => 26.6342, std. dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2194, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.57% (9.1159 => 9.2586, std. dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8224, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (5.2636 => 5.3381, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.30% (3.2827 => 3.3253, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.14% (1.3045 => 1.3194, std. dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.11% (2.2771 => 2.3024, std. dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.19% (5.2763 => 3.1556, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (5.3855 => 3.7095, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7093, std. dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0333, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5446, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -11.98% (22.1758 => 19.5182, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -8.79% (1.5373 => 1.4021, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/richards_benchmark: -6.99% (1.1396 => 1.0599, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8069, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4645, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4271, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9972, std. dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9624, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3349, std. dev.: 0.0074) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.16% (19.9488 => 19.7168, std. dev.: 0.0273) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8127, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2895, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 17:52:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 19:52:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816005232.4DC482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2932?compare_to=2930&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2932, Order: 161998, Start Time: 2012-08-15 23:39:27, End Time: 2012-08-16 00:53:15 To: 2930, Order: 161990, Start Time: 2012-08-15 21:57:51, End Time: 2012-08-15 23:12:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.78% (80.6511 => 78.4102, std. dev.: 0.8086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.39% (2.0176 => 2.3080, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: 9.33% (0.5818 => 0.6361, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.32% (0.7061 => 0.7719, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5748 => 0.6270, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.71% (0.1413 => 0.1522, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3578 => 0.3853, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.46% (0.3646 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.44% (0.3601 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.40% (0.3663 => 0.3934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3650 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.29% (0.4003 => 0.4295, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 7.27% (0.7038 => 0.7550, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.24% (3.9660 => 4.2530, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 7.19% (1.3693 => 1.4678, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4062 => 0.4354, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.10% (0.5265 => 0.5639, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4328 => 0.4629, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.90% (0.7710 => 0.8242, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.42% (0.6959 => 0.7406, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.32% (0.3022 => 0.3213, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.21% (0.3899 => 0.4141, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.20% (0.9199 => 0.9769, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 6.18% (0.2607 => 0.2768, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.17% (1.2193 => 1.2945, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.04% (0.2765 => 0.2932, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.04% (0.2966 => 0.3145, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.02% (0.2690 => 0.2852, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.01% (0.2628 => 0.2786, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.00% (1.9828 => 2.1018, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.95% (0.5577 => 0.5909, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.87% (0.3149 => 0.3334, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.3107 => 0.3289, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3192 => 0.3377, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.36% (13.8202 => 14.5613, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 5.34% (0.3293 => 0.3469, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.25% (1.4563 => 1.5327, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4016 => 0.4225, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.16% (1.1364 => 1.1950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3534 => 0.3715, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 5.04% (0.3868 => 0.4063, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.5637 => 0.5918, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.98% (0.8310 => 0.8724, std. dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.80% (0.7506 => 0.7866, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (7.2180 => 7.5607, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (1.3813 => 1.4468, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.67% (1.3245 => 1.3863, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 4.67% (1.9270 => 2.0169, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0448, std. dev.: 0.0101) MultiSource/Applications/Burg/burg: 4.66% (1.1061 => 1.1576, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 4.65% (1.0594 => 1.1087, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3819 => 1.4460, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2292 => 1.2847, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.7460 => 0.7792, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.41% (2.1791 => 2.2752, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.23% (16.6129 => 17.3158, std. dev.: 0.0140) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.99% (0.4791 => 0.4982, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.94% (3.6692 => 3.8138, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3755 => 0.3899, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6135 => 0.6367, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.78% (13.2842 => 13.7860, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (4.3801 => 4.5443, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1333 => 1.1752, std. dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.65% (4.9865 => 5.1685, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.50% (0.6283 => 0.6503, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.44% (0.8698 => 0.8997, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2886, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7497, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.93% (16.2614 => 16.7386, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.92% (1.5188 => 1.5632, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.90% (3.2742 => 3.3692, std. dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 2.77% (14.5298 => 14.9325, std. dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 2.67% (6.5754 => 6.7510, std. dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 2.62% (14.8535 => 15.2433, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.1007 => 2.1507, std. dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 2.22% (4.6629 => 4.7663, std. dev.: 0.0145) MultiSource/Applications/minisat/minisat: 1.91% (0.6744 => 0.6873, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.6250 => 0.6364, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.60% (1.0313 => 1.0478, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (0.9108 => 0.9246, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.30% (3.7467 => 3.7955, std. dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 1.17% (33.2944 => 33.6832, std. dev.: 0.0220) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std. dev.: 0.0530) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.07% (1.2998 => 1.4307, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.01% (1.5824 => 1.6616, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.30% (11.2619 => 11.7457, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0180) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5968, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9782, std. dev.: 0.0465) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3261, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.50% (3.7731 => 3.8298, std. dev.: 0.0207) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6425, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (22.5627 => 21.1808, std. dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.55% (0.6576 => 0.6474, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5118, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8059, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.80% (1.3780 => 1.3257, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.80% (20.3410 => 19.7724, std. dev.: 0.0555) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5874, std. dev.: 0.0191) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9629, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2416, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2229, std. dev.: 0.0223) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3626, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8694, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2254, std. dev.: 0.0391) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8028, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8986, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5644, std. dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 18:05:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 20:05:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120816010516.B5F792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2933?compare_to=2929&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2933, Order: 161990, Start Time: 2012-08-15 22:22:42, End Time: 2012-08-16 01:06:02 To: 2929, Order: 161969, Start Time: 2012-08-15 19:12:06, End Time: 2012-08-15 21:55:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (107 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (771 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.96% (0.2125 => 0.2273, std. dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.42% (125.1038 => 128.1318, std. dev.: 1.1502) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.69% (2.0772 => 2.1124, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.11% (54.0835 => 54.6818, std. dev.: 0.0889) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.64% (0.3465 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.57% (0.3460 => 0.3895, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3442 => 0.3874, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: 12.50% (0.3496 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.45% (0.3469 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.44% (0.3488 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.19% (0.3650 => 0.4095, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3643 => 0.4078, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3724 => 0.4162, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.07% (0.3792 => 0.4098, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.90% (1.5932 => 1.7031, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.76% (0.5826 => 0.6220, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 6.49% (0.5889 => 0.6271, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.5900 => 0.6254, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7158, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.82% (3.5627 => 3.7699, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (0.4361 => 0.4613, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.59% (1.3152 => 1.3887, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.48% (0.2866 => 0.3023, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.29% (0.4994 => 0.5258, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.27% (0.3930 => 0.4137, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 5.19% (0.4029 => 0.4238, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.02% (0.7171 => 0.7531, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 4.98% (1.0781 => 1.1318, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.96% (4.2109 => 4.4197, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (0.5026 => 0.5272, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (0.5000 => 0.5243, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.2736 => 0.2866, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.67% (5.5417 => 5.8005, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.10% (2.7292 => 2.8412, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 4.09% (0.2566 => 0.2671, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (0.4658 => 0.4848, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (1.9694 => 2.0487, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.01% (0.3890 => 0.4046, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.98% (0.6634 => 0.6898, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (1.9966 => 2.0753, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.91% (0.2738 => 0.2845, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (2.1013 => 2.1827, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.83% (0.2875 => 0.2985, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (0.3195 => 0.3313, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.62% (4.6177 => 4.7849, std. dev.: 0.0061) MultiSource/Applications/treecc/treecc: 3.61% (0.7875 => 0.8159, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.2823 => 0.2924, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.56% (0.3903 => 0.4042, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2813 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.55% (1.8794 => 1.9461, std. dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 3.53% (2.1653 => 2.2417, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 3.46% (0.3004 => 0.3108, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.43% (0.9909 => 1.0249, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.43% (4.4195 => 4.5709, std. dev.: 0.0128) MultiSource/Applications/lua/lua: 3.34% (1.4269 => 1.4745, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.31% (0.4139 => 0.4276, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.30% (2.0673 => 2.1355, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.3362 => 0.3471, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.3678 => 0.3797, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.3625 => 0.3740, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.3271 => 0.3374, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.13% (0.3258 => 0.3360, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.12% (0.3267 => 0.3369, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3726 => 0.3842, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3317 => 0.3420, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.05% (0.3282 => 0.3382, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.04% (0.4146 => 0.4272, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.99% (0.5546 => 0.5712, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 2.99% (0.3477 => 0.3581, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.96% (0.4251 => 0.4377, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.94% (0.9697 => 0.9982, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.91% (23.5202 => 24.2058, std. dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.3845 => 0.3956, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3690 => 0.3795, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.6435 => 0.6616, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.3981 => 0.4084, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.5012 => 0.5134, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.31% (2.0346 => 2.0815, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (0.7426 => 0.7596, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.28% (4.6926 => 4.7526, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.25% (11.6398 => 11.7850, std. dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.2122 => 0.2273, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6751, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 5.16% (1.8057 => 1.8988, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std. dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6465, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6875, std. dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2009, std. dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (41.7953 => 42.6119, std. dev.: 0.0178) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2273, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9090, std. dev.: 0.0201) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3137, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.46% (2.0820 => 2.1124, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2802, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.52% (2.4764 => 2.4140, std. dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5582, std. dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7932, std. dev.: 0.0159) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7884, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std. dev.: 0.0054) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.8000, std. dev.: 0.0606) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9590, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 18:18:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 20:18:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816011810.A81922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2934?compare_to=2931&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2934, Order: 161998, Start Time: 2012-08-15 23:59:32, End Time: 2012-08-16 01:18:55 To: 2931, Order: 161990, Start Time: 2012-08-15 22:12:55, End Time: 2012-08-15 23:31:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (87 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.37% (13.5020 => 13.6869, std. dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.4897 => 56.4629, std. dev.: 0.0912) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.22% (0.4746 => 0.4166, std. dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.02% (10.3673 => 13.6869, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.70% (1.1194 => 1.2504, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.06% (0.3473 => 0.3857, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.75% (0.3543 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3694 => 0.4078, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.62% (2.2022 => 2.3701, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.25% (1.7609 => 1.8886, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.74% (0.5925 => 0.6265, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.67% (0.6030 => 0.6372, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.3177 => 0.3344, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.89% (0.8172 => 0.8572, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.75% (7.0540 => 7.3889, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 4.70% (0.7326 => 0.7670, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.55% (0.4615 => 0.4825, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.43% (0.4879 => 0.5095, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.4361 => 10.8647, std. dev.: 0.0291) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (9.4845 => 9.8362, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.9449 => 5.1237, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.50% (0.5569 => 0.5764, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.42% (5.0018 => 5.1728, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4102, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5860 => 0.6052, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.26% (1.1642 => 1.2021, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.23% (0.7835 => 0.8088, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.19% (0.4636 => 0.4784, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.16% (8.1363 => 8.3931, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.14% (1.3050 => 1.3460, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.87% (0.5020 => 0.5164, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.86% (0.9765 => 1.0044, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.80% (0.3826 => 0.3933, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.79% (1.5603 => 1.6039, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.78% (1.1861 => 1.2191, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.75% (0.8067 => 0.8289, std. dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 2.67% (5.7591 => 5.9129, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.59% (0.4289 => 0.4400, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.5415 => 1.5811, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.53% (0.4064 => 0.4167, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.49% (2.0665 => 2.1180, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.38% (3.3354 => 3.4149, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.33% (0.5105 => 0.5224, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.31% (2.0273 => 2.0742, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.6456 => 0.6605, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.20% (1.5859 => 1.6208, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5981 => 0.6104, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.98% (0.6675 => 0.6807, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.97% (1.2842 => 1.3095, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 1.97% (3.8723 => 3.9485, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (14.3668 => 14.6405, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.85% (1.4186 => 1.4448, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.81% (2.2969 => 2.3384, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 1.80% (0.8921 => 0.9082, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.67% (2.2024 => 2.2392, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.67% (17.1811 => 17.4674, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1840 => 1.1983, std. dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.19% (1.0722 => 1.0850, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (4.2280 => 4.4509, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7469, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 2.17% (26.0924 => 26.6590, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1578 => 3.2193, std. dev.: 0.0087) MultiSource/Applications/minisat/minisat: 1.72% (9.1159 => 9.2729, std. dev.: 0.0272) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8228, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.36% (5.2636 => 5.3351, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 1.26% (3.2827 => 3.3241, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5818, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.08% (2.6546 => 2.6833, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1498, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7090, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7065, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0335, std. dev.: 0.0434) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5431, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -12.28% (22.1758 => 19.4525, std. dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (3.8922 => 3.8482, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.71% (1.6925 => 1.4266, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -8.03% (1.5373 => 1.4139, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5569, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8071, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4725, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4163, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/salsa20: -2.80% (10.2830 => 9.9950, std. dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (8.1563 => 7.9663, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3411, std. dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.05% (2.3135 => 2.2893, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 19:34:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 21:34:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816023415.3970F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2935?compare_to=2932&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2935, Order: 162003, Start Time: 2012-08-16 01:21:03, End Time: 2012-08-16 02:34:57 To: 2932, Order: 161998, Start Time: 2012-08-15 23:39:27, End Time: 2012-08-16 00:53:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.71% (2.0176 => 2.3143, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.98% (0.3130 => 0.3411, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.68% (0.7061 => 0.7674, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: 8.59% (0.5818 => 0.6318, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.23% (0.5748 => 0.6221, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.07% (0.1413 => 0.1527, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 7.91% (0.3578 => 0.3861, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3601 => 0.3881, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.69% (0.3914 => 0.4215, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.65% (0.3789 => 0.4079, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.65% (0.3623 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3663 => 0.3943, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3650 => 0.3928, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.49% (0.7038 => 0.7565, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.4003 => 0.4302, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.34% (3.9660 => 4.2573, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.24% (0.5265 => 0.5646, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.17% (1.3693 => 1.4675, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.7710 => 0.8261, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4062 => 0.4329, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.47% (0.9199 => 0.9794, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4328 => 0.4607, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.43% (1.2193 => 1.2977, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.41% (0.6959 => 0.7405, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.35% (0.3246 => 0.3452, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (0.4379 => 0.4650, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5577 => 0.5912, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.90% (0.2782 => 0.2946, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.74% (13.8202 => 14.6137, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.67% (1.4563 => 1.5388, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2690 => 0.2837, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.42% (0.1865 => 0.1966, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.40% (0.2628 => 0.2770, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.39% (0.2023 => 0.2132, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.38% (1.1364 => 1.1975, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2966 => 0.3125, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2761 => 0.2909, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2760 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.28% (0.3485 => 0.3669, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.26% (0.2925 => 0.3079, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.24% (1.9828 => 2.0866, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.23% (0.5637 => 0.5932, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.19% (0.8310 => 0.8741, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.14% (0.2726 => 0.2866, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.13% (7.2180 => 7.5883, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.04% (0.2696 => 0.2832, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.00% (1.1061 => 1.1614, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (1.3245 => 1.3904, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.91% (1.9270 => 2.0216, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.89% (3.8646 => 4.0537, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.3813 => 1.4487, std. dev.: 0.0063) MultiSource/Applications/spiff/spiff: 4.85% (0.7506 => 0.7870, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.77% (1.0594 => 1.1099, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.72% (0.4390 => 0.4597, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.70% (2.1791 => 2.2816, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.68% (1.3819 => 1.4466, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.63% (0.4016 => 0.4202, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.44% (0.2995 => 0.3128, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2825, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 4.22% (0.3220 => 0.3356, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 4.21% (16.6129 => 17.3117, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (13.2842 => 13.8422, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.12% (3.6692 => 3.8204, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.4791 => 0.4985, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.3801 => 4.5574, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6210, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.86% (1.1333 => 1.1771, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.85% (0.6135 => 0.6371, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 3.70% (0.3131 => 0.3247, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.54% (4.9865 => 5.1628, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3755 => 0.3887, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6283 => 0.6495, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.31% (3.1889 => 3.2945, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (8.4961 => 8.7684, std. dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 3.19% (16.2614 => 16.7799, std. dev.: 0.0237) MultiSource/Applications/JM/ldecod/ldecod: 3.18% (6.5754 => 6.7842, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.10% (0.8698 => 0.8968, std. dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.03% (14.8535 => 15.3039, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.99% (1.5188 => 1.5642, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.94% (3.2742 => 3.3704, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.85% (14.5298 => 14.9436, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1548, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 2.20% (4.6629 => 4.7656, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.92% (1.0313 => 1.0511, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.82% (0.6744 => 0.6867, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 1.75% (3.7467 => 3.8123, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.9108 => 0.9265, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.02% (33.2944 => 33.6336, std. dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 24.77% (1.8175 => 2.2677, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 9.77% (1.2998 => 1.4268, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.42% (11.2619 => 11.7599, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6033, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.11% (10.7476 => 10.9742, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3266, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5749, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.07% (4.5928 => 4.6420, std. dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.97% (22.5627 => 21.2149, std. dev.: 0.0235) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5096, std. dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3165, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9989, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5879, std. dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.58% (20.3410 => 19.8160, std. dev.: 0.0232) MultiSource/Benchmarks/Olden/bh/bh: -2.44% (1.9762 => 1.9280, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2213, std. dev.: 0.0110) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9635, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2227, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3575, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8018, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.9009, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 20:04:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 22:04:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816030449.B6B102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2936?compare_to=2934&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2936, Order: 162003, Start Time: 2012-08-16 01:46:25, End Time: 2012-08-16 03:05:32 To: 2934, Order: 161998, Start Time: 2012-08-15 23:59:32, End Time: 2012-08-16 01:18:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (84 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (752 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.31% (13.6869 => 13.3703, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.41% (80.4769 => 78.5334, std. dev.: 0.3425) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.97% (10.3673 => 13.3703, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.83% (1.1194 => 1.2518, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.49% (0.3543 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.50% (0.3886 => 0.4294, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.89% (2.2022 => 2.3760, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.33% (1.7609 => 1.8900, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.37% (0.8172 => 0.8611, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 5.28% (0.5925 => 0.6238, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 5.19% (0.6030 => 0.6343, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.81% (0.3282 => 0.3440, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.57% (7.0540 => 7.3763, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (10.4361 => 10.8943, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (0.7433 => 0.7754, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.26% (0.3121 => 0.3254, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.16% (0.7326 => 0.7631, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (4.9449 => 5.1298, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (5.0018 => 5.1885, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (9.4845 => 9.8366, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.58% (4.2646 => 4.4173, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.45% (1.3050 => 1.3500, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 3.42% (0.7835 => 0.8103, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.41% (0.4103 => 0.4243, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.32% (8.1363 => 8.4067, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.24% (0.4636 => 0.4786, std. dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 3.04% (0.3387 => 0.3490, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9765 => 1.0057, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.99% (0.8067 => 0.8308, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.91% (1.1861 => 1.2206, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.88% (1.5603 => 1.6053, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 2.70% (2.0273 => 2.0821, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.64% (1.1642 => 1.1949, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (1.5415 => 1.5819, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.61% (0.3826 => 0.3926, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.55% (5.7591 => 5.9062, std. dev.: 0.0131) MultiSource/Applications/d/make_dparser: 2.35% (3.3354 => 3.4139, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.29% (0.6450 => 0.6598, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (2.0665 => 2.1121, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6456 => 0.6595, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.12% (0.5981 => 0.6108, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5859 => 1.6191, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.07% (3.8723 => 3.9526, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.4186 => 1.4477, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 1.91% (1.2842 => 1.3087, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 1.87% (0.8921 => 0.9088, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 1.80% (2.2969 => 2.3383, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (14.3668 => 14.6208, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.2024 => 2.2397, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.65% (17.1811 => 17.4651, std. dev.: 0.0213) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1991, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (4.2280 => 4.4405, std. dev.: 0.0138) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7476, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.93% (26.0924 => 26.5950, std. dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/hash2: 1.92% (3.1578 => 3.2185, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2461, std. dev.: 0.0388) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.34% (5.2636 => 5.3339, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.30% (3.2827 => 3.3253, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.41% (5.2763 => 3.1443, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (5.3855 => 3.7094, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.79% (5.3526 => 3.7046, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -15.09% (54.1659 => 45.9934, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.50% (2.9384 => 2.5418, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -12.20% (22.1758 => 19.4713, std. dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.05% (3.8922 => 3.8513, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -8.82% (1.5373 => 1.4017, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8069, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4680, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4260, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0003, std. dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9617, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (12.5348 => 12.3336, std. dev.: 0.0077) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8132, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2895, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 21:15:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 23:15:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816041532.CD6C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2937?compare_to=2935&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2937, Order: 162005, Start Time: 2012-08-16 03:02:20, End Time: 2012-08-16 04:16:14 To: 2935, Order: 162003, Start Time: 2012-08-16 01:21:03, End Time: 2012-08-16 02:34:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5098 => 56.4629, std. dev.: 0.0475) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.81% (2.0176 => 2.3164, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.64% (0.7061 => 0.7671, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.40% (0.5818 => 0.6307, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5748 => 0.6219, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 8.02% (0.3578 => 0.3865, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3601 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.82% (0.3646 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.65% (0.3623 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3650 => 0.3928, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 7.61% (0.3914 => 0.4212, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.42% (0.7038 => 0.7560, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.40% (3.9660 => 4.2595, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5265 => 0.5645, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.08% (0.7710 => 0.8256, std. dev.: 0.0028) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4651, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.51% (0.6959 => 0.7412, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.50% (1.2193 => 1.2985, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.49% (0.9199 => 0.9796, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4328 => 0.4605, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.22% (0.3246 => 0.3448, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.14% (0.4379 => 0.4648, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.00% (0.3899 => 0.4133, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.97% (0.2782 => 0.2948, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.83% (0.5577 => 0.5902, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.73% (13.8202 => 14.6116, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3022 => 0.3195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2690 => 0.2838, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (1.4563 => 1.5356, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2760 => 0.2909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.39% (0.2655 => 0.2798, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.39% (1.1364 => 1.1976, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.35% (0.2765 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.34% (0.2023 => 0.2131, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.30% (0.2925 => 0.3080, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2966 => 0.3123, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.8310 => 0.8746, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.23% (0.5637 => 0.5932, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.2914 => 0.3066, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (1.9828 => 2.0858, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2696 => 0.2835, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.09% (7.2180 => 7.5853, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.3107 => 0.3265, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.04% (1.3245 => 1.3912, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3149 => 0.3307, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.95% (1.1061 => 1.1608, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: 4.94% (3.8646 => 4.0556, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4390 => 0.4601, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.80% (1.0594 => 1.1102, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.78% (0.7506 => 0.7865, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.77% (1.9270 => 2.0189, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3293 => 0.3447, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.66% (1.3819 => 1.4463, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.3756 => 0.3930, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (1.3813 => 1.4449, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.7460 => 0.7801, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.57% (2.1791 => 2.2786, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.3868 => 0.4039, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.32% (0.3220 => 0.3359, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.23% (16.6129 => 17.3163, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2292 => 1.2804, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.13% (13.2842 => 13.8333, std. dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.3801 => 4.5576, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.4791 => 0.4985, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (3.6692 => 3.8170, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6212, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (1.1333 => 1.1762, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6135 => 0.6366, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.74% (0.3131 => 0.3248, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (4.9865 => 5.1643, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.39% (0.6283 => 0.6496, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.28% (3.1889 => 3.2936, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 3.26% (16.2614 => 16.7914, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.25% (8.4961 => 8.7718, std. dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (0.8698 => 0.8976, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.08% (6.5754 => 6.7782, std. dev.: 0.0157) MultiSource/Applications/JM/lencod/lencod: 3.02% (14.8535 => 15.3018, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.01% (3.2742 => 3.3729, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.00% (1.5188 => 1.5643, std. dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.5298 => 14.9494, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1563, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.23% (4.6629 => 4.7667, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.99% (0.6744 => 0.6878, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.88% (1.0313 => 1.0507, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.73% (0.9108 => 0.9266, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.51% (3.7467 => 3.8034, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std. dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 10.33% (1.2998 => 1.4341, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7425, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5956, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.16% (10.7476 => 10.9801, std. dev.: 0.0525) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3255, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0073) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6424, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.99% (22.5627 => 21.2110, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5156, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5937, std. dev.: 0.0144) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.52% (20.3410 => 19.8287, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: -2.43% (1.9762 => 1.9281, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.32% (0.6589 => 0.6436, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9603, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2278, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (0.8342 => 0.8181, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2185, std. dev.: 0.0228) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std. dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3676, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (9.9194 => 9.8011, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8979, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 21:15:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 23:15:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120816041551.B5BF82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2938?compare_to=2933&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2938, Order: 162003, Start Time: 2012-08-16 01:33:16, End Time: 2012-08-16 04:16:32 To: 2933, Order: 161990, Start Time: 2012-08-15 22:22:42, End Time: 2012-08-16 01:06:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (109 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (769 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.52% (2.4140 => 2.3772, std. dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: -1.05% (1.7031 => 1.6853, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.16% (0.3465 => 0.3921, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.03% (0.3446 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3442 => 0.3889, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.89% (0.3469 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 12.58% (0.3650 => 0.4109, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3643 => 0.4095, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.14% (0.3724 => 0.4176, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.65% (0.3792 => 0.4120, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.1619 => 0.1730, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.71% (0.5826 => 0.6217, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.59% (0.5889 => 0.6277, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.14% (0.5900 => 0.6262, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (1.6211 => 1.7204, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.12% (3.5627 => 3.7809, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 5.78% (1.5932 => 1.6853, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.66% (1.3152 => 1.3896, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.56% (0.2014 => 0.2126, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (0.4361 => 0.4601, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.45% (0.3930 => 0.4144, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.39% (0.1968 => 0.2074, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 5.13% (4.2109 => 4.4271, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.12% (0.7171 => 0.7538, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (0.5026 => 0.5279, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.02% (0.2866 => 0.3010, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (0.5000 => 0.5248, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 4.93% (1.0781 => 1.1312, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.57% (5.5417 => 5.7952, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (0.4658 => 0.4869, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.34% (2.7292 => 2.8477, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 4.33% (0.2566 => 0.2677, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.20% (1.9694 => 2.0521, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (1.9966 => 2.0798, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.16% (0.3890 => 0.4052, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.16% (0.6634 => 0.6910, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (1.8794 => 1.9552, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3060 => 0.3183, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.01% (2.1013 => 2.1855, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.00% (0.2875 => 0.2990, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3195 => 0.3321, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.91% (4.6177 => 4.7981, std. dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 3.88% (2.1653 => 2.2493, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (4.4195 => 4.5860, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.3903 => 0.4048, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.71% (0.9909 => 1.0277, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 3.70% (0.2813 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2792 => 0.2895, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.63% (0.3004 => 0.3113, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.62% (2.0673 => 2.1422, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.60% (0.4139 => 0.4288, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.54% (0.7875 => 0.8154, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.52% (1.4269 => 1.4771, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.47% (0.2911 => 0.3012, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.45% (0.3362 => 0.3478, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.42% (0.3096 => 0.3202, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.40% (23.5202 => 24.3199, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/sieve: 3.38% (0.3726 => 0.3852, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3267 => 0.3377, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.35% (0.3258 => 0.3367, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.34% (0.3625 => 0.3746, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.34% (0.5546 => 0.5731, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.32% (0.3317 => 0.3427, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.32% (0.3348 => 0.3459, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 3.30% (0.3336 => 0.3446, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.3271 => 0.3378, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3678 => 0.3798, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.11% (0.4251 => 0.4383, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3690 => 0.3803, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.04% (0.3981 => 0.4102, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.03% (0.6435 => 0.6630, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 3.02% (0.9697 => 0.9990, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.4146 => 0.4271, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.61% (2.0346 => 2.0877, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (0.7426 => 0.7599, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (4.6926 => 4.7514, std. dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.24% (11.6398 => 11.7837, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6684, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std. dev.: 0.0255) SingleSource/Benchmarks/Misc/flops-2: 4.58% (1.8057 => 1.8884, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6308, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6316, std. dev.: 0.0249) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2000, std. dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.89% (41.7953 => 42.5871, std. dev.: 0.0344) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9244, std. dev.: 0.0109) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std. dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3078, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.29% (7.1849 => 7.2773, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.01% (2.4764 => 2.3772, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.97% (25.4195 => 16.5312, std. dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.88% (11.2080 => 10.7729, std. dev.: 0.0146) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0056) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.19% (17.2379 => 16.8607, std. dev.: 0.0729) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5806, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9689, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 4.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 21:51:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 15 Aug 2012 23:51:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816045126.47F5C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2939?compare_to=2936&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2939, Order: 162007, Start Time: 2012-08-16 03:33:06, End Time: 2012-08-16 04:52:03 To: 2936, Order: 162003, Start Time: 2012-08-16 01:46:25, End Time: 2012-08-16 03:05:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (88 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (747 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.52% (0.5325 => 0.5459, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.65% (78.5334 => 79.8317, std. dev.: 0.2864) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.85% (10.3673 => 13.3585, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3561 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3497 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.79% (1.1194 => 1.2514, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (2.2022 => 2.3752, std. dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.43% (1.7609 => 1.8918, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 5.62% (0.6030 => 0.6369, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.57% (0.5925 => 0.6255, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.45% (0.8172 => 0.8617, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.4615 => 0.4839, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.83% (0.7326 => 0.7680, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.60% (7.0540 => 7.3784, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.53% (0.4879 => 0.5100, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (0.7433 => 0.7766, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 4.31% (10.4361 => 10.8863, std. dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: 3.89% (9.4845 => 9.8532, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.5569 => 0.5779, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.72% (5.0018 => 5.1877, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (4.9449 => 5.1264, std. dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.49% (4.2646 => 4.4136, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.46% (0.5860 => 0.6063, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.4103 => 0.4241, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (8.1363 => 8.4096, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.3050 => 1.3471, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.13% (0.4636 => 0.4781, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 3.08% (0.7835 => 0.8076, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.98% (0.9765 => 1.0056, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 2.98% (0.3423 => 0.3525, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.96% (0.5105 => 0.5256, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.88% (1.5603 => 1.6053, std. dev.: 0.0108) MultiSource/Applications/Burg/burg: 2.76% (1.1642 => 1.1963, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.74% (0.8067 => 0.8288, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.71% (1.5415 => 1.5833, std. dev.: 0.0089) MultiSource/Applications/oggenc/oggenc: 2.70% (5.7591 => 5.9148, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.64% (0.3865 => 0.3967, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.4289 => 0.4398, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0778, std. dev.: 0.0073) MultiSource/Applications/d/make_dparser: 2.41% (3.3354 => 3.4157, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1162, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (0.4620 => 0.4728, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6450 => 0.6595, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.17% (0.6456 => 0.6596, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6675 => 0.6816, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.11% (0.5981 => 0.6107, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.08% (3.8723 => 3.9528, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.02% (1.5859 => 1.6179, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3097, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (1.4186 => 1.4456, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.88% (0.8921 => 0.9089, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (14.3668 => 14.6249, std. dev.: 0.0083) MultiSource/Applications/siod/siod: 1.72% (2.2969 => 2.3365, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 1.71% (17.1811 => 17.4752, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.69% (2.2024 => 2.2397, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.24% (1.1840 => 1.1987, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (4.2280 => 4.4274, std. dev.: 0.0149) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7480, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 1.98% (2.2771 => 2.3222, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 1.90% (26.0924 => 26.5883, std. dev.: 0.0382) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2127, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.61% (9.1159 => 9.2627, std. dev.: 0.0369) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8229, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.33% (5.2636 => 5.3334, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 1.30% (3.2827 => 3.3253, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.23% (1.3045 => 1.3205, std. dev.: 0.0061) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.06% (2.6546 => 2.6827, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1241, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1413, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7102, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.73% (5.3526 => 3.7076, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0254, std. dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.39% (2.9384 => 2.5449, std. dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: -12.29% (22.1758 => 19.4510, std. dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.00% (3.8922 => 3.8532, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.62% (1.6925 => 1.4282, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -8.63% (1.5373 => 1.4047, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8067, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4728, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.82% (8.6802 => 8.4355, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0140, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.29% (8.1563 => 7.9692, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3340, std. dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2895, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 7.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 22:56:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 00:56:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816055647.217DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2940?compare_to=2937&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2940, Order: 162012, Start Time: 2012-08-16 04:43:42, End Time: 2012-08-16 05:57:29 To: 2937, Order: 162005, Start Time: 2012-08-16 03:02:20, End Time: 2012-08-16 04:16:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (150 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 1.81% (0.6307 => 0.6421, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 1.75% (0.6219 => 0.6328, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 1.50% (0.7671 => 0.7786, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.09% (2.0858 => 2.1085, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.46% (7.9447 => 8.0605, std. dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.60% (2.0176 => 2.3121, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.36% (0.5818 => 0.6421, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.27% (0.7061 => 0.7786, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 10.09% (0.5748 => 0.6328, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.01% (0.3130 => 0.3412, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3914 => 0.4246, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.47% (0.3623 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.38% (0.3663 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.22% (0.3940 => 0.4264, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.98% (1.3693 => 1.4786, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.74% (0.7710 => 0.8307, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.61% (3.9660 => 4.2677, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.60% (0.7038 => 0.7573, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.45% (0.5265 => 0.5657, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4328 => 0.4648, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.28% (0.2596 => 0.2785, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2781 => 0.2981, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.13% (0.2721 => 0.2915, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4062 => 0.4344, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.3899 => 0.4166, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.72% (0.3022 => 0.3225, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.65% (0.6959 => 0.7422, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 6.63% (0.2760 => 0.2943, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.62% (0.9199 => 0.9808, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2765 => 0.2946, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.54% (1.2193 => 1.2990, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.53% (0.4379 => 0.4665, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.50% (0.2937 => 0.3128, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.45% (0.3489 => 0.3714, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.41% (0.2761 => 0.2938, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.38% (0.3246 => 0.3453, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.37% (0.2966 => 0.3155, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3580 => 0.3807, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.34% (1.9828 => 2.1085, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2696 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.19% (0.3149 => 0.3344, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.17% (0.3485 => 0.3700, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.12% (0.3107 => 0.3297, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.04% (0.1789 => 0.1897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3453 => 0.3659, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3192 => 0.3381, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.90% (0.4390 => 0.4649, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.83% (0.5577 => 0.5902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.80% (0.3534 => 0.3739, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.78% (0.2127 => 0.2250, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.74% (0.3293 => 0.3482, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.4016 => 0.4245, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.69% (13.8202 => 14.6068, std. dev.: 0.0217) MultiSource/Benchmarks/McCat/09-vor/vor: 5.57% (0.2925 => 0.3088, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.3756 => 0.3965, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.54% (0.2023 => 0.2135, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 5.53% (0.2243 => 0.2367, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.50% (1.1364 => 1.1989, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (1.4563 => 1.5363, std. dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.2914 => 0.3072, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.41% (0.5637 => 0.5942, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.32% (7.2180 => 7.6018, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 5.31% (3.8646 => 4.0700, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: 5.22% (0.7506 => 0.7898, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3868 => 0.4070, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.22% (1.1061 => 1.1638, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.8310 => 0.8739, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.16% (1.3245 => 1.3928, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (0.2945 => 0.3095, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.2292 => 1.2901, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.93% (1.9270 => 2.0220, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (1.3813 => 1.4490, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.3819 => 1.4492, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.86% (1.0594 => 1.1109, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.83% (0.7460 => 0.7820, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.81% (2.1791 => 2.2840, std. dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 4.73% (16.6129 => 17.3991, std. dev.: 0.0223) MultiSource/Benchmarks/McCat/18-imp/imp: 4.60% (0.3220 => 0.3368, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.42% (0.3755 => 0.3921, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.31% (4.4433 => 4.6348, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.28% (4.3801 => 4.5674, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.18% (3.6692 => 3.8227, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (13.2842 => 13.8313, std. dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.4791 => 0.4985, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.93% (1.1333 => 1.1778, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.88% (4.9865 => 5.1802, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6135 => 0.6367, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.61% (0.6283 => 0.6510, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.8698 => 0.9005, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.38% (3.1889 => 3.2967, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.26% (8.4961 => 8.7727, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (6.5754 => 6.7799, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 3.07% (14.8535 => 15.3100, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 3.00% (16.2614 => 16.7499, std. dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (3.2742 => 3.3723, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.94% (14.5298 => 14.9567, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.86% (1.5188 => 1.5622, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.63% (2.1007 => 2.1559, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6250 => 0.6386, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.02% (0.6744 => 0.6880, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.01% (4.6629 => 4.7567, std. dev.: 0.0080) MultiSource/Applications/lemon/lemon: 1.75% (1.0313 => 1.0493, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.65% (3.7467 => 3.8084, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9108 => 0.9252, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.55% (33.2944 => 33.8105, std. dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.28% (6.2785 => 6.3586, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.72% (5.7573 => 7.5257, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2561, std. dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.95% (1.2998 => 1.4161, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7436, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.55% (1.9199 => 1.9881, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8170, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6000, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.94% (10.7476 => 10.9564, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3269, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1860, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.02% (4.5928 => 4.6398, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.80% (22.5627 => 21.2541, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.11% (1.3780 => 1.3213, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5863, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.57% (20.3410 => 19.8179, std. dev.: 0.0266) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0106) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9628, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.94% (0.8342 => 0.8180, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2469, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3305 => 7.2223, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3627, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8026, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8993, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5628, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 15 23:37:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 01:37:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816063755.A1D9F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2941?compare_to=2939&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2941, Order: 162012, Start Time: 2012-08-16 05:19:38, End Time: 2012-08-16 06:38:37 To: 2939, Order: 162007, Start Time: 2012-08-16 03:33:06, End Time: 2012-08-16 04:52:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (90 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (746 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.16% (13.3585 => 13.9142, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.23% (54.3579 => 56.6558, std. dev.: 0.0697) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.21% (10.3673 => 13.9142, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 11.55% (0.3473 => 0.3874, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.15% (0.3543 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.96% (1.1194 => 1.2421, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.65% (2.2022 => 2.3706, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.80% (1.7609 => 1.8807, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.04% (0.5925 => 0.6283, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: 6.04% (0.6030 => 0.6394, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.36% (0.7326 => 0.7719, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.09% (0.4615 => 0.4850, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.09% (0.8172 => 0.8588, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 4.72% (0.3282 => 0.3437, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 4.71% (0.7433 => 0.7783, std. dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 4.57% (10.4361 => 10.9130, std. dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.52% (0.3121 => 0.3262, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.50% (7.0540 => 7.3711, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.22% (0.4879 => 0.5085, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.99% (4.9449 => 5.1421, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.97% (0.5569 => 0.5790, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (5.0018 => 5.1975, std. dev.: 0.0385) MultiSource/Benchmarks/mafft/pairlocalalign: 3.72% (9.4845 => 9.8370, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.70% (0.5860 => 0.6077, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (4.2646 => 4.4211, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 3.36% (0.7835 => 0.8098, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (8.1363 => 8.4090, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.33% (1.3050 => 1.3485, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.8067 => 0.8328, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.3423 => 0.3531, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.10% (1.1642 => 1.2003, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.09% (0.9765 => 1.0067, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1861 => 1.2215, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.91% (0.3441 => 0.3541, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.5415 => 1.5858, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.83% (0.4636 => 0.4767, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 2.69% (5.7591 => 5.9142, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.68% (2.0273 => 2.0817, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 2.53% (3.3354 => 3.4199, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.40% (0.6450 => 0.6605, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.38% (0.4289 => 0.4391, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 2.38% (1.5603 => 1.5974, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.37% (0.5981 => 0.6123, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9610, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.19% (2.0665 => 2.1118, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.4186 => 1.4481, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5020 => 0.5122, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6456 => 0.6587, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (14.3668 => 14.6543, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.5859 => 1.6175, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.97% (2.2969 => 2.3422, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8921 => 0.9096, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.83% (0.6675 => 0.6797, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (2.2024 => 2.2426, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.78% (17.1811 => 17.4867, std. dev.: 0.0140) MultiSource/Applications/hexxagon/hexxagon: 1.72% (1.2842 => 1.3063, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.35% (1.1840 => 1.2000, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.18% (1.0722 => 1.0848, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (4.2280 => 4.4385, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7496, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 2.01% (26.0924 => 26.6168, std. dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1578 => 3.2175, std. dev.: 0.0052) MultiSource/Applications/minisat/minisat: 1.61% (9.1159 => 9.2625, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8224, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.49% (0.9540 => 0.9682, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 1.41% (5.2636 => 5.3377, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.26% (3.2827 => 3.3239, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2067, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5770, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6816, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1241, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.49% (5.2763 => 3.1397, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6920, std. dev.: 0.0202) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (5.3526 => 3.6893, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0659, std. dev.: 0.0406) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.83% (2.9384 => 2.5319, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4541, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.05% (3.8922 => 3.8512, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -7.96% (1.5373 => 1.4150, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.33% (2.7294 => 2.5567, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8066, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4729, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.16% (8.6802 => 8.4058, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9995, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9598, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3453, std. dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.13% (1.8329 => 1.8121, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.3135 => 2.2896, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 5.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 00:29:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 02:29:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120816072946.8A7BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2942?compare_to=2938&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2942, Order: 162012, Start Time: 2012-08-16 04:43:53, End Time: 2012-08-16 07:30:30 To: 2938, Order: 162003, Start Time: 2012-08-16 01:33:16, End Time: 2012-08-16 04:16:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (116 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.10% (2.0762 => 2.1198, std. dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.83% (0.3442 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3460 => 0.3938, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3446 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.74% (0.3465 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.68% (0.3488 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.59% (0.3496 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.29% (0.3650 => 0.4135, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.20% (0.3643 => 0.4124, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.94% (0.3724 => 0.4206, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.88% (0.5826 => 0.6285, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.59% (0.5889 => 0.6336, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.37% (1.6211 => 1.7244, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.31% (0.5900 => 0.6272, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (3.5627 => 3.7849, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 6.12% (0.7171 => 0.7610, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 5.82% (1.5932 => 1.6859, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.76% (1.3152 => 1.3910, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.2014 => 0.2129, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.71% (0.4361 => 0.4610, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.49% (0.4029 => 0.4250, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.31% (0.4994 => 0.5259, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (0.5026 => 0.5291, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 5.23% (4.2109 => 4.4310, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (0.5000 => 0.5255, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2813 => 0.2956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.97% (0.2875 => 0.3018, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2823 => 0.2963, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2729 => 0.2860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.80% (0.2792 => 0.2926, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.75% (2.7292 => 2.8589, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.73% (0.3195 => 0.3346, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.71% (0.9909 => 1.0376, std. dev.: 0.0158) SingleSource/Regression/C++/ofstream_ctor: 4.63% (0.3004 => 0.3143, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.62% (0.2725 => 0.2851, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 4.59% (5.5417 => 5.7963, std. dev.: 0.0417) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.2736 => 0.2861, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 4.53% (0.2803 => 0.2930, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.53% (0.2738 => 0.2862, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.51% (0.3678 => 0.3844, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.2911 => 0.3042, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.48% (0.2811 => 0.2937, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.48% (0.3060 => 0.3197, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.47% (1.9694 => 2.0575, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.47% (0.2750 => 0.2873, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.44% (2.0673 => 2.1590, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.43% (1.9966 => 2.0851, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2780 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3267 => 0.3410, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.37% (0.3362 => 0.3509, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3096 => 0.3230, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.28% (0.3903 => 0.4070, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3124 => 0.3257, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.26% (0.3477 => 0.3625, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.25% (0.4658 => 0.4856, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (0.3890 => 0.4054, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.21% (0.2566 => 0.2674, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 4.21% (0.3258 => 0.3395, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.14% (0.4251 => 0.4427, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3348 => 0.3485, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3726 => 0.3877, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3282 => 0.3415, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.03% (4.6177 => 4.8037, std. dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4146 => 0.4313, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (2.1013 => 2.1857, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 4.01% (2.1653 => 2.2521, std. dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 3.99% (1.8794 => 1.9544, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3690 => 0.3835, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.84% (0.9697 => 1.0069, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.83% (23.5202 => 24.4208, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.72% (0.3981 => 0.4129, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (4.4195 => 4.5783, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.4139 => 0.4287, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 3.53% (1.4269 => 1.4773, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.3845 => 0.3977, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.30% (0.3271 => 0.3379, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.6435 => 0.6646, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.24% (0.3336 => 0.3444, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 3.07% (0.5012 => 0.5166, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.26% (2.0346 => 2.0806, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (0.7426 => 0.7579, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (0.5361 => 0.5470, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.24% (11.6398 => 11.7837, std. dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.82% (0.2122 => 0.2288, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (12.0509 => 12.6534, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std. dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6447, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (105.3826 => 107.6993, std. dev.: 0.0545) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2044, std. dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.99% (41.7953 => 42.6286, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.82% (2.0820 => 2.1198, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.71% (50.0626 => 50.9184, std. dev.: 0.0145) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2207, std. dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3043, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2832, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.42% (2.4764 => 2.3918, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5838, std. dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8018, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7941, std. dev.: 0.0120) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0056) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std. dev.: 0.0335) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7850, std. dev.: 0.0647) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9558, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 00:40:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 02:40:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816074056.BE4933524007@llvm.org> http://llvm.org/perf/db_default/v4/nts/2943?compare_to=2940&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2943, Order: 162013, Start Time: 2012-08-16 06:24:45, End Time: 2012-08-16 07:41:39 To: 2940, Order: 162012, Start Time: 2012-08-16 04:43:42, End Time: 2012-08-16 05:57:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (128 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (730 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.29% (55.1994 => 56.4612, std. dev.: 0.0518) SingleSource/Benchmarks/Misc/mandel-2: 1.60% (1.4161 => 1.4388, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.72% (3.8302 => 3.7644, std. dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.57% (2.0176 => 2.3116, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.14% (0.5818 => 0.6408, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.04% (0.7061 => 0.7770, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.81% (0.5748 => 0.6312, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.07% (0.3130 => 0.3414, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.06% (0.3578 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.94% (0.3646 => 0.3972, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/synchronized: 8.93% (0.3663 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3789 => 0.4125, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.77% (0.3650 => 0.3970, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-3: 8.69% (0.3623 => 0.3938, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 8.64% (0.3914 => 0.4252, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 8.62% (0.4003 => 0.4348, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 8.45% (0.3940 => 0.4273, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.69% (1.3693 => 1.4746, std. dev.: 0.0341) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.67% (0.7710 => 0.8301, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.37% (3.9660 => 4.2583, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5265 => 0.5648, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4328 => 0.4639, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.09% (0.2596 => 0.2780, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.08% (0.2782 => 0.2979, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.80% (0.2781 => 0.2970, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.77% (0.3899 => 0.4163, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.44% (0.6959 => 0.7407, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.36% (1.2193 => 1.2968, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.34% (0.2966 => 0.3154, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.32% (0.9199 => 0.9780, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3246 => 0.3449, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.22% (0.3489 => 0.3706, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.20% (1.9828 => 2.1058, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.14% (0.4379 => 0.4648, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.3107 => 0.3296, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.07% (0.3149 => 0.3340, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.92% (0.2988 => 0.3165, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.86% (0.5577 => 0.5904, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3192 => 0.3378, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.82% (0.3453 => 0.3654, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.79% (13.8202 => 14.6199, std. dev.: 0.3097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.74% (0.2127 => 0.2249, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.60% (0.4016 => 0.4241, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.50% (0.3293 => 0.3474, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.49% (0.3534 => 0.3728, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.44% (0.4390 => 0.4629, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.42% (0.1865 => 0.1966, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.40% (1.1364 => 1.1978, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.39% (0.2023 => 0.2132, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 5.33% (0.2925 => 0.3081, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.32% (0.5637 => 0.5937, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (1.4563 => 1.5334, std. dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.28% (0.2914 => 0.3068, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.3756 => 0.3954, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.22% (0.2243 => 0.2360, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.20% (7.2180 => 7.5935, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 5.02% (0.3868 => 0.4062, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.00% (3.8646 => 4.0578, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 4.96% (0.8310 => 0.8722, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2945 => 0.3091, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.86% (1.3245 => 1.3889, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.73% (1.3813 => 1.4467, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (1.3819 => 1.4473, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.61% (0.7460 => 0.7804, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.61% (1.0594 => 1.1082, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3755 => 0.3916, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.11% (4.3801 => 4.5601, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.09% (4.4433 => 4.6252, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (13.2842 => 13.8200, std. dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (3.6692 => 3.8129, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.87% (1.1333 => 1.1772, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6135 => 0.6367, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (0.4791 => 0.4968, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (4.9865 => 5.1682, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.40% (0.8698 => 0.8994, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.29% (0.6283 => 0.6490, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.10% (8.4961 => 8.7593, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (3.2742 => 3.3630, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (2.1007 => 2.1532, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6250 => 0.6366, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.54% (33.2944 => 33.8062, std. dev.: 0.0353) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (0.9108 => 0.9246, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (6.2785 => 6.3436, std. dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5116, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2641, std. dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 10.69% (1.2998 => 1.4388, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7437, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3856, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6046, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5738, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.01% (1.5089 => 1.5242, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.02% (22.5627 => 21.2034, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.85% (1.0460 => 0.8488, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5098, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0118) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1022, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.75% (20.3410 => 19.7809, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6021, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std. dev.: 0.0130) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9601, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.94% (0.8342 => 0.8180, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2402, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2231, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0090) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3620, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8024, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (28.2225 => 27.8982, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 01:28:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 03:28:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816082857.36A662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2944?compare_to=2941&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2944, Order: 162013, Start Time: 2012-08-16 07:10:19, End Time: 2012-08-16 08:29:40 To: 2941, Order: 162012, Start Time: 2012-08-16 05:19:38, End Time: 2012-08-16 06:38:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (112 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (724 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (2.1118 => 2.1361, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.07% (56.6558 => 56.0493, std. dev.: 0.2195) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.29% (10.3673 => 13.8186, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 13.30% (0.3473 => 0.3935, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 13.01% (0.3543 => 0.4004, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.01% (0.3497 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.00% (0.3561 => 0.4024, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.98% (0.3543 => 0.4003, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 12.94% (0.3516 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.51% (0.3694 => 0.4156, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.12% (0.3828 => 0.4292, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.86% (0.3886 => 0.4347, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.96% (1.1194 => 1.2421, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.31% (2.2022 => 2.3632, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.30% (0.6030 => 0.6470, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.26% (0.5925 => 0.6355, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.62% (1.7609 => 1.8775, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 6.21% (0.7326 => 0.7781, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.29% (0.4615 => 0.4859, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.76% (0.7433 => 0.7787, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.69% (0.8172 => 0.8555, std. dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 4.66% (10.4361 => 10.9228, std. dev.: 0.0203) MultiSource/Benchmarks/McCat/08-main/main: 4.54% (0.2554 => 0.2670, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (7.0540 => 7.3686, std. dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.40% (0.2271 => 0.2371, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5569 => 0.5808, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 4.12% (9.4845 => 9.8753, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.4879 => 0.5080, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.9449 => 5.1436, std. dev.: 0.0122) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (5.0018 => 5.2016, std. dev.: 0.0155) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.95% (4.2646 => 4.4329, std. dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5860 => 0.6081, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.77% (8.1363 => 8.4431, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.74% (0.2700 => 0.2801, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 3.68% (0.2905 => 0.3012, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.60% (0.7835 => 0.8117, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.54% (1.3050 => 1.3512, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3232 => 0.3345, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.49% (0.2891 => 0.2992, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.42% (0.3826 => 0.3957, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.42% (0.3098 => 0.3204, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.38% (0.3162 => 0.3269, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.37% (2.0665 => 2.1361, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.9765 => 1.0090, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1861 => 1.2251, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3650 => 0.3770, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 3.23% (0.3283 => 0.3389, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.22% (0.3136 => 0.3237, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.19% (0.3422 => 0.3531, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.4064 => 0.4193, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.14% (0.3441 => 0.3549, std. dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 3.10% (0.3387 => 0.3492, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.06% (0.4636 => 0.4778, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.04% (1.5415 => 1.5883, std. dev.: 0.0068) MultiSource/Applications/Burg/burg: 3.03% (1.1642 => 1.1995, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3865 => 0.3982, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.00% (0.3603 => 0.3711, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.98% (5.7591 => 5.9305, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 2.96% (1.5603 => 1.6065, std. dev.: 0.0096) MultiSource/Applications/d/make_dparser: 2.91% (3.3354 => 3.4324, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 2.88% (2.0273 => 2.0857, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.5105 => 0.5247, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.76% (3.8723 => 3.9792, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: 2.74% (0.3684 => 0.3785, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4203 => 0.4317, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.6456 => 0.6628, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.2842 => 1.3183, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6450 => 0.6620, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.45% (2.2969 => 2.3531, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 2.42% (0.4299 => 0.4403, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5981 => 0.6125, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5859 => 1.6233, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.5020 => 0.5137, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.29% (1.4186 => 1.4511, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (0.6675 => 0.6824, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.2024 => 2.2507, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8921 => 0.9110, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (14.3668 => 14.6676, std. dev.: 0.0304) MultiSource/Applications/sqlite3/sqlite3: 1.93% (17.1811 => 17.5128, std. dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 1.56% (1.1840 => 1.2025, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.33% (1.0722 => 1.0865, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.92% (4.3953 => 10.8967, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (4.2280 => 4.4542, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7490, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 2.10% (26.0924 => 26.6405, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2127, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.63% (9.1159 => 9.2644, std. dev.: 0.0295) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8228, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 1.38% (5.2636 => 5.3360, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.26% (3.2827 => 3.3239, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1244, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.65% (5.2763 => 3.1314, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.65% (5.3855 => 3.6809, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.27% (5.3526 => 3.6788, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -15.12% (54.1659 => 45.9765, std. dev.: 0.4451) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.84% (2.9384 => 2.5316, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4546, std. dev.: 0.0544) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: -7.94% (1.5373 => 1.4153, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.79% (5.0483 => 4.8067, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6143, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4646, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4254, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: -2.87% (10.2830 => 9.9883, std. dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9632, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5091, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.64% (0.8614 => 0.8473, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3374, std. dev.: 0.0084) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.06% (19.9488 => 19.7371, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.3135 => 2.2896, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.8329 => 1.8144, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 02:32:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 04:32:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816093227.F2AAF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2945?compare_to=2943&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2945, Order: 162014, Start Time: 2012-08-16 08:19:15, End Time: 2012-08-16 09:33:09 To: 2943, Order: 162013, Start Time: 2012-08-16 06:24:45, End Time: 2012-08-16 07:41:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.92% (0.5325 => 0.5427, std. dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.58% (2.0176 => 2.3118, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.18% (0.5818 => 0.6410, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 9.86% (0.5748 => 0.6315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.73% (0.7061 => 0.7748, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 9.08% (0.3578 => 0.3903, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3646 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.79% (0.3650 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3663 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.71% (0.3914 => 0.4255, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.69% (0.3623 => 0.3938, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 8.52% (0.4003 => 0.4344, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.50% (0.3940 => 0.4275, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.07% (0.1413 => 0.1527, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.96% (0.7710 => 0.8324, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 7.39% (0.7038 => 0.7558, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.39% (3.9660 => 4.2590, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 7.25% (1.3693 => 1.4686, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.13% (0.2596 => 0.2781, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (0.4328 => 0.4636, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.94% (0.2782 => 0.2975, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2781 => 0.2973, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.71% (0.6959 => 0.7426, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4062 => 0.4334, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.62% (0.3899 => 0.4157, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2607 => 0.2778, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.50% (0.2937 => 0.3128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.45% (0.9199 => 0.9792, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 6.38% (0.2760 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2628 => 0.2795, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.34% (1.2193 => 1.2966, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.28% (0.3489 => 0.3708, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.27% (0.2761 => 0.2934, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.17% (1.9828 => 2.1051, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.13% (0.4390 => 0.4659, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.10% (0.4379 => 0.4646, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3149 => 0.3339, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1789 => 0.1895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.92% (0.2988 => 0.3165, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.83% (0.5577 => 0.5902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.79% (0.3453 => 0.3653, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 5.62% (13.8202 => 14.5965, std. dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2127 => 0.2246, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 5.53% (0.3293 => 0.3475, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.50% (0.4016 => 0.4237, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2023 => 0.2134, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (0.3756 => 0.3959, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.4563 => 1.5343, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.35% (1.1364 => 1.1972, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.30% (0.2925 => 0.3080, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.23% (1.1061 => 1.1639, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.14% (7.2180 => 7.5892, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.13% (0.5637 => 0.5926, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.10% (1.3245 => 1.3921, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.04% (3.8646 => 4.0595, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 5.02% (0.8310 => 0.8727, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 5.02% (0.3868 => 0.4062, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.96% (1.9270 => 2.0225, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.92% (0.7506 => 0.7875, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.82% (1.2292 => 1.2884, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.77% (1.3813 => 1.4472, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.68% (1.3819 => 1.4466, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.61% (1.0594 => 1.1082, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.56% (0.7460 => 0.7800, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 4.44% (2.1791 => 2.2758, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3406, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3755 => 0.3917, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.16% (0.3220 => 0.3354, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.11% (4.3801 => 4.5602, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (4.4433 => 4.6257, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.09% (3.6692 => 3.8194, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (13.2842 => 13.8264, std. dev.: 0.0216) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.94% (0.4791 => 0.4980, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.80% (1.1333 => 1.1764, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.68% (0.6135 => 0.6361, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (4.9865 => 5.1649, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.39% (3.1889 => 3.2969, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7585, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 2.95% (14.5298 => 14.9590, std. dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 2.92% (16.2614 => 16.7359, std. dev.: 0.0195) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (6.5754 => 6.7657, std. dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 2.87% (14.8535 => 15.2797, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3641, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (1.5188 => 1.5596, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (2.1007 => 2.1502, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.93% (4.6629 => 4.7529, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 1.92% (0.6250 => 0.6370, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.75% (0.6744 => 0.6862, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.67% (1.0313 => 1.0485, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.53% (3.7467 => 3.8041, std. dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 1.51% (33.2944 => 33.7987, std. dev.: 0.0219) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.36% (0.9108 => 0.9232, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (6.2785 => 6.3439, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2571, std. dev.: 0.0182) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.32% (1.2998 => 1.4339, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.34% (11.2619 => 11.7505, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4271 => 7.6098, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.00% (1.4298 => 1.4584, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 1.92% (10.7476 => 10.9542, std. dev.: 0.0527) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3256, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.5928 => 4.6472, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5745, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (22.5627 => 21.1923, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.86% (1.0460 => 0.8487, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -4.59% (1.1560 => 1.1029, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.22% (1.3780 => 1.3199, std. dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -4.20% (5.0168 => 4.8060, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.85% (20.3410 => 19.7603, std. dev.: 0.0422) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5923, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9636, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2275, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (0.8342 => 0.8182, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3305 => 7.2212, std. dev.: 0.0175) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3659, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.18% (9.9194 => 9.8022, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (28.2225 => 27.9007, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 03:15:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 05:15:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816101551.EC8662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2946?compare_to=2944&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2946, Order: 162014, Start Time: 2012-08-16 08:57:27, End Time: 2012-08-16 10:16:39 To: 2944, Order: 162013, Start Time: 2012-08-16 07:10:19, End Time: 2012-08-16 08:29:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (110 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (727 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.31% (10.3673 => 13.8208, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3473 => 0.3933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.10% (0.3543 => 0.4007, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.07% (0.3497 => 0.3954, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-3: 13.00% (0.3516 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3561 => 0.4023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3543 => 0.4002, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 12.67% (0.3694 => 0.4162, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.07% (0.3828 => 0.4290, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.01% (1.1194 => 1.2426, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.29% (2.2022 => 2.3628, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 7.23% (0.6030 => 0.6466, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.22% (0.5925 => 0.6353, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.67% (1.7609 => 1.8783, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.25% (0.7326 => 0.7784, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.24% (0.4615 => 0.4857, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (0.7433 => 0.7807, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.93% (0.2271 => 0.2383, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.72% (0.8172 => 0.8558, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (10.4361 => 10.9219, std. dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.58% (7.0540 => 7.3769, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.30% (0.3282 => 0.3423, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.4879 => 0.5080, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.09% (0.5569 => 0.5797, std. dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8725, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.9449 => 5.1453, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.4103 => 0.4268, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.01% (0.3121 => 0.3246, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (5.0018 => 5.2012, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.96% (4.2646 => 4.4335, std. dev.: 0.0115) MultiSource/Benchmarks/McCat/09-vor/vor: 3.87% (0.3180 => 0.3303, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5860 => 0.6086, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (8.1363 => 8.4412, std. dev.: 0.0100) SingleSource/Regression/C++/ofstream_ctor: 3.72% (0.2905 => 0.3013, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.54% (0.7835 => 0.8112, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.3098 => 0.3205, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3826 => 0.3958, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (1.3050 => 1.3493, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 3.38% (0.4289 => 0.4434, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.38% (0.3136 => 0.3242, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3232 => 0.3339, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1861 => 1.2251, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 3.24% (0.3422 => 0.3533, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.21% (0.9765 => 1.0078, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (2.0665 => 2.1325, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.5415 => 1.5893, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3650 => 0.3763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.08% (0.3865 => 0.3984, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (0.4064 => 0.4189, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3935 => 0.4056, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.4636 => 0.4777, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.01% (1.1642 => 1.1993, std. dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.96% (5.7591 => 5.9298, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.94% (0.3441 => 0.3542, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.88% (2.0273 => 2.0857, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.86% (0.8067 => 0.8298, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sieve: 2.86% (0.3603 => 0.3706, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6036, std. dev.: 0.0053) MultiSource/Applications/d/make_dparser: 2.73% (3.3354 => 3.4266, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 2.71% (0.6456 => 0.6631, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.68% (0.6450 => 0.6623, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.64% (0.4620 => 0.4742, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3175, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9680, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.5020 => 0.5140, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5859 => 1.6234, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.36% (0.5981 => 0.6122, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.4186 => 1.4500, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 2.13% (2.2969 => 2.3458, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.2024 => 2.2485, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.05% (14.3668 => 14.6611, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 1.98% (0.8921 => 0.9098, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.85% (17.1811 => 17.4997, std. dev.: 0.0145) MultiSource/Benchmarks/nbench/nbench: 1.52% (1.1840 => 1.2020, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.50% (0.7115 => 0.7222, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.21% (1.0722 => 1.0852, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.43% (2.6778 => 2.9572, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (4.2280 => 4.4420, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7477, std. dev.: 0.0081) MultiSource/Applications/lua/lua: 2.06% (26.0924 => 26.6302, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/hash2: 1.88% (3.1578 => 3.2173, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.74% (9.1159 => 9.2742, std. dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8228, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (5.2636 => 5.3404, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.28% (3.2827 => 3.3246, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.24% (6.5088 => 6.5898, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6814, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1242, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.63% (5.2763 => 3.1323, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.65% (5.3855 => 3.6811, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6748, std. dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0040, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.87% (2.9384 => 2.5308, std. dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: -12.26% (22.1758 => 19.4579, std. dev.: 0.0358) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -9.15% (1.5373 => 1.3967, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.32% (2.7294 => 2.5568, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.78% (5.0483 => 4.8068, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.15% (4.8142 => 4.6144, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4777, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4116, std. dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0118, std. dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9626, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.8614 => 0.8472, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3483, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.17% (19.9488 => 19.7160, std. dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.04% (2.3135 => 2.2895, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 03:40:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 05:40:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120816104039.603CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2947?compare_to=2942&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2947, Order: 162013, Start Time: 2012-08-16 07:58:04, End Time: 2012-08-16 10:41:26 To: 2942, Order: 162012, Start Time: 2012-08-16 04:43:53, End Time: 2012-08-16 07:30:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.30% (0.3465 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.29% (0.3446 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3442 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3469 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3460 => 0.3911, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3488 => 0.3940, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 12.66% (0.3650 => 0.4112, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3643 => 0.4100, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.19% (0.3724 => 0.4178, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.23% (0.5826 => 0.6247, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.5889 => 0.6306, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.1968 => 0.2087, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (1.6211 => 1.7174, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7171 => 0.7578, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.66% (0.4361 => 0.4608, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (3.5627 => 3.7634, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (1.3152 => 1.3867, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 5.42% (1.5932 => 1.6795, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.32% (0.5900 => 0.6214, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (0.5026 => 0.5291, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.01% (0.3930 => 0.4127, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.98% (4.2109 => 4.4207, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.95% (0.4994 => 0.5241, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.86% (0.4029 => 0.4225, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.84% (0.5000 => 0.5242, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.59% (1.0781 => 1.1276, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.2866 => 0.2996, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.53% (0.2736 => 0.2860, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3195 => 0.3334, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.33% (0.2792 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (2.7292 => 2.8457, std. dev.: 0.0077) SingleSource/Regression/C++/ofstream_ctor: 4.26% (0.3004 => 0.3132, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.25% (0.2750 => 0.2867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.25% (0.2729 => 0.2845, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.22% (5.5417 => 5.7757, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 4.20% (0.9909 => 1.0325, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/methcall: 4.19% (0.2813 => 0.2931, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.16% (0.3362 => 0.3502, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2823 => 0.2940, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.11% (2.0673 => 2.1522, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 4.07% (0.3096 => 0.3222, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.2780 => 0.2893, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3258 => 0.3390, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (1.9966 => 2.0774, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (1.9694 => 2.0489, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.2911 => 0.3028, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.98% (0.2811 => 0.2923, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.98% (0.3267 => 0.3397, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3060 => 0.3180, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (0.3890 => 0.4041, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.84% (0.3726 => 0.3869, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.83% (0.9697 => 1.0068, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3282 => 0.3407, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.80% (0.3317 => 0.3443, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (0.3348 => 0.3475, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.78% (0.3124 => 0.3242, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (0.4658 => 0.4833, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.3625 => 0.3760, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.70% (0.3271 => 0.3392, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3678 => 0.3814, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.3903 => 0.4047, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.62% (23.5202 => 24.3714, std. dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: 3.53% (4.6177 => 4.7809, std. dev.: 0.0133) MultiSource/Applications/JM/ldecod/ldecod: 3.52% (2.1653 => 2.2416, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 3.47% (0.4146 => 0.4290, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 3.46% (0.4251 => 0.4398, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.43% (2.1013 => 2.1734, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (4.4195 => 4.5708, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (1.8794 => 1.9430, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.3981 => 0.4115, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3690 => 0.3814, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.32% (0.6634 => 0.6854, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.25% (0.7875 => 0.8131, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 3.24% (0.3336 => 0.3444, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 3.22% (1.4269 => 1.4728, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.97% (0.5012 => 0.5161, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.95% (0.6435 => 0.6625, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.95% (0.4139 => 0.4261, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.92% (0.5546 => 0.5708, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.07% (2.0346 => 2.0768, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.80% (0.7426 => 0.7560, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (11.6398 => 11.7618, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.26% (0.2122 => 0.2276, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8951, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1731, std. dev.: 0.0517) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6413, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6533, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2047, std. dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.83% (41.7953 => 42.5613, std. dev.: 0.0415) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.69% (50.0626 => 50.9077, std. dev.: 0.0152) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std. dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3051, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2792, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.98% (2.4764 => 2.4025, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5327, std. dev.: 0.0335) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7880, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -7.04% (0.2402 => 0.2233, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8063, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0032) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.07% (17.2379 => 16.8808, std. dev.: 0.0421) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5718, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9594, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 06:51:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 08:51:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120816135128.7D2232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2948?compare_to=2947&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2948, Order: 162014, Start Time: 2012-08-16 11:08:38, End Time: 2012-08-16 13:52:15 To: 2947, Order: 162013, Start Time: 2012-08-16 07:58:04, End Time: 2012-08-16 10:41:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (114 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.76% (124.8033 => 130.7397, std. dev.: 0.4135) SingleSource/Benchmarks/Misc/whetstone: 1.07% (2.7872 => 2.8171, std. dev.: 0.0104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.18% (0.3460 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3442 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3446 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.03% (0.3469 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.02% (0.3488 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.01% (0.3496 => 0.3951, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.60% (0.3643 => 0.4102, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.35% (0.5826 => 0.6254, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.5889 => 0.6307, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (1.6211 => 1.7159, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.67% (3.5627 => 3.7646, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference: 5.59% (0.7171 => 0.7572, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (0.4361 => 0.4598, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.41% (0.4029 => 0.4247, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.39% (1.3152 => 1.3861, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.29% (0.5900 => 0.6212, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 5.27% (1.5932 => 1.6772, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.12% (4.2109 => 4.4266, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (0.5000 => 0.5253, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.99% (0.4994 => 0.5243, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.72% (0.5026 => 0.5263, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 4.57% (1.0781 => 1.1274, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.56% (0.2875 => 0.3006, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.42% (0.2736 => 0.2857, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.40% (0.9909 => 1.0345, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.38% (2.7292 => 2.8488, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.3195 => 0.3333, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.29% (1.9694 => 2.0538, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.26% (0.2792 => 0.2911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2750 => 0.2866, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.19% (5.5417 => 5.7741, std. dev.: 0.0149) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.3004 => 0.3128, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.09% (1.9966 => 2.0782, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.08% (2.0673 => 2.1516, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2823 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.3845 => 0.4001, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.05% (0.2813 => 0.2927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2811 => 0.2924, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.2911 => 0.3028, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.01% (0.3096 => 0.3220, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.99% (0.2780 => 0.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3267 => 0.3396, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.3362 => 0.3493, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3726 => 0.3871, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (0.4658 => 0.4839, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (0.3890 => 0.4041, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3258 => 0.3384, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.83% (0.9697 => 1.0068, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 3.80% (0.3317 => 0.3443, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.79% (0.3060 => 0.3176, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3625 => 0.3758, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.64% (0.3348 => 0.3470, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.63% (0.6634 => 0.6875, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (2.1653 => 2.2426, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 3.57% (0.3336 => 0.3455, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 3.56% (4.6177 => 4.7821, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.3903 => 0.4041, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 3.51% (0.3477 => 0.3599, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (1.8794 => 1.9448, std. dev.: 0.0091) MultiSource/Applications/treecc/treecc: 3.48% (0.7875 => 0.8149, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 3.46% (23.5202 => 24.3346, std. dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4146 => 0.4289, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (4.4195 => 4.5708, std. dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 3.39% (2.1013 => 2.1725, std. dev.: 0.0095) MultiSource/Applications/lua/lua: 3.38% (1.4269 => 1.4751, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 3.36% (0.4251 => 0.4394, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.4139 => 0.4277, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.3271 => 0.3373, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.99% (0.5546 => 0.5712, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.6435 => 0.6621, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.83% (0.5012 => 0.5154, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.94% (2.0346 => 2.0741, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.82% (0.7426 => 0.7561, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6128, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6791, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1650, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6545, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.22% (105.3826 => 107.7247, std. dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std. dev.: 0.0592) MultiSource/Applications/lua/lua: 1.73% (50.0626 => 50.9303, std. dev.: 0.0199) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5914, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2231, std. dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3023, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2825, std. dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.29% (41.7953 => 42.3353, std. dev.: 0.1506) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.80% (2.4764 => 2.4071, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5675, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary2: -10.57% (0.2402 => 0.2148, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8008, std. dev.: 0.0033) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7839, std. dev.: 0.1081) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5808, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (16.2163 => 15.9528, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 10:02:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 12:02:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816170221.93A3B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2949?compare_to=2945&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2949, Order: 162023, Start Time: 2012-08-16 15:49:19, End Time: 2012-08-16 17:03:08 To: 2945, Order: 162014, Start Time: 2012-08-16 08:19:15, End Time: 2012-08-16 09:33:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (147 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 949 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.14% (0.8487 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.77% (19.7603 => 20.1092, std. dev.: 0.0231) MultiSource/Benchmarks/llubenchmark/llu: 1.25% (3.8047 => 3.8524, std. dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -11.05% (1.2307 => 1.0947, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.18% (4.6143 => 4.4677, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.63% (2.0176 => 2.3127, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 10.02% (0.5818 => 0.6401, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.76% (0.5748 => 0.6309, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 9.57% (0.7061 => 0.7737, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.97% (0.3578 => 0.3899, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 8.64% (0.3914 => 0.4252, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.58% (0.3623 => 0.3934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3663 => 0.3976, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 7.57% (0.7038 => 0.7571, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4062 => 0.4363, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.41% (0.7710 => 0.8281, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.37% (0.4328 => 0.4647, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.36% (3.9660 => 4.2580, std. dev.: 0.0117) MultiSource/Applications/hbd/hbd: 7.30% (1.3693 => 1.4692, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.14% (0.5265 => 0.5641, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2596 => 0.2776, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.3899 => 0.4169, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.78% (0.3022 => 0.3227, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.54% (0.2937 => 0.3129, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2765 => 0.2943, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2760 => 0.2937, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.41% (0.6959 => 0.7405, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.34% (0.2966 => 0.3154, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.34% (0.9199 => 0.9782, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3489 => 0.3710, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3580 => 0.3806, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.26% (0.3485 => 0.3703, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.23% (1.9828 => 2.1064, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.17% (1.2193 => 1.2945, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.15% (0.3107 => 0.3298, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3453 => 0.3663, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.03% (0.4379 => 0.4643, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.98% (0.3192 => 0.3383, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.92% (0.2988 => 0.3165, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.90% (0.4390 => 0.4649, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.83% (0.2127 => 0.2251, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.72% (0.5577 => 0.5896, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists: 5.71% (0.3293 => 0.3481, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.55% (0.3534 => 0.3730, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.50% (13.8202 => 14.5797, std. dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.40% (1.4563 => 1.5350, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 5.40% (0.3868 => 0.4077, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.37% (0.2925 => 0.3082, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.34% (0.2023 => 0.2131, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.30% (1.1364 => 1.1966, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2945 => 0.3096, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.5637 => 0.5925, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.09% (7.2180 => 7.5857, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 4.99% (1.1061 => 1.1613, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 4.95% (3.8646 => 4.0560, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.82% (1.3245 => 1.3883, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 4.81% (1.2292 => 1.2883, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.76% (0.7506 => 0.7863, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 4.72% (1.9270 => 2.0180, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.72% (0.8310 => 0.8702, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.71% (1.3813 => 1.4463, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3819 => 1.4460, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.52% (2.1791 => 2.2777, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.0594 => 1.1072, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.46% (16.6129 => 17.3543, std. dev.: 0.0158) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.45% (0.7460 => 0.7792, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.30% (0.4791 => 0.4997, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.26% (0.3755 => 0.3915, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (13.2842 => 13.8346, std. dev.: 0.0118) MultiSource/Benchmarks/McCat/18-imp/imp: 4.13% (0.3220 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.08% (4.4433 => 4.6246, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.08% (4.3801 => 4.5586, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.91% (0.6135 => 0.6375, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.84% (0.6283 => 0.6524, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (3.6692 => 3.8094, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.9865 => 5.1719, std. dev.: 0.0067) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (1.1333 => 1.1731, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.46% (3.1889 => 3.2992, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.40% (0.8698 => 0.8994, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.20% (16.2614 => 16.7825, std. dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7513, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7643, std. dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2763, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.5298 => 14.9419, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (3.2742 => 3.3605, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.60% (1.5188 => 1.5583, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.23% (2.1007 => 2.1475, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6250 => 0.6371, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.93% (4.6629 => 4.7530, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.60% (3.7467 => 3.8068, std. dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: 1.59% (33.2944 => 33.8254, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.34% (0.9108 => 0.9230, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2723, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.24% (1.2998 => 1.4199, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7431, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8173, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.59% (10.7476 => 11.0259, std. dev.: 0.0243) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3853, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5954, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.10% (3.7731 => 3.8524, std. dev.: 0.0160) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5928 => 4.6733, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3260, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5089 => 1.5271, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.96% (0.2670 => 0.2511, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.90% (22.5627 => 21.2306, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.19% (0.8818 => 0.8713, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2308 => 1.0947, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.93% (1.3780 => 1.3238, std. dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5912, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2061, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3565, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8692, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.23% (5.5401 => 5.4722, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.14% (20.3410 => 20.1092, std. dev.: 0.0231) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 10:07:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 12:07:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816170749.78DED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2950?compare_to=2946&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2950, Order: 162023, Start Time: 2012-08-16 15:49:34, End Time: 2012-08-16 17:08:35 To: 2946, Order: 162014, Start Time: 2012-08-16 08:57:27, End Time: 2012-08-16 10:16:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (112 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (726 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.18% (0.8472 => 0.9504, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 2.08% (19.7160 => 20.1255, std. dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.40% (2.2895 => 2.3216, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.84% (1.2306 => 1.1095, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.18% (4.6144 => 4.4678, std. dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.00% (10.3673 => 13.7881, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3473 => 0.3927, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.93% (0.3543 => 0.4001, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.87% (0.3497 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3516 => 0.3968, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3543 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.43% (0.3694 => 0.4153, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.84% (0.3927 => 0.4392, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.97% (1.1194 => 1.2422, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.48% (0.5925 => 0.6368, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.44% (2.2022 => 2.3660, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.38% (0.6030 => 0.6475, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.74% (1.7609 => 1.8795, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.33% (0.7326 => 0.7790, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.40% (0.4615 => 0.4864, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 5.11% (0.7433 => 0.7813, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 4.98% (10.4361 => 10.9558, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2271 => 0.2380, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 4.66% (0.3282 => 0.3435, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.62% (7.0540 => 7.3797, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.60% (0.8172 => 0.8548, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.5860 => 0.6111, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.4879 => 0.5087, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8888, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.20% (4.9449 => 5.1526, std. dev.: 0.0146) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.18% (5.0018 => 5.2109, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.13% (0.5569 => 0.5799, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.11% (4.2646 => 4.4399, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3121 => 0.3247, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.97% (0.7835 => 0.8146, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.80% (8.1363 => 8.4453, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.77% (0.2758 => 0.2862, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 3.74% (0.3180 => 0.3299, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.5105 => 0.5296, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2891 => 0.2999, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.70% (0.4103 => 0.4255, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 3.65% (0.2905 => 0.3011, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.62% (1.3050 => 1.3523, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.43% (0.3441 => 0.3559, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9765 => 1.0098, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.40% (1.5415 => 1.5939, std. dev.: 0.0091) MultiSource/Applications/Burg/burg: 3.38% (1.1642 => 1.2036, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: 3.36% (0.3098 => 0.3202, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.29% (0.3826 => 0.3952, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.26% (3.3354 => 3.4442, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.24% (0.3422 => 0.3533, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.24% (0.4636 => 0.4786, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9418, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.16% (0.8067 => 0.8322, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.4064 => 0.4191, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4289 => 0.4423, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.12% (1.1861 => 1.2231, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0665 => 2.1305, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3283 => 0.3383, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.02% (0.3935 => 0.4054, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.02% (0.3307 => 0.3407, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.01% (0.3650 => 0.3760, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.00% (2.0273 => 2.0882, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 2.92% (1.5603 => 1.6058, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.91% (0.6450 => 0.6638, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 2.91% (0.3603 => 0.3708, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.85% (0.6456 => 0.6640, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.85% (0.6675 => 0.6865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4620 => 0.4751, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.74% (3.8723 => 3.9784, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.4203 => 0.4315, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.5020 => 0.5152, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5859 => 1.6276, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.54% (1.2842 => 1.3168, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 2.47% (0.4048 => 0.4148, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.46% (1.4186 => 1.4535, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.44% (0.5981 => 0.6127, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.43% (2.2969 => 2.3528, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (14.3668 => 14.7005, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8921 => 0.9126, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.30% (17.1811 => 17.5759, std. dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.2024 => 2.2485, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.86% (0.7115 => 0.7247, std. dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 1.72% (1.1840 => 1.2044, std. dev.: 0.0050) MultiSource/Applications/lemon/lemon: 1.53% (1.0722 => 1.0886, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.15% (4.2280 => 4.4458, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7526, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 2.01% (26.0924 => 26.6173, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2151, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 1.60% (9.1159 => 9.2617, std. dev.: 0.0085) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3337, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1241, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.53% (0.8651 => 0.1684, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.68% (5.2763 => 3.1297, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.60% (5.3855 => 3.6839, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.24% (5.3526 => 3.6802, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -15.09% (54.1659 => 45.9939, std. dev.: 0.0423) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.99% (2.9384 => 2.5272, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.06% (22.1758 => 19.5003, std. dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2373 => 1.1095, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -8.24% (1.5373 => 1.4106, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.98% (1.1396 => 1.0601, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5578, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8478, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0512, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4696, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4281, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.66% (10.2830 => 10.0092, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.25% (8.1563 => 7.9728, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3340, std. dev.: 0.0095) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4234, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.00% (1.8329 => 1.8145, std. dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 11:32:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 13:32:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120816183200.8508E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2951?compare_to=2948&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2951, Order: 162023, Start Time: 2012-08-16 15:49:13, End Time: 2012-08-16 18:32:44 To: 2948, Order: 162014, Start Time: 2012-08-16 11:08:38, End Time: 2012-08-16 13:52:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (114 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 5.07% (0.2148 => 0.2257, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.43% (54.0721 => 54.8468, std. dev.: 0.0538) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.15% (0.3446 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.13% (0.3465 => 0.3920, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.99% (0.3496 => 0.3950, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 12.98% (0.3460 => 0.3909, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.97% (0.3469 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3488 => 0.3939, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.71% (0.3643 => 0.4106, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5826 => 0.6265, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.20% (0.5889 => 0.6313, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.85% (1.6211 => 1.7160, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 5.79% (0.7171 => 0.7586, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.69% (1.3152 => 1.3901, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.61% (3.5627 => 3.7626, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.5900 => 0.6228, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (0.4361 => 0.4600, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 5.26% (1.5932 => 1.6770, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.89% (0.2738 => 0.2872, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (0.3930 => 0.4120, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.76% (4.2109 => 4.4113, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.62% (1.0781 => 1.1279, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.52% (0.2875 => 0.3005, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.50% (0.2736 => 0.2859, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 4.31% (0.2714 => 0.2831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.26% (0.2792 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.26% (0.3195 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (2.7292 => 2.8452, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 4.20% (5.5417 => 5.7744, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 4.16% (0.2813 => 0.2930, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.16% (0.9909 => 1.0321, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2750 => 0.2864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2823 => 0.2940, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.10% (2.0673 => 2.1521, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.10% (0.3317 => 0.3453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (1.9694 => 2.0495, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (2.1013 => 2.1867, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2911 => 0.3029, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.01% (0.3267 => 0.3398, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.99% (0.2780 => 0.2891, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (1.9966 => 2.0757, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3060 => 0.3181, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.95% (0.2811 => 0.2922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.94% (0.3096 => 0.3218, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3124 => 0.3247, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.93% (0.3362 => 0.3494, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.90% (0.3258 => 0.3385, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.81% (0.3625 => 0.3763, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (0.3348 => 0.3475, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.77% (0.9697 => 1.0063, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.72% (0.3845 => 0.3988, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.70% (0.3726 => 0.3864, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (0.4658 => 0.4830, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 3.67% (0.4146 => 0.4298, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.62% (0.3477 => 0.3603, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.62% (1.8794 => 1.9475, std. dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 3.62% (23.5202 => 24.3710, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/moments: 3.62% (0.3678 => 0.3811, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (0.3890 => 0.4030, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 3.56% (4.6177 => 4.7822, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 3.55% (2.1653 => 2.2421, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (4.4195 => 4.5733, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3690 => 0.3817, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 3.43% (0.4251 => 0.4397, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.3903 => 0.4037, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.27% (0.6634 => 0.6851, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.23% (0.7875 => 0.8129, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 3.22% (1.4269 => 1.4728, std. dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.10% (0.5546 => 0.5718, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.6435 => 0.6632, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.97% (0.5012 => 0.5161, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.4139 => 0.4255, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.10% (2.0346 => 2.0773, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (0.7426 => 0.7566, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.09% (11.6398 => 11.7670, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (4.6926 => 4.7402, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.39% (0.2122 => 0.2300, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6137, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6775, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8963, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6491, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6553, std. dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1956, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 1.75% (50.0626 => 50.9373, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5913, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std. dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4403, std. dev.: 0.0856) MultiSource/Applications/viterbi/viterbi: 1.44% (46.6247 => 47.2976, std. dev.: 0.0196) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.12% (2.4764 => 2.3991, std. dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5657, std. dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7905, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -6.04% (0.2402 => 0.2257, std. dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7896, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.59% (0.6293 => 0.6130, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: -2.41% (17.2379 => 16.8219, std. dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9611, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 11:43:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 13:43:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816184336.8AD872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2952?compare_to=2949&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2952, Order: 162025, Start Time: 2012-08-16 17:30:30, End Time: 2012-08-16 18:44:23 To: 2949, Order: 162023, Start Time: 2012-08-16 15:49:19, End Time: 2012-08-16 17:03:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (146 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.36% (55.1841 => 56.4880, std. dev.: 0.1289) SingleSource/Regression/C/uint64_to_float: 1.89% (0.5345 => 0.5446, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: 1.11% (1.4199 => 1.4357, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.64% (3.8524 => 3.7893, std. dev.: 0.0237) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.66% (2.0176 => 2.3134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.93% (0.5818 => 0.6396, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.87% (0.7061 => 0.7758, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.76% (0.5748 => 0.6309, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.07% (0.3130 => 0.3414, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.06% (0.3578 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.69% (0.3646 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.60% (0.3663 => 0.3978, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.52% (0.4003 => 0.4344, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.50% (0.3623 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.17% (0.3940 => 0.4262, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.07% (0.1413 => 0.1527, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.64% (0.7710 => 0.8299, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 7.60% (0.7038 => 0.7573, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.48% (1.3693 => 1.4717, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.40% (3.9660 => 4.2594, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (0.4328 => 0.4640, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.12% (0.2782 => 0.2980, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5265 => 0.5637, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 6.98% (0.2781 => 0.2975, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.82% (0.3899 => 0.4165, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.72% (0.3022 => 0.3225, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.61% (0.2937 => 0.3131, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.54% (0.2690 => 0.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.52% (0.2760 => 0.2940, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.51% (0.2628 => 0.2799, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.37% (0.9199 => 0.9785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.25% (0.6959 => 0.7394, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3489 => 0.3707, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.23% (1.9828 => 2.1064, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.19% (0.3149 => 0.3344, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2696 => 0.2861, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.08% (1.2193 => 1.2934, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3192 => 0.3382, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.89% (0.2988 => 0.3164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.85% (0.3453 => 0.3655, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.83% (0.2127 => 0.2251, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.74% (0.2925 => 0.3093, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5577 => 0.5895, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3293 => 0.3480, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.60% (0.3534 => 0.3732, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.60% (13.8202 => 14.5942, std. dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.49% (0.4390 => 0.4631, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.48% (1.4563 => 1.5361, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 5.30% (0.3868 => 0.4073, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.29% (0.2023 => 0.2130, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.27% (1.1364 => 1.1963, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 5.26% (0.2243 => 0.2361, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.2914 => 0.3065, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.11% (7.2180 => 7.5872, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.11% (0.5637 => 0.5925, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.04% (0.7506 => 0.7884, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 4.93% (1.1061 => 1.1606, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 4.92% (3.8646 => 4.0548, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (1.3813 => 1.4490, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.85% (1.2292 => 1.2888, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.83% (1.9270 => 2.0200, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (1.3245 => 1.3882, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 4.80% (0.8310 => 0.8709, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.3819 => 1.4454, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 4.59% (2.1791 => 2.2792, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.54% (0.7460 => 0.7799, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.49% (0.4791 => 0.5006, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.47% (1.0594 => 1.1068, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.47% (16.6129 => 17.3556, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (13.2842 => 13.8375, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.11% (4.3801 => 4.5603, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (4.4433 => 4.6259, std. dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.6283 => 0.6526, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6135 => 0.6372, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.83% (3.6692 => 3.8098, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 3.40% (3.1889 => 3.2972, std. dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0098) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1711, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.23% (16.2614 => 16.7861, std. dev.: 0.0122) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.03% (6.5754 => 6.7744, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7495, std. dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2762, std. dev.: 0.0131) MultiSource/Applications/ClamAV/clamscan: 2.83% (14.5298 => 14.9414, std. dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (3.2742 => 3.3619, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5188 => 1.5587, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.1007 => 2.1506, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 1.98% (0.6250 => 0.6374, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 1.96% (4.6629 => 4.7543, std. dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.91% (1.0313 => 1.0510, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.56% (33.2944 => 33.8127, std. dev.: 0.0214) MultiSource/Applications/lua/lua: 1.55% (3.7467 => 3.8049, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.30% (0.9108 => 0.9226, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 23.76% (1.8175 => 2.2494, std. dev.: 0.0397) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.46% (1.2998 => 1.4357, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.44% (11.2619 => 11.7615, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9872, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8166, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3852, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5994, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.11% (10.7476 => 10.9739, std. dev.: 0.0504) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5928 => 4.6760, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3249, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5284, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.91% (22.5627 => 21.2291, std. dev.: 0.0177) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.45% (0.8818 => 0.8690, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.39% (1.2308 => 1.0906, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.59% (1.1560 => 1.1029, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5839, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9627, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2367, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3305 => 7.1995, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7920, std. dev.: 0.0326) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3710, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (20.3410 => 20.1265, std. dev.: 0.0434) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 11:54:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 13:54:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816185451.8681E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2953?compare_to=2950&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2953, Order: 162025, Start Time: 2012-08-16 17:36:21, End Time: 2012-08-16 18:55:37 To: 2950, Order: 162023, Start Time: 2012-08-16 15:49:34, End Time: 2012-08-16 17:08:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (54.7377 => 56.5648, std. dev.: 0.0530) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.02% (10.3673 => 13.7909, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.87% (0.3497 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3543 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.43% (0.3694 => 0.4153, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 12.07% (0.3828 => 0.4290, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.02% (0.3927 => 0.4399, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (1.1194 => 1.2437, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.51% (0.5925 => 0.6370, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.46% (2.2022 => 2.3664, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.45% (0.6030 => 0.6479, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.72% (1.7609 => 1.8793, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.31% (0.7326 => 0.7788, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.92% (0.4615 => 0.4888, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.8172 => 0.8633, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3121 => 0.3291, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 5.11% (0.7433 => 0.7813, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (10.4361 => 10.9614, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2271 => 0.2384, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 4.75% (0.7835 => 0.8207, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.67% (7.0540 => 7.3837, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.60% (0.2758 => 0.2885, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.57% (4.9449 => 5.1707, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.54% (0.2554 => 0.2670, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.49% (5.0018 => 5.2266, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.5569 => 0.5814, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 4.34% (9.4845 => 9.8959, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.29% (4.2646 => 4.4474, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.22% (0.4879 => 0.5085, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.14% (0.8067 => 0.8401, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.03% (0.5860 => 0.6096, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.4636 => 0.4822, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.96% (0.2756 => 0.2865, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.3050 => 1.3558, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.83% (0.2793 => 0.2900, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.83% (0.4103 => 0.4260, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.79% (8.1363 => 8.4445, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hello: 3.76% (0.2714 => 0.2816, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.71% (0.3180 => 0.3298, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.64% (1.5415 => 1.5976, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.59% (0.3423 => 0.3546, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.4064 => 0.4208, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.45% (0.5105 => 0.5281, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 3.44% (0.2905 => 0.3005, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.42% (0.3826 => 0.3957, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std. dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 3.34% (0.3387 => 0.3500, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.9765 => 1.0090, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.1861 => 1.2254, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.31% (0.3441 => 0.3555, std. dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 3.30% (5.7591 => 5.9489, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/matrix: 3.29% (0.3098 => 0.3200, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.28% (1.1642 => 1.2024, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.26% (0.3162 => 0.3265, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.21% (0.3865 => 0.3989, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.19% (0.3232 => 0.3335, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.19% (0.3422 => 0.3531, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.17% (3.3354 => 3.4411, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (2.0665 => 2.1318, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4289 => 0.4423, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.11% (2.0273 => 2.0903, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3379 => 0.3483, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.05% (0.6450 => 0.6647, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.05% (0.3307 => 0.3408, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.95% (0.6675 => 0.6872, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 2.91% (0.3603 => 0.3708, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.91% (0.6456 => 0.6644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.76% (3.8723 => 3.9790, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (1.5859 => 1.6290, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.70% (1.5603 => 1.6025, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.69% (1.4186 => 1.4568, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.4203 => 0.4315, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.66% (0.8921 => 0.9158, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2842 => 1.3170, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.55% (0.5020 => 0.5148, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.51% (0.5981 => 0.6131, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 2.50% (0.4048 => 0.4149, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.46% (17.1811 => 17.6035, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 2.44% (2.2969 => 2.3529, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 2.37% (0.4299 => 0.4401, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (14.3668 => 14.7004, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.23% (2.2024 => 2.2516, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.71% (1.1840 => 1.2043, std. dev.: 0.0042) MultiSource/Applications/lemon/lemon: 1.62% (1.0722 => 1.0896, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (4.2280 => 4.4452, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.01% (26.0924 => 26.6169, std. dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/hash2: 1.60% (3.1578 => 3.2083, std. dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8229, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.53% (3.2827 => 3.3328, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2415, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5844, std. dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.57% (5.2763 => 3.1355, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.56% (5.3855 => 3.6856, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.21% (5.3526 => 3.6820, std. dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0034, std. dev.: 0.0928) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.92% (2.9384 => 2.5293, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -12.06% (22.1758 => 19.5017, std. dev.: 0.0342) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.08% (1.1396 => 1.0589, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -7.04% (1.5373 => 1.4290, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5577, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4689, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4203, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.82% (1.3677 => 1.3291, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9611, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3393, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8129, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 13:26:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 15:26:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816202613.C53472A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/2954?compare_to=2952&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2954, Order: 162037, Start Time: 2012-08-16 19:13:03, End Time: 2012-08-16 20:26:59 To: 2952, Order: 162025, Start Time: 2012-08-16 17:30:30, End Time: 2012-08-16 18:44:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (149 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.00% (28.0380 => 29.7210, std. dev.: 0.0645) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.68% (79.5115 => 80.8478, std. dev.: 0.2598) SingleSource/Benchmarks/McGill/chomp: 1.12% (1.0906 => 1.1028, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.40% (2.0176 => 2.3081, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3578 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.52% (0.7061 => 0.7733, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5818 => 0.6370, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.39% (0.3601 => 0.3939, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.33% (0.3646 => 0.3986, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.32% (0.3650 => 0.3990, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.29% (0.5748 => 0.6282, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/synchronized: 9.12% (0.3663 => 0.3997, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.08% (0.3789 => 0.4133, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.99% (0.3914 => 0.4266, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.4003 => 0.4359, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.68% (0.3940 => 0.4282, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.83% (1.3693 => 1.4765, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.79% (0.7038 => 0.7586, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.67% (0.7710 => 0.8301, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.50% (0.5265 => 0.5660, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.46% (3.9660 => 4.2619, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 7.26% (0.4328 => 0.4642, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.09% (0.2596 => 0.2780, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.08% (0.2781 => 0.2978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.84% (0.4062 => 0.4340, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.82% (0.3022 => 0.3228, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.3899 => 0.4162, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2607 => 0.2778, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.56% (0.2761 => 0.2942, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2765 => 0.2945, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.50% (0.2937 => 0.3128, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.49% (0.2760 => 0.2939, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.48% (0.3580 => 0.3812, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.2966 => 0.3158, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.40% (0.9199 => 0.9788, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.35% (1.9828 => 2.1087, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.30% (1.2193 => 1.2961, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.28% (0.3485 => 0.3704, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.28% (0.3107 => 0.3302, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.27% (0.6959 => 0.7395, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.24% (0.5577 => 0.5925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.19% (0.4379 => 0.4650, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.16% (0.3149 => 0.3343, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.14% (0.3192 => 0.3388, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.10% (0.3246 => 0.3444, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.83% (0.3293 => 0.3485, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.76% (0.3453 => 0.3652, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.74% (0.1865 => 0.1972, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.65% (13.8202 => 14.6017, std. dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (0.3756 => 0.3968, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 5.61% (0.2925 => 0.3089, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.58% (0.4390 => 0.4635, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.49% (0.3534 => 0.3728, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.48% (0.2243 => 0.2366, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.46% (1.4563 => 1.5358, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.39% (0.2023 => 0.2132, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.35% (0.3868 => 0.4075, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.32% (7.2180 => 7.6022, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.32% (1.1364 => 1.1968, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.29% (0.5637 => 0.5935, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (1.3813 => 1.4539, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.24% (1.3819 => 1.4543, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 5.18% (3.8646 => 4.0646, std. dev.: 0.0100) MultiSource/Applications/Burg/burg: 5.05% (1.1061 => 1.1620, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 4.96% (0.8310 => 0.8722, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.94% (1.3245 => 1.3899, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.86% (1.2292 => 1.2890, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: 4.81% (0.7506 => 0.7867, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.78% (1.9270 => 2.0191, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.69% (1.0594 => 1.1091, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.59% (16.6129 => 17.3752, std. dev.: 0.0167) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.58% (0.7460 => 0.7802, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.51% (0.4791 => 0.5007, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.3220 => 0.3365, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.41% (2.1791 => 2.2751, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3755 => 0.3920, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.31% (4.3801 => 4.5687, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.31% (4.4433 => 4.6346, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.17% (13.2842 => 13.8387, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.12% (0.6283 => 0.6542, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.05% (3.1889 => 3.3179, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (3.6692 => 3.8172, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.81% (0.6135 => 0.6369, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.71% (4.9865 => 5.1714, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 3.70% (0.3131 => 0.3247, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.1333 => 1.1723, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.43% (0.8698 => 0.8996, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.22% (8.4961 => 8.7693, std. dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 3.20% (16.2614 => 16.7815, std. dev.: 0.0177) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (6.5754 => 6.7798, std. dev.: 0.0106) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.05% (14.8535 => 15.3072, std. dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 2.92% (14.5298 => 14.9547, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5188 => 1.5590, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.2742 => 3.3582, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.38% (4.6629 => 4.7737, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (2.1007 => 2.1490, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.6250 => 0.6380, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.88% (1.0313 => 1.0507, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.84% (0.6744 => 0.6868, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0045) MultiSource/Applications/lua/lua: 1.62% (3.7467 => 3.8075, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 1.36% (33.2944 => 33.7476, std. dev.: 0.0209) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.36% (6.2785 => 6.3637, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5126, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2571, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 10.32% (1.2998 => 1.4339, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7414, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3840, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6045, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.12% (10.7476 => 10.9757, std. dev.: 0.0213) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5928 => 4.6731, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.57% (3.2729 => 3.3243, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (1.5089 => 1.5285, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.83% (22.5627 => 21.2465, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.40% (1.2308 => 1.1028, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.54% (1.1560 => 1.1035, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4681, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5930, std. dev.: 0.0151) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2234, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9636, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3305 => 7.2003, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3559, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.10% (20.3410 => 20.1180, std. dev.: 0.0276) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 13:41:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 15:41:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816204153.8F6FB2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/2955?compare_to=2953&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2955, Order: 162038, Start Time: 2012-08-16 19:23:27, End Time: 2012-08-16 20:42:40 To: 2953, Order: 162025, Start Time: 2012-08-16 17:36:21, End Time: 2012-08-16 18:55:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (104 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (733 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.01% (13.7909 => 14.2063, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 1.18% (1.6025 => 1.6214, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.03% (10.3673 => 14.2063, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3473 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3561 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.25% (1.1194 => 1.2453, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.98% (2.2022 => 2.3560, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.91% (1.7609 => 1.8826, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7433 => 0.7825, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.24% (0.4615 => 0.4857, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.8172 => 0.8571, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2271 => 0.2381, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.52% (10.4361 => 10.9080, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.49% (7.0540 => 7.3706, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.42% (9.4845 => 9.9037, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.39% (0.4879 => 0.5093, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.37% (4.2646 => 4.4508, std. dev.: 0.0118) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (5.0018 => 5.2193, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 4.30% (0.3282 => 0.3423, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2758 => 0.2875, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.9449 => 5.1542, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: 4.14% (0.7835 => 0.8159, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.08% (0.5860 => 0.6099, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.04% (0.5569 => 0.5794, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.92% (1.5603 => 1.6214, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.4636 => 0.4813, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.81% (8.1363 => 8.4462, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.8067 => 0.8367, std. dev.: 0.0097) MultiSource/Benchmarks/McCat/09-vor/vor: 3.68% (0.3180 => 0.3297, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.64% (1.3050 => 1.3525, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.61% (0.4103 => 0.4251, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.60% (1.5415 => 1.5970, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 3.59% (0.3423 => 0.3546, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.33% (0.5105 => 0.5275, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.30% (1.1642 => 1.2026, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.28% (0.3441 => 0.3554, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.26% (3.3354 => 3.4441, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.9765 => 1.0080, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1861 => 1.2243, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4289 => 0.4423, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.12% (2.0273 => 2.0906, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.10% (0.4064 => 0.4190, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3650 => 0.3763, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.06% (0.3826 => 0.3943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3865 => 0.3979, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (2.0665 => 2.1273, std. dev.: 0.0135) MultiSource/Applications/oggenc/oggenc: 2.90% (5.7591 => 5.9260, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3684 => 0.3790, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 2.86% (0.3603 => 0.3706, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (14.3668 => 14.7734, std. dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.76% (0.6450 => 0.6628, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 2.75% (0.4620 => 0.4747, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.73% (3.8723 => 3.9782, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.73% (0.6675 => 0.6857, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6456 => 0.6632, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.60% (2.2969 => 2.3567, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.57% (0.4203 => 0.4311, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3166, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (1.5859 => 1.6259, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 2.50% (0.4048 => 0.4149, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.47% (17.1811 => 17.6063, std. dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.44% (1.4186 => 1.4532, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8921 => 0.9137, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5981 => 0.6120, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.25% (0.5020 => 0.5133, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (2.2024 => 2.2455, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.90% (0.7115 => 0.7250, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.76% (1.1840 => 1.2048, std. dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.69% (1.0722 => 1.0903, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.15% (4.2280 => 4.4459, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7531, std. dev.: 0.0020) MultiSource/Applications/lua/lua: 1.96% (26.0924 => 26.6033, std. dev.: 0.0723) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2099, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3346, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8229, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2414, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (1.5086 => 1.5265, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.52% (0.8651 => 0.1685, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1416, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.63% (5.3855 => 3.6818, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.31% (5.3526 => 3.6768, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0766, std. dev.: 0.0391) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.73% (2.9384 => 2.5350, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.00% (22.1758 => 19.5144, std. dev.: 0.0314) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.43% (1.2373 => 1.0959, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -8.01% (1.5373 => 1.4141, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -7.01% (1.1396 => 1.0597, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.27% (2.7294 => 2.5584, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5117, std. dev.: 0.0032) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4688, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.14% (8.6802 => 8.4079, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9956, std. dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9592, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std. dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3499, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8128, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 14:42:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 16:42:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120816214229.774082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2956?compare_to=2951&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2956, Order: 162033, Start Time: 2012-08-16 19:00:09, End Time: 2012-08-16 21:43:16 To: 2951, Order: 162023, Start Time: 2012-08-16 15:49:13, End Time: 2012-08-16 18:32:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.31% (2.0732 => 2.1004, std. dev.: 0.0104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3446 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.42% (0.3465 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.36% (0.3442 => 0.3902, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3469 => 0.3928, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.18% (0.3460 => 0.3916, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.16% (0.3488 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std. dev.: 0.0075) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3643 => 0.4101, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5826 => 0.6208, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.49% (0.5889 => 0.6271, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (1.6211 => 1.7143, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (3.5627 => 3.7631, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 5.49% (1.5932 => 1.6807, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.2014 => 0.2124, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.35% (1.3152 => 1.3856, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.34% (0.4361 => 0.4594, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.27% (0.4994 => 0.5257, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (0.5000 => 0.5260, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.99% (0.7171 => 0.7529, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (0.3930 => 0.4125, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.95% (0.2866 => 0.3008, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.93% (0.5900 => 0.6191, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.89% (0.4029 => 0.4226, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.84% (4.2109 => 4.4147, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.80% (0.5026 => 0.5267, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 4.68% (0.2566 => 0.2686, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.64% (2.7292 => 2.8559, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.53% (1.0781 => 1.1269, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.42% (0.4658 => 0.4864, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.21% (5.5417 => 5.7751, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.07% (0.2875 => 0.2992, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (1.9966 => 2.0773, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (1.9694 => 2.0488, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.2823 => 0.2934, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.93% (0.3004 => 0.3122, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.91% (0.3195 => 0.3320, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.84% (0.2813 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.83% (0.2738 => 0.2843, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.75% (0.9909 => 1.0281, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.75% (0.3890 => 0.4036, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.74% (0.2729 => 0.2831, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.72% (1.8794 => 1.9493, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.71% (2.0673 => 2.1441, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3258 => 0.3379, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.70% (0.3267 => 0.3388, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2803 => 0.2904, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.56% (0.3625 => 0.3754, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2911 => 0.3014, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3362 => 0.3480, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.46% (0.3060 => 0.3166, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.44% (2.1013 => 2.1736, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.3845 => 0.3977, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.42% (0.9697 => 1.0029, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3317 => 0.3430, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.39% (0.3124 => 0.3230, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.38% (0.3726 => 0.3852, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.3903 => 0.4034, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.33% (2.1653 => 2.2375, std. dev.: 0.0110) MultiSource/Applications/JM/lencod/lencod: 3.32% (4.6177 => 4.7709, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/moments: 3.32% (0.3678 => 0.3800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.32% (0.3348 => 0.3459, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.30% (0.7875 => 0.8135, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (4.4195 => 4.5636, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists1: 3.19% (0.3477 => 0.3588, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.15% (0.6634 => 0.6843, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 3.14% (0.4146 => 0.4276, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.13% (1.4269 => 1.4715, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.09% (0.3690 => 0.3804, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 3.09% (23.5202 => 24.2463, std. dev.: 0.0181) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.4139 => 0.4266, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 2.99% (0.4251 => 0.4378, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.90% (0.5546 => 0.5707, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.6435 => 0.6616, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3981 => 0.4091, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.5012 => 0.5135, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.84% (2.0346 => 2.0720, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (0.7426 => 0.7555, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.72% (0.2122 => 0.2307, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6752, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8926, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1681, std. dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6333, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6928, std. dev.: 0.0479) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2067, std. dev.: 0.0119) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.92% (41.7953 => 42.5982, std. dev.: 0.0192) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.78% (3.1722 => 3.2286, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 1.74% (50.0626 => 50.9327, std. dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3080, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2895, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.26% (2.4764 => 2.3956, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5605, std. dev.: 0.0232) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7928, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -6.41% (0.2402 => 0.2248, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7968, std. dev.: 0.0025) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.80% (17.2379 => 16.7546, std. dev.: 0.0834) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5693, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9671, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 15:07:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 17:07:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816220721.80A912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2957?compare_to=2954&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2957, Order: 162045, Start Time: 2012-08-16 20:54:17, End Time: 2012-08-16 22:08:07 To: 2954, Order: 162037, Start Time: 2012-08-16 19:13:03, End Time: 2012-08-16 20:26:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.38% (2.0176 => 2.3077, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.18% (0.5818 => 0.6410, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 10.14% (0.7061 => 0.7777, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 10.00% (0.5748 => 0.6323, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.08% (0.3646 => 0.3977, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.92% (0.3623 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 8.68% (0.3940 => 0.4282, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.95% (0.7710 => 0.8323, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.53% (3.9660 => 4.2645, std. dev.: 0.0063) MultiSource/Applications/hbd/hbd: 7.48% (1.3693 => 1.4717, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 7.46% (0.7038 => 0.7563, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.18% (0.5265 => 0.5643, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.72% (0.2781 => 0.2968, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.65% (0.2782 => 0.2967, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.57% (0.4062 => 0.4329, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.47% (0.9199 => 0.9794, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3022 => 0.3215, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.35% (0.6959 => 0.7401, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.27% (1.2193 => 1.2958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2760 => 0.2931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.09% (0.2726 => 0.2892, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4379 => 0.4645, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.06% (0.4390 => 0.4656, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.03% (0.3485 => 0.3695, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.02% (1.9828 => 2.1021, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5577 => 0.5912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.3107 => 0.3290, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.88% (0.2127 => 0.2252, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.85% (0.3246 => 0.3436, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.81% (0.1789 => 0.1893, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.81% (0.3149 => 0.3332, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3192 => 0.3375, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.63% (13.8202 => 14.5982, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.53% (0.3453 => 0.3644, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.2925 => 0.3084, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.41% (1.4563 => 1.5351, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.37% (1.1364 => 1.1974, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.35% (0.2243 => 0.2363, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.34% (0.2023 => 0.2131, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.28% (0.4016 => 0.4228, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.26% (1.3819 => 1.4546, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.18% (7.2180 => 7.5920, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.14% (0.5637 => 0.5927, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.05% (1.3813 => 1.4511, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 4.99% (0.3868 => 0.4061, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.98% (1.1061 => 1.1612, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 4.98% (3.8646 => 4.0569, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 4.93% (0.8310 => 0.8720, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.90% (0.7506 => 0.7874, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.3245 => 1.3880, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.74% (0.4791 => 0.5018, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.65% (1.9270 => 2.0167, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.65% (0.7460 => 0.7807, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.64% (1.0594 => 1.1086, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.2292 => 1.2856, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.44% (16.6129 => 17.3505, std. dev.: 0.0192) MultiSource/Applications/siod/siod: 4.32% (2.1791 => 2.2733, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (13.2842 => 13.8483, std. dev.: 0.0281) MultiSource/Benchmarks/McCat/18-imp/imp: 4.22% (0.3220 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.22% (4.4433 => 4.6307, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3755 => 0.3911, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.15% (4.3801 => 4.5620, std. dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (3.6692 => 3.8177, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.99% (0.6283 => 0.6534, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.94% (0.6135 => 0.6377, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.87% (4.9865 => 5.1796, std. dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.44% (3.1889 => 3.2985, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.37% (1.1333 => 1.1715, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.13% (16.2614 => 16.7703, std. dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7584, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.5754 => 6.7728, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.94% (14.8535 => 15.2906, std. dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.5298 => 14.9497, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.66% (3.2742 => 3.3612, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5188 => 1.5588, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.1007 => 2.1504, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.32% (4.6629 => 4.7710, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.6250 => 0.6369, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.83% (1.0313 => 1.0502, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.68% (0.9108 => 0.9261, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.56% (3.7467 => 3.8050, std. dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7631, std. dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2785 => 6.3483, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5129, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 25.17% (1.8175 => 2.2750, std. dev.: 0.0439) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 10.01% (1.2998 => 1.4299, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.35% (11.2619 => 11.7521, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.55% (1.9199 => 1.9881, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6061, std. dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 2.28% (10.7476 => 10.9930, std. dev.: 0.0443) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6784, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5284, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.81% (22.5627 => 21.2514, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2308 => 1.1013, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3107, std. dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5827, std. dev.: 0.0154) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2380, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2039, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8653, std. dev.: 0.0191) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7918, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3674, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.22% (5.5401 => 5.4726, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.09% (20.3410 => 20.1190, std. dev.: 0.0246) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5630, std. dev.: 0.0129) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2420, std. dev.: 0.0135) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 15:28:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 17:28:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120816222834.93D1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2958?compare_to=2955&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2958, Order: 162045, Start Time: 2012-08-16 21:10:12, End Time: 2012-08-16 22:29:22 To: 2955, Order: 162038, Start Time: 2012-08-16 19:23:27, End Time: 2012-08-16 20:42:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (106 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (731 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.76% (14.2063 => 13.9567, std. dev.: 0.0137) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.62% (10.3673 => 13.9567, std. dev.: 0.0137) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.32% (0.3473 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.09% (0.3516 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.05% (0.3543 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.72% (0.3694 => 0.4127, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3927 => 0.4372, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.84% (2.2022 => 2.3749, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8964, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.57% (0.1584 => 0.1688, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.92% (0.8172 => 0.8656, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 5.87% (0.6030 => 0.6384, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.86% (0.5925 => 0.6272, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4615 => 0.4866, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 5.38% (0.7433 => 0.7833, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2271 => 0.2382, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.88% (7.0540 => 7.3979, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7326 => 0.7678, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.4879 => 0.5109, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5569 => 0.5824, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 4.54% (0.2554 => 0.2670, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.4361 => 10.9061, std. dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.33% (0.5860 => 0.6114, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.28% (4.9449 => 5.1566, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (9.4845 => 9.8871, std. dev.: 0.0206) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2078, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.05% (4.2646 => 4.4375, std. dev.: 0.0078) MultiSource/Benchmarks/McCat/09-vor/vor: 3.99% (0.3180 => 0.3307, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.2700 => 0.2803, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.3121 => 0.3240, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.80% (0.4103 => 0.4259, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.80% (0.3162 => 0.3282, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.70% (8.1363 => 8.4375, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.66% (0.7835 => 0.8122, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (0.4636 => 0.4805, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.59% (1.3050 => 1.3519, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.3136 => 0.3247, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.43% (0.3092 => 0.3198, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.41% (0.5105 => 0.5279, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.40% (0.3441 => 0.3558, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.40% (1.5415 => 1.5939, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.9765 => 1.0093, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 3.35% (1.5603 => 1.6125, std. dev.: 0.0048) MultiSource/Applications/d/make_dparser: 3.24% (3.3354 => 3.4436, std. dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.19% (0.8067 => 0.8324, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 3.15% (1.1642 => 1.2009, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4289 => 0.4423, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.12% (1.1861 => 1.2231, std. dev.: 0.0028) MultiSource/Applications/treecc/treecc: 3.08% (2.0273 => 2.0897, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.06% (0.3826 => 0.3943, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.02% (5.7591 => 5.9332, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (0.4064 => 0.4184, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3865 => 0.3977, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.87% (0.6456 => 0.6641, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.85% (0.3650 => 0.3754, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6450 => 0.6633, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.80% (0.6675 => 0.6862, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.77% (3.8723 => 3.9796, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (2.0665 => 2.1223, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (14.3668 => 14.7502, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.66% (1.4186 => 1.4564, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.62% (0.4620 => 0.4741, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.53% (2.2969 => 2.3549, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (1.5859 => 1.6258, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.46% (0.5981 => 0.6128, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.43% (1.2842 => 1.3154, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.43% (0.4203 => 0.4305, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.41% (17.1811 => 17.5946, std. dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8921 => 0.9132, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.5020 => 0.5134, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.76% (0.7115 => 0.7240, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.70% (1.0722 => 1.0904, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.69% (1.1840 => 1.2040, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (4.2280 => 4.4197, std. dev.: 0.0151) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7525, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.01% (26.0924 => 26.6161, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2149, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3344, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8234, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2426, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.32% (1.3045 => 1.3217, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 1.18% (2.2771 => 2.3039, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5773, std. dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.03% (5.2763 => 3.1642, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7059, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7012, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -15.13% (54.1659 => 45.9708, std. dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.18% (2.9384 => 2.5510, std. dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: -11.87% (22.1758 => 19.5434, std. dev.: 0.0446) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -10.82% (1.2373 => 1.1034, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -8.02% (1.5373 => 1.4140, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5576, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4698, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.6802 => 8.4323, std. dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0108, std. dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9609, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -1.77% (2.5528 => 2.5075, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3384, std. dev.: 0.0055) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4225, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 16:48:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 18:48:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120816234843.8BF9E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2959?compare_to=2957&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2959, Order: 162048, Start Time: 2012-08-16 22:35:34, End Time: 2012-08-16 23:49:28 To: 2957, Order: 162045, Start Time: 2012-08-16 20:54:17, End Time: 2012-08-16 22:08:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.90% (78.7778 => 80.2752, std. dev.: 0.5807) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.36% (0.7777 => 0.7671, std. dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.74% (2.0176 => 2.3150, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 9.06% (0.5818 => 0.6345, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.85% (0.3130 => 0.3407, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.77% (0.5748 => 0.6252, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.64% (0.7061 => 0.7671, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 8.16% (0.3578 => 0.3870, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.05% (0.3650 => 0.3944, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.97% (0.3601 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3663 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.86% (0.3789 => 0.4087, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.81% (0.3623 => 0.3906, std. dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 7.73% (0.7038 => 0.7582, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 7.61% (0.3940 => 0.4240, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.59% (0.7710 => 0.8295, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.53% (3.9660 => 4.2647, std. dev.: 0.0089) MultiSource/Applications/hbd/hbd: 7.40% (1.3693 => 1.4706, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4062 => 0.4349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (0.4328 => 0.4624, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2782 => 0.2961, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.3899 => 0.4147, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.26% (0.9199 => 0.9775, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.23% (1.2193 => 1.2953, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.22% (0.6959 => 0.7392, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.12% (0.3022 => 0.3207, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.03% (0.4379 => 0.4643, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.2937 => 0.3114, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: 6.02% (0.2607 => 0.2764, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.90% (0.2765 => 0.2928, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.88% (0.3489 => 0.3694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.86% (0.2628 => 0.2782, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.77% (1.9828 => 2.0972, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.2966 => 0.3137, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2726 => 0.2883, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2127 => 0.2247, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5577 => 0.5890, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.59% (0.3149 => 0.3325, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.57% (13.8202 => 14.5894, std. dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.56% (0.2696 => 0.2846, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.52% (1.4563 => 1.5367, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.51% (0.3192 => 0.3368, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.2988 => 0.3152, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4390 => 0.4623, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 5.30% (0.2925 => 0.3080, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.29% (0.8310 => 0.8750, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 5.28% (0.3293 => 0.3467, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.28% (1.1364 => 1.1964, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.2914 => 0.3066, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.15% (0.4016 => 0.4223, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (0.3756 => 0.3949, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.5637 => 0.5924, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 5.04% (1.1061 => 1.1618, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (7.2180 => 7.5803, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.97% (1.3819 => 1.4506, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 4.95% (3.8646 => 4.0559, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.86% (1.3813 => 1.4484, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.73% (1.0594 => 1.1095, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.72% (1.3245 => 1.3870, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.60% (1.9270 => 2.0156, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 4.55% (16.6129 => 17.3694, std. dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.55% (0.4791 => 0.5009, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2292 => 1.2850, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 4.54% (2.1791 => 2.2780, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.48% (0.7460 => 0.7794, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.45% (0.2945 => 0.3076, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (4.4433 => 4.6302, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (13.2842 => 13.8422, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.3801 => 4.5597, std. dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3220 => 0.3349, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.00% (3.6692 => 3.8161, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.89% (0.3755 => 0.3901, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.6283 => 0.6526, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.81% (0.6135 => 0.6369, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.9865 => 5.1751, std. dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.35% (3.1889 => 3.2956, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.1333 => 1.1704, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 3.21% (16.2614 => 16.7833, std. dev.: 0.0115) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (8.4961 => 8.7557, std. dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: 3.04% (14.8535 => 15.3056, std. dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (6.5754 => 6.7702, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 2.93% (14.5298 => 14.9551, std. dev.: 0.0131) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (0.4805 => 0.4939, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.73% (3.2742 => 3.3635, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.66% (1.5188 => 1.5592, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (2.1007 => 2.1512, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.04% (4.6629 => 4.7580, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.99% (0.6744 => 0.6878, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.93% (1.0313 => 1.0512, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.71% (0.6250 => 0.6357, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.61% (0.9108 => 0.9255, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.53% (3.7467 => 3.8042, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 1.19% (33.2944 => 33.6912, std. dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5146, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2640, std. dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.69% (1.2998 => 1.4258, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7449, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.66% (10.7476 => 11.0340, std. dev.: 0.0364) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5983, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5928 => 4.6758, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5746, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.74% (22.5627 => 21.2684, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.20% (1.2308 => 1.1053, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -4.54% (1.1560 => 1.1035, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5763, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9611, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2312, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2056, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3607, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.20% (5.5401 => 5.4735, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.15% (20.3410 => 20.1063, std. dev.: 0.0131) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2373, std. dev.: 0.0120) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 17:15:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 19:15:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817001508.1B4462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2960?compare_to=2958&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2960, Order: 162048, Start Time: 2012-08-16 22:56:49, End Time: 2012-08-17 00:15:54 To: 2958, Order: 162045, Start Time: 2012-08-16 21:10:12, End Time: 2012-08-16 22:29:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (105 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (732 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.73% (0.8656 => 0.8506, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.57% (10.3673 => 14.0552, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.30% (1.1194 => 1.2459, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.01% (0.3927 => 0.4320, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.50% (2.2022 => 2.3673, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.80% (1.7609 => 1.8807, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.51% (0.6030 => 0.6362, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.46% (0.7433 => 0.7839, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 5.35% (0.5925 => 0.6242, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.21% (0.7326 => 0.7708, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.13% (0.3177 => 0.3340, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.4615 => 0.4851, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.65% (7.0540 => 7.3822, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.45% (0.2271 => 0.2372, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.32% (10.4361 => 10.8874, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.18% (0.4879 => 0.5083, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (9.4845 => 9.8782, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.09% (0.8172 => 0.8506, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.04% (4.2646 => 4.4368, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1430, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.97% (0.5569 => 0.5790, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.83% (0.4103 => 0.4260, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (5.0018 => 5.1920, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4636 => 0.4812, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2756 => 0.2860, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.61% (0.2877 => 0.2981, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (1.3050 => 1.3493, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.4064 => 0.4200, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.1363 => 8.4053, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.25% (0.3441 => 0.3553, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.24% (0.3826 => 0.3950, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.19% (0.5105 => 0.5268, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.5415 => 1.5904, std. dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.15% (1.1642 => 1.2009, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.13% (0.3865 => 0.3986, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3232 => 0.3333, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.12% (1.5603 => 1.6090, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.11% (0.9765 => 1.0069, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.4289 => 0.4422, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.8067 => 0.8317, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.07% (0.3650 => 0.3762, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.05% (0.3603 => 0.3713, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.02% (2.0665 => 2.1290, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.93% (2.0273 => 2.0868, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.90% (3.3354 => 3.4321, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.88% (0.6456 => 0.6642, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.84% (1.1861 => 1.2198, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.81% (0.4620 => 0.4750, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.80% (0.3684 => 0.3787, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.71% (1.5859 => 1.6288, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.70% (5.7591 => 5.9148, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.6675 => 0.6853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.4203 => 0.4315, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2842 => 1.3170, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9709, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.53% (0.6450 => 0.6613, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.50% (2.2969 => 2.3544, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.44% (1.4186 => 1.4532, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (14.3668 => 14.7114, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.31% (0.5981 => 0.6119, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5748, std. dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8921 => 0.9113, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2472, std. dev.: 0.0150) MultiSource/Applications/minisat/minisat: 1.70% (0.7115 => 0.7236, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.55% (1.0722 => 1.0888, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 1.50% (1.1840 => 1.2018, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (4.2280 => 4.4413, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.10% (3.6395 => 3.7524, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 2.07% (26.0924 => 26.6324, std. dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2135, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3343, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8225, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2407, std. dev.: 0.0129) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (1.5086 => 1.5289, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1239, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.56% (5.2763 => 3.1364, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.55% (5.3855 => 3.6865, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.22% (5.3526 => 3.6813, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -15.06% (54.1659 => 46.0091, std. dev.: 0.0527) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.84% (2.9384 => 2.5317, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4901, std. dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2373 => 1.1088, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -7.52% (1.5373 => 1.4217, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5577, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4717, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4271, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9972, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9628, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (12.5348 => 12.3329, std. dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8126, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 17:53:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 19:53:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120817005309.4AB272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2961?compare_to=2956&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2961, Order: 162045, Start Time: 2012-08-16 22:10:36, End Time: 2012-08-17 00:53:56 To: 2956, Order: 162033, Start Time: 2012-08-16 19:00:09, End Time: 2012-08-16 21:43:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (110 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (768 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.73% (116.2632 => 125.2504, std. dev.: 2.8156) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (2.8559 => 2.8250, std. dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.22% (0.3446 => 0.3867, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.15% (0.3465 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.99% (0.3460 => 0.3875, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3469 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.96% (0.3496 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.91% (0.3442 => 0.3852, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.84% (0.3488 => 0.3901, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.59% (0.3650 => 0.4073, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3643 => 0.4061, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3724 => 0.4141, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.98% (0.1619 => 0.1732, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.93% (0.5826 => 0.6230, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 6.74% (0.5889 => 0.6286, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.85% (1.5932 => 1.6864, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (1.6211 => 1.7109, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.53% (0.5026 => 0.5304, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.36% (1.3152 => 1.3857, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.31% (3.5627 => 3.7518, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 5.29% (0.7171 => 0.7550, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.24% (0.4029 => 0.4240, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.12% (0.5000 => 0.5256, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (0.4361 => 0.4578, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.5900 => 0.6192, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 4.76% (4.2109 => 4.4113, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 4.46% (1.0781 => 1.1262, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2875 => 0.3002, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.36% (0.2823 => 0.2946, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.27% (0.2813 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2750 => 0.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.20% (0.2738 => 0.2853, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.16% (0.3195 => 0.3328, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.3004 => 0.3128, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 4.12% (0.9909 => 1.0317, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.2736 => 0.2847, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.01% (0.2792 => 0.2904, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.00% (2.0673 => 2.1499, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 3.99% (0.2780 => 0.2891, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3258 => 0.3388, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.98% (0.3267 => 0.3397, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.97% (5.5417 => 5.7618, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.2866 => 0.2978, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2803 => 0.2912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (0.4658 => 0.4839, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2911 => 0.3024, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.88% (0.2811 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (1.9694 => 2.0450, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.3096 => 0.3214, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (1.9966 => 2.0724, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sieve: 3.73% (0.3726 => 0.3865, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (0.3890 => 0.4035, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.73% (0.3060 => 0.3174, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3362 => 0.3486, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3625 => 0.3758, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.3124 => 0.3238, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.65% (0.3317 => 0.3438, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.61% (0.3348 => 0.3469, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.61% (1.8794 => 1.9473, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3282 => 0.3399, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.51% (2.7292 => 2.8250, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.3903 => 0.4038, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3477 => 0.3597, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.42% (4.6177 => 4.7758, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 3.38% (2.1653 => 2.2385, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 3.37% (23.5202 => 24.3126, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash: 3.35% (0.4146 => 0.4285, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (2.1013 => 2.1715, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 3.33% (0.7875 => 0.8137, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 3.32% (0.4251 => 0.4392, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (4.4195 => 4.5640, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 3.25% (0.9697 => 1.0012, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.22% (0.3690 => 0.3809, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 3.18% (1.4269 => 1.4723, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 3.17% (0.6634 => 0.6844, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.17% (0.3981 => 0.4107, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.09% (0.4139 => 0.4267, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.69% (0.5546 => 0.5695, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.68% (0.3845 => 0.3948, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.5012 => 0.5145, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.98% (2.0346 => 2.0749, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (0.7426 => 0.7564, std. dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (11.6398 => 11.7630, std. dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.28% (0.2122 => 0.2319, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6703, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6284, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6631, std. dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2126, std. dev.: 0.0416) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (41.7953 => 42.6478, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 1.74% (50.0626 => 50.9356, std. dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2271, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3095, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2826, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.23% (2.4764 => 2.3965, std. dev.: 0.0232) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5802, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std. dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -3.77% (11.2080 => 10.7853, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0007) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.88% (17.2379 => 16.7406, std. dev.: 0.0620) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5717, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9681, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 18:30:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 20:30:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817013006.07DDD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2962?compare_to=2959&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2962, Order: 162061, Start Time: 2012-08-17 00:16:55, End Time: 2012-08-17 01:30:49 To: 2959, Order: 162048, Start Time: 2012-08-16 22:35:34, End Time: 2012-08-16 23:49:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3048, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.98% (0.3130 => 0.3411, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.94% (0.5818 => 0.6338, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.75% (0.5748 => 0.6251, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.72% (0.7061 => 0.7677, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 8.11% (0.3578 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.05% (0.3601 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: 7.81% (0.3789 => 0.4085, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.73% (0.3623 => 0.3903, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.72% (0.7038 => 0.7581, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.4003 => 0.4307, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (3.9660 => 4.2493, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.7710 => 0.8260, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 6.97% (1.3693 => 1.4648, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.00% (0.9199 => 0.9751, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.90% (1.2193 => 1.2912, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.6959 => 0.7363, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.63% (0.4390 => 0.4637, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1819 => 0.1920, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.51% (0.3246 => 0.3425, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.43% (0.2690 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.39% (0.3485 => 0.3673, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.36% (0.3489 => 0.3676, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.36% (0.2726 => 0.2872, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.34% (1.4563 => 1.5341, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.32% (0.2765 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.2937 => 0.3093, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.28% (1.9828 => 2.0875, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 5.23% (13.8202 => 14.5430, std. dev.: 0.0213) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2696 => 0.2834, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.10% (1.1364 => 1.1943, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 4.98% (0.3453 => 0.3625, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (1.3819 => 1.4476, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 4.73% (0.3534 => 0.3701, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.71% (3.8646 => 4.0465, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.67% (0.8310 => 0.8698, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.66% (7.2180 => 7.5547, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.56% (1.1061 => 1.1565, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.50% (1.3245 => 1.3841, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.43% (1.0594 => 1.1063, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.38% (2.1791 => 2.2746, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.34% (0.7506 => 0.7832, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 4.31% (1.9270 => 2.0100, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.29% (16.6129 => 17.3264, std. dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.26% (0.4791 => 0.4995, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 4.04% (1.2292 => 1.2789, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5543, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (4.4433 => 4.6134, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (13.2842 => 13.7752, std. dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.65% (3.6692 => 3.8033, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.6283 => 0.6511, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.59% (0.6135 => 0.6355, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.56% (4.9865 => 5.1639, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3755 => 0.3884, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.28% (3.1889 => 3.2934, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 3.23% (16.2614 => 16.7874, std. dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1333 => 1.1674, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.90% (8.4961 => 8.7423, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.8698 => 0.8948, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3642, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.75% (14.8535 => 15.2614, std. dev.: 0.0110) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9245, std. dev.: 0.0142) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4113 => 0.4224, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.67% (6.5754 => 6.7512, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.32% (1.5188 => 1.5540, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.1007 => 2.1438, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.02% (0.6744 => 0.6880, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.97% (4.6629 => 4.7546, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.33% (0.9108 => 0.9229, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.28% (3.7467 => 3.7947, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.27% (1.8175 => 2.2586, std. dev.: 0.0436) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.96% (1.2998 => 1.4292, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.33% (11.2619 => 11.7496, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.26% (10.7476 => 10.9902, std. dev.: 0.0534) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5912, std. dev.: 0.0167) MultiSource/Applications/sqlite3/sqlite3: 1.77% (4.5928 => 4.6743, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5738, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6854, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.5627 => 21.1758, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.39% (0.3511 => 0.3392, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2308 => 1.1017, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.15% (1.3780 => 1.3208, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5901, std. dev.: 0.0165) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.27% (0.8342 => 0.8153, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.14% (3.0263 => 2.9614, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2031, std. dev.: 0.0263) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2468, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3644, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.17% (20.3410 => 20.1031, std. dev.: 0.0328) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4768, std. dev.: 0.0205) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 19:01:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 21:01:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817020148.3067A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2963?compare_to=2960&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2963, Order: 162067, Start Time: 2012-08-17 00:43:37, End Time: 2012-08-17 02:02:35 To: 2960, Order: 162048, Start Time: 2012-08-16 22:56:49, End Time: 2012-08-17 00:15:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (98 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.42% (54.2846 => 55.5995, std. dev.: 0.4608) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.10% (1.3107 => 1.3251, std. dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.32% (14.0552 => 13.5891, std. dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.08% (10.3673 => 13.5891, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.24% (0.3497 => 0.3890, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.12% (0.3561 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.37% (1.7609 => 1.8906, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.30% (2.2022 => 2.3630, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.03% (0.5925 => 0.6282, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.00% (0.6030 => 0.6392, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.4615 => 0.4851, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.94% (0.7326 => 0.7688, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2271 => 0.2380, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.56% (7.0540 => 7.3759, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.26% (10.4361 => 10.8809, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.24% (0.4879 => 0.5086, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.14% (9.4845 => 9.8771, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.12% (0.8172 => 0.8509, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.99% (0.2758 => 0.2868, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.9449 => 5.1418, std. dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.94% (4.2646 => 4.4328, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5860 => 0.6088, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (5.0018 => 5.1919, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.63% (8.1363 => 8.4315, std. dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (0.4636 => 0.4797, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3423 => 0.3540, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.42% (1.3050 => 1.3496, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: 3.41% (0.7835 => 0.8102, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.28% (0.3441 => 0.3554, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.26% (1.1642 => 1.2022, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.12% (0.9765 => 1.0070, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.4289 => 0.4421, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.06% (0.5105 => 0.5261, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3865 => 0.3982, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.00% (3.3354 => 3.4353, std. dev.: 0.0139) MultiSource/Applications/hbd/hbd: 2.98% (1.5603 => 1.6068, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 2.92% (0.3422 => 0.3522, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.5415 => 1.5863, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.88% (0.8067 => 0.8299, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3826 => 0.3936, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.87% (1.1861 => 1.2202, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.85% (0.3650 => 0.3754, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.4064 => 0.4178, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.80% (0.6456 => 0.6637, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 2.79% (2.0273 => 2.0839, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.76% (2.0665 => 2.1236, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.70% (5.7591 => 5.9147, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.69% (0.3935 => 0.4041, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.48% (0.6450 => 0.6610, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.47% (0.4203 => 0.4307, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6675 => 0.6840, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9680, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4620 => 0.4732, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.41% (1.2842 => 1.3152, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.32% (14.3668 => 14.6994, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.31% (0.5020 => 0.5136, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.4186 => 1.4509, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.24% (2.2969 => 2.3483, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.23% (17.1811 => 17.5639, std. dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8921 => 0.9113, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.2024 => 2.2451, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.59% (0.7115 => 0.7228, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.1840 => 1.2010, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.33% (1.0722 => 1.0865, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (4.2280 => 4.4582, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.63% (0.2944 => 0.3051, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7498, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.07% (26.0924 => 26.6318, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2158, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3349, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.58% (1.3045 => 1.3251, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8227, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2375, std. dev.: 0.0064) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5765, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.50% (5.2763 => 3.1396, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6934, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6873, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0259, std. dev.: 0.0803) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.42% (2.9384 => 2.5440, std. dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: -12.10% (22.1758 => 19.4916, std. dev.: 0.0304) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2373 => 1.1026, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -6.71% (1.5373 => 1.4342, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5577, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4627, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4221, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9998, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9634, std. dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.78% (2.5528 => 2.5073, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3428, std. dev.: 0.0077) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.15% (1.8329 => 1.8118, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 20:11:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 22:11:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817031132.E39F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2964?compare_to=2962&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2964, Order: 162071, Start Time: 2012-08-17 01:58:22, End Time: 2012-08-17 03:12:17 To: 2962, Order: 162061, Start Time: 2012-08-17 00:16:55, End Time: 2012-08-17 01:30:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.28% (54.7041 => 56.4984, std. dev.: 0.1152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.77% (2.0176 => 2.2955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.55% (0.7061 => 0.7735, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5818 => 0.6370, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.41% (0.5748 => 0.6289, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.05% (0.3578 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.71% (0.3789 => 0.4081, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.64% (0.3650 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.64% (0.3914 => 0.4213, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.4003 => 0.4301, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.08% (0.7710 => 0.8256, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 7.04% (1.3693 => 1.4657, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 6.93% (0.7038 => 0.7526, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.81% (3.9660 => 4.2359, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.40% (0.4062 => 0.4322, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.94% (0.9199 => 0.9745, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.2914 => 0.3084, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.83% (1.2193 => 1.2904, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.6959 => 0.7362, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.77% (0.1819 => 0.1924, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.68% (0.2782 => 0.2940, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.53% (0.4379 => 0.4621, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.40% (0.5577 => 0.5878, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.36% (0.3022 => 0.3184, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.30% (0.3246 => 0.3418, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.27% (0.2655 => 0.2795, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.26% (1.4563 => 1.5329, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2628 => 0.2765, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.14% (0.3485 => 0.3664, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5268, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.3580 => 0.3763, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.08% (0.4390 => 0.4613, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.07% (1.9828 => 2.0834, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 5.07% (0.2760 => 0.2900, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 5.06% (0.2726 => 0.2864, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3149 => 0.3308, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 5.02% (0.3107 => 0.3263, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.00% (0.2761 => 0.2899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.86% (0.2696 => 0.2827, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.73% (1.1364 => 1.1901, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3453 => 0.3614, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5516, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.3756 => 0.3928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.51% (0.8310 => 0.8685, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.49% (0.3293 => 0.3441, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3835, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.3534 => 0.3691, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.43% (1.3819 => 1.4431, std. dev.: 0.0040) MultiSource/Applications/Burg/burg: 4.40% (1.1061 => 1.1548, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (3.8646 => 4.0334, std. dev.: 0.0129) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.32% (1.3813 => 1.4410, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 4.26% (1.0594 => 1.1045, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3868 => 0.4032, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.21% (0.7506 => 0.7822, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.20% (0.4791 => 0.4992, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.03% (2.1791 => 2.2669, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.97% (1.9270 => 2.0035, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.7460 => 0.7752, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.2292 => 1.2771, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.84% (16.6129 => 17.2516, std. dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.2945 => 0.3057, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (13.2842 => 13.7738, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.62% (4.3801 => 4.5388, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (4.4433 => 4.6034, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.58% (0.6283 => 0.6508, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.58% (3.6692 => 3.8004, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.33% (0.6135 => 0.6339, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (4.9865 => 5.1518, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.99% (3.1889 => 3.2843, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1333 => 1.1661, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.79% (16.2614 => 16.7158, std. dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.71% (0.8698 => 0.8934, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (8.4961 => 8.7266, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 2.67% (0.4113 => 0.4223, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (6.5754 => 6.7433, std. dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.8535 => 15.2224, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.44% (3.2742 => 3.3540, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.43% (14.5298 => 14.8830, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.15% (1.5188 => 1.5515, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.1007 => 2.1416, std. dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 1.84% (4.6629 => 4.7486, std. dev.: 0.0183) MultiSource/Applications/lemon/lemon: 1.40% (1.0313 => 1.0457, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.12% (3.7467 => 3.7885, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5184, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2556, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.74% (1.2998 => 1.4264, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7410, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6057, std. dev.: 0.0080) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9941, std. dev.: 0.0157) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.79% (4.5928 => 4.6752, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.28% (1.5089 => 1.5282, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1477, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.96% (0.6576 => 0.6447, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0982, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.88% (1.3780 => 1.3245, std. dev.: 0.0112) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5966, std. dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9634, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2298, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2004, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3675, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.21% (20.3410 => 20.0956, std. dev.: 0.0316) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4770, std. dev.: 0.0042) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2392, std. dev.: 0.0350) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5641, std. dev.: 0.0136) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 20:48:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 22:48:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817034806.3E5C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2965?compare_to=2963&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2965, Order: 162072, Start Time: 2012-08-17 02:30:03, End Time: 2012-08-17 03:48:51 To: 2963, Order: 162067, Start Time: 2012-08-17 00:43:37, End Time: 2012-08-17 02:02:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (95 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (744 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.82% (10.3673 => 13.5630, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.96% (1.1194 => 1.2421, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3473 => 0.3844, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.87% (0.3828 => 0.4206, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.63% (0.3927 => 0.4305, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.81% (2.2022 => 2.3522, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.67% (1.7609 => 1.8784, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.87% (0.6030 => 0.6384, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.84% (0.5925 => 0.6271, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.61% (0.3121 => 0.3296, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.03% (0.4615 => 0.4847, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (0.7433 => 0.7806, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.3177 => 0.3336, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.85% (0.7326 => 0.7681, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.40% (0.2271 => 0.2371, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.5569 => 0.5806, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (7.0540 => 7.3458, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 4.05% (10.4361 => 10.8584, std. dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: 3.97% (9.4845 => 9.8609, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/oourafft: 3.96% (0.3282 => 0.3412, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.8172 => 0.8489, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.87% (0.4879 => 0.5068, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (4.2646 => 4.4256, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (4.9449 => 5.1314, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.64% (5.0018 => 5.1839, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5860 => 0.6073, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.51% (0.7835 => 0.8110, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.49% (0.2891 => 0.2992, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.8067 => 0.8344, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.4103 => 0.4242, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.1363 => 8.4108, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.37% (1.3050 => 1.3490, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.32% (0.4636 => 0.4790, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.04% (0.9765 => 1.0062, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.01% (0.3387 => 0.3489, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.99% (0.3441 => 0.3544, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.98% (1.5603 => 1.6068, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.98% (0.5105 => 0.5257, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.94% (1.1642 => 1.1984, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.5415 => 1.5863, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.4289 => 0.4412, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.83% (3.3354 => 3.4297, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2196, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.76% (2.0273 => 2.0833, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.75% (5.7591 => 5.9174, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (0.4064 => 0.4172, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.62% (2.0665 => 2.1207, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6456 => 0.6625, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.52% (0.6675 => 0.6843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.50% (0.4203 => 0.4308, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.50% (0.6450 => 0.6611, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.41% (3.8723 => 3.9657, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.41% (1.5859 => 1.6241, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8921 => 0.9133, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (0.4620 => 0.4729, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.31% (17.1811 => 17.5785, std. dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (14.3668 => 14.6924, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.24% (1.2842 => 1.3130, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.4186 => 1.4504, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.17% (2.2969 => 2.3467, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.06% (0.5981 => 0.6104, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.55% (0.7115 => 0.7225, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.34% (1.0722 => 1.0866, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (4.2280 => 4.4524, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7535, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.21% (26.0924 => 26.6681, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 1.62% (3.1578 => 3.2091, std. dev.: 0.0098) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3338, std. dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8229, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2421, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.14% (1.5086 => 1.5258, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1238, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.57% (0.8651 => 0.1681, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.70% (5.2763 => 3.1287, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.86% (5.3855 => 3.6698, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.58% (5.3526 => 3.6623, std. dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -15.13% (54.1659 => 45.9688, std. dev.: 0.0277) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.80% (2.9384 => 2.5328, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4557, std. dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2373 => 1.1020, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -9.71% (1.5373 => 1.3880, std. dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.21% (4.8142 => 4.4672, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -7.01% (1.1396 => 1.0597, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5577, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4601, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4245, std. dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0108, std. dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.26% (8.1563 => 7.9718, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3348, std. dev.: 0.0057) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.13% (1.8329 => 1.8121, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 21:03:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 23:03:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120817040357.3C9CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2966?compare_to=2961&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2966, Order: 162069, Start Time: 2012-08-17 01:21:16, End Time: 2012-08-17 04:04:44 To: 2961, Order: 162045, Start Time: 2012-08-16 22:10:36, End Time: 2012-08-17 00:53:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 14.74% (0.3792 => 0.4351, std. dev.: 0.0147) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.93% (0.3488 => 0.3904, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.92% (0.3465 => 0.3878, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3446 => 0.3856, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3442 => 0.3849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.79% (0.3460 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.76% (0.3469 => 0.3877, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.73% (0.3496 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.48% (0.3650 => 0.4069, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3643 => 0.4057, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.12% (0.3724 => 0.4138, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.87% (0.5826 => 0.6226, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.57% (0.5889 => 0.6276, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (3.5627 => 3.7641, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (1.6211 => 1.7111, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (0.5026 => 0.5302, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.47% (1.3152 => 1.3871, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.1968 => 0.2075, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.23% (0.2866 => 0.3016, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.22% (0.7171 => 0.7545, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.5900 => 0.6206, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (0.4361 => 0.4584, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.08% (1.5932 => 1.6742, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (0.5000 => 0.5230, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (0.4658 => 0.4869, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.53% (0.3930 => 0.4108, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 4.44% (1.0781 => 1.1260, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 4.42% (4.2109 => 4.3972, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.10% (0.2875 => 0.2993, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3195 => 0.3321, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.81% (0.9909 => 1.0287, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 3.81% (5.5417 => 5.7527, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (1.9966 => 2.0714, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.73% (0.2738 => 0.2840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (2.7292 => 2.8303, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2792 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.68% (0.2823 => 0.2927, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.66% (0.3004 => 0.3114, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.66% (1.9694 => 2.0414, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 3.65% (0.3096 => 0.3209, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4146 => 0.4295, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0673 => 2.1415, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2813 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3362 => 0.3480, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (1.8794 => 1.9447, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.47% (0.2911 => 0.3012, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.44% (0.3258 => 0.3370, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.43% (0.3348 => 0.3463, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.37% (0.3890 => 0.4021, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.35% (0.3726 => 0.3851, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.32% (0.9697 => 1.0019, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.3903 => 0.4032, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.30% (0.3060 => 0.3161, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.3678 => 0.3798, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3317 => 0.3425, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.23% (0.3625 => 0.3742, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.20% (0.7875 => 0.8127, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (2.1013 => 2.1682, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.15% (0.6634 => 0.6843, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.14% (0.3282 => 0.3385, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.09% (4.6177 => 4.7604, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (2.1653 => 2.2317, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists1: 3.05% (0.3477 => 0.3583, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.03% (1.4269 => 1.4702, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (4.4195 => 4.5490, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 2.86% (23.5202 => 24.1922, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3981 => 0.4091, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.6435 => 0.6604, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (0.4139 => 0.4242, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.5012 => 0.5129, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.55% (2.0346 => 2.0662, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (0.7426 => 0.7530, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.10% (0.2122 => 0.2315, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6740, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8961, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1716, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6434, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6408, std. dev.: 0.0550) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std. dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.80% (41.7953 => 42.5483, std. dev.: 0.0467) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.71% (50.0626 => 50.9195, std. dev.: 0.0112) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std. dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3084, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.62% (2.4764 => 2.4114, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5640, std. dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7993, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9569, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std. dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7921, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.49% (17.2379 => 16.8080, std. dev.: 0.0398) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.24% (0.6293 => 0.6152, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9696, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: -1.41% (5.5810 => 5.5022, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 21:53:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 16 Aug 2012 23:53:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817045301.ABFBB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2967?compare_to=2964&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2967, Order: 162073, Start Time: 2012-08-17 03:39:51, End Time: 2012-08-17 04:53:46 To: 2964, Order: 162071, Start Time: 2012-08-17 01:58:22, End Time: 2012-08-17 03:12:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.58% (2.0176 => 2.2915, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 9.08% (0.7061 => 0.7702, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5818 => 0.6339, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 8.92% (0.5748 => 0.6261, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3601 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.34% (0.3650 => 0.3918, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 7.27% (0.3646 => 0.3911, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.12% (0.3623 => 0.3881, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.10% (0.3914 => 0.4192, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.01% (1.3693 => 1.4653, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 6.99% (0.4003 => 0.4283, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.7710 => 0.8239, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 6.83% (0.3940 => 0.4209, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.73% (0.7038 => 0.7512, std. dev.: 0.0167) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.70% (3.9660 => 4.2316, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5265 => 0.5600, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.36% (0.2721 => 0.2894, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.22% (0.4328 => 0.4597, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.86% (0.2781 => 0.2944, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.69% (0.3899 => 0.4121, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.62% (0.9199 => 0.9716, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.6959 => 0.7349, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.54% (0.2690 => 0.2839, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.51% (1.2193 => 1.2865, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.50% (0.2655 => 0.2801, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.44% (0.2628 => 0.2771, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4379 => 0.4617, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.40% (0.5577 => 0.5878, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.36% (0.3246 => 0.3420, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3485 => 0.3670, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.22% (0.3489 => 0.3671, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0859, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.19% (0.2966 => 0.3120, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2696 => 0.2833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5264, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.80% (13.8202 => 14.4837, std. dev.: 0.0162) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.77% (1.3819 => 1.4478, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.69% (0.4390 => 0.4596, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.66% (1.1364 => 1.1893, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.58% (0.4016 => 0.4200, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3534 => 0.3694, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.49% (7.2180 => 7.5420, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.49% (1.3813 => 1.4433, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.49% (0.5637 => 0.5890, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 4.29% (3.8646 => 4.0304, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 4.22% (1.1061 => 1.1528, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.14% (0.7506 => 0.7817, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3793, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 4.00% (1.0594 => 1.1018, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.95% (1.2292 => 1.2778, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.7460 => 0.7754, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.90% (1.9270 => 2.0021, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.75% (2.1791 => 2.2608, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 3.65% (16.6129 => 17.2193, std. dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (13.2842 => 13.7530, std. dev.: 0.0175) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3220 => 0.3332, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2995 => 0.3099, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (4.4433 => 4.5958, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.40% (4.3801 => 4.5290, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.24% (3.6692 => 3.7880, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1465, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.18% (0.6135 => 0.6330, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.79% (1.1333 => 1.1649, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 2.69% (3.1889 => 3.2748, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.64% (16.2614 => 16.6904, std. dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.8698 => 0.8925, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.49% (8.4961 => 8.7076, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: 2.48% (0.4113 => 0.4215, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2046, std. dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 2.36% (6.5754 => 6.7305, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 2.31% (14.5298 => 14.8652, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.05% (3.2742 => 3.3412, std. dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (1.5188 => 1.5496, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.1007 => 2.1374, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.51% (4.6629 => 4.7335, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.21% (1.0313 => 1.0438, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5123, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2550, std. dev.: 0.0555) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.78% (1.2998 => 1.4269, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.01% (1.5824 => 1.6617, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.39% (11.2619 => 11.7563, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.84% (1.7688 => 1.8191, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4271 => 7.6070, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9792, std. dev.: 0.0695) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5928 => 4.6757, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.56% (3.2729 => 3.3241, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1835, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.50% (22.5627 => 21.0960, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.68% (0.8818 => 0.8670, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.6576 => 0.6469, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2308 => 1.1035, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: -4.52% (1.1560 => 1.1038, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.80% (0.4867 => 0.4682, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4675, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.46% (8.8259 => 8.6089, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9593, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0166) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2042, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (84.4286 => 83.3462, std. dev.: 0.0102) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.19% (5.5401 => 5.4739, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.07% (20.3410 => 20.1243, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 22:34:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 00:34:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817053438.A53672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2968?compare_to=2965&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2968, Order: 162075, Start Time: 2012-08-17 04:16:30, End Time: 2012-08-17 05:35:24 To: 2965, Order: 162072, Start Time: 2012-08-17 02:30:03, End Time: 2012-08-17 03:48:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (91 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (747 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.7228 => 56.6280, std. dev.: 0.0696) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.84% (10.3673 => 13.5649, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.91% (1.1194 => 1.2415, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.11% (0.3886 => 0.4279, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.82% (2.2022 => 2.3525, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.73% (1.7609 => 1.8794, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.67% (0.6030 => 0.6372, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.60% (0.5925 => 0.6257, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.28% (0.7326 => 0.7713, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.10% (0.3177 => 0.3339, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.98% (0.4615 => 0.4845, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.88% (0.7433 => 0.7796, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.45% (0.2271 => 0.2372, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.16% (10.4361 => 10.8705, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.15% (0.8172 => 0.8511, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.10% (7.0540 => 7.3430, std. dev.: 0.0218) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.01% (9.4845 => 9.8650, std. dev.: 0.0139) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.91% (0.4879 => 0.5070, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (4.2646 => 4.4271, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (4.9449 => 5.1302, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (5.0018 => 5.1874, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.69% (0.5860 => 0.6076, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.48% (8.1363 => 8.4194, std. dev.: 0.0054) MultiSource/Applications/spiff/spiff: 3.38% (0.7835 => 0.8100, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.37% (1.3050 => 1.3490, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4636 => 0.4783, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.17% (0.4103 => 0.4233, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.16% (1.5603 => 1.6096, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.9765 => 1.0065, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.02% (0.3441 => 0.3545, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.96% (0.5105 => 0.5256, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.92% (1.1861 => 1.2207, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.5415 => 1.5857, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.84% (3.3354 => 3.4302, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.8067 => 0.8295, std. dev.: 0.0037) MultiSource/Applications/Burg/burg: 2.83% (1.1642 => 1.1971, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.82% (2.0273 => 2.0845, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.64% (0.3826 => 0.3927, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.61% (0.3865 => 0.3966, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.60% (5.7591 => 5.9086, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4289 => 0.4399, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9678, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.43% (0.6450 => 0.6607, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (2.0665 => 2.1161, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.38% (0.6675 => 0.6834, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.28% (17.1811 => 17.5730, std. dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8921 => 0.9117, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (14.3668 => 14.6810, std. dev.: 0.0116) MultiSource/Applications/siod/siod: 2.19% (2.2969 => 2.3471, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.16% (1.4186 => 1.4493, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.13% (1.5859 => 1.6197, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (2.2024 => 2.2380, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.32% (1.0722 => 1.0864, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (4.2280 => 4.4476, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7505, std. dev.: 0.0071) MultiSource/Applications/lua/lua: 2.04% (26.0924 => 26.6249, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.54% (3.2827 => 3.3331, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.53% (11.6436 => 11.8217, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2445, std. dev.: 0.0223) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.05% (1.5086 => 1.5245, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6821, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5749, std. dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1241, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.61% (5.2763 => 3.1336, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.83% (5.3855 => 3.6714, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.43% (5.3526 => 3.6701, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0028, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.75% (2.9384 => 2.5344, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4553, std. dev.: 0.0241) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.18% (1.6925 => 1.4187, std. dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0988, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -8.96% (1.5373 => 1.3995, std. dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5578, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-5: -5.02% (1.5835 => 1.5040, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0013) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4674, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4199, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9899, std. dev.: 0.0177) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3299, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9616, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3380, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 16 23:34:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 01:34:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817063432.AA3262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2969?compare_to=2967&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2969, Order: 162080, Start Time: 2012-08-17 05:21:23, End Time: 2012-08-17 06:35:19 To: 2967, Order: 162073, Start Time: 2012-08-17 03:39:51, End Time: 2012-08-17 04:53:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (136 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.99% (2.0176 => 2.2998, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 9.18% (0.5818 => 0.6352, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.13% (0.7061 => 0.7706, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5748 => 0.6273, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.15% (0.3130 => 0.3385, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.77% (0.3578 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3601 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3663 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.57% (0.3789 => 0.4076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.56% (0.3623 => 0.3897, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.51% (1.3693 => 1.4721, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.19% (0.4003 => 0.4291, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.15% (0.2782 => 0.2981, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (0.4328 => 0.4634, std. dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.81% (0.7038 => 0.7517, std. dev.: 0.0132) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (3.9660 => 4.2331, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.71% (0.7710 => 0.8227, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.57% (0.2937 => 0.3130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.52% (0.2760 => 0.2940, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.52% (0.3022 => 0.3219, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.51% (0.2628 => 0.2799, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.46% (0.5265 => 0.5605, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2765 => 0.2943, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.28% (0.2596 => 0.2759, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.3899 => 0.4143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.24% (0.3107 => 0.3301, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2696 => 0.2864, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.16% (0.3149 => 0.3343, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.15% (1.9828 => 2.1048, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.05% (0.3489 => 0.3700, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4390 => 0.4655, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.2988 => 0.3166, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.91% (0.3485 => 0.3691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.73% (0.3453 => 0.3651, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.70% (0.9199 => 0.9723, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2875, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.50% (0.3293 => 0.3474, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.39% (0.3246 => 0.3421, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (0.4379 => 0.4615, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.6959 => 0.7334, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.28% (0.4016 => 0.4228, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.06% (0.5577 => 0.5859, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.98% (1.4563 => 1.5288, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.94% (13.8202 => 14.5029, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.73% (1.1364 => 1.1901, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.57% (1.3819 => 1.4451, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.56% (1.2292 => 1.2853, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (7.2180 => 7.5463, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.54% (0.5637 => 0.5893, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.54% (1.3813 => 1.4440, std. dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.50% (0.2914 => 0.3045, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.40% (0.7506 => 0.7836, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 4.38% (0.8310 => 0.8674, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.24% (1.1061 => 1.1530, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (1.3245 => 1.3800, std. dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 4.18% (3.8646 => 4.0262, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3755 => 0.3911, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.0594 => 1.1025, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.7460 => 0.7763, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.99% (0.4791 => 0.4982, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.83% (1.9270 => 2.0009, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 3.75% (16.6129 => 17.2361, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 3.72% (2.1791 => 2.2602, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.60% (0.6283 => 0.6509, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.57% (13.2842 => 13.7591, std. dev.: 0.0134) MultiSource/Applications/sgefa/sgefa: 3.51% (0.2995 => 0.3100, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (4.9865 => 5.1613, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (4.4433 => 4.5982, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3220 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.41% (4.3801 => 4.5293, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.31% (3.6692 => 3.7908, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.15% (0.6135 => 0.6328, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.09% (0.8698 => 0.8967, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.76% (1.1333 => 1.1646, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.73% (3.1889 => 3.2758, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.58% (8.4961 => 8.7151, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.48% (6.5754 => 6.7387, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 2.48% (0.4113 => 0.4215, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.40% (14.8535 => 15.2097, std. dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 2.27% (14.5298 => 14.8592, std. dev.: 0.0225) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.12% (3.2742 => 3.3435, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5188 => 1.5486, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 1.76% (0.6250 => 0.6360, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 1.69% (4.6629 => 4.7416, std. dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5203, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 25.00% (1.8175 => 2.2719, std. dev.: 0.0428) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.65% (1.2998 => 1.4252, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7416, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0173) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3835, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5953, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.03% (10.7476 => 10.9655, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3249, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9701, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.36% (1.5089 => 1.5294, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1833, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1434, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.52% (0.8818 => 0.8684, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2308 => 1.1035, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1031, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5757, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9598, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2322, std. dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2010, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8591, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3662, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.23% (5.5401 => 5.4719, std. dev.: 0.0173) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 00:18:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 02:18:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120817071814.2E0842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2970?compare_to=2966&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2970, Order: 162076, Start Time: 2012-08-17 04:32:16, End Time: 2012-08-17 07:18:57 To: 2966, Order: 162069, Start Time: 2012-08-17 01:21:16, End Time: 2012-08-17 04:04:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (57 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (823 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 1.66% (10.7388 => 10.9176, std. dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3446 => 0.3846, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3465 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.50% (0.3442 => 0.3838, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.50% (0.3460 => 0.3858, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.44% (0.3488 => 0.3887, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 11.41% (0.3496 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.39% (0.3469 => 0.3864, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.26% (0.3650 => 0.4061, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.06% (0.3643 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.69% (0.3724 => 0.4122, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.27% (0.5826 => 0.6191, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 6.11% (0.5889 => 0.6249, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 5.37% (0.7171 => 0.7556, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.06% (0.4029 => 0.4233, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.99% (1.5932 => 1.6727, std. dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 4.42% (4.2109 => 4.3972, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 4.16% (1.0781 => 1.1229, std. dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 3.76% (5.5417 => 5.7502, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.35% (0.6634 => 0.6856, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.25% (0.7875 => 0.8131, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.10% (0.9909 => 1.0216, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 3.09% (4.6177 => 4.7605, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary3: 3.09% (0.3267 => 0.3368, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (2.1653 => 2.2313, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (2.1013 => 2.1647, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.81% (1.4269 => 1.4670, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.62% (23.5202 => 24.1376, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash: 2.44% (0.4146 => 0.4247, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.43% (0.9697 => 0.9933, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 2.40% (0.5546 => 0.5679, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4251 => 0.4352, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.6435 => 0.6579, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.56% (2.0346 => 2.0664, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (0.7426 => 0.7526, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6130, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8907, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1679, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6424, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (105.3826 => 107.6951, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2108, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (41.7953 => 42.6316, std. dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2261, std. dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3134, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2873, std. dev.: 0.0358) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.23% (2.4764 => 2.3963, std. dev.: 0.0218) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5862, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7924, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0114) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0035) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7935, std. dev.: 0.0063) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.51% (17.2379 => 16.8059, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5798, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9632, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0199) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 4.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 00:23:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 02:23:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817072341.8F9B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2971?compare_to=2968&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2971, Order: 162083, Start Time: 2012-08-17 06:02:55, End Time: 2012-08-17 07:24:26 To: 2968, Order: 162075, Start Time: 2012-08-17 04:16:30, End Time: 2012-08-17 05:35:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (94 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (744 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.09% (10.3673 => 13.5904, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.72% (1.1194 => 1.2506, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3543 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 11.18% (0.3516 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.40% (1.7609 => 1.8912, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.28% (2.2022 => 2.3626, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 6.72% (0.5925 => 0.6323, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.63% (0.6030 => 0.6430, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.07% (0.7326 => 0.7771, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4615 => 0.4887, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 5.05% (0.7433 => 0.7808, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.62% (0.2271 => 0.2376, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.49% (7.0540 => 7.3707, std. dev.: 0.0128) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.8172 => 0.8531, std. dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: 4.33% (10.4361 => 10.8879, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.26% (0.4879 => 0.5087, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (9.4845 => 9.8863, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1443, std. dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (4.2646 => 4.4321, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.4636 => 0.4816, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1957, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.73% (0.4103 => 0.4256, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.67% (8.1363 => 8.4350, std. dev.: 0.0133) MultiSource/Applications/spiff/spiff: 3.57% (0.7835 => 0.8115, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.40% (1.3050 => 1.3494, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3826 => 0.3955, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.22% (0.3136 => 0.3237, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.21% (0.3865 => 0.3989, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.20% (1.5603 => 1.6103, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 3.19% (0.3387 => 0.3495, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9765 => 1.0073, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0665 => 2.1306, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.5415 => 1.5891, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.4289 => 0.4421, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.05% (0.3603 => 0.3713, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.04% (0.3650 => 0.3761, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.03% (1.1642 => 1.1995, std. dev.: 0.0134) MultiSource/Applications/d/make_dparser: 2.95% (3.3354 => 3.4338, std. dev.: 0.0103) MultiSource/Applications/treecc/treecc: 2.94% (2.0273 => 2.0869, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.90% (1.1861 => 1.2205, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4620 => 0.4748, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.76% (3.8723 => 3.9792, std. dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 2.71% (5.7591 => 5.9150, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.4048 => 0.4157, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.6450 => 0.6621, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3174, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5981 => 0.6120, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.26% (17.1811 => 17.5692, std. dev.: 0.0260) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.3668 => 14.6870, std. dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.19% (1.4186 => 1.4497, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 2.18% (2.2969 => 2.3470, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.8921 => 0.9109, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.57% (0.7115 => 0.7227, std. dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.41% (1.1840 => 1.2007, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.34% (1.0722 => 1.0866, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (4.2280 => 4.4413, std. dev.: 0.0132) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7585, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 2.14% (26.0924 => 26.6495, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2135, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3347, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2369, std. dev.: 0.0332) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.12% (1.5086 => 1.5255, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1242, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.43% (5.2763 => 3.1430, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.46% (5.3855 => 3.6911, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (5.3526 => 3.6894, std. dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0347, std. dev.: 0.0618) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5447, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -11.97% (22.1758 => 19.5206, std. dev.: 0.0378) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -11.07% (1.2373 => 1.1003, std. dev.: 0.0420) SingleSource/Benchmarks/Misc/mandel-2: -9.00% (1.5373 => 1.3990, std. dev.: 0.0252) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5578, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.81% (5.0483 => 4.8053, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.56% (1.5835 => 1.5113, std. dev.: 0.0019) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4703, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4335, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3299, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -2.57% (10.2830 => 10.0186, std. dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.30% (8.1563 => 7.9686, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5133, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3450, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 01:19:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 03:19:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817081959.0973E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2972?compare_to=2969&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2972, Order: 162086, Start Time: 2012-08-17 07:04:26, End Time: 2012-08-17 08:20:44 To: 2969, Order: 162080, Start Time: 2012-08-17 05:21:23, End Time: 2012-08-17 06:35:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (728 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.15% (1.3020 => 1.3170, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.10% (2.0176 => 2.3021, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.75% (0.5818 => 0.6385, std. dev.: 0.0090) SingleSource/UnitTests/ObjC++/Hello: 9.52% (0.5748 => 0.6295, std. dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference: 8.68% (0.7061 => 0.7674, std. dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.24% (0.3578 => 0.3873, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-2: 8.14% (0.3601 => 0.3894, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/synchronized: 8.08% (0.3663 => 0.3959, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-4: 8.01% (0.3646 => 0.3938, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.95% (0.3650 => 0.3940, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: 7.94% (0.3789 => 0.4090, std. dev.: 0.0063) MultiSource/Applications/hbd/hbd: 7.90% (1.3693 => 1.4775, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-3: 7.84% (0.3623 => 0.3907, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std. dev.: 0.0089) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.7710 => 0.8280, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.08% (0.2782 => 0.2979, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 7.00% (0.7038 => 0.7531, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.80% (3.9660 => 4.2357, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.32% (0.3022 => 0.3213, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3899 => 0.4144, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.2937 => 0.3121, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2628 => 0.2792, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2596 => 0.2757, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.97% (0.2966 => 0.3143, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.93% (0.3489 => 0.3696, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.93% (1.9828 => 2.1003, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.82% (0.3453 => 0.3654, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.78% (0.3580 => 0.3787, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.69% (1.2193 => 1.2887, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.67% (0.9199 => 0.9721, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.6959 => 0.7343, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.42% (0.3246 => 0.3422, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.30% (0.4016 => 0.4229, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.08% (1.4563 => 1.5303, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.00% (13.8202 => 14.5118, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.81% (1.3813 => 1.4478, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.71% (1.3819 => 1.4470, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5549, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.65% (1.1364 => 1.1892, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.51% (0.8310 => 0.8685, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.45% (1.2292 => 1.2839, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.3245 => 1.3828, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.28% (1.1061 => 1.1534, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 4.27% (1.0594 => 1.1046, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.24% (0.7506 => 0.7824, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.22% (3.8646 => 4.0276, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.05% (0.7460 => 0.7762, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.99% (0.3755 => 0.3905, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.99% (0.4791 => 0.4982, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.95% (1.9270 => 2.0031, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.86% (2.1791 => 2.2632, std. dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 3.83% (16.6129 => 17.2485, std. dev.: 0.0216) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 3.71% (0.2995 => 0.3106, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.66% (13.2842 => 13.7698, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.64% (0.6283 => 0.6512, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (4.9865 => 5.1644, std. dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.55% (4.3801 => 4.5357, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.52% (3.6692 => 3.7982, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (4.4433 => 4.5985, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.33% (0.6135 => 0.6339, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.06% (3.1889 => 3.2864, std. dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.8698 => 0.8962, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.86% (1.1333 => 1.1657, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.75% (8.4961 => 8.7298, std. dev.: 0.0206) MultiSource/Applications/sqlite3/sqlite3: 2.69% (16.2614 => 16.6990, std. dev.: 0.0172) MultiSource/Benchmarks/McCat/05-eks/eks: 2.60% (0.4113 => 0.4220, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.55% (14.8535 => 15.2323, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 2.52% (6.5754 => 6.7411, std. dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 2.40% (14.5298 => 14.8781, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.24% (3.2742 => 3.3474, std. dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.08% (1.5188 => 1.5504, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.05% (4.6629 => 4.7584, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.1007 => 2.1399, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6250 => 0.6363, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.32% (1.0313 => 1.0449, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0295) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std. dev.: 0.0350) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.93% (1.2998 => 1.4289, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.30% (0.2093 => 0.2204, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7436, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8184, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5974, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.13% (10.7476 => 10.9764, std. dev.: 0.0455) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6765, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5283, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1601, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.43% (0.8818 => 0.8692, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.29% (1.2308 => 1.0919, std. dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0249) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5115, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (1.3780 => 1.3076, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.63% (8.8259 => 8.5939, std. dev.: 0.0147) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9619, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2423, std. dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2038, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (20.3410 => 20.0380, std. dev.: 0.0370) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3727, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4764, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.07% (6.6320 => 6.5611, std. dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 02:11:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 04:11:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817091152.D9DEA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2973?compare_to=2971&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2973, Order: 162089, Start Time: 2012-08-17 07:53:30, End Time: 2012-08-17 09:12:37 To: 2971, Order: 162083, Start Time: 2012-08-17 06:02:55, End Time: 2012-08-17 07:24:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (733 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.79% (10.3673 => 13.5590, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3473 => 0.3864, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.15% (0.3497 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3516 => 0.3904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.95% (1.1194 => 1.2420, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.19% (0.3927 => 0.4327, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.88% (2.2022 => 2.3538, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.76% (1.7609 => 1.8799, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 5.94% (0.6030 => 0.6388, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.86% (0.5925 => 0.6272, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.4615 => 0.4860, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.3177 => 0.3343, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 4.98% (0.7433 => 0.7803, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7326 => 0.7684, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (0.8172 => 0.8527, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.26% (7.0540 => 7.3546, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/oourafft: 4.17% (0.3282 => 0.3419, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.15% (10.4361 => 10.8696, std. dev.: 0.0108) MultiSource/Benchmarks/mafft/pairlocalalign: 4.12% (9.4845 => 9.8757, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.4879 => 0.5076, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.99% (0.5569 => 0.5791, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.94% (4.2646 => 4.4328, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5860 => 0.6086, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.9449 => 5.1342, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.76% (5.0018 => 5.1900, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2891 => 0.2999, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.4103 => 0.4253, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (0.3121 => 0.3235, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.56% (8.1363 => 8.4257, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.49% (1.3050 => 1.3506, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 3.44% (0.2905 => 0.3005, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.37% (0.3826 => 0.3955, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.37% (0.7835 => 0.8099, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 3.36% (0.3098 => 0.3202, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.33% (0.3422 => 0.3536, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.25% (0.3603 => 0.3720, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.4064 => 0.4193, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.16% (1.5603 => 1.6096, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.16% (0.3865 => 0.3987, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.12% (0.9765 => 1.0070, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0665 => 2.1306, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.06% (0.5105 => 0.5261, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.00% (0.4636 => 0.4775, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.99% (0.3441 => 0.3544, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.99% (0.3650 => 0.3759, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (1.5415 => 1.5875, std. dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.91% (1.1642 => 1.1981, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.90% (2.0273 => 2.0860, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.86% (0.4203 => 0.4323, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.85% (3.3354 => 3.4305, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.85% (0.6456 => 0.6640, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.81% (5.7591 => 5.9208, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 2.80% (0.3684 => 0.3787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.68% (0.6450 => 0.6623, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 2.57% (0.4048 => 0.4152, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4620 => 0.4738, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.52% (3.8723 => 3.9700, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3165, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.47% (0.6675 => 0.6840, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.34% (1.5859 => 1.6230, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.5020 => 0.5135, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5741, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.3668 => 14.6870, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.22% (0.5981 => 0.6114, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8921 => 0.9117, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.19% (1.4186 => 1.4496, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 2.17% (2.2969 => 2.3468, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (2.2024 => 2.2423, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.42% (1.1840 => 1.2008, std. dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.33% (1.0722 => 1.0865, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (4.2280 => 4.4538, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7504, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 2.04% (26.0924 => 26.6240, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash2: 1.68% (3.1578 => 3.2109, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3341, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2459, std. dev.: 0.0402) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.16% (1.5086 => 1.5261, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6839, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1239, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.55% (0.8651 => 0.1683, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.62% (5.2763 => 3.1332, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.81% (5.3855 => 3.6726, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.41% (5.3526 => 3.6711, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -15.20% (54.1659 => 45.9341, std. dev.: 0.0379) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.82% (2.9384 => 2.5323, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.13% (22.1758 => 19.4867, std. dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2373 => 1.1018, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -7.81% (1.5373 => 1.4173, std. dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5577, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4784, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4231, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.80% (1.3677 => 1.3294, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0050, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.30% (8.1563 => 7.9686, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3349, std. dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 03:02:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 05:02:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817100213.9FA8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2974?compare_to=2972&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2974, Order: 162089, Start Time: 2012-08-17 08:48:21, End Time: 2012-08-17 10:02:18 To: 2972, Order: 162086, Start Time: 2012-08-17 07:04:26, End Time: 2012-08-17 08:20:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.34% (1.3170 => 1.2993, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.74% (2.0176 => 2.2948, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.82% (0.5818 => 0.6331, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.72% (0.5748 => 0.6249, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.95% (0.7061 => 0.7622, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3578 => 0.3857, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.62% (0.3646 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3601 => 0.3875, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.59% (0.3650 => 0.3927, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.52% (0.3789 => 0.4074, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.48% (0.3663 => 0.3937, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.36% (1.3693 => 1.4701, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 7.19% (0.4003 => 0.4291, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.7710 => 0.8245, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.79% (0.7038 => 0.7516, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (3.9660 => 4.2347, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.40% (0.5265 => 0.5602, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4328 => 0.4600, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.28% (0.2596 => 0.2759, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.00% (0.2782 => 0.2949, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.90% (0.2781 => 0.2945, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4062 => 0.4298, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.9199 => 0.9727, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.56% (1.2193 => 1.2871, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.54% (0.3899 => 0.4115, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.6959 => 0.7344, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.42% (0.2655 => 0.2799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.27% (0.3246 => 0.3417, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.27% (0.2127 => 0.2239, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.25% (1.9828 => 2.0868, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.23% (0.2966 => 0.3121, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.20% (0.5577 => 0.5867, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.16% (0.3485 => 0.3665, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.15% (0.3107 => 0.3267, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3149 => 0.3309, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.94% (13.8202 => 14.5036, std. dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5263, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.75% (1.3813 => 1.4469, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.68% (1.3819 => 1.4466, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.63% (0.2914 => 0.3049, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.2925 => 0.3060, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.61% (1.1364 => 1.1888, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.56% (7.2180 => 7.5469, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.54% (0.5637 => 0.5893, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.53% (0.4016 => 0.4198, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.37% (0.8310 => 0.8673, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (3.8646 => 4.0316, std. dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.24% (1.1061 => 1.1530, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.21% (0.3868 => 0.4031, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2809, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3802, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.08% (0.7506 => 0.7812, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (1.0594 => 1.1022, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 3.85% (1.9270 => 2.0011, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.4791 => 0.4975, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.70% (16.6129 => 17.2273, std. dev.: 0.0193) MultiSource/Applications/siod/siod: 3.65% (2.1791 => 2.2587, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2995 => 0.3102, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (13.2842 => 13.7546, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.44% (4.4433 => 4.5960, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (4.3801 => 4.5297, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.34% (3.6692 => 3.7919, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.25% (4.9865 => 5.1486, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.10% (0.6135 => 0.6325, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.94% (3.1889 => 3.2826, std. dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.1333 => 1.1647, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7080, std. dev.: 0.0213) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.64% (0.8698 => 0.8928, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 2.61% (8.4961 => 8.7176, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 2.46% (0.4113 => 0.4214, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2050, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (6.5754 => 6.7310, std. dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 2.31% (14.5298 => 14.8658, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (1.5188 => 1.5500, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.05% (3.2742 => 3.3413, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.95% (4.6629 => 4.7540, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.1007 => 2.1374, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.33% (1.0313 => 1.0450, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5182, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.43% (1.8175 => 2.2796, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 9.65% (1.2998 => 1.4252, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7446, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8170, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3831, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5945, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.19% (10.7476 => 10.9826, std. dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5928 => 4.6730, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3256, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.53% (1.4298 => 1.4517, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5089 => 1.5278, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1856, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6469 => 3.6851, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1232, std. dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.53% (0.8818 => 0.8683, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.17% (1.2308 => 1.0933, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.18% (1.3780 => 1.3066, std. dev.: 0.0084) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.54% (1.1560 => 1.1035, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6009, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2190, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9613, std. dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2035, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3672, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.11% (5.5401 => 5.4784, std. dev.: 0.0167) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.10% (20.3410 => 20.1181, std. dev.: 0.0146) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5638, std. dev.: 0.0131) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 7.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 03:29:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 05:29:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120817102939.E46A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2975?compare_to=2970&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2975, Order: 162088, Start Time: 2012-08-17 07:46:54, End Time: 2012-08-17 10:30:26 To: 2970, Order: 162076, Start Time: 2012-08-17 04:32:16, End Time: 2012-08-17 07:18:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (779 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/d/make_dparser: 1.13% (1.1229 => 1.1356, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.22% (0.3446 => 0.3867, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.17% (0.3442 => 0.3861, std. dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-4: 12.12% (0.3465 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.07% (0.3488 => 0.3909, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3469 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3460 => 0.3874, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.90% (0.3496 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.67% (0.3650 => 0.4076, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.50% (0.3643 => 0.4062, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3724 => 0.4144, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 6.21% (0.5826 => 0.6188, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (0.5026 => 0.5338, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (1.6211 => 1.7205, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 6.01% (0.5889 => 0.6243, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.84% (1.5932 => 1.6863, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.79% (3.5627 => 3.7689, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.79% (1.3152 => 1.3913, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.1968 => 0.2080, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.69% (0.4994 => 0.5278, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.58% (0.4029 => 0.4254, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.37% (0.4361 => 0.4595, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.33% (1.0781 => 1.1356, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (0.5000 => 0.5257, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.5900 => 0.6201, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 4.94% (4.2109 => 4.4189, std. dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference: 4.64% (0.7171 => 0.7504, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 4.49% (5.5417 => 5.7903, std. dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (2.7292 => 2.8499, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.2866 => 0.2992, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.05% (0.2566 => 0.2670, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (0.4658 => 0.4843, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (1.9694 => 2.0472, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.90% (2.1013 => 2.1833, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.83% (0.3890 => 0.4039, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 3.79% (1.8794 => 1.9507, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 3.75% (0.2691 => 0.2792, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 3.72% (4.6177 => 4.7897, std. dev.: 0.0110) MultiSource/Applications/siod/siod: 3.72% (0.6634 => 0.6881, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 3.63% (2.1653 => 2.2440, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.61% (4.4195 => 4.5790, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (0.3195 => 0.3310, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.58% (0.2875 => 0.2978, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (1.9966 => 2.0675, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3258 => 0.3372, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.46% (0.9909 => 1.0252, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.3903 => 0.4038, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.45% (0.4139 => 0.4282, std. dev.: 0.0039) MultiSource/Applications/hbd/hbd: 3.41% (0.9697 => 1.0028, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (2.0673 => 2.1354, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.29% (0.7875 => 0.8134, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.3362 => 0.3472, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.24% (1.4269 => 1.4731, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.23% (0.3625 => 0.3742, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.21% (0.3271 => 0.3376, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 3.09% (23.5202 => 24.2473, std. dev.: 0.0211) MultiSource/Applications/minisat/minisat: 3.09% (0.3336 => 0.3439, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 3.01% (0.5546 => 0.5713, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.99% (0.3845 => 0.3960, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3477 => 0.3578, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4146 => 0.4266, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.78% (0.4251 => 0.4369, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.6435 => 0.6593, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.32% (2.0346 => 2.0818, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.5012 => 0.5123, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.83% (0.7426 => 0.7562, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (11.6398 => 11.7816, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.04% (0.2122 => 0.2335, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6739, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1693, std. dev.: 0.1469) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6336, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.21% (105.3826 => 107.7107, std. dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2128, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (41.7953 => 42.6388, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5912, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.70% (50.0626 => 50.9135, std. dev.: 0.0154) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2908, std. dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3065, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.59% (2.4764 => 2.3875, std. dev.: 0.0260) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5386, std. dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8054, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.33% (2.1113 => 1.9566, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7960, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0046) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.93% (3.6262 => 3.5199, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8438, std. dev.: 0.0284) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5734, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9579, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4967, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 03:58:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 05:58:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817105812.6398F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2976?compare_to=2973&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2976, Order: 162090, Start Time: 2012-08-17 09:40:13, End Time: 2012-08-17 10:58:57 To: 2973, Order: 162089, Start Time: 2012-08-17 07:53:30, End Time: 2012-08-17 09:12:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (107 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (729 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.86% (10.3673 => 13.5666, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 11.43% (0.3473 => 0.3870, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.02% (1.1194 => 1.2428, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.89% (2.2022 => 2.3539, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.77% (1.7609 => 1.8801, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 5.85% (0.6030 => 0.6383, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.77% (0.5925 => 0.6267, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7433 => 0.7825, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.20% (0.4615 => 0.4855, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 4.86% (0.7326 => 0.7682, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 4.24% (0.3282 => 0.3421, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.23% (0.2554 => 0.2662, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.17% (7.0540 => 7.3480, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.17% (10.4361 => 10.8709, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.8172 => 0.8510, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.02% (0.5569 => 0.5793, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.00% (0.4879 => 0.5074, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (9.4845 => 9.8619, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (5.0018 => 5.1991, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.88% (4.2646 => 4.4301, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5860 => 0.6084, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.9449 => 5.1328, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: 3.62% (0.3423 => 0.3547, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.61% (8.1363 => 8.4302, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.60% (0.2891 => 0.2995, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.49% (0.3098 => 0.3206, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.48% (0.7835 => 0.8108, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.3050 => 1.3497, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.29% (0.3826 => 0.3952, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.14% (0.9765 => 1.0072, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.13% (0.3865 => 0.3986, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.4064 => 0.4191, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.4289 => 0.4422, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.09% (1.5603 => 1.6085, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3441 => 0.3547, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.08% (2.0665 => 2.1301, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.06% (0.5105 => 0.5261, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.04% (0.3650 => 0.3761, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.03% (1.1642 => 1.1995, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.97% (1.5415 => 1.5873, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.96% (3.3354 => 3.4341, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2209, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3684 => 0.3790, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.81% (2.0273 => 2.0842, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 2.80% (0.6456 => 0.6637, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4620 => 0.4748, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.77% (5.7591 => 5.9184, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.74% (0.4203 => 0.4318, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.69% (1.2842 => 1.3188, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6450 => 0.6617, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.57% (3.8723 => 3.9717, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.55% (0.6675 => 0.6845, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5859 => 1.6252, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.47% (0.4048 => 0.4148, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (14.3668 => 14.6955, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5738, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.5020 => 0.5134, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.27% (2.2969 => 2.3490, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.4186 => 1.4499, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.19% (0.5981 => 0.6112, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8921 => 0.9110, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (2.2024 => 2.2422, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.46% (0.7115 => 0.7219, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.41% (1.0722 => 1.0873, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.28% (1.1840 => 1.1992, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.11% (4.2280 => 4.4441, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7493, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.87% (26.0924 => 26.5798, std. dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2123, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8233, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.54% (3.2827 => 3.3331, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2407, std. dev.: 0.0272) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5773, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6819, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1239, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.56% (0.8651 => 0.1682, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.65% (5.2763 => 3.1313, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.86% (5.3855 => 3.6699, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.54% (5.3526 => 3.6642, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -15.13% (54.1659 => 45.9728, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.78% (2.9384 => 2.5334, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -12.19% (22.1758 => 19.4734, std. dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.2373 => 1.0974, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -7.29% (1.5373 => 1.4252, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5578, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.36% (1.5835 => 1.5144, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4715, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4284, std. dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.58% (10.2830 => 10.0173, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.31% (8.1563 => 7.9676, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0055) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3484, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.17% (1.8329 => 1.8114, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std. dev.: 0.0068) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 04:43:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 06:43:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817114345.662712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2977?compare_to=2974&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2977, Order: 162090, Start Time: 2012-08-17 10:30:54, End Time: 2012-08-17 11:44:33 To: 2974, Order: 162089, Start Time: 2012-08-17 08:48:21, End Time: 2012-08-17 10:02:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (139 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.69% (2.0176 => 2.2939, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 8.89% (0.5818 => 0.6335, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.70% (0.5748 => 0.6248, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.83% (0.7061 => 0.7614, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.80% (0.3578 => 0.3857, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.57% (0.3646 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.55% (0.3601 => 0.3873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.50% (0.3789 => 0.4073, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.43% (0.3663 => 0.3935, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.40% (0.3623 => 0.3891, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.32% (1.3693 => 1.4696, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.94% (0.7710 => 0.8245, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (3.9660 => 4.2310, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 6.65% (0.7038 => 0.7506, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.38% (0.5265 => 0.5601, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.28% (0.2596 => 0.2759, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.26% (0.4328 => 0.4599, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.11% (0.2782 => 0.2952, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.83% (0.4062 => 0.4299, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.72% (0.1819 => 0.1923, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.66% (0.9199 => 0.9720, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.61% (0.2690 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.2655 => 0.2804, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.60% (0.6959 => 0.7349, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (1.2193 => 1.2876, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3022 => 0.3190, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4379 => 0.4618, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2761 => 0.2909, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.33% (0.3246 => 0.3419, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.2966 => 0.3124, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.27% (0.3489 => 0.3673, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.22% (0.3485 => 0.3667, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.21% (0.3107 => 0.3269, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.20% (1.9828 => 2.0859, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 5.12% (0.2988 => 0.3141, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.11% (0.5577 => 0.5862, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.00% (1.4563 => 1.5291, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.94% (0.4390 => 0.4607, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 4.90% (13.8202 => 14.4979, std. dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/sieve: 4.84% (0.3453 => 0.3620, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (1.3819 => 1.4475, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.71% (1.1364 => 1.1899, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.66% (0.4016 => 0.4203, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.63% (1.3813 => 1.4453, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.52% (7.2180 => 7.5442, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2243 => 0.2344, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.30% (3.8646 => 4.0307, std. dev.: 0.0091) MultiSource/Applications/Burg/burg: 4.28% (1.1061 => 1.1534, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.26% (0.7506 => 0.7826, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.24% (0.3868 => 0.4032, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.7460 => 0.7773, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.17% (1.3245 => 1.3797, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.0594 => 1.1028, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.99% (1.2292 => 1.2782, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 3.94% (0.2945 => 0.3061, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.94% (1.9270 => 2.0029, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.86% (0.4791 => 0.4976, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.71% (2.1791 => 2.2600, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 3.67% (16.6129 => 17.2229, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (13.2842 => 13.7574, std. dev.: 0.0171) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3220 => 0.3332, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (3.6692 => 3.7957, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.43% (4.4433 => 4.5955, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.42% (4.3801 => 4.5300, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6283 => 0.6493, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1465, std. dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (0.6135 => 0.6324, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.86% (3.1889 => 3.2802, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.1333 => 1.1640, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (0.8698 => 0.8933, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.64% (16.2614 => 16.6912, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 2.55% (8.4961 => 8.7130, std. dev.: 0.0156) MultiSource/Applications/JM/ldecod/ldecod: 2.38% (6.5754 => 6.7319, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8737, std. dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 2.33% (14.8535 => 15.2001, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.12% (3.2742 => 3.3435, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.04% (1.5188 => 1.5498, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 1.95% (4.6629 => 4.7536, std. dev.: 0.0132) MultiSource/Applications/lemon/lemon: 1.37% (1.0313 => 1.0454, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std. dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 7.76% (1.2998 => 1.4006, std. dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7444, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.81% (1.7688 => 1.8185, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5986, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.17% (10.7476 => 10.9810, std. dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 1.78% (4.5928 => 4.6747, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3265, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0084) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5089 => 1.5278, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5740, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.15% (0.4657 => 0.3998, std. dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.5627 => 21.1150, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.64% (0.8818 => 0.8673, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.71% (1.2308 => 1.0990, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.20% (1.9290 => 1.8094, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3181, std. dev.: 0.0128) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5968, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: -2.46% (1.9762 => 1.9276, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2172, std. dev.: 0.0121) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9639, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2044, std. dev.: 0.0247) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3637, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.21% (5.5401 => 5.4732, std. dev.: 0.0165) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2361, std. dev.: 0.0365) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 05:44:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 07:44:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817124430.EAF612A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/2978?compare_to=2976&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2978, Order: 162093, Start Time: 2012-08-17 11:26:28, End Time: 2012-08-17 12:45:18 To: 2976, Order: 162090, Start Time: 2012-08-17 09:40:13, End Time: 2012-08-17 10:58:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (103 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (735 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.19% (10.3673 => 13.6011, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.49% (0.3516 => 0.3920, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3543 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.35% (0.3497 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (1.1194 => 1.2437, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.58% (0.3886 => 0.4297, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.45% (0.1432 => 0.1553, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.03% (2.2022 => 2.3571, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.77% (1.7609 => 1.8801, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0080) SingleSource/UnitTests/ObjC++/Hello: 6.01% (0.5925 => 0.6281, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.16% (0.3177 => 0.3341, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.4615 => 0.4853, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.01% (0.7326 => 0.7693, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.7433 => 0.7795, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.24% (0.3282 => 0.3421, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.22% (10.4361 => 10.8768, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.15% (7.0540 => 7.3468, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.8172 => 0.8510, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.06% (0.4879 => 0.5077, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (9.4845 => 9.8662, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.88% (4.2646 => 4.4300, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.9449 => 5.1349, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (5.0018 => 5.1938, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5860 => 0.6081, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.77% (0.5569 => 0.5779, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.60% (0.2891 => 0.2995, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.50% (8.1363 => 8.4211, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.44% (0.4103 => 0.4244, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.43% (0.3180 => 0.3289, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.40% (1.3050 => 1.3494, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9765 => 1.0073, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3232 => 0.3333, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.10% (0.5105 => 0.5263, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.02% (1.1642 => 1.1994, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.02% (0.3441 => 0.3545, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 3.01% (1.5603 => 1.6073, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.94% (1.5415 => 1.5868, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.8067 => 0.8300, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3826 => 0.3935, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3865 => 0.3975, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.85% (3.3354 => 3.4303, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 2.84% (0.4289 => 0.4411, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.81% (1.1861 => 1.2194, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.79% (2.0273 => 2.0838, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.77% (5.7591 => 5.9188, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.76% (2.0665 => 2.1236, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (0.4064 => 0.4175, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.6675 => 0.6853, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.62% (0.4620 => 0.4741, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.60% (0.6450 => 0.6618, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 2.50% (3.8723 => 3.9693, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.5859 => 1.6249, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.33% (1.2842 => 1.3141, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.23% (17.1811 => 17.5647, std. dev.: 0.0236) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (14.3668 => 14.6828, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.20% (1.4186 => 1.4498, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5981 => 0.6110, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.15% (2.2969 => 2.3463, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.13% (0.5020 => 0.5127, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.2024 => 2.2442, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.63% (0.7115 => 0.7231, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.42% (1.1840 => 1.2008, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.31% (1.0722 => 1.0862, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (4.2280 => 4.4420, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.08% (26.0924 => 26.6360, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2113, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3350, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 1.55% (11.6436 => 11.8236, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2478, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5086 => 1.5292, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5757, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.00% (2.6546 => 2.6812, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1239, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.66% (5.2763 => 3.1308, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.79% (5.3855 => 3.6737, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.46% (5.3526 => 3.6687, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -15.11% (54.1659 => 45.9829, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.82% (2.9384 => 2.5323, std. dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -12.16% (22.1758 => 19.4783, std. dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1061, std. dev.: 0.0293) SingleSource/Benchmarks/Misc/mandel-2: -8.25% (1.5373 => 1.4104, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.28% (2.7294 => 2.5579, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std. dev.: 0.0006) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4640, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.6802 => 8.4319, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9995, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9573, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.62% (12.5348 => 12.3318, std. dev.: 0.0129) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8126, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 06:24:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 08:24:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817132454.74ABE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2979?compare_to=2977&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2979, Order: 162094, Start Time: 2012-08-17 12:11:57, End Time: 2012-08-17 13:25:41 To: 2977, Order: 162090, Start Time: 2012-08-17 10:30:54, End Time: 2012-08-17 11:44:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (141 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.28% (2.0176 => 2.3058, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 9.26% (0.5748 => 0.6280, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.21% (0.5818 => 0.6354, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7061 => 0.7647, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 8.22% (0.3578 => 0.3872, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.03% (0.3601 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.87% (0.3646 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3650 => 0.3937, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 7.77% (0.3914 => 0.4218, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.36% (1.3693 => 1.4701, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.10% (0.7038 => 0.7538, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.7710 => 0.8246, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.95% (3.9660 => 4.2415, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4328 => 0.4613, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.39% (0.2596 => 0.2762, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 6.36% (0.2781 => 0.2958, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.11% (0.4062 => 0.4310, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.86% (0.9199 => 0.9738, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.83% (0.1819 => 0.1925, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (1.2193 => 1.2898, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.65% (0.3489 => 0.3686, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (0.4379 => 0.4623, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2765 => 0.2919, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.54% (0.2655 => 0.2802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.52% (0.2628 => 0.2773, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (1.9828 => 2.0912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.45% (0.3580 => 0.3775, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.43% (0.2761 => 0.2911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3107 => 0.3275, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.3149 => 0.3318, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.36% (0.3246 => 0.3420, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.18% (1.4563 => 1.5317, std. dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 5.12% (13.8202 => 14.5274, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.99% (0.4390 => 0.4609, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.91% (1.1364 => 1.1922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.89% (0.3293 => 0.3454, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.2925 => 0.3063, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.5637 => 0.5901, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 4.67% (0.3534 => 0.3699, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.55% (0.8310 => 0.8688, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.3819 => 1.4447, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.47% (7.2180 => 7.5409, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.3813 => 1.4429, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.43% (1.0594 => 1.1063, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (3.8646 => 4.0341, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.36% (1.1061 => 1.1543, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.34% (1.3245 => 1.3820, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.22% (0.4791 => 0.4993, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.19% (1.9270 => 2.0077, std. dev.: 0.0067) MultiSource/Applications/spiff/spiff: 4.17% (0.7506 => 0.7819, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.10% (1.2292 => 1.2796, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.09% (0.7460 => 0.7765, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.01% (16.6129 => 17.2797, std. dev.: 0.0148) MultiSource/Applications/siod/siod: 3.96% (2.1791 => 2.2653, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.6283 => 0.6521, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 3.63% (0.3220 => 0.3337, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.63% (4.3801 => 4.5390, std. dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (4.4433 => 4.6044, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.62% (13.2842 => 13.7651, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (4.9865 => 5.1649, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (3.6692 => 3.8001, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3755 => 0.3888, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.47% (0.6135 => 0.6348, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.01% (3.1889 => 3.2850, std. dev.: 0.0171) MultiSource/Applications/sqlite3/sqlite3: 2.98% (16.2614 => 16.7461, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.97% (0.8698 => 0.8956, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.88% (1.1333 => 1.1659, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 2.68% (8.4961 => 8.7241, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2409, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.5754 => 6.7424, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.50% (3.2742 => 3.3560, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.45% (14.5298 => 14.8854, std. dev.: 0.0092) MultiSource/Benchmarks/McCat/05-eks/eks: 2.43% (0.4113 => 0.4213, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5188 => 1.5533, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.01% (4.6629 => 4.7568, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.1007 => 2.1405, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.13% (0.9108 => 0.9211, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.01% (3.7467 => 3.7847, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5129, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2680, std. dev.: 0.0499) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.52% (1.2998 => 1.4236, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7411, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8174, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3859, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5969, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.23% (10.7476 => 10.9874, std. dev.: 0.0280) MultiSource/Applications/sqlite3/sqlite3: 1.77% (4.5928 => 4.6743, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1834, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1692, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.6576 => 0.6453, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.30% (0.8818 => 0.8703, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1031, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.17% (1.3780 => 1.3206, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0219, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6066, std. dev.: 0.0149) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9613, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2266, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3305 => 7.2107, std. dev.: 0.0172) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7918, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3642, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0139) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4766, std. dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (20.3410 => 20.1216, std. dev.: 0.0161) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2384, std. dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 06:40:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 08:40:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120817134037.01A1B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2980?compare_to=2975&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2980, Order: 162093, Start Time: 2012-08-17 10:57:54, End Time: 2012-08-17 13:41:24 To: 2975, Order: 162088, Start Time: 2012-08-17 07:46:54, End Time: 2012-08-17 10:30:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (83 on baseline) Performance Improvements: 2 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (794 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 6.12% (0.3984 => 0.4228, std. dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.00% (0.5338 => 0.5231, std. dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.09% (2.8499 => 2.8187, std. dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 11.50% (0.3792 => 0.4228, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3446 => 0.3836, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 11.31% (0.3465 => 0.3857, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3488 => 0.3879, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.10% (0.3460 => 0.3844, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.10% (0.3442 => 0.3824, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3496 => 0.3883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.07% (0.3469 => 0.3853, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.77% (0.3650 => 0.4043, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3643 => 0.4032, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3724 => 0.4112, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.23% (0.1620 => 0.1721, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 5.94% (0.5826 => 0.6172, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.84% (1.5932 => 1.6863, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.77% (0.5889 => 0.6229, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (1.6211 => 1.7039, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.05% (1.3152 => 1.3816, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.99% (0.4029 => 0.4230, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.97% (0.4994 => 0.5242, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.96% (3.5627 => 3.7393, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.72% (0.4361 => 0.4567, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.66% (0.5900 => 0.6175, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.2866 => 0.2996, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.45% (0.7171 => 0.7490, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.40% (0.3930 => 0.4103, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (0.5000 => 0.5220, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.36% (1.0781 => 1.1251, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 4.34% (4.2109 => 4.3937, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.33% (0.2566 => 0.2677, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.08% (0.5026 => 0.5231, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 3.86% (5.5417 => 5.7555, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.40% (1.9694 => 2.0363, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.4139 => 0.4277, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.28% (2.7292 => 2.8187, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 3.26% (4.6177 => 4.7683, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.21% (0.3890 => 0.4015, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (1.8794 => 1.9396, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.11% (0.7875 => 0.8120, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.11% (0.9909 => 1.0217, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.08% (1.9966 => 2.0581, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (2.1013 => 2.1656, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (2.1653 => 2.2305, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.3625 => 0.3733, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.3903 => 0.4018, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4146 => 0.4268, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 2.94% (0.6634 => 0.6829, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.89% (2.0673 => 2.1271, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.88% (1.4269 => 1.4680, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (4.4195 => 4.5458, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 2.72% (23.5202 => 24.1592, std. dev.: 0.0100) MultiSource/Applications/hbd/hbd: 2.60% (0.9697 => 0.9949, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4251 => 0.4353, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.29% (0.5546 => 0.5673, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.19% (0.6435 => 0.6576, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.58% (2.0346 => 2.0668, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (0.7426 => 0.7529, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2122 => 0.2275, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6669, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8926, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6234, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.23% (105.3826 => 107.7310, std. dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2134, std. dev.: 0.0377) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.96% (41.7953 => 42.6129, std. dev.: 0.0189) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.68% (50.0626 => 50.9029, std. dev.: 0.0172) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std. dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3081, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.26% (7.1849 => 7.2754, std. dev.: 0.0095) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.15% (2.4764 => 2.3984, std. dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: -1.05% (11.9555 => 11.8296, std. dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5823, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7871, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8102, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0059) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.45% (17.2379 => 16.8150, std. dev.: 0.0659) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9626, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 07:30:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 09:30:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817143041.C24E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2981?compare_to=2978&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2981, Order: 162097, Start Time: 2012-08-17 13:12:45, End Time: 2012-08-17 14:31:29 To: 2978, Order: 162093, Start Time: 2012-08-17 11:26:28, End Time: 2012-08-17 12:45:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (89 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (749 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.19% (13.6011 => 14.1711, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.00% (54.8268 => 56.4725, std. dev.: 0.0946) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.05% (81.0645 => 78.5950, std. dev.: 0.8608) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.69% (10.3673 => 14.1711, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.27% (1.1194 => 1.2456, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3561 => 0.3947, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.30% (2.2022 => 2.3629, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.50% (1.7609 => 1.8754, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.74% (0.6030 => 0.6376, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.70% (0.5925 => 0.6263, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.09% (0.4615 => 0.4850, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (0.7433 => 0.7794, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 4.64% (0.7326 => 0.7666, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.43% (7.0540 => 7.3664, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.14% (0.4879 => 0.5081, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.4361 => 10.8596, std. dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (9.4845 => 9.8673, std. dev.: 0.0139) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.96% (4.2646 => 4.4335, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.90% (0.8172 => 0.8491, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.81% (0.5569 => 0.5781, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.9449 => 5.1306, std. dev.: 0.0108) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (5.0018 => 5.1862, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9765 => 1.0111, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.40% (1.3050 => 1.3494, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.40% (0.7835 => 0.8101, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.1363 => 8.4109, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.5105 => 0.5273, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.27% (1.5415 => 1.5919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3441 => 0.3551, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.19% (0.3387 => 0.3495, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.03% (1.1642 => 1.1995, std. dev.: 0.0074) MultiSource/Applications/d/make_dparser: 3.00% (3.3354 => 3.4356, std. dev.: 0.0155) MultiSource/Applications/oggenc/oggenc: 2.98% (5.7591 => 5.9305, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2209, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.91% (2.0273 => 2.0862, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.8067 => 0.8301, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6450 => 0.6620, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.4103 => 0.4210, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.58% (0.6675 => 0.6847, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.55% (1.5603 => 1.6001, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5859 => 1.6254, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9679, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (14.3668 => 14.7089, std. dev.: 0.0292) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.6456 => 0.6608, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.35% (17.1811 => 17.5852, std. dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.32% (0.5981 => 0.6120, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8921 => 0.9128, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.30% (1.4186 => 1.4512, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.26% (0.4636 => 0.4741, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.25% (2.2969 => 2.3486, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.17% (0.5020 => 0.5129, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.2024 => 2.2473, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (2.0665 => 2.1058, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.67% (1.2842 => 1.3056, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.66% (1.1840 => 1.2036, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.64% (0.7115 => 0.7232, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.52% (1.0722 => 1.0885, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.83% (4.2280 => 4.4321, std. dev.: 0.0086) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7550, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 1.99% (26.0924 => 26.6117, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2126, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.63% (9.1159 => 9.2641, std. dev.: 0.0280) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3337, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.55% (11.6436 => 11.8235, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.34% (1.3045 => 1.3220, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.26% (1.5086 => 1.5276, std. dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1239, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.67% (5.2763 => 3.1303, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.67% (5.3855 => 3.6801, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.39% (5.3526 => 3.6725, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0049, std. dev.: 0.0320) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.89% (2.9384 => 2.5303, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -12.09% (22.1758 => 19.4939, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2373 => 1.1030, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.00% (1.5373 => 1.3836, std. dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5576, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0012) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4649, std. dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4117, std. dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0056, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (8.1563 => 7.9659, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5131, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3421, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4232, std. dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.19% (1.8329 => 1.8110, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 08:06:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 10:06:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817150614.E965A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2982?compare_to=2979&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2982, Order: 162097, Start Time: 2012-08-17 13:53:08, End Time: 2012-08-17 15:07:02 To: 2979, Order: 162094, Start Time: 2012-08-17 12:11:57, End Time: 2012-08-17 13:25:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (141 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.32% (55.3860 => 56.6706, std. dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.17% (78.8798 => 80.5911, std. dev.: 0.1535) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3048, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 9.26% (0.5748 => 0.6280, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.21% (0.5818 => 0.6354, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.95% (0.7061 => 0.7693, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.21% (0.3130 => 0.3387, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.16% (0.3578 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.97% (0.3601 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.95% (0.3646 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.95% (0.3650 => 0.3940, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 7.92% (0.3914 => 0.4224, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 7.84% (0.3789 => 0.4086, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.4003 => 0.4305, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.46% (0.3940 => 0.4234, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1986 => 0.2132, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.30% (1.3693 => 1.4692, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.95% (0.7038 => 0.7527, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2375, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.2781 => 0.2969, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.58% (0.7710 => 0.8217, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.39% (0.2596 => 0.2762, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4062 => 0.4312, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.84% (0.9199 => 0.9736, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.82% (0.3899 => 0.4126, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.81% (0.4390 => 0.4645, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.77% (1.2193 => 1.2897, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.71% (0.2628 => 0.2778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.6959 => 0.7350, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 5.62% (0.2937 => 0.3102, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.56% (0.2966 => 0.3131, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1819 => 0.1920, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.44% (1.9828 => 2.0906, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4379 => 0.4617, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.42% (0.3485 => 0.3674, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.27% (0.3246 => 0.3417, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.27% (0.2127 => 0.2239, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.26% (0.3192 => 0.3360, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.11% (0.5577 => 0.5862, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.06% (13.8202 => 14.5197, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: 4.98% (0.3293 => 0.3457, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.93% (1.4563 => 1.5281, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.3756 => 0.3937, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.81% (1.1364 => 1.1911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.66% (1.3819 => 1.4463, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.60% (0.2914 => 0.3048, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.60% (0.8310 => 0.8692, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (7.2180 => 7.5463, std. dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.2925 => 0.3057, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.3868 => 0.4042, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.39% (3.8646 => 4.0343, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.38% (0.4791 => 0.5001, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4416, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.33% (1.0594 => 1.1053, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.30% (1.1061 => 1.1537, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.15% (1.3245 => 1.3795, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.11% (1.2292 => 1.2797, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.7460 => 0.7761, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.02% (0.7506 => 0.7808, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.01% (1.9270 => 2.0043, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 3.91% (16.6129 => 17.2622, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 3.77% (2.1791 => 2.2613, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.72% (0.6283 => 0.6517, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (4.3801 => 4.5410, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (4.9865 => 5.1682, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (4.4433 => 4.6037, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (13.2842 => 13.7599, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.53% (3.6692 => 3.7988, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3220 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.06% (16.2614 => 16.7590, std. dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.06% (0.8698 => 0.8964, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 2.89% (3.1889 => 3.2810, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.80% (1.1333 => 1.1650, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.65% (8.4961 => 8.7213, std. dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.8535 => 15.2332, std. dev.: 0.0104) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.5754 => 6.7401, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 2.50% (0.4113 => 0.4216, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.43% (14.5298 => 14.8827, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.42% (3.2742 => 3.3535, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5523, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.02% (4.6629 => 4.7572, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.1007 => 2.1412, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.36% (1.0313 => 1.0453, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.02% (3.7467 => 3.7850, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 26.64% (1.8175 => 2.3017, std. dev.: 0.0357) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.93% (1.2998 => 1.4289, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7412, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8175, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6029, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.99% (10.7476 => 10.9614, std. dev.: 0.0192) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5928 => 4.6755, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3262, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9701, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5283, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.30% (0.4657 => 0.4084, std. dev.: 0.0078) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1626, std. dev.: 0.0160) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.79% (0.6576 => 0.6458, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.21% (0.8818 => 0.8711, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2308 => 1.0942, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5100, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.62% (0.4867 => 0.4691, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.42% (8.8259 => 8.6121, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9287, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.18% (6.3560 => 6.2174, std. dev.: 0.0139) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9626, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3305 => 7.2014, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9917, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.30% (9.9194 => 9.7909, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3668, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.08% (1.0310 => 1.0199, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.07% (5.5401 => 5.4810, std. dev.: 0.0168) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 09:16:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 11:16:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817161658.EE4532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2983?compare_to=2981&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2983, Order: 162098, Start Time: 2012-08-17 14:58:59, End Time: 2012-08-17 16:17:46 To: 2981, Order: 162097, Start Time: 2012-08-17 13:12:45, End Time: 2012-08-17 14:31:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (92 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (748 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (14.1711 => 14.4328, std. dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.05% (1.3836 => 1.4258, std. dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -4.24% (3.9530 => 3.7855, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/fbench: -1.61% (2.3435 => 2.3058, std. dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 39.21% (10.3673 => 14.4328, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (1.1194 => 1.2442, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.80% (0.1432 => 0.1558, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.19% (2.2022 => 2.3606, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.42% (1.7609 => 1.8740, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.86% (0.5925 => 0.6272, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.85% (0.6030 => 0.6383, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.07% (0.3177 => 0.3338, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.88% (0.7433 => 0.7796, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 4.80% (0.7326 => 0.7678, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.62% (0.2271 => 0.2376, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.51% (7.0540 => 7.3723, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 4.27% (0.3282 => 0.3422, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.8172 => 0.8519, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.09% (10.4361 => 10.8633, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.09% (4.2646 => 4.4391, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.01% (9.4845 => 9.8653, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5860 => 0.6093, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.96% (0.4879 => 0.5072, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (5.0018 => 5.1921, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (4.9449 => 5.1306, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.57% (0.5105 => 0.5287, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.51% (1.3050 => 1.3508, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.48% (8.1363 => 8.4192, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.46% (0.7835 => 0.8106, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.37% (0.3441 => 0.3557, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.35% (1.5415 => 1.5931, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.22% (0.9765 => 1.0079, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.8067 => 0.8314, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.04% (1.1642 => 1.1996, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (1.1861 => 1.2217, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.00% (5.7591 => 5.9318, std. dev.: 0.0071) MultiSource/Applications/d/make_dparser: 2.97% (3.3354 => 3.4345, std. dev.: 0.0111) MultiSource/Applications/treecc/treecc: 2.93% (2.0273 => 2.0866, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.75% (0.4103 => 0.4216, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.71% (0.6675 => 0.6856, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 2.68% (3.8723 => 3.9761, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.6450 => 0.6621, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.63% (1.5603 => 1.6013, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5859 => 1.6273, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4289 => 0.4399, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (14.3668 => 14.7329, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5981 => 0.6133, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.46% (17.1811 => 17.6030, std. dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8921 => 0.9138, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.40% (2.2969 => 2.3521, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4636 => 0.4747, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.39% (0.6456 => 0.6610, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.4186 => 1.4517, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.25% (0.5020 => 0.5133, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (0.4620 => 0.4721, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.2024 => 2.2497, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (2.0665 => 2.1105, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 1.89% (1.2842 => 1.3085, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.73% (1.1840 => 1.2045, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.58% (1.0722 => 1.0891, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.65% (4.2280 => 4.4247, std. dev.: 0.0164) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7507, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 1.90% (26.0924 => 26.5885, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash2: 1.61% (3.1578 => 3.2087, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 1.60% (3.2827 => 3.3351, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.59% (9.1159 => 9.2605, std. dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.53% (11.6436 => 11.8220, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.43% (1.3045 => 1.3231, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.33% (0.9540 => 0.9667, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5086 => 1.5275, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5773, std. dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1240, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.79% (5.2763 => 3.1242, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.67% (5.3855 => 3.6801, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.44% (5.3526 => 3.6698, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -15.06% (54.1659 => 46.0069, std. dev.: 0.0300) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.84% (2.9384 => 2.5317, std. dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: -12.03% (22.1758 => 19.5091, std. dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -11.15% (1.2373 => 1.0993, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -7.25% (1.5373 => 1.4258, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.28% (2.7294 => 2.5579, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0021) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4691, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4253, std. dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.83% (1.3677 => 1.3290, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0076, std. dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (8.1563 => 7.9563, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3413, std. dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 09:47:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 11:47:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817164751.E13E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2984?compare_to=2982&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2984, Order: 162099, Start Time: 2012-08-17 15:34:48, End Time: 2012-08-17 16:48:38 To: 2982, Order: 162097, Start Time: 2012-08-17 13:53:08, End Time: 2012-08-17 15:07:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.81% (2.3017 => 2.2601, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.34% (2.0176 => 2.3069, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 9.50% (0.7061 => 0.7732, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5818 => 0.6366, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 9.39% (0.5748 => 0.6288, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.02% (0.3578 => 0.3865, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3601 => 0.3885, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.82% (0.3646 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.78% (0.3663 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.73% (0.3623 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.72% (0.3914 => 0.4216, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.70% (0.3650 => 0.3931, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.65% (0.7710 => 0.8300, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.46% (1.3693 => 1.4715, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.4003 => 0.4301, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 7.26% (0.7038 => 0.7549, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.12% (3.9660 => 4.2484, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4328 => 0.4623, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.80% (0.5265 => 0.5623, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4062 => 0.4334, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.29% (0.6959 => 0.7397, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.08% (0.9199 => 0.9758, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.2193 => 1.2918, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.90% (0.3899 => 0.4129, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.88% (0.4390 => 0.4648, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3022 => 0.3198, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.66% (0.2914 => 0.3079, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.65% (0.2760 => 0.2916, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3246 => 0.3428, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0934, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.53% (0.3580 => 0.3778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3485 => 0.3675, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.4563 => 1.5343, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2988 => 0.3146, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.26% (13.8202 => 14.5465, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.3453 => 0.3627, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.1364 => 1.1924, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.90% (0.3534 => 0.3707, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.89% (0.3293 => 0.3454, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.78% (1.1061 => 1.1590, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.75% (0.5637 => 0.5905, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.71% (7.2180 => 7.5577, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8310 => 0.8701, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 4.59% (3.8646 => 4.0418, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/moments: 4.55% (0.3868 => 0.4044, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.54% (0.7506 => 0.7847, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.0594 => 1.1072, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.50% (1.3245 => 1.3841, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (1.3819 => 1.4428, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.3813 => 1.4416, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.24% (0.4791 => 0.4994, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.23% (1.9270 => 2.0085, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2292 => 1.2804, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.7460 => 0.7770, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 4.05% (2.1791 => 2.2673, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 3.99% (16.6129 => 17.2764, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (4.4433 => 4.6138, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.3801 => 4.5469, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.78% (0.3755 => 0.3897, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.74% (4.9865 => 5.1730, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.72% (0.6283 => 0.6517, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (13.2842 => 13.7755, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (3.6692 => 3.8018, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.54% (0.6135 => 0.6352, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2884, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 3.09% (16.2614 => 16.7634, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.07% (0.8698 => 0.8965, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1333 => 1.1672, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7493, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.74% (3.2742 => 3.3639, std. dev.: 0.0182) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (6.5754 => 6.7540, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9187, std. dev.: 0.0109) MultiSource/Applications/JM/lencod/lencod: 2.65% (14.8535 => 15.2474, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5188 => 1.5565, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.1007 => 2.1458, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.06% (4.6629 => 4.7591, std. dev.: 0.0202) MultiSource/Applications/minisat/minisat: 1.65% (0.6744 => 0.6855, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.54% (1.0313 => 1.0472, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.23% (0.9108 => 0.9220, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.18% (3.7467 => 3.7909, std. dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.20% (1.2998 => 1.4324, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7419, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0146) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6050, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.10% (10.7476 => 10.9732, std. dev.: 0.0194) MultiSource/Applications/sqlite3/sqlite3: 1.79% (4.5928 => 4.6751, std. dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3252, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5089 => 1.5295, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5743, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.51% (0.4657 => 0.4121, std. dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1721, std. dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.75% (0.6576 => 0.6461, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (0.8818 => 0.8712, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2308 => 1.0955, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5946, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9635, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2314, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2047, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7923, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3534, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.24% (5.5401 => 5.4713, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.19% (20.3410 => 20.0983, std. dev.: 0.0476) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 09:51:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 11:51:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120817165152.91C492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2985?compare_to=2980&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2985, Order: 162097, Start Time: 2012-08-17 14:08:58, End Time: 2012-08-17 16:52:39 To: 2980, Order: 162093, Start Time: 2012-08-17 10:57:54, End Time: 2012-08-17 13:41:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (93 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (784 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 8.87% (0.4228 => 0.4603, std. dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.51% (2.0447 => 2.1165, std. dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 21.39% (0.3792 => 0.4603, std. dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3465 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3446 => 0.3848, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.65% (0.3442 => 0.3843, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.56% (0.3460 => 0.3860, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.56% (0.3469 => 0.3870, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3496 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.53% (0.3488 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.32% (0.3650 => 0.4063, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3643 => 0.4052, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3724 => 0.4128, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5826 => 0.6199, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.01% (0.5889 => 0.6243, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.71% (1.5932 => 1.6841, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.46% (1.6211 => 1.7096, std. dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (1.3152 => 1.3830, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.15% (3.5627 => 3.7461, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.09% (0.4994 => 0.5248, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.78% (0.5900 => 0.6182, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.75% (0.4361 => 0.4568, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.71% (0.7171 => 0.7509, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (0.3930 => 0.4113, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.64% (0.2866 => 0.2999, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.62% (0.5000 => 0.5231, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 4.59% (4.2109 => 4.4040, std. dev.: 0.0054) MultiSource/Applications/d/make_dparser: 4.23% (1.0781 => 1.1237, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.13% (0.2566 => 0.2672, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.2736 => 0.2842, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 3.75% (5.5417 => 5.7494, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.51% (0.2875 => 0.2976, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (2.7292 => 2.8246, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 3.45% (0.9909 => 1.0251, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (0.4658 => 0.4811, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.3362 => 0.3472, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.3271 => 0.3378, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (0.3890 => 0.4017, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.25% (2.1653 => 2.2357, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.23% (1.9694 => 2.0331, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 3.18% (0.6634 => 0.6845, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.18% (1.9966 => 2.0601, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.17% (0.4139 => 0.4270, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.16% (0.7875 => 0.8124, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3258 => 0.3361, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.16% (1.8794 => 1.9388, std. dev.: 0.0086) MultiSource/Applications/hbd/hbd: 3.12% (0.9697 => 1.0000, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 3.12% (0.3267 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (2.1013 => 2.1669, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.10% (2.0673 => 2.1313, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3726 => 0.3839, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.03% (0.3336 => 0.3437, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.99% (4.6177 => 4.7559, std. dev.: 0.0101) MultiSource/Applications/lua/lua: 2.95% (1.4269 => 1.4690, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (4.4195 => 4.5475, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (0.3625 => 0.3729, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.74% (23.5202 => 24.1636, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4146 => 0.4257, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 2.54% (0.4251 => 0.4359, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 2.45% (0.5546 => 0.5682, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.6435 => 0.6577, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.02% (0.5012 => 0.5113, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.45% (2.0346 => 2.0642, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 10.08% (0.2122 => 0.2336, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6634, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std. dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6433, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6616, std. dev.: 0.0232) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (41.7953 => 42.6449, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1935, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9258, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (2.0820 => 2.1165, std. dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std. dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3100, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2854, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.98% (2.4764 => 2.4025, std. dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: -1.18% (11.9555 => 11.8139, std. dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5485, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7909, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7992, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0044) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7752, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.35% (17.2379 => 16.8332, std. dev.: 0.0416) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5796, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9584, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 11:03:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 13:03:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817180333.0F1FF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2986?compare_to=2983&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2986, Order: 162102, Start Time: 2012-08-17 16:45:35, End Time: 2012-08-17 18:04:20 To: 2983, Order: 162098, Start Time: 2012-08-17 14:58:59, End Time: 2012-08-17 16:17:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (85 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.63% (42.7586 => 42.0611, std. dev.: 0.2652) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.97% (10.3673 => 14.4078, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.14% (1.1194 => 1.2441, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.34% (0.3694 => 0.4076, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.00% (2.2022 => 2.3563, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.60% (1.7609 => 1.8772, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.2065 => 0.2182, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 5.42% (0.5925 => 0.6246, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.32% (0.6030 => 0.6351, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.4615 => 0.4853, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.88% (0.3177 => 0.3332, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7433 => 0.7772, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 4.31% (0.7326 => 0.7642, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.29% (7.0540 => 7.3569, std. dev.: 0.0120) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (10.4361 => 10.8598, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (9.4845 => 9.8488, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.82% (4.2646 => 4.4277, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 3.81% (0.3282 => 0.3407, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.79% (0.4879 => 0.5064, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.67% (0.5860 => 0.6075, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.57% (0.8172 => 0.8464, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.5569 => 0.5767, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.53% (4.9449 => 5.1193, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (5.0018 => 5.1764, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.35% (0.5105 => 0.5276, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.3050 => 1.3472, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.3423 => 0.3531, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3910, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.05% (0.3441 => 0.3546, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.01% (0.7835 => 0.8071, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.98% (0.9765 => 1.0056, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.5415 => 1.5865, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.89% (5.7591 => 5.9258, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.77% (1.1861 => 1.2189, std. dev.: 0.0037) MultiSource/Applications/treecc/treecc: 2.74% (2.0273 => 2.0828, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.73% (0.8067 => 0.8287, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4260, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1951, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.56% (0.4103 => 0.4208, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.50% (0.6675 => 0.6842, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.39% (0.6450 => 0.6604, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.38% (1.5603 => 1.5974, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.33% (17.1811 => 17.5806, std. dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6226, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.31% (0.4636 => 0.4743, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.28% (3.8723 => 3.9605, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (14.3668 => 14.6883, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8921 => 0.9120, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.20% (0.6456 => 0.6598, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.12% (2.2969 => 2.3456, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.4186 => 1.4479, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (2.2024 => 2.2423, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.74% (2.0665 => 2.1024, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.61% (1.2842 => 1.3049, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.60% (0.7115 => 0.7229, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.34% (1.0722 => 1.0866, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (4.2280 => 4.4496, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7519, std. dev.: 0.0097) MultiSource/Applications/lua/lua: 1.94% (26.0924 => 26.5995, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: 1.71% (9.1159 => 9.2717, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3344, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8226, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.18% (1.5086 => 1.5264, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1236, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.66% (5.2763 => 3.1308, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.81% (5.3855 => 3.6726, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.54% (5.3526 => 3.6645, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -15.08% (54.1659 => 45.9993, std. dev.: 0.4668) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.90% (2.9384 => 2.5301, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.21% (22.1758 => 19.4676, std. dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4204, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.2373 => 1.1042, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -7.52% (1.5373 => 1.4217, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.30% (2.7294 => 2.5575, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std. dev.: 0.0027) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4778, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4107, std. dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.83% (1.3677 => 1.3290, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0061, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9588, std. dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5067, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3418, std. dev.: 0.0066) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.06% (1.7254 => 1.7071, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 11:29:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 13:29:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817182928.A49ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2987?compare_to=2984&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2987, Order: 162106, Start Time: 2012-08-17 17:16:23, End Time: 2012-08-17 18:30:15 To: 2984, Order: 162099, Start Time: 2012-08-17 15:34:48, End Time: 2012-08-17 16:48:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (145 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.17% (3.8312 => 3.7865, std. dev.: 0.0148) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.38% (2.0176 => 2.3078, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.69% (0.5818 => 0.6382, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.50% (0.7061 => 0.7732, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 9.50% (0.5748 => 0.6294, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.99% (0.3578 => 0.3864, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3601 => 0.3879, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.72% (0.7710 => 0.8305, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.70% (0.3663 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.60% (0.3789 => 0.4077, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.56% (0.3623 => 0.3897, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.53% (0.3650 => 0.3925, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.29% (0.4003 => 0.4295, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.28% (0.3940 => 0.4227, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.17% (1.3693 => 1.4675, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.15% (3.9660 => 4.2496, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.09% (0.7038 => 0.7537, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.17% (0.9199 => 0.9767, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.04% (1.2193 => 1.2930, std. dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.00% (0.2782 => 0.2949, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.98% (0.4062 => 0.4305, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.88% (0.6959 => 0.7368, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.76% (0.5577 => 0.5898, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3489 => 0.3688, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3022 => 0.3194, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.61% (0.2690 => 0.2841, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2607 => 0.2753, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.54% (0.3899 => 0.4115, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.51% (1.9828 => 2.0920, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.40% (0.3149 => 0.3319, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2966 => 0.3125, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.36% (0.2726 => 0.2872, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.25% (0.3485 => 0.3668, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.24% (13.8202 => 14.5442, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.4563 => 1.5315, std. dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2696 => 0.2835, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.09% (0.2988 => 0.3140, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.08% (0.3192 => 0.3354, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (1.1364 => 1.1931, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.92% (0.3453 => 0.3623, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.86% (0.5637 => 0.5911, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4390 => 0.4602, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.79% (7.2180 => 7.5638, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.79% (0.8310 => 0.8708, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.78% (0.4016 => 0.4208, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3756 => 0.3935, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.76% (1.3245 => 1.3876, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.3819 => 1.4462, std. dev.: 0.0123) MultiSource/Applications/Burg/burg: 4.62% (1.1061 => 1.1572, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.61% (0.3534 => 0.3697, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.58% (3.8646 => 4.0417, std. dev.: 0.0136) MultiSource/Applications/spiff/spiff: 4.56% (0.7506 => 0.7848, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.54% (1.0594 => 1.1075, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.3868 => 0.4039, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.3813 => 1.4415, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.34% (1.9270 => 2.0107, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.20% (0.4791 => 0.4992, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.14% (2.1791 => 2.2693, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.11% (1.2292 => 1.2797, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.09% (16.6129 => 17.2919, std. dev.: 0.0204) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6193, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.3801 => 4.5483, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.6283 => 0.6519, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (13.2842 => 13.7791, std. dev.: 0.1303) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.70% (3.6692 => 3.8051, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6135 => 0.6358, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3755 => 0.3885, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (4.9865 => 5.1572, std. dev.: 0.0119) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2887, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.1333 => 1.1681, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 3.06% (16.2614 => 16.7594, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (8.4961 => 8.7473, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.8698 => 0.8950, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7603, std. dev.: 0.0156) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2660, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.72% (3.2742 => 3.3633, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9050, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5188 => 1.5566, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.07% (4.6629 => 4.7594, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.36% (3.7467 => 3.7976, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2642, std. dev.: 0.0496) SingleSource/Benchmarks/Misc/mandel-2: 10.93% (1.2998 => 1.4419, std. dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.94% (1.5824 => 1.6606, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7442, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8159, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3840, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6001, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 2.28% (10.7476 => 10.9923, std. dev.: 0.0567) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.78% (4.5928 => 4.6747, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.38% (1.5089 => 1.5297, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6861, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5720, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -11.77% (0.4657 => 0.4109, std. dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.5627 => 21.1645, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.83% (0.2670 => 0.2541, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2308 => 1.0908, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.22% (1.3780 => 1.3198, std. dev.: 0.0128) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5954, std. dev.: 0.0145) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9287, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9640, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2295, std. dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2047, std. dev.: 0.0238) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3617, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8687, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.22% (5.5401 => 5.4726, std. dev.: 0.0139) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.17% (20.3410 => 20.1021, std. dev.: 0.0140) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5633, std. dev.: 0.0065) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 12:49:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 14:49:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817194952.1F5012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2988?compare_to=2986&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2988, Order: 162110, Start Time: 2012-08-17 18:31:53, End Time: 2012-08-17 19:50:38 To: 2986, Order: 162102, Start Time: 2012-08-17 16:45:35, End Time: 2012-08-17 18:04:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (91 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (746 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.14% (14.4078 => 14.8601, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.07% (42.0611 => 42.5104, std. dev.: 0.0176) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.34% (10.3673 => 14.8601, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.91% (1.1194 => 1.2415, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.75% (0.3927 => 0.4310, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.65% (0.3886 => 0.4261, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.90% (2.2022 => 2.3542, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.52% (1.7609 => 1.8757, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/Hello: 6.13% (0.5925 => 0.6288, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.07% (0.6030 => 0.6396, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.4615 => 0.4851, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.04% (0.7326 => 0.7695, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.04% (0.3177 => 0.3337, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.95% (0.7433 => 0.7801, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.77% (10.4361 => 10.9342, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.62% (0.2271 => 0.2376, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.36% (7.0540 => 7.3613, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.27% (4.2646 => 4.4467, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/oourafft: 4.08% (0.3282 => 0.3416, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (9.4845 => 9.8675, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.00% (0.4879 => 0.5074, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.97% (0.5569 => 0.5790, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.9449 => 5.1370, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.8172 => 0.8489, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1958, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5860 => 0.6086, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (0.5105 => 0.5291, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.50% (8.1363 => 8.4209, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 3.50% (0.7835 => 0.8109, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.46% (1.3050 => 1.3501, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9765 => 1.0097, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.37% (0.3441 => 0.3557, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.32% (1.5415 => 1.5927, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.16% (1.1861 => 1.2236, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.12% (1.1642 => 1.2005, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 3.12% (3.3354 => 3.4393, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.05% (0.8067 => 0.8313, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.94% (2.0273 => 2.0869, std. dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 2.84% (5.7591 => 5.9228, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.74% (1.5603 => 1.6031, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7607, std. dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.65% (0.4636 => 0.4759, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.6450 => 0.6621, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.65% (3.8723 => 3.9749, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.61% (0.3865 => 0.3966, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.57% (2.2969 => 2.3560, std. dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5859 => 1.6264, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.53% (17.1811 => 17.6162, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/football/football: 2.45% (0.8921 => 0.9140, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.39% (0.5981 => 0.6124, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.34% (1.4186 => 1.4518, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (2.0665 => 2.1148, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.18% (1.2842 => 1.3122, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.17% (0.5020 => 0.5129, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2460, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.88% (1.1840 => 1.2062, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: 1.84% (0.7115 => 0.7246, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.54% (1.0722 => 1.0887, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (4.2280 => 4.4276, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7496, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 1.98% (26.0924 => 26.6087, std. dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2151, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.62% (3.2827 => 3.3360, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8224, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2476, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5772, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1240, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.57% (0.8651 => 0.1681, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.62% (5.2763 => 3.1329, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.82% (5.3855 => 3.6720, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.57% (5.3526 => 3.6627, std. dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -15.19% (54.1659 => 45.9359, std. dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -14.00% (2.9384 => 2.5269, std. dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: -12.12% (22.1758 => 19.4878, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2373 => 1.1059, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -8.16% (1.5373 => 1.4118, std. dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5578, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std. dev.: 0.0018) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4778, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4226, std. dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0109, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9577, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5128, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3430, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8125, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 13:02:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 15:02:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120817200254.237AD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2989?compare_to=2985&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2989, Order: 162106, Start Time: 2012-08-17 17:20:10, End Time: 2012-08-17 20:03:40 To: 2985, Order: 162097, Start Time: 2012-08-17 14:08:58, End Time: 2012-08-17 16:52:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (86 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (791 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -8.26% (0.4603 => 0.4223, std. dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3465 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3446 => 0.3851, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.68% (0.3460 => 0.3864, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3496 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.62% (0.3442 => 0.3842, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.62% (0.3469 => 0.3872, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.58% (0.3488 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.37% (0.3792 => 0.4223, std. dev.: 0.0098) SingleSource/UnitTests/ObjC/property: 11.34% (0.3650 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.20% (0.3643 => 0.4051, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3724 => 0.4130, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.56% (1.5932 => 1.6977, std. dev.: 0.0154) SingleSource/UnitTests/ObjC++/Hello: 6.39% (0.5826 => 0.6198, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 6.06% (0.5889 => 0.6246, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.58% (1.6211 => 1.7115, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.33% (3.5627 => 3.7527, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.26% (0.4029 => 0.4241, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.19% (0.4994 => 0.5253, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.04% (0.4361 => 0.4581, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (0.5026 => 0.5276, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.97% (1.3152 => 1.3805, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.69% (0.5900 => 0.6177, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.62% (0.5000 => 0.5231, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 4.59% (0.7171 => 0.7500, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 4.58% (4.2109 => 4.4038, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 4.56% (1.0781 => 1.1273, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.01% (5.5417 => 5.7639, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (1.9694 => 2.0482, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 3.75% (0.2750 => 0.2853, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.69% (1.9966 => 2.0703, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (2.7292 => 2.8276, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.60% (0.3890 => 0.4030, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (0.4658 => 0.4822, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.48% (0.3362 => 0.3479, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 3.35% (1.8794 => 1.9423, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.22% (0.3195 => 0.3298, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.21% (0.9909 => 1.0227, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (2.1013 => 2.1678, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 3.10% (23.5202 => 24.2501, std. dev.: 0.0111) MultiSource/Applications/JM/lencod/lencod: 3.10% (4.6177 => 4.7609, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 3.07% (0.7875 => 0.8117, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.07% (2.0673 => 2.1307, std. dev.: 0.0088) MultiSource/Applications/siod/siod: 3.06% (0.6634 => 0.6837, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (4.4195 => 4.5546, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.3903 => 0.4020, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (2.1653 => 2.2302, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 2.97% (1.4269 => 1.4693, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.4146 => 0.4263, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (0.3625 => 0.3726, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 2.78% (0.9697 => 0.9967, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.75% (0.3678 => 0.3779, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.68% (0.3726 => 0.3826, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.68% (0.4139 => 0.4250, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.60% (0.5546 => 0.5690, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4251 => 0.4356, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.6435 => 0.6577, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.58% (2.0346 => 2.0667, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (0.7426 => 0.7533, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6776, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1708, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6392, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6222, std. dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2093, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.73% (41.7953 => 42.5193, std. dev.: 0.0567) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.72% (50.0626 => 50.9216, std. dev.: 0.0127) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2205, std. dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3125, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.92% (2.4764 => 2.4041, std. dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: -1.20% (11.9555 => 11.8115, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.70% (25.4195 => 16.5983, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary2: -10.62% (0.2402 => 0.2147, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7955, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std. dev.: 0.0042) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.98% (17.2379 => 16.7243, std. dev.: 0.1287) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9586, std. dev.: 0.0140) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 13:12:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 15:12:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817201245.ED9712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2990?compare_to=2987&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2990, Order: 162113, Start Time: 2012-08-17 18:59:33, End Time: 2012-08-17 20:13:25 To: 2987, Order: 162106, Start Time: 2012-08-17 17:16:23, End Time: 2012-08-17 18:30:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (144 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.37% (79.5327 => 80.6224, std. dev.: 0.1586) SingleSource/Benchmarks/McGill/chomp: 1.15% (1.0908 => 1.1033, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.73% (2.0176 => 2.2946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.5818 => 0.6366, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5748 => 0.6277, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.11% (0.7061 => 0.7704, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 8.02% (0.3578 => 0.3865, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.82% (0.3646 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.70% (0.3650 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.68% (0.3789 => 0.4080, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 7.66% (0.3914 => 0.4214, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.54% (0.7710 => 0.8291, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.13% (0.7038 => 0.7540, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.08% (3.9660 => 4.2469, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4652, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.82% (0.5265 => 0.5624, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4328 => 0.4618, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.33% (0.4062 => 0.4319, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.15% (0.2781 => 0.2952, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.07% (0.9199 => 0.9757, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.2193 => 1.2924, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.92% (0.6959 => 0.7371, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.85% (0.3246 => 0.3436, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.75% (0.4379 => 0.4631, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.74% (1.4563 => 1.5399, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.69% (0.2127 => 0.2248, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 5.68% (0.2607 => 0.2755, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.65% (0.2690 => 0.2842, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.2937 => 0.3099, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.48% (1.9828 => 2.0914, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.47% (0.3580 => 0.3776, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.47% (0.5577 => 0.5882, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2966 => 0.3127, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3149 => 0.3316, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 5.26% (13.8202 => 14.5468, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.07% (1.1364 => 1.1940, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3453 => 0.3628, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.95% (0.5637 => 0.5916, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (7.2180 => 7.5663, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.77% (0.8310 => 0.8706, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.75% (1.3245 => 1.3874, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.66% (1.1061 => 1.1576, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.57% (3.8646 => 4.0411, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.49% (1.0594 => 1.1070, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.44% (0.7506 => 0.7839, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (1.3813 => 1.4422, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (1.3819 => 1.4427, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.26% (1.9270 => 2.0090, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.24% (0.4791 => 0.4994, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.19% (2.1791 => 2.2705, std. dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: 4.14% (1.2292 => 1.2801, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2945 => 0.3065, std. dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 4.07% (16.6129 => 17.2897, std. dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.3801 => 4.5544, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (13.2842 => 13.8029, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (4.4433 => 4.6166, std. dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.80% (0.6283 => 0.6522, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (3.6692 => 3.8060, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.67% (0.6135 => 0.6360, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.48% (4.9865 => 5.1602, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.31% (3.1889 => 3.2943, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 3.24% (16.2614 => 16.7881, std. dev.: 0.0195) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.11% (1.1333 => 1.1686, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.98% (0.8698 => 0.8957, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7437, std. dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.88% (14.8535 => 15.2819, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.2742 => 3.3658, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7584, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9244, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.37% (1.5188 => 1.5548, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (2.1007 => 2.1455, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.12% (4.6629 => 4.7617, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.25% (3.7467 => 3.7937, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2668, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.72% (1.2998 => 1.4131, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7429, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.50% (10.7476 => 11.0162, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5977, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6764, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3261, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5280, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6878, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1614, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2308 => 1.1033, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.45% (1.3780 => 1.3167, std. dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.90% (0.4867 => 0.4677, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5928, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9634, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2311, std. dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2043, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (84.4286 => 83.3515, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4962, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2366, std. dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (20.3410 => 20.1273, std. dev.: 0.0287) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 14:36:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 16:36:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817213642.460302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2991?compare_to=2988&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2991, Order: 162120, Start Time: 2012-08-17 20:18:15, End Time: 2012-08-17 21:37:28 To: 2988, Order: 162110, Start Time: 2012-08-17 18:31:53, End Time: 2012-08-17 19:50:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (108 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 929 (730 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.49% (3.6627 => 3.7174, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.28% (3.6720 => 3.7189, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.06% (2.3542 => 2.3791, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.32% (1.4118 => 1.4304, std. dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.19% (14.8601 => 14.5340, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.19% (10.3673 => 14.5340, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.41% (1.1194 => 1.2471, std. dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.11% (0.3886 => 0.4279, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (2.2022 => 2.3791, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.31% (1.7609 => 1.8897, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.09% (0.5925 => 0.6286, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.17% (7.0540 => 7.4184, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.09% (0.7326 => 0.7699, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.7433 => 0.7795, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.71% (0.2271 => 0.2378, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 4.56% (10.4361 => 10.9122, std. dev.: 0.0165) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.20% (0.8172 => 0.8515, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (9.4845 => 9.8816, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.17% (4.2646 => 4.4423, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.09% (0.5569 => 0.5797, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (4.9449 => 5.1456, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (5.0018 => 5.2039, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.96% (0.5860 => 0.6092, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.64% (8.1363 => 8.4328, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.58% (1.3050 => 1.3517, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.47% (0.7835 => 0.8107, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.44% (0.4103 => 0.4244, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.5415 => 1.5938, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.37% (0.3441 => 0.3557, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3232 => 0.3339, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.31% (0.5105 => 0.5274, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 3.28% (1.5603 => 1.6114, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9765 => 1.0084, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.8067 => 0.8329, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.14% (0.3283 => 0.3386, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.11% (1.1642 => 1.2004, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.08% (0.3826 => 0.3944, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.05% (0.3865 => 0.3983, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.04% (0.3387 => 0.3490, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.4636 => 0.4776, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.00% (2.0273 => 2.0881, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.99% (5.7591 => 5.9313, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.99% (3.3354 => 3.4350, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1861 => 1.2215, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.95% (2.0665 => 2.1275, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 2.95% (0.3422 => 0.3523, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.91% (0.3603 => 0.3708, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (0.4064 => 0.4180, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.85% (0.6456 => 0.6640, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6450 => 0.6625, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (0.6675 => 0.6853, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5981 => 0.6140, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.62% (0.4620 => 0.4741, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (14.3668 => 14.7423, std. dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.57% (0.4203 => 0.4311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.54% (0.4048 => 0.4151, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.53% (3.8723 => 3.9704, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.43% (1.2842 => 1.3154, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5859 => 1.6242, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8921 => 0.9134, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.4186 => 1.4517, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.5020 => 0.5137, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.24% (2.2969 => 2.3483, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.19% (17.1811 => 17.5576, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (2.2024 => 2.2493, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.80% (1.1840 => 1.2053, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.67% (0.7115 => 0.7234, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.38% (1.0722 => 1.0870, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (4.2280 => 4.4399, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7559, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.06% (26.0924 => 26.6297, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: 1.69% (9.1159 => 9.2696, std. dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1578 => 3.2101, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3341, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.53% (11.6436 => 11.8221, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5086 => 1.5280, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5756, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.49% (5.2763 => 3.1400, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.95% (5.3855 => 3.7189, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7174, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0179, std. dev.: 0.0300) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.67% (2.9384 => 2.5367, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -11.96% (22.1758 => 19.5228, std. dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std. dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: -11.00% (1.2373 => 1.1012, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.1396 => 1.0596, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.95% (1.5373 => 1.4304, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.29% (2.7294 => 2.5578, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4678, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4225, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9943, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9632, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (12.5348 => 12.3440, std. dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.14% (1.8329 => 1.8120, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.09% (1.0313 => 1.0201, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 14:54:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 16:54:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817215417.F06FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2992?compare_to=2990&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2992, Order: 162120, Start Time: 2012-08-17 20:41:08, End Time: 2012-08-17 21:55:05 To: 2990, Order: 162113, Start Time: 2012-08-17 18:59:33, End Time: 2012-08-17 20:13:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (149 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.66% (54.4539 => 56.4442, std. dev.: 0.0897) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.71% (2.0176 => 2.2942, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.97% (0.5818 => 0.6398, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.93% (0.7061 => 0.7762, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.83% (0.5748 => 0.6313, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.25% (0.3601 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.20% (0.3646 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3650 => 0.3949, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 8.14% (0.3663 => 0.3961, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3914 => 0.4229, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.00% (0.3623 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.59% (0.3940 => 0.4239, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.37% (0.4328 => 0.4647, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.7710 => 0.8272, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4062 => 0.4354, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.12% (1.3693 => 1.4668, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.07% (3.9660 => 4.2464, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.05% (0.2782 => 0.2978, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.75% (0.7038 => 0.7513, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.52% (0.2760 => 0.2940, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 6.47% (0.2690 => 0.2864, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (0.3149 => 0.3351, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.35% (0.3022 => 0.3214, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.29% (0.2655 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.26% (0.4390 => 0.4665, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.26% (0.3580 => 0.3804, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.24% (1.9828 => 2.1065, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.24% (0.2966 => 0.3151, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.08% (0.3899 => 0.4136, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.02% (0.3107 => 0.3294, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.99% (1.2193 => 1.2923, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.96% (0.9199 => 0.9747, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3192 => 0.3382, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.93% (0.3489 => 0.3696, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.82% (0.2988 => 0.3162, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.76% (0.3453 => 0.3652, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.76% (0.6959 => 0.7360, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.74% (0.2127 => 0.2249, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.55% (0.3246 => 0.3426, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.53% (0.3293 => 0.3475, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.38% (0.3534 => 0.3724, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.28% (0.4016 => 0.4228, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.22% (13.8202 => 14.5410, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.17% (1.4563 => 1.5316, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.02% (1.1364 => 1.1935, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (7.2180 => 7.5800, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.3813 => 1.4491, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.90% (0.5637 => 0.5913, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.79% (1.3819 => 1.4481, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.77% (0.7506 => 0.7864, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.68% (1.2292 => 1.2867, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.60% (0.8310 => 0.8692, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (1.3245 => 1.3837, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (3.8646 => 4.0370, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 4.43% (1.0594 => 1.1063, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 4.39% (1.1061 => 1.1547, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.26% (0.4791 => 0.4995, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.19% (1.9270 => 2.0077, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.7460 => 0.7766, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.05% (0.3755 => 0.3907, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.01% (16.6129 => 17.2785, std. dev.: 0.0189) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (4.4433 => 4.6199, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.3801 => 4.5524, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8085, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.78% (13.2842 => 13.7867, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 3.76% (2.1791 => 2.2610, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.71% (0.6283 => 0.6516, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.42% (0.6135 => 0.6345, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.9865 => 5.1531, std. dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.8698 => 0.8984, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2887, std. dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1333 => 1.1680, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7514, std. dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 2.85% (16.2614 => 16.7244, std. dev.: 0.0182) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (6.5754 => 6.7535, std. dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 2.66% (14.5298 => 14.9164, std. dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2447, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (3.2742 => 3.3586, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5188 => 1.5539, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.1007 => 2.1453, std. dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 2.02% (4.6629 => 4.7572, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6250 => 0.6358, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.51% (0.6744 => 0.6846, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.36% (1.0313 => 1.0453, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (0.9108 => 0.9214, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7868, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 26.43% (1.8175 => 2.2978, std. dev.: 0.0350) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 9.80% (1.2998 => 1.4272, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.00% (1.5824 => 1.6615, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7409, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9637, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8170, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6009, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.12% (10.7476 => 10.9752, std. dev.: 0.0420) SingleSource/Benchmarks/Misc/ffbench: 1.79% (0.8273 => 0.8421, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5928 => 4.6734, std. dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3260, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (1.5089 => 1.5285, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6861, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5716, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.73% (0.4657 => 0.4204, std. dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.5627 => 21.1262, std. dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1041, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1031, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.34% (1.3780 => 1.3182, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5757, std. dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9285, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9623, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.84% (7.3305 => 7.1959, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7922, std. dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3684, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8715, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.04% (20.3410 => 20.1288, std. dev.: 0.0148) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 16:14:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 18:14:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120817231407.99EF72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2993?compare_to=2989&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2993, Order: 162120, Start Time: 2012-08-17 20:31:13, End Time: 2012-08-17 23:14:54 To: 2989, Order: 162106, Start Time: 2012-08-17 17:20:10, End Time: 2012-08-17 20:03:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (113 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.52% (0.7500 => 0.7614, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 12.71% (0.2085 => 0.2350, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.84% (0.2147 => 0.2251, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.77% (0.3446 => 0.3886, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.76% (0.3465 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3442 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.54% (0.3469 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3460 => 0.3893, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.50% (0.3496 => 0.3933, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 12.30% (0.3650 => 0.4099, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.16% (0.3643 => 0.4086, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3724 => 0.4162, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5826 => 0.6245, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.03% (0.5889 => 0.6303, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.21% (1.6211 => 1.7218, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 6.18% (0.7171 => 0.7614, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.08% (3.5627 => 3.7792, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.94% (1.3152 => 1.3933, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 5.76% (1.5932 => 1.6849, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.5900 => 0.6233, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.53% (0.5026 => 0.5304, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.2014 => 0.2123, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (0.4361 => 0.4596, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.17% (0.4994 => 0.5252, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.11% (0.4029 => 0.4235, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 5.10% (4.2109 => 4.4258, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (0.5000 => 0.5244, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.80% (1.0781 => 1.1299, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.60% (0.2566 => 0.2684, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.45% (1.9966 => 2.0854, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.37% (1.9694 => 2.0554, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.35% (0.2875 => 0.3000, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.30% (5.5417 => 5.7799, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.16% (0.3195 => 0.3328, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.2866 => 0.2985, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.06% (0.3890 => 0.4048, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.05% (0.2714 => 0.2824, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.05% (0.9909 => 1.0310, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.04% (0.2750 => 0.2861, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.00% (2.7292 => 2.8385, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 3.98% (0.6634 => 0.6898, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2792 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.92% (0.2729 => 0.2836, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.3004 => 0.3121, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (0.4658 => 0.4839, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 3.88% (0.2780 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.2823 => 0.2932, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.85% (1.8794 => 1.9517, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 3.84% (0.2811 => 0.2919, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.84% (0.2813 => 0.2921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.82% (0.2803 => 0.2910, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.81% (0.2911 => 0.3022, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3267 => 0.3391, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.78% (2.0673 => 2.1455, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.76% (4.4195 => 4.5858, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3258 => 0.3379, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.70% (4.6177 => 4.7886, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.68% (0.7875 => 0.8165, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.4139 => 0.4291, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.67% (2.1013 => 2.1784, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.66% (0.3060 => 0.3172, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.65% (0.3317 => 0.3438, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.61% (0.3903 => 0.4044, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.60% (0.3362 => 0.3483, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.56% (0.3625 => 0.3754, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.54% (2.1653 => 2.2419, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.3271 => 0.3386, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.49% (0.3348 => 0.3465, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.3678 => 0.3806, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 3.41% (0.3726 => 0.3853, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.40% (0.9697 => 1.0027, std. dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 3.39% (23.5202 => 24.3186, std. dev.: 0.0087) MultiSource/Applications/lua/lua: 3.38% (1.4269 => 1.4751, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 3.36% (0.3477 => 0.3594, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.28% (0.4146 => 0.4282, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 3.11% (0.4251 => 0.4383, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3690 => 0.3803, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 2.98% (0.5546 => 0.5711, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.89% (0.3981 => 0.4096, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.3845 => 0.3951, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.74% (0.6435 => 0.6611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.49% (0.5012 => 0.5137, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.96% (2.0346 => 2.0745, std. dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 10.74% (0.2122 => 0.2350, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6722, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1700, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6285, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.20% (105.3826 => 107.6977, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1954, std. dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.00% (41.7953 => 42.6294, std. dev.: 0.0169) MultiSource/Applications/lua/lua: 1.74% (50.0626 => 50.9313, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2260, std. dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3081, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2804, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5728, std. dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7972, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std. dev.: 0.0097) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.42% (17.2379 => 16.8212, std. dev.: 0.0657) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.42% (0.6293 => 0.6141, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5763, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9582, std. dev.: 0.0142) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 16:33:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 18:33:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120817233309.3123F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2994?compare_to=2991&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2994, Order: 162136, Start Time: 2012-08-17 22:15:05, End Time: 2012-08-17 23:33:54 To: 2991, Order: 162120, Start Time: 2012-08-17 20:18:15, End Time: 2012-08-17 21:37:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (96 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.17% (14.5340 => 13.9275, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.34% (10.3673 => 13.9275, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 11.89% (0.3473 => 0.3886, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.55% (0.3516 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 10.97% (0.3828 => 0.4248, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.65% (0.3886 => 0.4300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.15% (0.1432 => 0.1563, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.97% (2.2022 => 2.3998, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.65% (0.3817 => 0.4147, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.12% (1.7609 => 1.8862, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 6.14% (0.6030 => 0.6400, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.81% (0.7326 => 0.7752, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.42% (0.4615 => 0.4865, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.38% (0.7433 => 0.7833, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.36% (7.0540 => 7.4323, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.96% (0.4879 => 0.5121, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.93% (0.2271 => 0.2383, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (10.4361 => 10.9203, std. dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.5569 => 0.5818, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.47% (9.4845 => 9.9085, std. dev.: 0.0089) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.2554 => 0.2667, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.8172 => 0.8529, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.32% (4.2646 => 4.4489, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.27% (0.5860 => 0.6110, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.26% (4.9449 => 5.1557, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.25% (5.0018 => 5.2145, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 3.90% (5.7591 => 5.9835, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.88% (0.3121 => 0.3242, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.84% (8.1363 => 8.4489, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.2758 => 0.2861, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.71% (0.3180 => 0.3298, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (1.3050 => 1.3531, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.65% (0.7835 => 0.8121, std. dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 3.60% (0.3109 => 0.3221, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.59% (0.3423 => 0.3546, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.57% (0.9765 => 1.0114, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.53% (0.8067 => 0.8352, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5105 => 0.5284, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.5415 => 1.5955, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.49% (0.3441 => 0.3561, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.37% (1.1642 => 1.2034, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2253, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.29% (3.3354 => 3.4453, std. dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 3.25% (0.3387 => 0.3497, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6675 => 0.6890, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.20% (2.0273 => 2.0921, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.07% (0.4103 => 0.4229, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.02% (3.8723 => 3.9892, std. dev.: 0.0118) MultiSource/Applications/hbd/hbd: 3.00% (1.5603 => 1.6071, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.85% (0.6450 => 0.6634, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.85% (0.4636 => 0.4768, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (1.5859 => 1.6297, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (14.3668 => 14.7541, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.68% (0.5981 => 0.6141, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.61% (17.1811 => 17.6301, std. dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.4186 => 1.4549, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.8921 => 0.9149, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.51% (2.2969 => 2.3546, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6456 => 0.6618, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.5020 => 0.5138, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.2024 => 2.2541, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.30% (2.0665 => 2.1140, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (0.4620 => 0.4721, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.08% (1.2842 => 1.3109, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 1.94% (1.1840 => 1.2070, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.87% (0.7115 => 0.7248, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.78% (1.0722 => 1.0913, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (4.2280 => 4.4405, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0065) MultiSource/Applications/lua/lua: 2.93% (26.0924 => 26.8567, std. dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/hash2: 1.86% (3.1578 => 3.2165, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3337, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.53% (11.6436 => 11.8223, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2480, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6815, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1562, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.75% (5.3855 => 3.7295, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.36% (5.3526 => 3.7273, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0512, std. dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.26% (2.9384 => 2.5487, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -11.87% (22.1758 => 19.5446, std. dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1078, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -8.51% (1.5373 => 1.4065, std. dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.56% (1.9577 => 1.8489, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std. dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4820, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4155, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9888, std. dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9611, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std. dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3389, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8129, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 16:36:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 18:36:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120817233609.44A742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2995?compare_to=2992&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2995, Order: 162138, Start Time: 2012-08-17 22:22:59, End Time: 2012-08-17 23:36:54 To: 2992, Order: 162120, Start Time: 2012-08-17 20:41:08, End Time: 2012-08-17 21:55:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (152 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (704 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.03% (1.1547 => 1.1666, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.03% (2.2610 => 2.2842, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.75% (7.9279 => 8.0667, std. dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.45% (2.0176 => 2.3091, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 10.42% (0.5818 => 0.6424, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.19% (0.5748 => 0.6334, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.97% (0.7061 => 0.7765, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3578 => 0.3917, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.36% (0.3601 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.22% (0.3646 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.21% (0.3650 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.17% (0.3663 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.12% (0.3914 => 0.4271, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.11% (0.3789 => 0.4134, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.08% (0.3623 => 0.3952, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.07% (0.3130 => 0.3414, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.87% (0.4003 => 0.4358, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.65% (0.3940 => 0.4281, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.05% (0.7710 => 0.8331, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.67% (3.9660 => 4.2700, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 7.59% (0.7038 => 0.7572, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4062 => 0.4367, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.51% (1.3693 => 1.4721, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.41% (0.5265 => 0.5655, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.4328 => 0.4643, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2781 => 0.2981, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.16% (0.2596 => 0.2782, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.05% (0.2782 => 0.2978, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.53% (0.9199 => 0.9800, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.52% (0.3022 => 0.3219, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.51% (0.4379 => 0.4664, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.44% (1.9828 => 2.1105, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.44% (0.6959 => 0.7407, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.41% (1.2193 => 1.2975, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.38% (0.2726 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2760 => 0.2935, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.32% (0.3149 => 0.3348, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3580 => 0.3806, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3899 => 0.4144, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.26% (0.3485 => 0.3703, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.25% (0.2127 => 0.2260, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.21% (0.3107 => 0.3300, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1789 => 0.1900, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.92% (0.2988 => 0.3165, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.92% (13.8202 => 14.6385, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.86% (1.4563 => 1.5417, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.5577 => 0.5903, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 5.79% (0.3453 => 0.3653, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.79% (0.1865 => 0.1973, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3293 => 0.3480, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.60% (0.4390 => 0.4636, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.57% (0.2925 => 0.3088, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.56% (0.2914 => 0.3076, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.54% (0.2023 => 0.2135, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.48% (0.4016 => 0.4236, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.47% (1.1061 => 1.1666, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.47% (7.2180 => 7.6127, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 5.44% (0.2243 => 0.2365, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.41% (1.1364 => 1.1979, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3534 => 0.3725, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.39% (0.5637 => 0.5941, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 5.23% (3.8646 => 4.0668, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.14% (0.8310 => 0.8737, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.10% (1.3245 => 1.3920, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.09% (0.7506 => 0.7888, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.94% (1.3819 => 1.4501, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 4.92% (1.9270 => 2.0219, std. dev.: 0.0095) MultiSource/Benchmarks/nbench/nbench: 4.91% (1.0594 => 1.1114, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.3813 => 1.4491, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 4.82% (2.1791 => 2.2842, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.82% (0.4791 => 0.5022, std. dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: 4.78% (1.2292 => 1.2880, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.77% (0.7460 => 0.7816, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3220 => 0.3367, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.54% (16.6129 => 17.3670, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.36% (0.6283 => 0.6557, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.36% (4.3801 => 4.5709, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.33% (4.4433 => 4.6355, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3755 => 0.3916, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.22% (3.6692 => 3.8239, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.21% (0.6135 => 0.6393, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.19% (13.2842 => 13.8406, std. dev.: 0.0265) MultiSource/Benchmarks/sim/sim: 3.77% (0.3131 => 0.3249, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.69% (4.9865 => 5.1707, std. dev.: 0.0149) MultiSource/Applications/d/make_dparser: 3.68% (3.1889 => 3.3064, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.51% (1.1333 => 1.1731, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.44% (8.4961 => 8.7886, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.4113 => 0.4254, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.18% (16.2614 => 16.7777, std. dev.: 0.0248) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (6.5754 => 6.7796, std. dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 3.08% (14.8535 => 15.3103, std. dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 3.02% (14.5298 => 14.9683, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.96% (1.5188 => 1.5637, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.92% (3.2742 => 3.3699, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1555, std. dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 2.57% (4.6629 => 4.7829, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.10% (0.6250 => 0.6381, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 2.02% (1.0313 => 1.0521, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.90% (3.7467 => 3.8180, std. dev.: 0.0140) MultiSource/Applications/minisat/minisat: 1.87% (0.6744 => 0.6870, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.73% (0.9108 => 0.9266, std. dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.51% (6.2785 => 6.3733, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.23% (33.2944 => 33.7049, std. dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2649, std. dev.: 0.0426) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.30% (1.2998 => 1.3947, std. dev.: 0.0195) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7412, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5965, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9792, std. dev.: 0.0321) MultiSource/Applications/sqlite3/sqlite3: 1.92% (4.5928 => 4.6808, std. dev.: 0.0079) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3252, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.32% (1.5089 => 1.5288, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5738, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.02% (26.5159 => 26.7851, std. dev.: 0.0162) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.56% (0.4657 => 0.4212, std. dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.94% (22.5627 => 21.2221, std. dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0972, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std. dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.80% (0.4867 => 0.4682, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5900, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9602, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2234, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2125, std. dev.: 0.0301) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3651, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.19% (5.5401 => 5.4743, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.17% (20.3410 => 20.1033, std. dev.: 0.0317) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 18:17:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 20:17:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818011741.4D16F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2996?compare_to=2995&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2996, Order: 162146, Start Time: 2012-08-18 00:04:37, End Time: 2012-08-18 01:18:28 To: 2995, Order: 162138, Start Time: 2012-08-17 22:22:59, End Time: 2012-08-17 23:36:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (148 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.91% (54.4515 => 56.5804, std. dev.: 0.0413) SingleSource/Benchmarks/Misc/mandel-2: 2.24% (1.3947 => 1.4260, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.08% (2.0176 => 2.3016, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.63% (0.5818 => 0.6378, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.48% (0.5748 => 0.6293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7061 => 0.7724, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.47% (0.3650 => 0.3959, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3663 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.71% (0.1413 => 0.1522, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.65% (0.7710 => 0.8300, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.39% (0.7038 => 0.7558, std. dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.26% (3.9660 => 4.2540, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 7.06% (1.3693 => 1.4660, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.95% (0.5265 => 0.5631, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4328 => 0.4612, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.18% (1.2193 => 1.2946, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.16% (0.9199 => 0.9766, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4062 => 0.4311, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4379 => 0.4645, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.6959 => 0.7370, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.88% (0.2127 => 0.2252, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.3022 => 0.3197, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.76% (0.3246 => 0.3433, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.75% (0.3899 => 0.4123, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.73% (0.3489 => 0.3689, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.65% (0.2655 => 0.2805, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.65% (1.9828 => 2.0948, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3107 => 0.3282, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.63% (0.5577 => 0.5891, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.61% (0.3580 => 0.3781, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2765 => 0.2920, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3485 => 0.3678, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.43% (13.8202 => 14.5708, std. dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.2914 => 0.3072, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.38% (1.4563 => 1.5346, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2696 => 0.2839, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 5.30% (0.2925 => 0.3080, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2988 => 0.3145, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.11% (7.2180 => 7.5870, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.10% (1.1364 => 1.1944, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.97% (0.4390 => 0.4608, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.90% (0.7506 => 0.7874, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.90% (0.5637 => 0.5913, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.82% (1.3813 => 1.4479, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.80% (0.8310 => 0.8709, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 4.75% (3.8646 => 4.0480, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3756 => 0.3934, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.73% (0.4016 => 0.4206, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.65% (1.3245 => 1.3861, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.65% (1.1061 => 1.1575, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.3819 => 1.4455, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 4.58% (0.3868 => 0.4045, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.55% (1.0594 => 1.1076, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7460 => 0.7793, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.2945 => 0.3075, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.36% (0.4791 => 0.5000, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.33% (1.9270 => 2.0105, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2292 => 1.2814, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.22% (16.6129 => 17.3134, std. dev.: 0.0199) MultiSource/Applications/sgefa/sgefa: 4.17% (0.2995 => 0.3120, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 4.16% (0.3220 => 0.3354, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 4.13% (2.1791 => 2.2692, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (4.4433 => 4.6235, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.03% (0.6283 => 0.6536, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.99% (4.3801 => 4.5550, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.92% (13.2842 => 13.8052, std. dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.90% (0.6135 => 0.6374, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (3.6692 => 3.8102, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1521, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 3.31% (3.1889 => 3.2943, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1333 => 1.1694, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.13% (8.4961 => 8.7617, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.07% (16.2614 => 16.7609, std. dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.00% (0.8698 => 0.8959, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.85% (14.8535 => 15.2761, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7619, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3644, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9251, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.5188 => 1.5561, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.35% (4.6629 => 4.7724, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1471, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.65% (1.0313 => 1.0483, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.53% (3.7467 => 3.8042, std. dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2680, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.71% (1.2998 => 1.4260, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7433, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9841, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.77% (1.7688 => 1.8178, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4271 => 7.6092, std. dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 2.42% (10.7476 => 11.0078, std. dev.: 0.0430) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.84% (4.5928 => 4.6775, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.65% (3.2729 => 3.3269, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0510, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.32% (1.5089 => 1.5288, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.11% (26.5159 => 26.8112, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1567, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.39% (1.2308 => 1.0906, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3184, std. dev.: 0.0115) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0211, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5932, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9611, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2261, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2146, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3566, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.03% (5.5401 => 5.4833, std. dev.: 0.0107) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 18:21:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 20:21:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818012102.203432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2997?compare_to=2994&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2997, Order: 162146, Start Time: 2012-08-18 00:03:02, End Time: 2012-08-18 01:21:49 To: 2994, Order: 162136, Start Time: 2012-08-17 22:15:05, End Time: 2012-08-17 23:33:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (97 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (13.9275 => 13.7637, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.76% (10.3673 => 13.7637, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3561 => 0.3989, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 11.92% (0.3516 => 0.3935, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.85% (1.1194 => 1.2521, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.94% (0.3886 => 0.4311, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.22% (2.2022 => 2.3832, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.34% (1.7609 => 1.8901, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.51% (0.5925 => 0.6311, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.6030 => 0.6418, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7326 => 0.7769, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.27% (0.4615 => 0.4858, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.24% (7.0540 => 7.4233, std. dev.: 0.0155) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (0.7433 => 0.7807, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2271 => 0.2381, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (10.4361 => 10.9414, std. dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.60% (0.8172 => 0.8548, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 4.27% (0.2554 => 0.2663, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5569 => 0.5805, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (9.4845 => 9.8799, std. dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.17% (4.9449 => 5.1510, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (5.0018 => 5.2094, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.14% (4.2646 => 4.4413, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.5860 => 0.6102, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.90% (8.1363 => 8.4539, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.89% (0.2700 => 0.2805, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.84% (0.3121 => 0.3241, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.84% (0.3180 => 0.3302, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.61% (1.3050 => 1.3521, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.59% (0.7835 => 0.8116, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 3.56% (0.3423 => 0.3545, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.35% (1.5415 => 1.5932, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.31% (0.3441 => 0.3555, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.8067 => 0.8334, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.29% (0.9765 => 1.0086, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.21% (1.1642 => 1.2016, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.17% (0.4103 => 0.4233, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.15% (0.5105 => 0.5266, std. dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2228, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 3.08% (3.8723 => 3.9916, std. dev.: 0.0121) MultiSource/Applications/d/make_dparser: 3.07% (3.3354 => 3.4379, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.05% (5.7591 => 5.9347, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.01% (2.0273 => 2.0883, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.86% (1.5603 => 1.6049, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.70% (0.6450 => 0.6624, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.65% (2.2969 => 2.3577, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.64% (0.3826 => 0.3927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.64% (0.3865 => 0.3967, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.56% (14.3668 => 14.7349, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.49% (0.5981 => 0.6130, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.47% (1.4186 => 1.4536, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.46% (0.6456 => 0.6615, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.5859 => 1.6246, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.42% (0.4636 => 0.4748, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1153, std. dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 2.32% (17.1811 => 17.5795, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/football/football: 2.21% (0.8921 => 0.9118, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5020 => 0.5130, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.16% (1.2842 => 1.3119, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.2024 => 2.2447, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.70% (0.7115 => 0.7236, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.66% (1.1840 => 1.2036, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.48% (1.0722 => 1.0881, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8964, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (4.2280 => 4.4400, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7549, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 3.01% (26.0924 => 26.8766, std. dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/hash2: 1.62% (3.1578 => 3.2088, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3344, std. dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8225, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2339, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (1.5086 => 1.5273, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1250, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1475, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.64% (5.3855 => 3.7356, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.29% (5.3526 => 3.7314, std. dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0439, std. dev.: 0.0291) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.42% (2.9384 => 2.5440, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -11.87% (22.1758 => 19.5441, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -7.72% (1.5373 => 1.4186, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std. dev.: 0.0010) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4750, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.6802 => 8.4393, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.60% (10.2830 => 10.0160, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9632, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.70% (12.5348 => 12.3219, std. dev.: 0.0145) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 19:25:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 21:25:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120818022504.F36A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2998?compare_to=2993&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2998, Order: 162145, Start Time: 2012-08-17 23:42:23, End Time: 2012-08-18 02:25:50 To: 2993, Order: 162120, Start Time: 2012-08-17 20:31:13, End Time: 2012-08-17 23:14:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (114 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.12% (53.7896 => 54.9282, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.06% (2.0658 => 2.1084, std. dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.54% (0.7614 => 0.7497, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (107.6977 => 106.3868, std. dev.: 0.0576) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 11.81% (0.3792 => 0.4240, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-4: 11.40% (0.3465 => 0.3860, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.29% (0.3446 => 0.3835, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.21% (0.3442 => 0.3828, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.18% (0.3460 => 0.3847, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.16% (0.3496 => 0.3886, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3488 => 0.3877, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.13% (0.3469 => 0.3855, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.96% (0.3650 => 0.4050, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.73% (0.3643 => 0.4034, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.53% (0.3724 => 0.4116, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5826 => 0.6180, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.99% (1.5932 => 1.6886, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (1.6211 => 1.7172, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.92% (1.3152 => 1.3931, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 5.91% (0.5889 => 0.6237, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.1968 => 0.2083, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (0.5026 => 0.5319, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (0.4994 => 0.5282, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.74% (3.5627 => 3.7673, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 5.31% (0.4029 => 0.4243, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.07% (4.2109 => 4.4243, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (0.3930 => 0.4129, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.03% (0.5900 => 0.6197, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.99% (0.2866 => 0.3009, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (0.5000 => 0.5249, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.87% (1.0781 => 1.1306, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.55% (0.7171 => 0.7497, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.26% (1.9694 => 2.0533, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (0.4658 => 0.4853, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.14% (0.2875 => 0.2994, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.13% (0.2566 => 0.2672, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 4.04% (0.9697 => 1.0089, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (1.9966 => 2.0767, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.00% (2.7292 => 2.8385, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.98% (0.9909 => 1.0303, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.97% (5.5417 => 5.7618, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.93% (2.1653 => 2.2504, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.91% (4.4195 => 4.5924, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (2.1013 => 2.1828, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.2823 => 0.2932, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.85% (0.3195 => 0.3318, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.83% (0.3890 => 0.4039, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.83% (0.3004 => 0.3119, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.77% (0.2729 => 0.2832, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.76% (0.2738 => 0.2841, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 3.73% (0.2813 => 0.2918, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.71% (4.6177 => 4.7889, std. dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 3.69% (1.8794 => 1.9488, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (2.0673 => 2.1436, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.66% (0.7875 => 0.8163, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.61% (0.3271 => 0.3389, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2803 => 0.2904, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2811 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.59% (0.3096 => 0.3207, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3258 => 0.3373, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.3362 => 0.3480, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.49% (0.3267 => 0.3381, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.49% (0.3726 => 0.3856, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.48% (1.4269 => 1.4765, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.3903 => 0.4038, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.40% (0.3060 => 0.3164, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.3625 => 0.3747, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.36% (0.4139 => 0.4278, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.35% (0.4146 => 0.4285, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.35% (0.6634 => 0.6856, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3282 => 0.3391, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.30% (0.3124 => 0.3227, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.3678 => 0.3799, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 3.25% (0.3477 => 0.3590, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (0.3348 => 0.3456, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.99% (0.5546 => 0.5712, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.99% (0.4251 => 0.4378, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.85% (23.5202 => 24.1911, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.79% (0.3981 => 0.4092, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.26% (2.0346 => 2.0805, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (0.7426 => 0.7542, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.67% (0.2122 => 0.2306, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6650, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1644, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6454, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1927, std. dev.: 0.0098) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5069, std. dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.80% (41.7953 => 42.5481, std. dev.: 0.0426) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2894, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.27% (2.0820 => 2.1084, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5878, std. dev.: 0.0334) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.36% (2.4764 => 2.3933, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5621, std. dev.: 0.0267) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7972, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std. dev.: 0.0106) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.67% (0.6293 => 0.6125, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/fldry: -2.58% (17.2379 => 16.7937, std. dev.: 0.0457) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.82% (10.7630 => 10.5676, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9687, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 19:59:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 21:59:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818025911.5C9CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/2999?compare_to=2996&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2999, Order: 162159, Start Time: 2012-08-18 01:46:00, End Time: 2012-08-18 02:59:57 To: 2996, Order: 162146, Start Time: 2012-08-18 00:04:37, End Time: 2012-08-18 01:18:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.10% (1.0906 => 1.1026, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.67% (2.0176 => 2.2935, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.93% (0.5818 => 0.6396, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.81% (0.7061 => 0.7754, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5748 => 0.6301, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.55% (0.3578 => 0.3848, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.41% (0.3646 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.40% (0.3663 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.39% (0.3601 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.32% (0.3650 => 0.3917, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 7.23% (0.3623 => 0.3885, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7038 => 0.7542, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.09% (1.3693 => 1.4664, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 7.07% (0.4003 => 0.4286, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.99% (0.7710 => 0.8249, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2388, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4062 => 0.4341, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (0.4328 => 0.4619, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.69% (0.5265 => 0.5617, std. dev.: 0.0062) SingleSource/Regression/C++/ofstream_ctor: 6.58% (0.2781 => 0.2964, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2782 => 0.2962, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2760 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.98% (0.2607 => 0.2763, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.98% (0.9199 => 0.9749, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.97% (0.2628 => 0.2785, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.92% (0.2937 => 0.3111, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.89% (0.3022 => 0.3200, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.85% (0.3246 => 0.3436, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.3899 => 0.4127, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.85% (0.3489 => 0.3693, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.82% (1.2193 => 1.2903, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.2966 => 0.3138, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.6959 => 0.7361, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.73% (0.3580 => 0.3785, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.72% (1.9828 => 2.0962, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.71% (0.2696 => 0.2850, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.68% (0.3149 => 0.3328, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.68% (0.5577 => 0.5894, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.2988 => 0.3154, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.49% (0.4390 => 0.4631, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.17% (13.8202 => 14.5349, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3192 => 0.3357, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.4563 => 1.5314, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3453 => 0.3629, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.1364 => 1.1924, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.88% (0.4016 => 0.4212, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.3293 => 0.3453, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.72% (0.5637 => 0.5903, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (0.3756 => 0.3933, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.70% (7.2180 => 7.5572, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 4.67% (0.8310 => 0.8698, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.61% (3.8646 => 4.0428, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3855, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.57% (0.7506 => 0.7849, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 4.43% (1.1061 => 1.1551, std. dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: 4.37% (1.2292 => 1.2829, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/objinst: 4.35% (0.2945 => 0.3073, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.30% (1.3819 => 1.4413, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.19% (1.9270 => 2.0078, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.0594 => 1.1037, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.15% (16.6129 => 17.3016, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.07% (0.4791 => 0.4986, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.02% (2.1791 => 2.2666, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.89% (0.3755 => 0.3901, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.85% (0.6283 => 0.6525, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6101, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (4.3801 => 4.5413, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.68% (13.2842 => 13.7724, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.62% (3.6692 => 3.8022, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.44% (0.6135 => 0.6346, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.38% (4.9865 => 5.1552, std. dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.8698 => 0.8984, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 2.99% (3.1889 => 3.2844, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.98% (16.2614 => 16.7468, std. dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1333 => 1.1670, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.4961 => 8.7287, std. dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4113 => 0.4224, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.5754 => 6.7527, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.61% (3.2742 => 3.3597, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.5188 => 1.5579, std. dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.5298 => 14.8995, std. dev.: 0.0101) MultiSource/Applications/JM/lencod/lencod: 2.51% (14.8535 => 15.2265, std. dev.: 0.0108) MultiSource/Applications/oggenc/oggenc: 2.01% (4.6629 => 4.7568, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.1007 => 2.1430, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.56% (1.0313 => 1.0474, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.39% (3.7467 => 3.7986, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.24% (0.9108 => 0.9221, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5195, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0490) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 10.06% (1.2998 => 1.4306, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.37% (11.2619 => 11.7539, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3851, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5940, std. dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: 2.12% (10.7476 => 10.9751, std. dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6782, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3249, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.38% (1.5089 => 1.5297, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.17% (26.5159 => 26.8269, std. dev.: 0.0275) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5746, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1486, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.43% (0.8818 => 0.8692, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1026, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5103, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3166, std. dev.: 0.0069) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5817, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9627, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2293, std. dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2005, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7911, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3671, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4758, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.07% (20.3410 => 20.1241, std. dev.: 0.0124) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 20:07:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 22:07:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818030728.DDAAA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3000?compare_to=2997&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3000, Order: 162159, Start Time: 2012-08-18 01:49:24, End Time: 2012-08-18 03:08:16 To: 2997, Order: 162146, Start Time: 2012-08-18 00:03:02, End Time: 2012-08-18 01:21:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (98 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (740 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.40% (13.7637 => 14.3688, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 1.70% (10.9414 => 11.1272, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.60% (10.3673 => 14.3688, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.27% (1.1194 => 1.2456, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.48% (2.2022 => 2.3890, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.03% (0.1892 => 0.2025, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.82% (1.7609 => 1.8810, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.62% (10.4361 => 11.1272, std. dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.50% (0.1584 => 0.1687, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.18% (0.5925 => 0.6291, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.15% (0.2065 => 0.2192, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.12% (0.6030 => 0.6399, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (7.0540 => 7.4179, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 5.11% (0.7326 => 0.7700, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2271 => 0.2384, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (0.7433 => 0.7799, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 4.91% (0.3282 => 0.3443, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.69% (0.4879 => 0.5108, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (9.4845 => 9.8849, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.12% (4.2646 => 4.4402, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.09% (0.8172 => 0.8506, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.95% (5.0018 => 5.1995, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.93% (0.5569 => 0.5788, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.9449 => 5.1387, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.82% (0.9765 => 1.0138, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.78% (0.3121 => 0.3239, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.62% (1.3050 => 1.3522, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.62% (8.1363 => 8.4305, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.48% (0.7835 => 0.8108, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 3.40% (0.3387 => 0.3502, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.35% (1.5415 => 1.5931, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.8067 => 0.8334, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 3.30% (5.7591 => 5.9491, std. dev.: 0.0177) MultiSource/Applications/Burg/burg: 3.25% (1.1642 => 1.2020, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (0.5105 => 0.5264, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1861 => 1.2223, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.03% (3.3354 => 3.4363, std. dev.: 0.0110) MultiSource/Applications/treecc/treecc: 2.92% (2.0273 => 2.0864, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.80% (0.6675 => 0.6862, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.4289 => 0.4409, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.76% (1.5603 => 1.6034, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.74% (0.3650 => 0.3750, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6450 => 0.6625, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (14.3668 => 14.7555, std. dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.61% (1.4186 => 1.4556, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.60% (3.8723 => 3.9729, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.57% (0.4636 => 0.4755, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (0.4064 => 0.4165, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.46% (0.5981 => 0.6128, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (2.0665 => 2.1167, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: 2.39% (0.8921 => 0.9134, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.38% (2.2969 => 2.3516, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4620 => 0.4730, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6456 => 0.6606, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5740, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5859 => 1.6214, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.13% (1.2842 => 1.3115, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5020 => 0.5124, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2461, std. dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 1.67% (1.1840 => 1.2038, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.63% (0.7115 => 0.7231, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.59% (1.0722 => 1.0893, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (4.2280 => 4.4465, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0072) MultiSource/Applications/lua/lua: 2.94% (26.0924 => 26.8604, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.57% (9.1159 => 9.2594, std. dev.: 0.0073) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3343, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8231, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.31% (1.3045 => 1.3216, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5086 => 1.5277, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6826, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.29% (0.8651 => 0.1705, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.52% (5.2763 => 3.1386, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7069, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.72% (5.3526 => 3.7083, std. dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0463, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.74% (2.9384 => 2.5347, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -12.28% (22.1758 => 19.4530, std. dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1057, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -7.73% (1.5373 => 1.4185, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.15% (1.5835 => 1.5020, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0012) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4717, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4324, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -2.84% (10.2830 => 9.9908, std. dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.47% (8.1563 => 7.9552, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3358, std. dev.: 0.0090) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8128, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 21:36:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 23:36:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818043639.C0BAC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3001?compare_to=2999&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3001, Order: 162160, Start Time: 2012-08-18 03:27:25, End Time: 2012-08-18 04:37:25 To: 2999, Order: 162159, Start Time: 2012-08-18 01:46:00, End Time: 2012-08-18 02:59:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 36 (36 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 917 (695 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.43% (3.7884 => 3.8424, std. dev.: 0.0149) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.74% (2.0176 => 2.2948, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 9.76% (0.7061 => 0.7750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.63% (0.5818 => 0.6378, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.39% (0.5748 => 0.6288, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3578 => 0.3852, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 7.47% (0.3601 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.46% (0.3646 => 0.3918, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3663 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.23% (0.3914 => 0.4197, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.96% (0.7038 => 0.7528, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (3.9660 => 4.2410, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.7710 => 0.8233, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4328 => 0.4618, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.63% (0.2655 => 0.2831, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2782 => 0.2959, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.11% (0.9199 => 0.9761, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4062 => 0.4309, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.00% (0.3899 => 0.4133, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.93% (1.2193 => 1.2916, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.91% (0.2690 => 0.2849, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.83% (0.2966 => 0.3139, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.82% (0.2937 => 0.3108, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2760 => 0.2919, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2765 => 0.2924, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3246 => 0.3430, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4379 => 0.4627, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.62% (0.3489 => 0.3685, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.60% (0.2696 => 0.2847, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0935, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3107 => 0.3280, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.57% (0.3485 => 0.3679, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.53% (0.3149 => 0.3323, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2988 => 0.3148, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.27% (0.5577 => 0.5871, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.13% (0.3453 => 0.3630, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.11% (0.3192 => 0.3355, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (1.4563 => 1.5298, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.01% (0.4390 => 0.4610, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.87% (1.1364 => 1.1917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.86% (0.4016 => 0.4211, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.77% (1.1061 => 1.1589, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.72% (0.8310 => 0.8702, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (7.2180 => 7.5549, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0446, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3856, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 4.50% (0.3868 => 0.4042, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.36% (1.0594 => 1.1056, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2292 => 1.2826, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.19% (1.9270 => 2.0077, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.17% (0.7460 => 0.7771, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.11% (0.4791 => 0.4988, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.11% (16.6129 => 17.2951, std. dev.: 0.0093) MultiSource/Applications/siod/siod: 4.09% (2.1791 => 2.2682, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.85% (0.6283 => 0.6525, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (4.4433 => 4.6125, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (4.3801 => 4.5430, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.50% (0.6135 => 0.6350, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.47% (4.9865 => 5.1594, std. dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8698 => 0.8963, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.87% (0.4113 => 0.4231, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.62% (3.2742 => 3.3599, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.33% (1.5188 => 1.5542, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.11% (4.6629 => 4.7612, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.1007 => 2.1431, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 1.62% (0.6250 => 0.6351, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.61% (1.0313 => 1.0479, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.33% (0.9108 => 0.9229, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.27% (3.7467 => 3.7944, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.36% (1.2998 => 1.4215, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.35% (11.2619 => 11.7519, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.06% (1.7081 => 1.7775, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8184, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4271 => 7.6093, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.84% (3.7731 => 3.8424, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0066) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5089 => 1.5278, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.24% (26.5159 => 26.8438, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5716, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.26% (22.5627 => 21.1493, std. dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.17% (0.8818 => 0.8715, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.17% (2.6470 => 2.5102, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.61% (1.1560 => 1.1027, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.53% (1.3780 => 1.3156, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9989, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5867, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2252, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3305 => 7.2112, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3547, std. dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.23% (20.3410 => 20.0903, std. dev.: 0.0318) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4763, std. dev.: 0.0085) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 21:50:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 17 Aug 2012 23:50:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818045026.A81A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3002?compare_to=3000&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3002, Order: 162160, Start Time: 2012-08-18 03:35:46, End Time: 2012-08-18 04:51:13 To: 3000, Order: 162159, Start Time: 2012-08-18 01:49:24, End Time: 2012-08-18 03:08:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 33 (34 on baseline) Performance Regressions: 0 (80 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (19 on baseline) Unchanged Tests: 900 (730 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.54% (14.3688 => 14.1469, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.46% (10.3673 => 14.1469, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3473 => 0.3844, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.42% (0.3561 => 0.3932, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3516 => 0.3880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.27% (0.3543 => 0.3907, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.82% (0.3828 => 0.4204, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.60% (0.3886 => 0.4259, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.38% (0.3817 => 0.4137, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.38% (2.2022 => 2.3868, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.99% (1.7609 => 1.8839, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 6.67% (0.5925 => 0.6320, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.53% (0.6030 => 0.6424, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.14% (0.7326 => 0.7776, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.32% (0.3177 => 0.3346, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.91% (0.3282 => 0.3443, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.7433 => 0.7797, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.49% (0.2271 => 0.2373, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.93% (0.8172 => 0.8493, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.91% (4.2646 => 4.4315, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.9449 => 5.1360, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (5.0018 => 5.1896, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.75% (0.5860 => 0.6080, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.49% (1.3050 => 1.3505, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3423 => 0.3540, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3121 => 0.3227, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.1363 => 8.4109, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.34% (0.3441 => 0.3556, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.26% (0.8067 => 0.8330, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.19% (0.4636 => 0.4784, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9418, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: 3.15% (0.4289 => 0.4424, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.14% (1.5415 => 1.5899, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.9765 => 1.0068, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.04% (0.5105 => 0.5260, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.01% (1.1642 => 1.1992, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0852, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.76% (0.6675 => 0.6859, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9712, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6450 => 0.6612, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1152, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.31% (1.4186 => 1.4513, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6456 => 0.6601, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.21% (2.2969 => 2.3477, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8921 => 0.9117, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.19% (1.5859 => 1.6207, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3110, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.80% (2.2024 => 2.2421, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.72% (1.1840 => 1.2044, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.39% (1.0722 => 1.0871, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (4.2280 => 4.4611, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.04% (26.0924 => 26.8864, std. dev.: 0.0195) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7486, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3337, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.17% (1.5086 => 1.5262, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.60% (5.2763 => 3.1342, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0250, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.54% (2.9384 => 2.5405, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -8.21% (1.5373 => 1.4111, std. dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4785, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4153, std. dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0109, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9602, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std. dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4224, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.45% (12.5348 => 12.3527, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 22:35:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 00:35:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120818053549.DA7022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3003?compare_to=2998&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3003, Order: 162159, Start Time: 2012-08-18 02:53:20, End Time: 2012-08-18 05:36:37 To: 2998, Order: 162145, Start Time: 2012-08-17 23:42:23, End Time: 2012-08-18 02:25:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (771 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3446 => 0.3836, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.28% (0.3465 => 0.3856, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.21% (0.3469 => 0.3858, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3488 => 0.3879, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.18% (0.3460 => 0.3847, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3496 => 0.3887, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.13% (0.3442 => 0.3825, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.88% (0.3650 => 0.4047, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3643 => 0.4035, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3724 => 0.4112, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.83% (0.5826 => 0.6224, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 6.61% (0.5889 => 0.6278, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 6.16% (1.5932 => 1.6913, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.45% (0.4994 => 0.5266, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.39% (3.5627 => 3.7549, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.38% (1.6211 => 1.7083, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.17% (1.3152 => 1.3832, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.13% (0.7171 => 0.7539, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.07% (0.4361 => 0.4582, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (0.5026 => 0.5279, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.74% (4.2109 => 4.4107, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.56% (0.5900 => 0.6169, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (0.5000 => 0.5225, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 4.42% (1.0781 => 1.1257, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.2866 => 0.2988, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.2823 => 0.2942, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.19% (0.2792 => 0.2909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.16% (0.2813 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2750 => 0.2864, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.3004 => 0.3128, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.11% (0.9909 => 1.0316, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.2780 => 0.2894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2811 => 0.2925, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.05% (2.0673 => 2.1511, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3195 => 0.3324, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.97% (5.5417 => 5.7616, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/wc: 3.88% (0.3096 => 0.3216, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.81% (0.2911 => 0.3022, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.81% (0.3124 => 0.3243, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.81% (0.3362 => 0.3490, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3060 => 0.3175, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.70% (0.3267 => 0.3388, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (0.3890 => 0.4034, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.68% (0.3317 => 0.3439, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.65% (0.9697 => 1.0051, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3348 => 0.3468, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4146 => 0.4294, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.54% (0.3726 => 0.3858, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.54% (0.3477 => 0.3600, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (0.4658 => 0.4822, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.50% (1.9694 => 2.0384, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 3.50% (0.6634 => 0.6866, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (4.4195 => 4.5730, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3690 => 0.3817, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 3.43% (0.3678 => 0.3804, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (2.1013 => 2.1722, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 3.34% (1.8794 => 1.9422, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.32% (1.9966 => 2.0629, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.3903 => 0.4029, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.18% (4.6177 => 4.7645, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 3.18% (0.4251 => 0.4386, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.15% (2.1653 => 2.2336, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.09% (2.7292 => 2.8134, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.01% (0.3981 => 0.4101, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.01% (1.4269 => 1.4699, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.3845 => 0.3958, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.92% (0.7875 => 0.8105, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.4139 => 0.4253, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 2.61% (0.5012 => 0.5143, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.61% (0.6435 => 0.6603, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.97% (2.0346 => 2.0747, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.68% (0.2122 => 0.2285, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6728, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6446, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1928, std. dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (41.7953 => 42.5798, std. dev.: 0.0371) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4988, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2257, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5848, std. dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.14% (2.4764 => 2.3738, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -1.04% (11.9555 => 11.8313, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5648, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary2: -8.66% (0.2402 => 0.2194, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7945, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0034) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.86% (17.2379 => 16.7443, std. dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9635, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -1.42% (5.5810 => 5.5020, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 23:35:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 01:35:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818063553.891042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3004?compare_to=3001&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3004, Order: 162163, Start Time: 2012-08-18 05:26:37, End Time: 2012-08-18 06:36:39 To: 3001, Order: 162160, Start Time: 2012-08-18 03:27:25, End Time: 2012-08-18 04:37:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (36 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Existing Failures: 36 (0 on baseline) Unchanged Tests: 916 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.03% (54.3563 => 56.5444, std. dev.: 0.0827) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.83% (3.8424 => 3.7722, std. dev.: 0.0236) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.79% (2.0176 => 2.2958, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 9.88% (0.5818 => 0.6393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.77% (0.7061 => 0.7751, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.74% (0.5748 => 0.6308, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.11% (0.3130 => 0.3415, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.92% (0.3650 => 0.3939, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.91% (0.3578 => 0.3861, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.76% (0.3646 => 0.3929, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.55% (0.3789 => 0.4075, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3623 => 0.3895, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.39% (0.4003 => 0.4299, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.22% (0.7710 => 0.8267, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (3.9660 => 4.2476, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4328 => 0.4629, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.80% (0.5265 => 0.5623, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.2781 => 0.2969, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.65% (0.2782 => 0.2967, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.44% (0.3899 => 0.4150, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.4062 => 0.4320, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 6.33% (0.2607 => 0.2772, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.32% (0.3022 => 0.3213, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2628 => 0.2792, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2690 => 0.2857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.2937 => 0.3118, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.13% (0.9199 => 0.9763, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.09% (0.2760 => 0.2928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.6959 => 0.7378, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.2193 => 1.2925, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.3107 => 0.3290, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.84% (1.9828 => 2.0986, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 5.81% (0.3149 => 0.3332, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.5577 => 0.5901, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.78% (0.3580 => 0.3787, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3489 => 0.3690, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2761 => 0.2920, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.73% (0.3246 => 0.3432, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.2988 => 0.3156, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3192 => 0.3365, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4390 => 0.4623, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (1.4563 => 1.5331, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.04% (0.2023 => 0.2125, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.02% (1.1364 => 1.1935, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (0.3756 => 0.3942, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.85% (7.2180 => 7.5683, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/moments: 4.78% (0.3868 => 0.4053, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.76% (3.8646 => 4.0484, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.72% (0.8310 => 0.8702, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.58% (1.3245 => 1.3851, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.57% (1.1061 => 1.1566, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 4.55% (0.2945 => 0.3079, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2292 => 1.2850, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 4.49% (1.0594 => 1.1070, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.29% (16.6129 => 17.3255, std. dev.: 0.0231) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.7460 => 0.7778, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.22% (1.9270 => 2.0084, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.20% (0.4791 => 0.4992, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.07% (2.1791 => 2.2678, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5526, std. dev.: 0.0139) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.6283 => 0.6526, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.85% (4.4433 => 4.6142, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.68% (0.6135 => 0.6361, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (4.9865 => 5.1644, std. dev.: 0.0211) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (0.8698 => 0.8982, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 2.99% (0.4113 => 0.4236, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (3.2742 => 3.3608, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.20% (4.6629 => 4.7653, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.1007 => 2.1438, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.69% (1.0313 => 1.0487, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6250 => 0.6354, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.47% (0.9108 => 0.9242, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.39% (3.7467 => 3.7986, std. dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2549, std. dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.76% (1.2998 => 1.4267, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7441, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5946, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3256, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0074) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.28% (26.5159 => 26.8549, std. dev.: 0.0404) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5089 => 1.5272, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1588, std. dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0055) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5097, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.77% (1.3780 => 1.3260, std. dev.: 0.0123) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5729, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2321, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2133, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7911, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (84.4286 => 83.3507, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.11% (20.3410 => 20.1142, std. dev.: 0.0323) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.11% (5.5401 => 5.4788, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 17 23:41:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 01:41:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818064113.6AD432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3005?compare_to=3002&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3005, Order: 162163, Start Time: 2012-08-18 05:26:33, End Time: 2012-08-18 06:42:00 To: 3002, Order: 162160, Start Time: 2012-08-18 03:35:46, End Time: 2012-08-18 04:51:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (34 on baseline) Performance Regressions: 2 (82 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 53 (19 on baseline) Unchanged Tests: 899 (728 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.78% (78.5997 => 80.7844, std. dev.: 0.1598) SingleSource/Benchmarks/Misc/mandel-2: 1.62% (1.4111 => 1.4340, std. dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/kimwitu++/kc MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.63% (10.3673 => 14.1646, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.33% (0.3543 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3543 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.92% (0.1432 => 0.1574, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3828 => 0.4201, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.65% (0.3927 => 0.4306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.50% (0.3886 => 0.4255, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.92% (2.2022 => 2.3986, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.92% (1.7609 => 1.9004, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.91% (0.3817 => 0.4119, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 6.72% (0.5925 => 0.6323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.65% (0.6030 => 0.6431, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 6.07% (0.7326 => 0.7771, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.08% (0.4879 => 0.5127, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 4.91% (0.7433 => 0.7798, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.67% (0.2271 => 0.2377, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.96% (4.2646 => 4.4335, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.95% (4.9449 => 5.1402, std. dev.: 0.0113) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.89% (5.0018 => 5.1965, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.81% (0.8172 => 0.8483, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.72% (8.1363 => 8.4388, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.56% (1.3050 => 1.3514, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.34% (5.7591 => 5.9512, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.29% (0.4289 => 0.4430, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.5105 => 0.5272, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.25% (0.3387 => 0.3497, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.8067 => 0.8328, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3441 => 0.3552, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.19% (0.5020 => 0.5180, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.18% (0.9765 => 1.0076, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.07% (1.5415 => 1.5889, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.06% (1.1642 => 1.1998, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.4103 => 0.4228, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0852, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3826 => 0.3935, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.65% (0.6675 => 0.6852, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9709, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.52% (2.0665 => 2.1186, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (0.4064 => 0.4165, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.48% (0.6450 => 0.6610, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.36% (0.4620 => 0.4729, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8921 => 0.9125, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.26% (2.2969 => 2.3489, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (1.4186 => 1.4505, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6213, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2842 => 1.3124, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.2024 => 2.2458, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.72% (1.1840 => 1.2044, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.42% (1.0722 => 1.0874, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (4.2280 => 4.4413, std. dev.: 0.0101) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7507, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 2.97% (26.0924 => 26.8686, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2143, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5770, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1461, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1274, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.23% (2.9384 => 2.5496, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4194, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.1396 => 1.0596, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -6.72% (1.5373 => 1.4340, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std. dev.: 0.0022) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4692, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4215, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0083, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9586, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3413, std. dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std. dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 01:21:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 03:21:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818082144.584A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3006?compare_to=3004&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3006, Order: 162165, Start Time: 2012-08-18 07:07:08, End Time: 2012-08-18 08:22:27 To: 3004, Order: 162163, Start Time: 2012-08-18 05:26:37, End Time: 2012-08-18 06:36:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 36 (0 on baseline) Performance Regressions: 0 (144 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 918 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.68% (2.0176 => 2.2936, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.83% (0.5818 => 0.6390, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/Hello: 9.79% (0.5748 => 0.6311, std. dev.: 0.0154) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std. dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3646 => 0.3925, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.53% (0.3601 => 0.3872, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std. dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.43% (0.3663 => 0.3935, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3789 => 0.4067, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std. dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.30% (0.7710 => 0.8273, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 7.23% (0.7038 => 0.7547, std. dev.: 0.0104) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.97% (3.9660 => 4.2425, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.84% (1.3693 => 1.4630, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (0.4328 => 0.4624, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.5265 => 0.5625, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.47% (0.4062 => 0.4325, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.3899 => 0.4147, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.2937 => 0.3121, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2655 => 0.2821, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.21% (0.9199 => 0.9770, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 6.12% (0.2760 => 0.2929, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.11% (0.6959 => 0.7384, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.00% (0.2765 => 0.2931, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.93% (1.9828 => 2.1003, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3107 => 0.3291, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.90% (0.3489 => 0.3695, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2761 => 0.2922, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.81% (1.2193 => 1.2902, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.75% (0.3149 => 0.3330, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3246 => 0.3428, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3192 => 0.3366, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.36% (0.5577 => 0.5876, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 5.33% (0.2925 => 0.3081, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.28% (13.8202 => 14.5493, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: 5.27% (0.3453 => 0.3635, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.2914 => 0.3066, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.3756 => 0.3950, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.4563 => 1.5315, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.10% (0.4016 => 0.4221, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 5.07% (0.3534 => 0.3713, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.97% (1.1364 => 1.1929, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5637 => 0.5915, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 4.84% (1.1061 => 1.1596, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.82% (7.2180 => 7.5662, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.67% (1.3245 => 1.3863, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.66% (1.3819 => 1.4463, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0447, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 4.65% (0.8310 => 0.8696, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.62% (1.3813 => 1.4451, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.59% (2.1791 => 2.2791, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2292 => 1.2848, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 4.40% (0.7506 => 0.7836, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.24% (1.0594 => 1.1043, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.7460 => 0.7776, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.18% (1.9270 => 2.0076, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.16% (16.6129 => 17.3034, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.13% (0.3755 => 0.3910, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.03% (0.4791 => 0.4984, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.4433 => 4.6151, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.85% (0.6283 => 0.6525, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5474, std. dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.66% (13.2842 => 13.7704, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6135 => 0.6353, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.51% (3.6692 => 3.7981, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.48% (4.9865 => 5.1598, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.09% (3.1889 => 3.2873, std. dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.94% (16.2614 => 16.7398, std. dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1333 => 1.1665, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.4961 => 8.7292, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.63% (3.2742 => 3.3602, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.5298 => 14.9019, std. dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.8535 => 15.2332, std. dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: 2.47% (6.5754 => 6.7380, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (1.5188 => 1.5534, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.00% (4.6629 => 4.7563, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.1007 => 2.1397, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 1.62% (0.6250 => 0.6351, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.32% (0.9108 => 0.9228, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 1.32% (3.7467 => 3.7960, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5182, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.89% (1.2998 => 1.4024, std. dev.: 0.0241) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7399, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6022, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.16% (10.7476 => 10.9800, std. dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6766, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3248, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0141) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.13% (1.5089 => 1.5259, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.09% (26.5159 => 26.8037, std. dev.: 0.0223) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5720, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.28% (22.5627 => 21.1462, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.03% (1.2308 => 1.0951, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0245) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5155, std. dev.: 0.0131) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.39% (1.3780 => 1.3313, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5824, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.44% (1.9762 => 1.9279, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.21% (3.0263 => 2.9595, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2245, std. dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3305 => 7.2144, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.51% (20.3410 => 20.0334, std. dev.: 0.0549) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3684, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 01:32:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 03:32:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818083214.5048F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3007?compare_to=3005&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3007, Order: 162165, Start Time: 2012-08-18 07:13:34, End Time: 2012-08-18 08:33:01 To: 3005, Order: 162163, Start Time: 2012-08-18 05:26:33, End Time: 2012-08-18 06:42:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 33 (1 on baseline) Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 900 (740 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/minisat/minisat MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/McGill/chomp Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (14.1646 => 14.3831, std. dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.74% (10.3673 => 14.3831, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.00% (1.1194 => 1.2537, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.43% (0.3473 => 0.3870, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.71% (0.1432 => 0.1571, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.98% (2.2022 => 2.4000, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.60% (1.7609 => 1.8947, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 6.94% (10.4361 => 11.1605, std. dev.: 0.0217) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.57% (0.1584 => 0.1688, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5925 => 0.6297, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.6030 => 0.6405, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.48% (7.0540 => 7.4408, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/oourafft: 5.39% (0.3282 => 0.3459, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 5.28% (0.7326 => 0.7713, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.25% (0.4879 => 0.5135, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.7433 => 0.7797, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.76% (0.2271 => 0.2379, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.8172 => 0.8531, std. dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (9.4845 => 9.8854, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.18% (4.2646 => 4.4427, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (5.0018 => 5.2085, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5569 => 0.5796, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.9449 => 5.1462, std. dev.: 0.0129) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.82% (8.1363 => 8.4475, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.71% (1.3050 => 1.3534, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.52% (0.3441 => 0.3562, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 3.46% (0.7835 => 0.8106, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.34% (0.3387 => 0.3500, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.33% (1.5415 => 1.5928, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9765 => 1.0087, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 3.29% (5.7591 => 5.9487, std. dev.: 0.0155) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1861 => 1.2242, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 3.18% (1.1642 => 1.2012, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.16% (0.3826 => 0.3947, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3650 => 0.3763, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.4289 => 0.4421, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.08% (0.5105 => 0.5262, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.06% (3.3354 => 3.4375, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists: 3.01% (0.3422 => 0.3525, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.92% (1.5603 => 1.6059, std. dev.: 0.0100) MultiSource/Applications/treecc/treecc: 2.91% (2.0273 => 2.0863, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.81% (0.6450 => 0.6631, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.4064 => 0.4178, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (2.0665 => 2.1243, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (14.3668 => 14.7672, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.76% (0.4636 => 0.4764, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (0.3935 => 0.4043, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.71% (0.6675 => 0.6856, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.68% (3.8723 => 3.9762, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5981 => 0.6139, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 2.63% (0.6456 => 0.6626, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.60% (1.4186 => 1.4555, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4620 => 0.4735, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8921 => 0.9137, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.40% (0.4203 => 0.4304, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.39% (17.1811 => 17.5914, std. dev.: 0.0187) MultiSource/Applications/siod/siod: 2.32% (2.2969 => 2.3503, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.5020 => 0.5135, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.29% (1.2842 => 1.3136, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5859 => 1.6218, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.2024 => 2.2434, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.81% (1.1840 => 1.2054, std. dev.: 0.0059) MultiSource/Applications/minisat/minisat: 1.67% (0.7115 => 0.7234, std. dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.81% (4.2280 => 4.4314, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 3.05% (26.0924 => 26.8878, std. dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2125, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8230, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2384, std. dev.: 0.0116) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.09% (1.5086 => 1.5251, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.47% (5.2763 => 3.1412, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.73% (5.3855 => 3.7305, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.28% (5.3526 => 3.7319, std. dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1034, std. dev.: 0.0229) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.28% (2.9384 => 2.5482, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4907, std. dev.: 0.0457) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2373 => 1.1030, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -6.86% (1.5373 => 1.4318, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4715, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4112, std. dev.: 0.0197) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.59% (10.2830 => 10.0168, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (8.1563 => 7.9534, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3495, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 01:48:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 03:48:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120818084854.B95342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3008?compare_to=3003&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3008, Order: 162164, Start Time: 2012-08-18 06:03:58, End Time: 2012-08-18 08:49:39 To: 3003, Order: 162159, Start Time: 2012-08-18 02:53:20, End Time: 2012-08-18 05:36:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (86 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (792 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.41% (125.1757 => 129.4493, std. dev.: 1.0083) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.62% (2.0510 => 2.0843, std. dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.04% (1.3510 => 1.3650, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3446 => 0.3843, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3465 => 0.3864, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.48% (0.3442 => 0.3837, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.47% (0.3488 => 0.3888, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.33% (0.3460 => 0.3852, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.33% (0.3469 => 0.3862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.30% (0.3496 => 0.3891, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.12% (0.3650 => 0.4056, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.06% (0.3643 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.61% (0.3724 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.00% (0.5826 => 0.6234, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.41% (1.5932 => 1.6953, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.78% (0.3930 => 0.4157, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.67% (3.5627 => 3.7648, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.61% (1.6211 => 1.7121, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 5.33% (0.7171 => 0.7553, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.28% (1.3152 => 1.3847, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.16% (0.4361 => 0.4586, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.11% (0.2875 => 0.3022, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.08% (0.5000 => 0.5254, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.05% (1.0781 => 1.1325, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.2736 => 0.2871, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 4.91% (4.2109 => 4.4177, std. dev.: 0.0168) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.72% (0.5026 => 0.5263, std. dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 4.53% (0.3004 => 0.3140, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.50% (2.0673 => 2.1603, std. dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.48% (0.3195 => 0.3338, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.46% (0.9909 => 1.0351, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.42% (0.3124 => 0.3262, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.36% (0.2566 => 0.2678, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.2866 => 0.2989, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 4.27% (5.5417 => 5.7781, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.25% (0.3362 => 0.3505, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (0.3890 => 0.4053, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.14% (0.3282 => 0.3418, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.12% (0.3060 => 0.3186, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.3845 => 0.4000, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.00% (0.9697 => 1.0085, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.82% (0.4658 => 0.4836, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (1.9694 => 2.0442, std. dev.: 0.0087) MultiSource/Applications/siod/siod: 3.77% (0.6634 => 0.6884, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.67% (1.9966 => 2.0699, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (2.1013 => 2.1779, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 3.60% (1.8794 => 1.9470, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (4.4195 => 4.5749, std. dev.: 0.0089) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.51% (2.7292 => 2.8249, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.50% (2.1653 => 2.2411, std. dev.: 0.0050) MultiSource/Applications/treecc/treecc: 3.45% (0.7875 => 0.8147, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.3903 => 0.4037, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 3.39% (1.4269 => 1.4753, std. dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 3.38% (4.6177 => 4.7736, std. dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: 3.05% (23.5202 => 24.2385, std. dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.6435 => 0.6631, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 2.99% (0.5546 => 0.5712, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (0.4139 => 0.4259, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.5012 => 0.5153, std. dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 2.12% (2.0346 => 2.0778, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (12.0509 => 12.6517, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1711, std. dev.: 0.0210) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8868, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6376, std. dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.92% (41.7953 => 42.5959, std. dev.: 0.0224) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5027, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5914, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/ary3: 1.70% (15.8721 => 16.1412, std. dev.: 0.0317) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2808, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5807, std. dev.: 0.0201) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.76% (2.4764 => 2.3337, std. dev.: 0.0406) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.33% (25.4195 => 16.1841, std. dev.: 0.1910) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8091, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8021, std. dev.: 0.0051) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.78% (17.2379 => 16.7583, std. dev.: 0.0417) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (16.2163 => 15.9755, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 03:03:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 05:03:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818100357.79EB92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3009?compare_to=3006&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3009, Order: 162166, Start Time: 2012-08-18 08:50:12, End Time: 2012-08-18 10:03:56 To: 3006, Order: 162165, Start Time: 2012-08-18 07:07:08, End Time: 2012-08-18 08:22:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.72% (55.6204 => 56.5754, std. dev.: 0.0189) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.44% (2.0176 => 2.2888, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 10.09% (0.5818 => 0.6405, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.85% (0.5748 => 0.6314, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.08% (0.7061 => 0.7702, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3578 => 0.3853, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.55% (0.3601 => 0.3873, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.49% (0.3646 => 0.3919, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.43% (0.3663 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.40% (0.3650 => 0.3920, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3623 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3789 => 0.4067, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.4062 => 0.4353, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.7710 => 0.8262, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 7.09% (0.4003 => 0.4287, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (0.4328 => 0.4632, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.01% (0.2781 => 0.2976, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.86% (3.9660 => 4.2382, std. dev.: 0.0041) MultiSource/Applications/hbd/hbd: 6.86% (1.3693 => 1.4632, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (0.2655 => 0.2829, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.54% (0.2628 => 0.2800, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2760 => 0.2937, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2607 => 0.2774, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.19% (0.3022 => 0.3209, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.17% (0.9199 => 0.9767, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.17% (0.2966 => 0.3149, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.2937 => 0.3118, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.13% (0.2726 => 0.2893, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.11% (0.3485 => 0.3698, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.03% (0.3580 => 0.3796, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.02% (1.9828 => 2.1022, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.99% (0.3489 => 0.3698, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3107 => 0.3291, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3149 => 0.3335, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.88% (1.2193 => 1.2910, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.6959 => 0.7356, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3246 => 0.3427, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.53% (0.3453 => 0.3644, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.3192 => 0.3367, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.24% (0.5577 => 0.5869, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.21% (0.3534 => 0.3718, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.19% (0.3293 => 0.3464, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5336, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.05% (0.4016 => 0.4219, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.01% (1.4563 => 1.5293, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.93% (0.3756 => 0.3941, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.88% (1.1061 => 1.1601, std. dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.82% (1.1364 => 1.1912, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.71% (7.2180 => 7.5578, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.62% (0.8310 => 0.8694, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.53% (0.7506 => 0.7846, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2292 => 1.2848, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (3.8646 => 4.0391, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (1.3245 => 1.3837, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.3819 => 1.4430, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.34% (1.3813 => 1.4412, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 4.29% (16.6129 => 17.3249, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.23% (0.3755 => 0.3914, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.0594 => 1.1037, std. dev.: 0.0059) MultiSource/Applications/treecc/treecc: 4.15% (1.9270 => 2.0069, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.13% (0.7460 => 0.7768, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.99% (2.1791 => 2.2660, std. dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.99% (0.4791 => 0.4982, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.84% (0.6283 => 0.6524, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.3801 => 4.5478, std. dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.70% (4.4433 => 4.6075, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (3.6692 => 3.8015, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.57% (13.2842 => 13.7586, std. dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6135 => 0.6349, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.49% (4.9865 => 5.1604, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.8698 => 0.8983, std. dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.09% (3.1889 => 3.2874, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1333 => 1.1670, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7216, std. dev.: 0.0273) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.77% (8.4961 => 8.7317, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.2742 => 3.3569, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.52% (6.5754 => 6.7411, std. dev.: 0.0145) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8955, std. dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5567, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.8535 => 15.2225, std. dev.: 0.0147) MultiSource/Applications/oggenc/oggenc: 2.01% (4.6629 => 4.7566, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.1007 => 2.1405, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.81% (0.6250 => 0.6363, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.46% (1.0313 => 1.0464, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.33% (3.7467 => 3.7967, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.22% (0.9108 => 0.9219, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std. dev.: 0.0329) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.61% (1.2998 => 1.4247, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.61% (1.9144 => 2.0026, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7425, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3840, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5950, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.19% (10.7476 => 10.9833, std. dev.: 0.0217) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5928 => 4.6754, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.58% (3.2729 => 3.3246, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0066) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.20% (1.5089 => 1.5270, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (26.5159 => 26.8030, std. dev.: 0.0218) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.5627 => 21.1385, std. dev.: 0.0234) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.54% (0.8818 => 0.8682, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1047, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5100, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -4.55% (1.1560 => 1.1034, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.82% (1.3780 => 1.3254, std. dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5809, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9628, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2238, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2122, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3659, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.11% (20.3410 => 20.1142, std. dev.: 0.0418) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 03:19:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 05:19:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818101906.79AE12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3010?compare_to=3007&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3010, Order: 162166, Start Time: 2012-08-18 09:00:54, End Time: 2012-08-18 10:19:53 To: 3007, Order: 162165, Start Time: 2012-08-18 07:13:34, End Time: 2012-08-18 08:33:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (740 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.96% (10.3673 => 14.3026, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.61% (0.3561 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.61% (0.3497 => 0.3868, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.58% (0.3543 => 0.3918, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.95% (0.3828 => 0.4209, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 9.75% (0.3886 => 0.4265, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.71% (0.1432 => 0.1571, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.82% (2.2022 => 2.3965, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.66% (1.7609 => 1.8957, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 6.87% (10.4361 => 11.1532, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.50% (0.1584 => 0.1687, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5925 => 0.6304, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.6030 => 0.6411, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.50% (7.0540 => 7.4422, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 5.30% (0.3282 => 0.3456, std. dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 5.30% (0.7326 => 0.7714, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.02% (0.4879 => 0.5124, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.71% (0.2271 => 0.2378, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 4.67% (0.7433 => 0.7780, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (9.4845 => 9.8759, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.08% (4.2646 => 4.4387, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.9449 => 5.1452, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (5.0018 => 5.2013, std. dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.94% (0.8172 => 0.8494, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.5569 => 0.5783, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.81% (0.5860 => 0.6083, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.66% (8.1363 => 8.4337, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.56% (1.3050 => 1.3515, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 3.34% (0.3387 => 0.3500, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.30% (0.9765 => 1.0087, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.8067 => 0.8331, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.25% (0.3441 => 0.3553, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.21% (5.7591 => 5.9441, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.5415 => 1.5903, std. dev.: 0.0028) MultiSource/Applications/d/make_dparser: 3.10% (3.3354 => 3.4389, std. dev.: 0.0056) MultiSource/Applications/Burg/burg: 3.09% (1.1642 => 1.2002, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.07% (0.4103 => 0.4229, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1861 => 1.2215, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.98% (0.5105 => 0.5257, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.85% (0.3650 => 0.3754, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.81% (0.6450 => 0.6631, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.77% (2.0273 => 2.0835, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.72% (1.5603 => 1.6027, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.70% (0.6675 => 0.6855, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (14.3668 => 14.7482, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.61% (0.3826 => 0.3926, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4289 => 0.4401, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.57% (0.4636 => 0.4755, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9711, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (0.4064 => 0.4164, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.43% (1.5859 => 1.6244, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.39% (0.6456 => 0.6610, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.37% (0.5981 => 0.6123, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.35% (0.8921 => 0.9131, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.35% (17.1811 => 17.5854, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.34% (1.4186 => 1.4518, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.34% (2.0665 => 2.1148, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.30% (2.2969 => 2.3498, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (0.4620 => 0.4724, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.11% (0.5020 => 0.5126, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.99% (1.2842 => 1.3097, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.2024 => 2.2454, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.71% (0.7115 => 0.7237, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.71% (1.1840 => 1.2043, std. dev.: 0.0056) MultiSource/Applications/lemon/lemon: 1.57% (1.0722 => 1.0890, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.23% (4.2280 => 4.4490, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7519, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 3.05% (26.0924 => 26.8887, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 1.57% (3.1578 => 3.2074, std. dev.: 0.0046) MultiSource/Applications/siod/siod: 1.54% (3.2827 => 3.3332, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8227, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2408, std. dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5784, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6821, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.48% (5.2763 => 3.1406, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.76% (5.3855 => 3.7290, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.29% (5.3526 => 3.7311, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0946, std. dev.: 0.0281) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5460, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -12.24% (22.1758 => 19.4613, std. dev.: 0.0209) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2373 => 1.1075, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel-2: -8.05% (1.5373 => 1.4135, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4764, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4141, std. dev.: 0.0219) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9918, std. dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9631, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3383, std. dev.: 0.0086) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 05:00:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 07:00:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120818120053.CF6882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3011?compare_to=3008&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3011, Order: 162166, Start Time: 2012-08-18 09:17:24, End Time: 2012-08-18 12:01:42 To: 3008, Order: 162164, Start Time: 2012-08-18 06:03:58, End Time: 2012-08-18 08:49:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (103 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (775 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 31.69% (56.8888 => 74.9151, std. dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/ary: 8.71% (0.2147 => 0.2334, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 2.20% (16.1841 => 16.5403, std. dev.: 0.0370) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.62% (54.0298 => 54.9050, std. dev.: 0.0784) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.90% (0.3488 => 0.3903, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3446 => 0.3853, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.73% (0.3460 => 0.3866, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3465 => 0.3870, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3469 => 0.3873, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3496 => 0.3902, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.59% (0.3442 => 0.3841, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.48% (0.3650 => 0.4069, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3643 => 0.4055, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3724 => 0.4130, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5826 => 0.6245, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5889 => 0.6300, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 6.18% (1.5932 => 1.6916, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.87% (1.3152 => 1.3924, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.85% (0.5026 => 0.5320, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (1.6211 => 1.7153, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (3.5627 => 3.7639, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (0.4994 => 0.5276, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.63% (0.5900 => 0.6232, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 5.52% (0.7171 => 0.7567, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (0.4361 => 0.4600, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (0.3930 => 0.4142, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 5.17% (4.2109 => 4.4286, std. dev.: 0.0098) MultiSource/Applications/d/make_dparser: 5.17% (1.0781 => 1.1338, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (0.5000 => 0.5238, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.73% (0.2875 => 0.3011, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.69% (0.4029 => 0.4218, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4146 => 0.4338, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 4.53% (0.9909 => 1.0358, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.2866 => 0.2992, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 4.39% (0.2823 => 0.2947, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.36% (0.2729 => 0.2848, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 4.33% (0.3004 => 0.3134, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2750 => 0.2869, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.30% (0.2813 => 0.2934, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2780 => 0.2899, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.21% (5.5417 => 5.7752, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3195 => 0.3329, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.19% (0.3362 => 0.3503, std. dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (0.2691 => 0.2803, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.12% (2.0673 => 2.1524, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2911 => 0.3029, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.04% (0.3096 => 0.3221, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3060 => 0.3183, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.01% (0.3890 => 0.4046, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3124 => 0.3248, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (1.9694 => 2.0457, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (2.1013 => 2.1826, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (1.9966 => 2.0730, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 3.83% (0.9697 => 1.0068, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.82% (0.4658 => 0.4836, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.81% (0.3726 => 0.3868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.80% (0.3317 => 0.3443, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3282 => 0.3405, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.68% (1.8794 => 1.9486, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3625 => 0.3758, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.64% (0.3678 => 0.3812, std. dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (2.7292 => 2.8273, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.4139 => 0.4287, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.57% (0.6634 => 0.6871, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.55% (4.4195 => 4.5764, std. dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 3.48% (4.6177 => 4.7782, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.3903 => 0.4035, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.29% (0.3981 => 0.4112, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3690 => 0.3811, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 3.27% (1.4269 => 1.4735, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.27% (2.1653 => 2.2360, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.25% (0.3845 => 0.3970, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.01% (0.7875 => 0.8112, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.97% (23.5202 => 24.2196, std. dev.: 0.0303) MultiSource/Applications/Burg/burg: 2.85% (0.5546 => 0.5704, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.6435 => 0.6617, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.08% (2.0346 => 2.0769, std. dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.20% (0.2162 => 0.3550, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.99% (0.2122 => 0.2334, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6652, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1647, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6414, std. dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.99% (41.7953 => 42.6253, std. dev.: 0.0207) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5121, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5899, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 1.63% (15.8721 => 16.1305, std. dev.: 0.0354) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.40% (1.0142 => 1.0284, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.39% (1.0927 => 1.1079, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5935, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4729, std. dev.: 0.0210) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.22% (2.4764 => 2.3720, std. dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5403, std. dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/ary2: -8.28% (0.2402 => 0.2203, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7978, std. dev.: 0.0155) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7950, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0030) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.81% (17.2379 => 16.7543, std. dev.: 0.0482) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5750, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9598, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 05:19:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 07:19:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818121958.D752C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3012?compare_to=3009&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3012, Order: 162168, Start Time: 2012-08-18 11:06:53, End Time: 2012-08-18 12:20:46 To: 3009, Order: 162166, Start Time: 2012-08-18 08:50:12, End Time: 2012-08-18 10:03:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.51% (2.0176 => 2.2902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.02% (0.5818 => 0.6401, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.86% (0.5748 => 0.6315, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 8.95% (0.7061 => 0.7693, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3578 => 0.3852, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.46% (0.3646 => 0.3918, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.39% (0.3601 => 0.3867, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.34% (0.3663 => 0.3932, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 7.29% (0.3623 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3789 => 0.4064, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.15% (0.3914 => 0.4194, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2781 => 0.2973, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.90% (3.9660 => 4.2395, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.88% (0.7038 => 0.7522, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 6.81% (1.3693 => 1.4626, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.76% (0.2782 => 0.2970, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.74% (0.7710 => 0.8230, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4062 => 0.4332, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.40% (0.2655 => 0.2825, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.37% (0.2937 => 0.3124, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2628 => 0.2795, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.33% (0.2607 => 0.2772, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.22% (0.3489 => 0.3706, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3580 => 0.3801, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.13% (0.3899 => 0.4138, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.07% (0.2966 => 0.3146, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.05% (0.3485 => 0.3696, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.04% (1.9828 => 2.1025, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2761 => 0.2926, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3149 => 0.3336, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.87% (0.9199 => 0.9739, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.2193 => 1.2908, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.6959 => 0.7359, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.73% (0.3246 => 0.3432, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 5.42% (0.3453 => 0.3640, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.34% (0.2023 => 0.2131, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.3534 => 0.3720, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.22% (0.4390 => 0.4619, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5267, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/moments: 5.07% (0.3868 => 0.4064, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (1.4563 => 1.5298, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.3756 => 0.3940, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (1.1364 => 1.1919, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.76% (7.2180 => 7.5616, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.74% (0.5637 => 0.5904, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (3.8646 => 4.0452, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.60% (0.8310 => 0.8692, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.58% (0.2945 => 0.3080, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2243 => 0.2344, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.50% (1.2292 => 1.2845, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.48% (1.3245 => 1.3839, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.48% (1.1061 => 1.1557, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (1.3813 => 1.4421, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.37% (0.3755 => 0.3919, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.3819 => 1.4421, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: 4.30% (0.7506 => 0.7829, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 4.21% (16.6129 => 17.3117, std. dev.: 0.0155) MultiSource/Applications/treecc/treecc: 4.15% (1.9270 => 2.0070, std. dev.: 0.0131) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0059) MultiSource/Applications/siod/siod: 4.06% (2.1791 => 2.2676, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.4791 => 0.4985, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.84% (0.6283 => 0.6524, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.3801 => 4.5468, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (4.4433 => 4.6093, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (13.2842 => 13.7593, std. dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6135 => 0.6353, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.50% (4.9865 => 5.1609, std. dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.45% (3.6692 => 3.7959, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.35% (0.8698 => 0.8989, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 2.99% (3.1889 => 3.2842, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1333 => 1.1671, std. dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 2.81% (16.2614 => 16.7185, std. dev.: 0.0253) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (8.4961 => 8.7254, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (3.2742 => 3.3611, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 2.55% (14.8535 => 15.2317, std. dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: 2.54% (6.5754 => 6.7427, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.5298 => 14.8896, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.5188 => 1.5562, std. dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 2.08% (4.6629 => 4.7598, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.1007 => 2.1407, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 1.68% (0.6250 => 0.6355, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.60% (0.6744 => 0.6852, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.55% (1.0313 => 1.0473, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.32% (3.7467 => 3.7960, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9108 => 0.9227, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5140, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 10.37% (1.2998 => 1.4346, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.33% (11.2619 => 11.7500, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (2.8606 => 2.9625, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3852, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.37% (10.7476 => 11.0022, std. dev.: 0.0459) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5919, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6763, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3250, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (1.5089 => 1.5286, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1838, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.17% (26.5159 => 26.8253, std. dev.: 0.0268) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.5627 => 21.1561, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.54% (0.8818 => 0.8682, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.03% (1.2308 => 1.0951, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.61% (1.1560 => 1.1027, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5913, std. dev.: 0.0174) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9635, std. dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -1.89% (0.5449 => 0.5346, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2360, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3305 => 7.2107, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8682, std. dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3720, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.20% (5.5401 => 5.4738, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 05:25:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 07:25:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818122509.D25D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3013?compare_to=3010&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3013, Order: 162168, Start Time: 2012-08-18 11:06:39, End Time: 2012-08-18 12:25:59 To: 3010, Order: 162166, Start Time: 2012-08-18 09:00:54, End Time: 2012-08-18 10:19:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (95 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.02% (10.3673 => 14.3090, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.90% (1.1194 => 1.2526, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.58% (0.3543 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.93% (0.3927 => 0.4317, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.71% (2.2022 => 2.3941, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (1.7609 => 1.8951, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 7.01% (10.4361 => 11.1679, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.50% (0.1584 => 0.1687, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.41% (0.5925 => 0.6305, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.27% (0.6030 => 0.6408, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (7.0540 => 7.4470, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.45% (0.3282 => 0.3461, std. dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 5.41% (0.7433 => 0.7835, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.00% (0.4879 => 0.5123, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.62% (0.2271 => 0.2376, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8722, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.09% (0.8172 => 0.8506, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.08% (0.5860 => 0.6099, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.08% (4.2646 => 4.4385, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (5.0018 => 5.2028, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.98% (4.9449 => 5.1417, std. dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: 3.94% (0.7835 => 0.8144, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.2700 => 0.2803, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.60% (0.5105 => 0.5289, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (8.1363 => 8.4274, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.50% (1.3050 => 1.3507, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.47% (0.8067 => 0.8347, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 3.43% (0.3180 => 0.3289, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9765 => 1.0083, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3441 => 0.3552, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.20% (1.1642 => 1.2015, std. dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 3.18% (5.7591 => 5.9425, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.10% (1.5415 => 1.5893, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 3.06% (3.3354 => 3.4375, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.06% (2.0273 => 2.0893, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.86% (1.5603 => 1.6050, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.71% (0.6450 => 0.6625, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.69% (0.3826 => 0.3929, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.67% (0.4636 => 0.4760, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (14.3668 => 14.7417, std. dev.: 0.0088) MultiSource/Applications/lua/lua: 2.60% (3.8723 => 3.9730, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.58% (0.6675 => 0.6847, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.51% (0.5981 => 0.6131, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.46% (2.2969 => 2.3535, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.39% (2.0665 => 2.1159, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.34% (0.8921 => 0.9130, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.31% (1.4186 => 1.4514, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (1.5859 => 1.6221, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.27% (17.1811 => 17.5707, std. dev.: 0.0145) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3111, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2471, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2049, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.55% (1.0722 => 1.0888, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.84% (4.2280 => 4.4326, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7557, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 2.95% (26.0924 => 26.8632, std. dev.: 0.0345) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.89% (1.3045 => 1.3291, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2099, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3335, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8234, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.52% (9.1159 => 9.2544, std. dev.: 0.0418) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.32% (1.5086 => 1.5285, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.48% (5.2763 => 3.1404, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.77% (5.3855 => 3.7283, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.30% (5.3526 => 3.7309, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0904, std. dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.48% (2.9384 => 2.5424, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -12.14% (22.1758 => 19.4838, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -11.40% (1.2373 => 1.0963, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: -9.04% (1.5373 => 1.3984, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.82% (1.5660 => 1.4905, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std. dev.: 0.0006) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4680, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4231, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9895, std. dev.: 0.0263) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9584, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3386, std. dev.: 0.0092) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0078) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.13% (1.8329 => 1.8122, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 07:55:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 09:55:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818145551.6DEF12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3014?compare_to=3012&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3014, Order: 162170, Start Time: 2012-08-18 13:42:55, End Time: 2012-08-18 14:56:38 To: 3012, Order: 162168, Start Time: 2012-08-18 11:06:53, End Time: 2012-08-18 12:20:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.56% (78.6502 => 80.6660, std. dev.: 0.1724) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.57% (2.0176 => 2.2914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.97% (0.5818 => 0.6398, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.92% (0.5748 => 0.6318, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7061 => 0.7689, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3578 => 0.3858, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.64% (0.3601 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.49% (0.3646 => 0.3919, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.37% (0.3663 => 0.3933, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.29% (0.3623 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.03% (0.3940 => 0.4217, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.89% (0.7038 => 0.7523, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.87% (0.2781 => 0.2972, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.7710 => 0.8239, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.84% (3.9660 => 4.2372, std. dev.: 0.0034) MultiSource/Applications/hbd/hbd: 6.83% (1.3693 => 1.4628, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.76% (0.2782 => 0.2970, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.62% (0.4062 => 0.4331, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2607 => 0.2774, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.37% (0.2937 => 0.3124, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2690 => 0.2859, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.17% (0.3485 => 0.3700, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.15% (0.2765 => 0.2935, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.13% (0.3899 => 0.4138, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.13% (0.2726 => 0.2893, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.12% (0.3022 => 0.3207, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3580 => 0.3799, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2696 => 0.2859, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.03% (1.9828 => 2.1023, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.02% (0.3489 => 0.3699, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.02% (0.3107 => 0.3294, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.00% (0.9199 => 0.9751, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3149 => 0.3335, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.90% (0.2761 => 0.2924, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.77% (1.2193 => 1.2897, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.6959 => 0.7359, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.64% (0.3246 => 0.3429, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.3192 => 0.3367, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.47% (0.3453 => 0.3642, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.38% (0.3534 => 0.3724, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4390 => 0.4621, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.18% (0.4016 => 0.4224, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.15% (13.8202 => 14.5325, std. dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.12% (0.3868 => 0.4066, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.10% (0.3293 => 0.3461, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.99% (1.4563 => 1.5290, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (0.3756 => 0.3943, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.95% (1.1364 => 1.1926, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.73% (7.2180 => 7.5595, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5637 => 0.5902, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0445, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.57% (0.8310 => 0.8690, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.54% (1.1061 => 1.1563, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2243 => 0.2344, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.48% (1.2292 => 1.2843, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (1.3245 => 1.3837, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.41% (1.3813 => 1.4422, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4417, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.26% (0.7506 => 0.7826, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.21% (1.0594 => 1.1040, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (0.7460 => 0.7774, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.16% (16.6129 => 17.3044, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.10% (0.3755 => 0.3909, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.09% (1.9270 => 2.0059, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.99% (0.4791 => 0.4982, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.94% (2.1791 => 2.2650, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.88% (0.6283 => 0.6527, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.3801 => 4.5466, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6099, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (13.2842 => 13.7658, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.47% (3.6692 => 3.7967, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.47% (0.6135 => 0.6348, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.40% (4.9865 => 5.1562, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.35% (0.8698 => 0.8989, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1333 => 1.1671, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 2.96% (3.1889 => 3.2833, std. dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 2.85% (16.2614 => 16.7244, std. dev.: 0.0241) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.76% (8.4961 => 8.7306, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.59% (3.2742 => 3.3590, std. dev.: 0.0141) MultiSource/Applications/JM/ldecod/ldecod: 2.51% (6.5754 => 6.7405, std. dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 2.50% (14.5298 => 14.8933, std. dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.8535 => 15.2212, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.32% (1.5188 => 1.5540, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.1007 => 2.1443, std. dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 2.02% (4.6629 => 4.7572, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 1.79% (0.6250 => 0.6362, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.48% (0.6744 => 0.6844, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (0.9108 => 0.9227, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.25% (3.7467 => 3.7937, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2539, std. dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.97% (1.2998 => 1.4294, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.00% (1.5824 => 1.6615, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.30% (11.2619 => 11.7460, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5983, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.17% (10.7476 => 10.9813, std. dev.: 0.0389) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6780, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3261, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5151, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5089 => 1.5278, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0033) MultiSource/Applications/lua/lua: 1.17% (26.5159 => 26.8250, std. dev.: 0.0417) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.44% (0.4657 => 0.3938, std. dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1615, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.51% (0.8818 => 0.8685, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2308 => 1.0955, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5909, std. dev.: 0.0133) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9600, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2349, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3305 => 7.2117, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7920, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3631, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.26% (20.3410 => 20.0845, std. dev.: 0.0336) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4763, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 08:01:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 10:01:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818150155.C3DA82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3015?compare_to=3013&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3015, Order: 162170, Start Time: 2012-08-18 13:43:22, End Time: 2012-08-18 15:02:41 To: 3013, Order: 162168, Start Time: 2012-08-18 11:06:39, End Time: 2012-08-18 12:25:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (94 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.98% (54.3910 => 56.5545, std. dev.: 0.1242) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.93% (10.3673 => 14.2994, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.92% (1.1194 => 1.2528, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3543 => 0.3929, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.71% (0.1432 => 0.1571, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.69% (2.2022 => 2.3936, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.69% (1.7609 => 1.8964, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 6.87% (10.4361 => 11.1531, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.50% (0.1584 => 0.1687, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.48% (0.5925 => 0.6309, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.6030 => 0.6411, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.63% (7.0540 => 7.4508, std. dev.: 0.0125) SingleSource/UnitTests/ObjC++/property-reference: 5.45% (0.7326 => 0.7725, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.21% (0.3282 => 0.3453, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.12% (0.4879 => 0.5129, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 4.98% (0.7433 => 0.7803, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.76% (0.2271 => 0.2379, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (9.4845 => 9.8854, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.9449 => 5.1436, std. dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.00% (4.2646 => 4.4352, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (5.0018 => 5.2013, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.99% (0.3109 => 0.3233, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.79% (0.5860 => 0.6082, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.61% (1.3050 => 1.3521, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.59% (8.1363 => 8.4284, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.37% (0.3387 => 0.3501, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.23% (1.5415 => 1.5913, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.23% (0.9765 => 1.0080, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3441 => 0.3550, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 3.17% (5.7591 => 5.9414, std. dev.: 0.0134) MultiSource/Applications/Burg/burg: 3.16% (1.1642 => 1.2010, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.13% (0.5105 => 0.5265, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.8067 => 0.8314, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1861 => 1.2224, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.97% (3.3354 => 3.4344, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.92% (2.0273 => 2.0865, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.80% (0.3826 => 0.3933, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.77% (0.6675 => 0.6860, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.73% (0.6450 => 0.6626, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.70% (1.5603 => 1.6024, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4636 => 0.4761, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.4289 => 0.4403, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (14.3668 => 14.7442, std. dev.: 0.0065) MultiSource/Applications/lua/lua: 2.58% (3.8723 => 3.9723, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5981 => 0.6133, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4620 => 0.4734, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.46% (2.0665 => 2.1174, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (0.4064 => 0.4164, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.39% (2.2969 => 2.3517, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.37% (1.4186 => 1.4522, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.33% (0.8921 => 0.9129, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.30% (17.1811 => 17.5764, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.28% (1.5859 => 1.6221, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5020 => 0.5122, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.2024 => 2.2446, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 1.84% (1.1840 => 1.2058, std. dev.: 0.0053) MultiSource/Applications/minisat/minisat: 1.59% (0.7115 => 0.7228, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.38% (1.0722 => 1.0870, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.83% (4.2280 => 4.4324, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7507, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 2.95% (26.0924 => 26.8627, std. dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.62% (3.7781 => 3.8394, std. dev.: 0.0105) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3350, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 1.56% (2.2771 => 2.3126, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8228, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5086 => 1.5278, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1413, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.74% (5.3855 => 3.7298, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.33% (5.3526 => 3.7289, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1093, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.46% (2.9384 => 2.5429, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -12.24% (22.1758 => 19.4624, std. dev.: 0.0325) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2373 => 1.0996, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -9.92% (1.5373 => 1.3848, std. dev.: 0.0299) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.05% (2.7294 => 2.5644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4768, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.6802 => 8.4319, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9960, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9635, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5090, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3452, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4193, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8132, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 08:12:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 10:12:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120818151222.1345C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3016?compare_to=3011&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3016, Order: 162168, Start Time: 2012-08-18 12:29:27, End Time: 2012-08-18 15:13:11 To: 3011, Order: 162166, Start Time: 2012-08-18 09:17:24, End Time: 2012-08-18 12:01:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (110 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (769 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.94% (2.0627 => 2.1233, std. dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.81% (123.9850 => 126.2330, std. dev.: 0.2543) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 11.79% (0.3460 => 0.3868, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3446 => 0.3851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.75% (0.3465 => 0.3872, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 11.62% (0.3469 => 0.3872, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.59% (0.3442 => 0.3841, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3496 => 0.3900, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.53% (0.3488 => 0.3890, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3643 => 0.4057, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.34% (0.3650 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.93% (0.3724 => 0.4131, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5826 => 0.6241, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.96% (0.5889 => 0.6299, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.30% (1.5932 => 1.6936, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 5.90% (0.7171 => 0.7594, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.77% (1.6211 => 1.7147, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (3.5627 => 3.7652, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (0.3930 => 0.4149, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (0.4361 => 0.4601, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.46% (0.5000 => 0.5273, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.46% (1.3152 => 1.3870, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 5.29% (1.0781 => 1.1351, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.27% (0.4994 => 0.5257, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 5.20% (4.2109 => 4.4299, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.15% (0.2738 => 0.2879, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.95% (0.2866 => 0.3008, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.5900 => 0.6187, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 4.82% (0.4029 => 0.4223, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.78% (0.9909 => 1.0383, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (0.5026 => 0.5261, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.36% (0.3004 => 0.3135, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.36% (0.2823 => 0.2946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.34% (0.2813 => 0.2935, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.32% (0.2729 => 0.2847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.32% (0.2803 => 0.2924, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.30% (0.2792 => 0.2912, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.29% (5.5417 => 5.7795, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/strcat: 4.29% (0.2750 => 0.2868, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.28% (0.3362 => 0.3506, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.2780 => 0.2898, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3195 => 0.3329, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.15% (0.3060 => 0.3187, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (0.4658 => 0.4851, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.14% (2.0673 => 2.1528, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.07% (0.3096 => 0.3222, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (1.9694 => 2.0486, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.2736 => 0.2846, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.01% (0.9697 => 1.0086, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3258 => 0.3388, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3267 => 0.3396, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3124 => 0.3247, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.92% (0.2911 => 0.3025, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (0.2691 => 0.2796, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.85% (0.3845 => 0.3993, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.83% (0.3890 => 0.4039, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3282 => 0.3405, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.73% (0.3726 => 0.3865, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.3903 => 0.4048, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 3.71% (0.3317 => 0.3440, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.68% (0.3477 => 0.3605, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.67% (0.3348 => 0.3471, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 3.66% (2.1013 => 2.1782, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.65% (1.9966 => 2.0694, std. dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 3.64% (1.8794 => 1.9479, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4146 => 0.4294, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.54% (2.7292 => 2.8257, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.53% (0.3625 => 0.3753, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (4.4195 => 4.5744, std. dev.: 0.0180) MultiSource/Applications/JM/lencod/lencod: 3.42% (4.6177 => 4.7757, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3690 => 0.3815, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.4139 => 0.4277, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (0.4251 => 0.4391, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.29% (0.7875 => 0.8134, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 3.28% (2.1653 => 2.2363, std. dev.: 0.0084) MultiSource/Applications/lua/lua: 3.24% (1.4269 => 1.4732, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.96% (23.5202 => 24.2175, std. dev.: 0.0207) MultiSource/Applications/Burg/burg: 2.79% (0.5546 => 0.5701, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.6435 => 0.6614, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.59% (0.5012 => 0.5142, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.91% (2.0346 => 2.0734, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6088, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6439, std. dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.04% (41.7953 => 42.6464, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std. dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.98% (2.0820 => 2.1233, std. dev.: 0.0107) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5036, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5923, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2825, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5798, std. dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5321, std. dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/ary2: -10.16% (0.2402 => 0.2158, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7923, std. dev.: 0.0147) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7957, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0042) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.07% (17.2379 => 16.8811, std. dev.: 0.0534) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5771, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9661, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 11:23:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 13:23:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120818182335.725762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3017?compare_to=3016&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3017, Order: 162170, Start Time: 2012-08-18 15:40:43, End Time: 2012-08-18 18:24:24 To: 3016, Order: 162168, Start Time: 2012-08-18 12:29:27, End Time: 2012-08-18 15:13:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (113 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 9.65% (0.2115 => 0.2319, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3446 => 0.3852, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.72% (0.3465 => 0.3871, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.71% (0.3460 => 0.3865, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.68% (0.3442 => 0.3844, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3496 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.53% (0.3469 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.47% (0.3488 => 0.3888, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 11.37% (0.3650 => 0.4065, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.17% (0.3643 => 0.4050, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.79% (0.3724 => 0.4126, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.16% (0.5826 => 0.6243, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5889 => 0.6300, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.36% (1.5932 => 1.6946, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 6.26% (0.7171 => 0.7620, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7158, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.76% (0.4361 => 0.4612, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.75% (0.5900 => 0.6239, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (3.5627 => 3.7633, std. dev.: 0.0114) MultiSource/Applications/d/make_dparser: 5.60% (1.0781 => 1.1385, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.48% (1.3152 => 1.3873, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.41% (0.4994 => 0.5264, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.39% (0.4029 => 0.4246, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.1968 => 0.2072, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 5.25% (4.2109 => 4.4319, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.56% (0.5000 => 0.5228, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.52% (0.3362 => 0.3514, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.49% (0.9909 => 1.0354, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 4.48% (0.2725 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2780 => 0.2903, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.41% (0.2813 => 0.2937, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.39% (0.3004 => 0.3136, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.33% (0.2792 => 0.2913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.32% (0.2729 => 0.2847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.32% (0.2823 => 0.2945, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.29% (0.2750 => 0.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.28% (0.2803 => 0.2923, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.26% (0.3195 => 0.3331, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.25% (0.6634 => 0.6916, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.23% (0.2811 => 0.2930, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.16% (5.5417 => 5.7724, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.2866 => 0.2985, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 4.13% (0.3096 => 0.3224, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.12% (2.0673 => 2.1524, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.04% (0.3890 => 0.4047, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.3845 => 0.3999, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.94% (0.9697 => 1.0079, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3124 => 0.3247, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3258 => 0.3386, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3060 => 0.3180, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3317 => 0.3447, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.86% (0.3726 => 0.3870, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.81% (0.4146 => 0.4304, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 3.77% (1.8794 => 1.9503, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.76% (1.9694 => 2.0434, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3477 => 0.3607, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (0.4658 => 0.4832, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 3.70% (0.3348 => 0.3472, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 3.70% (4.6177 => 4.7886, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.68% (2.1013 => 2.1787, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (2.7292 => 2.8291, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (0.3625 => 0.3757, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.62% (1.9966 => 2.0688, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.57% (2.1653 => 2.2425, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.49% (0.3271 => 0.3385, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.3903 => 0.4038, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (4.4195 => 4.5722, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3690 => 0.3815, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 3.32% (0.4251 => 0.4392, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 3.31% (1.4269 => 1.4741, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.20% (0.7875 => 0.8127, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.3981 => 0.4108, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.10% (0.5546 => 0.5718, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.09% (0.4139 => 0.4267, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 2.97% (23.5202 => 24.2190, std. dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/bigfib: 2.61% (0.5012 => 0.5143, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.98% (2.0346 => 2.0748, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.28% (0.2122 => 0.2319, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6766, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1643, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8867, std. dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6241, std. dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (41.7953 => 42.6531, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std. dev.: 0.0140) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5082, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.23% (7.1849 => 7.2733, std. dev.: 0.0105) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5160, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5880, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4479, std. dev.: 0.0587) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.09% (2.4764 => 2.3750, std. dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5786, std. dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7970, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8088, std. dev.: 0.0072) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (17.2379 => 16.8542, std. dev.: 0.0376) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9631, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4969, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 11:43:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 13:43:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818184315.93D1A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3018?compare_to=3014&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3018, Order: 162171, Start Time: 2012-08-18 17:30:24, End Time: 2012-08-18 18:44:03 To: 3014, Order: 162170, Start Time: 2012-08-18 13:42:55, End Time: 2012-08-18 14:56:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.89% (2.0176 => 2.2978, std. dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5818 => 0.6380, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.64% (0.5748 => 0.6302, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7061 => 0.7672, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.27% (0.3578 => 0.3874, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.03% (0.3601 => 0.3890, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.98% (0.3646 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.87% (0.3623 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.84% (0.3914 => 0.4221, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.84% (0.3663 => 0.3950, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.09% (0.7038 => 0.7537, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.97% (3.9660 => 4.2424, std. dev.: 0.0113) MultiSource/Applications/hbd/hbd: 6.94% (1.3693 => 1.4643, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.79% (0.2782 => 0.2971, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.69% (0.5265 => 0.5617, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.29% (0.2607 => 0.2771, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3022 => 0.3212, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2690 => 0.2859, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2760 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.15% (0.2765 => 0.2935, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3580 => 0.3798, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3149 => 0.3339, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.97% (0.2696 => 0.2857, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.97% (0.9199 => 0.9748, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.94% (1.9828 => 2.1006, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2761 => 0.2925, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.88% (0.3489 => 0.3694, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.82% (1.2193 => 1.2903, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.76% (0.6959 => 0.7360, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.51% (0.3246 => 0.3425, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3453 => 0.3643, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3192 => 0.3365, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.26% (0.4390 => 0.4621, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.22% (13.8202 => 14.5417, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3534 => 0.3717, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.15% (0.4016 => 0.4223, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.01% (0.3293 => 0.3458, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.01% (1.4563 => 1.5292, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.95% (1.1364 => 1.1927, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.5637 => 0.5912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5599, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.56% (0.8310 => 0.8689, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (3.8646 => 4.0402, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.2292 => 1.2849, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.50% (1.1061 => 1.1559, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (1.3245 => 1.3837, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.45% (1.3813 => 1.4428, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.33% (1.3819 => 1.4418, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.33% (0.7506 => 0.7831, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.0594 => 1.1052, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3755 => 0.3916, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (0.7460 => 0.7774, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.15% (0.4791 => 0.4990, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.10% (1.9270 => 2.0061, std. dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 4.10% (16.6129 => 17.2942, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.93% (0.6283 => 0.6530, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.89% (2.1791 => 2.2639, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.3801 => 4.5472, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6099, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 3.71% (0.2995 => 0.3106, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (13.2842 => 13.7567, std. dev.: 0.0226) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.52% (3.6692 => 3.7984, std. dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (0.8698 => 0.9003, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.42% (0.6135 => 0.6345, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.01% (3.1889 => 3.2848, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1333 => 1.1671, std. dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.89% (16.2614 => 16.7308, std. dev.: 0.0104) MultiSource/Benchmarks/McCat/05-eks/eks: 2.84% (0.4113 => 0.4230, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.4961 => 8.7293, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.53% (14.8535 => 15.2299, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.2742 => 3.3571, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 2.51% (14.5298 => 14.8949, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 2.45% (6.5754 => 6.7364, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5188 => 1.5533, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.02% (4.6629 => 4.7571, std. dev.: 0.0143) MultiSource/Applications/lua/lua: 1.37% (3.7467 => 3.7982, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.16% (0.9108 => 0.9214, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 26.62% (1.8175 => 2.3013, std. dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.31% (1.2998 => 1.4208, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7410, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6006, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.08% (10.7476 => 10.9709, std. dev.: 0.0865) MultiSource/Applications/sqlite3/sqlite3: 1.83% (4.5928 => 4.6769, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std. dev.: 0.0080) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (1.5089 => 1.5287, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1857, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.10% (26.5159 => 26.8066, std. dev.: 0.0381) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.05% (0.4657 => 0.3956, std. dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1621, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.36% (1.2308 => 1.0910, std. dev.: 0.0251) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0118) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5910, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.12% (3.0263 => 2.9620, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2261, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3305 => 7.2134, std. dev.: 0.0254) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0168) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3552, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2414, std. dev.: 0.0318) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 11:48:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 13:48:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818184843.DD3D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3019?compare_to=3015&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3019, Order: 162171, Start Time: 2012-08-18 17:30:43, End Time: 2012-08-18 18:49:32 To: 3015, Order: 162170, Start Time: 2012-08-18 13:43:22, End Time: 2012-08-18 15:02:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (101 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (737 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.72% (14.2994 => 13.9101, std. dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.58% (3.8394 => 3.7786, std. dev.: 0.0192) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.17% (10.3673 => 13.9101, std. dev.: 0.0160) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3473 => 0.3864, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (1.1194 => 1.2433, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.26% (0.3927 => 0.4330, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.22% (0.1432 => 0.1564, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.01% (0.3817 => 0.4161, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.07% (2.2022 => 2.3799, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.11% (1.7609 => 1.8861, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.87% (10.4361 => 11.1526, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 6.68% (0.5925 => 0.6321, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.58% (0.6030 => 0.6427, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.61% (0.7326 => 0.7737, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.04% (7.0540 => 7.4092, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.03% (0.4615 => 0.4847, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.91% (0.3282 => 0.3443, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (0.7433 => 0.7792, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.4879 => 0.5109, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.49% (0.2271 => 0.2373, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (9.4845 => 9.8803, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.15% (0.5569 => 0.5800, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.9449 => 5.1490, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.06% (0.8172 => 0.8504, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.5860 => 0.6098, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (5.0018 => 5.2028, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.91% (4.2646 => 4.4313, std. dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.48% (1.3050 => 1.3504, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.45% (8.1363 => 8.4166, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.5415 => 1.5935, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3423 => 0.3537, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.32% (0.7835 => 0.8095, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.29% (0.4103 => 0.4238, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.5105 => 0.5269, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.21% (0.3650 => 0.3767, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.20% (5.7591 => 5.9436, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9765 => 1.0073, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4289 => 0.4423, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.11% (0.8067 => 0.8318, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.06% (0.4636 => 0.4778, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.05% (1.1642 => 1.1997, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.03% (2.0665 => 2.1292, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.00% (0.6675 => 0.6875, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.99% (0.3441 => 0.3544, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.96% (1.1861 => 1.2212, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 2.95% (0.3422 => 0.3523, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3865 => 0.3979, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.90% (3.3354 => 3.4320, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.85% (0.3826 => 0.3935, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 2.77% (1.5603 => 1.6035, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 2.77% (2.0273 => 2.0834, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (0.4064 => 0.4176, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.70% (3.8723 => 3.9767, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.64% (0.3935 => 0.4039, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.60% (0.6456 => 0.6624, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.60% (0.4620 => 0.4740, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3175, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6450 => 0.6617, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7260, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5981 => 0.6129, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.4186 => 1.4504, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.22% (17.1811 => 17.5628, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.19% (1.5859 => 1.6206, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5020 => 0.5128, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.14% (0.8921 => 0.9112, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.07% (2.2969 => 2.3445, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.67% (1.1840 => 1.2038, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.66% (0.7115 => 0.7233, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.29% (1.0722 => 1.0860, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (4.2280 => 4.4397, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7488, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.88% (26.0924 => 26.8435, std. dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3338, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.54% (11.6436 => 11.8225, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2462, std. dev.: 0.0369) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.26% (1.5086 => 1.5276, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1413, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.18% (5.3855 => 3.7063, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.74% (5.3526 => 3.7073, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0829, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.70% (2.9384 => 2.5357, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -12.33% (22.1758 => 19.4418, std. dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2373 => 1.1040, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -9.93% (1.5373 => 1.3846, std. dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.1396 => 1.0596, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std. dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4730, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4148, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9920, std. dev.: 0.0234) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.75% (1.3677 => 1.3301, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.28% (8.1563 => 7.9702, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5084, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3361, std. dev.: 0.0085) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 13:24:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 15:24:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818202416.E70B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3020?compare_to=3018&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3020, Order: 162172, Start Time: 2012-08-18 19:11:22, End Time: 2012-08-18 20:25:04 To: 3018, Order: 162171, Start Time: 2012-08-18 17:30:24, End Time: 2012-08-18 18:44:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (147 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.15% (54.8828 => 56.6121, std. dev.: 0.0687) SingleSource/Regression/C/uint64_to_float: 1.88% (0.5369 => 0.5470, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 1.64% (1.0910 => 1.1089, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.85% (2.0176 => 2.2970, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 9.67% (0.5748 => 0.6304, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5818 => 0.6380, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.71% (0.7061 => 0.7676, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3578 => 0.3879, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3650 => 0.3953, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.22% (0.3601 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.17% (0.3646 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3623 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 7.30% (0.4328 => 0.4644, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.08% (1.3693 => 1.4663, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.08% (0.2782 => 0.2979, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.91% (3.9660 => 4.2399, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hello: 6.79% (0.2607 => 0.2784, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.69% (0.2690 => 0.2870, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.62% (0.4062 => 0.4331, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.61% (0.5265 => 0.5613, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.41% (0.3899 => 0.4149, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3107 => 0.3306, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.38% (0.3149 => 0.3350, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2696 => 0.2867, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.28% (0.3485 => 0.3704, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.27% (1.9828 => 2.1072, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.06% (0.2988 => 0.3169, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.03% (0.9199 => 0.9754, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3192 => 0.3380, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.79% (0.3453 => 0.3653, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (1.2193 => 1.2898, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.6959 => 0.7358, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.71% (0.4379 => 0.4629, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.51% (0.3246 => 0.3425, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.47% (0.4390 => 0.4630, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3534 => 0.3725, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.40% (0.4016 => 0.4233, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.38% (0.3868 => 0.4076, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.38% (0.3293 => 0.3470, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.3756 => 0.3953, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.18% (13.8202 => 14.5367, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.06% (1.4563 => 1.5300, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.87% (1.1364 => 1.1917, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (7.2180 => 7.5668, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.77% (0.5637 => 0.5906, std. dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 4.69% (1.2292 => 1.2869, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.55% (1.3245 => 1.3847, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (3.8646 => 4.0399, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (1.3813 => 1.4437, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.51% (0.8310 => 0.8685, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.51% (1.1061 => 1.1560, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4435, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3755 => 0.3917, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.29% (0.7506 => 0.7828, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.7460 => 0.7776, std. dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 4.17% (16.6129 => 17.3059, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.4791 => 0.4985, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.04% (1.9270 => 2.0048, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.93% (0.6283 => 0.6530, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.82% (2.1791 => 2.2624, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (4.3801 => 4.5453, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 3.74% (0.2995 => 0.3107, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.68% (4.4433 => 4.6069, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (13.2842 => 13.7668, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.58% (0.8698 => 0.9009, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.55% (4.9865 => 5.1637, std. dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.53% (3.6692 => 3.7989, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.46% (0.6135 => 0.6347, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.04% (3.1889 => 3.2857, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1333 => 1.1672, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 2.87% (0.4113 => 0.4231, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.79% (16.2614 => 16.7150, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 2.75% (8.4961 => 8.7296, std. dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9084, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.5754 => 6.7401, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 2.47% (14.8535 => 15.2209, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.42% (3.2742 => 3.3533, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5527, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.15% (4.6629 => 4.7633, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1007 => 2.1381, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.47% (1.0313 => 1.0465, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.32% (3.7467 => 3.7962, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.13% (0.9108 => 0.9211, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.09% (33.2944 => 33.6564, std. dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5128, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0464) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.12% (1.2998 => 1.4184, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7447, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8173, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.58% (7.4271 => 7.6189, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 2.40% (12.0921 => 12.3827, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.13% (10.7476 => 10.9760, std. dev.: 0.0409) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6777, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3249, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0064) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.28% (1.5089 => 1.5282, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 1.24% (26.5159 => 26.8451, std. dev.: 0.0602) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1836, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6869, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5726, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.82% (0.4657 => 0.3967, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.29% (22.5627 => 21.1441, std. dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (0.8818 => 0.8712, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2308 => 1.1089, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.61% (1.1560 => 1.1027, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3165, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5894, std. dev.: 0.0111) MultiSource/Benchmarks/Olden/bh/bh: -2.43% (1.9762 => 1.9281, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9623, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2169, std. dev.: 0.0212) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3644, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.25% (5.5401 => 5.4708, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8704, std. dev.: 0.0144) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 13:35:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 15:35:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818203510.9EC3F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3021?compare_to=3019&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3021, Order: 162172, Start Time: 2012-08-18 19:17:05, End Time: 2012-08-18 20:35:59 To: 3019, Order: 162171, Start Time: 2012-08-18 17:30:43, End Time: 2012-08-18 18:49:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (102 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (735 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.06% (78.6698 => 81.0740, std. dev.: 0.3974) SingleSource/Regression/C/uint64_to_float: 1.91% (0.5354 => 0.5456, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.36% (13.9101 => 13.7207, std. dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.35% (10.3673 => 13.7207, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (1.1194 => 1.2438, std. dev.: 0.0114) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.31% (0.1432 => 0.1551, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (2.2022 => 2.3753, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.97% (1.7609 => 1.8837, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 6.76% (10.4361 => 11.1415, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.94% (0.7326 => 0.7761, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.35% (0.3177 => 0.3347, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 4.95% (0.7433 => 0.7801, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.76% (7.0540 => 7.3901, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.61% (0.4879 => 0.5104, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5569 => 0.5802, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.10% (9.4845 => 9.8737, std. dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.98% (0.8172 => 0.8497, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (4.2646 => 4.4323, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1383, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.84% (0.2758 => 0.2864, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5860 => 0.6085, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (5.0018 => 5.1926, std. dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.46% (0.7835 => 0.8106, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (1.3050 => 1.3493, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.36% (0.3423 => 0.3538, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.34% (0.4103 => 0.4240, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.33% (8.1363 => 8.4076, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.31% (5.7591 => 5.9498, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.22% (0.9765 => 1.0079, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 3.16% (0.3422 => 0.3530, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (0.5105 => 0.5264, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.10% (2.0273 => 2.0901, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4289 => 0.4419, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.02% (1.1642 => 1.1994, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.02% (0.3441 => 0.3545, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.98% (1.5415 => 1.5874, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.94% (1.1861 => 1.2210, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 2.89% (3.3354 => 3.4319, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4636 => 0.4770, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.89% (0.8067 => 0.8300, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.83% (1.5603 => 1.6045, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6675 => 0.6861, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.76% (2.0665 => 2.1236, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.76% (0.6456 => 0.6634, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.72% (0.3826 => 0.3930, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (0.4064 => 0.4171, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.57% (0.6450 => 0.6616, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9710, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.53% (0.4620 => 0.4737, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.43% (0.4203 => 0.4305, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5859 => 1.6242, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.34% (1.2842 => 1.3143, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (14.3668 => 14.6931, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.27% (1.4186 => 1.4508, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5020 => 0.5130, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8921 => 0.9116, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.17% (2.2969 => 2.3467, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 2.11% (17.1811 => 17.5443, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.2024 => 2.2457, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.79% (1.1840 => 1.2052, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.69% (0.7115 => 0.7235, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.38% (1.0722 => 1.0870, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.15% (4.2280 => 4.4457, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.26% (3.6395 => 3.7583, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 3.09% (26.0924 => 26.8993, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2135, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3336, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2457, std. dev.: 0.0301) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5842, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.07% (2.6546 => 2.6831, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.03% (19.9488 => 20.1542, std. dev.: 0.0270) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.55% (5.2763 => 3.1369, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.43% (5.3855 => 3.6929, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.93% (5.3526 => 3.6970, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0366, std. dev.: 0.0278) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.88% (2.9384 => 2.5306, std. dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: -12.45% (22.1758 => 19.4158, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -11.34% (1.2373 => 1.0970, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -8.66% (1.5373 => 1.4042, std. dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std. dev.: 0.0026) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4638, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.17% (8.6802 => 8.4050, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9850, std. dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9607, std. dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: -1.87% (2.5528 => 2.5051, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3458, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8132, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 14:34:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 16:34:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120818213449.3392E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3022?compare_to=3017&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3022, Order: 162172, Start Time: 2012-08-18 18:52:00, End Time: 2012-08-18 21:35:38 To: 3017, Order: 162170, Start Time: 2012-08-18 15:40:43, End Time: 2012-08-18 18:24:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (113 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.33% (2.1060 => 2.1340, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.31% (54.1575 => 54.8646, std. dev.: 0.0441) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.01% (0.3465 => 0.3881, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3446 => 0.3856, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3469 => 0.3881, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 11.77% (0.3442 => 0.3847, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.76% (0.3496 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.71% (0.3460 => 0.3865, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.67% (0.3488 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.40% (0.3650 => 0.4066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3643 => 0.4058, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.01% (0.3724 => 0.4134, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.52% (0.5826 => 0.6264, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.28% (0.5889 => 0.6318, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.02% (1.5932 => 1.6891, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 5.88% (0.7171 => 0.7593, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.61% (1.6211 => 1.7120, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.1968 => 0.2075, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (1.3152 => 1.3867, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.43% (3.5627 => 3.7563, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.5900 => 0.6193, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.89% (0.4994 => 0.5238, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.82% (0.4361 => 0.4571, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (0.5000 => 0.5240, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.71% (0.2866 => 0.3001, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.67% (1.0781 => 1.1284, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (0.3930 => 0.4113, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 4.65% (4.2109 => 4.4069, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.42% (0.5026 => 0.5248, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.34% (0.3362 => 0.3508, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.33% (0.2566 => 0.2677, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.17% (0.9909 => 1.0322, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2792 => 0.2907, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.09% (0.3004 => 0.3127, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (0.4658 => 0.4847, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.99% (0.2729 => 0.2838, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3195 => 0.3321, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2780 => 0.2889, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2811 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 3.91% (0.2813 => 0.2923, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2803 => 0.2911, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.85% (5.5417 => 5.7552, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.83% (2.0673 => 2.1464, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.2823 => 0.2931, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.78% (0.2911 => 0.3021, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 3.75% (0.3096 => 0.3212, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.71% (0.3124 => 0.3240, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.70% (0.3267 => 0.3388, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.68% (0.3258 => 0.3378, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.65% (0.3890 => 0.4032, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.3845 => 0.3985, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (1.9966 => 2.0684, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.53% (0.3060 => 0.3168, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3726 => 0.3857, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.49% (1.9694 => 2.0381, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: 3.45% (0.3678 => 0.3805, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3477 => 0.3597, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.42% (0.4146 => 0.4288, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.40% (23.5202 => 24.3200, std. dev.: 0.0097) MultiSource/Applications/siod/siod: 3.35% (0.6634 => 0.6856, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 3.35% (0.3348 => 0.3460, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.34% (0.3625 => 0.3746, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.25% (0.7875 => 0.8131, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (4.4195 => 4.5628, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.3903 => 0.4028, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.4251 => 0.4387, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.19% (2.7292 => 2.8163, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (2.1013 => 2.1683, std. dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 3.15% (4.6177 => 4.7631, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 3.12% (0.9697 => 1.0000, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3690 => 0.3805, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 3.11% (2.1653 => 2.2327, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (1.8794 => 1.9379, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.04% (0.3981 => 0.4102, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.4139 => 0.4263, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.95% (1.4269 => 1.4690, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.64% (0.6435 => 0.6605, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.63% (0.5012 => 0.5144, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.68% (2.0346 => 2.0688, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.73% (0.2122 => 0.2286, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6759, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.94% (1.8057 => 1.8949, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.75% (15.4430 => 16.1761, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6452, std. dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.50% (2.0820 => 2.1340, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1987, std. dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (41.7953 => 42.6404, std. dev.: 0.0153) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5055, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.26% (7.1849 => 7.2756, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5846, std. dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.70% (2.4764 => 2.3848, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.70% (25.4195 => 16.5978, std. dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8065, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std. dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -3.80% (11.2080 => 10.7826, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.65% (0.6293 => 0.6126, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8434, std. dev.: 0.0711) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5701, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9586, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 15:05:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 17:05:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818220505.2BF512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3023?compare_to=3020&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3023, Order: 162174, Start Time: 2012-08-18 20:52:27, End Time: 2012-08-18 22:05:52 To: 3020, Order: 162172, Start Time: 2012-08-18 19:11:22, End Time: 2012-08-18 20:25:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 4 (4 on baseline) Performance Regressions: 1 (142 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 948 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.10% (2.2636 => 2.3338, std. dev.: 0.0184) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.20% (1.1089 => 1.0956, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.90% (2.0176 => 2.2981, std. dev.: 0.0175) SingleSource/UnitTests/ObjC++/property-reference-object: 10.18% (0.5818 => 0.6410, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.83% (0.5748 => 0.6313, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7061 => 0.7697, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.11% (0.3578 => 0.3868, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.97% (0.3601 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3646 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.81% (0.3650 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.66% (0.3914 => 0.4214, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4328 => 0.4641, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2781 => 0.2980, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.13% (0.3899 => 0.4177, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.09% (0.7038 => 0.7537, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4659, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.94% (0.2782 => 0.2975, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2378, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.82% (0.7710 => 0.8236, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.5265 => 0.5614, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.60% (0.4062 => 0.4330, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.54% (0.2628 => 0.2800, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.44% (0.2655 => 0.2826, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2765 => 0.2943, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.43% (0.2596 => 0.2763, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3022 => 0.3216, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.40% (0.2937 => 0.3125, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.37% (0.2966 => 0.3155, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2760 => 0.2935, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2696 => 0.2863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.15% (1.9828 => 2.1047, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.98% (0.3580 => 0.3794, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.94% (0.9199 => 0.9745, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.76% (0.3453 => 0.3652, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.6959 => 0.7358, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3192 => 0.3375, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.66% (1.2193 => 1.2883, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.64% (0.4379 => 0.4626, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.55% (0.3246 => 0.3426, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.49% (0.3534 => 0.3728, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.38% (0.4016 => 0.4232, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.38% (0.4390 => 0.4626, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.31% (0.5577 => 0.5873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.28% (0.3293 => 0.3467, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.25% (0.3868 => 0.4071, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.3756 => 0.3952, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.08% (13.8202 => 14.5223, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.92% (1.4563 => 1.5279, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.82% (1.1364 => 1.1912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.81% (0.5637 => 0.5908, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2292 => 1.2861, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.56% (0.8310 => 0.8689, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (7.2180 => 7.5464, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.48% (3.8646 => 4.0377, std. dev.: 0.0116) MultiSource/Applications/Burg/burg: 4.48% (1.1061 => 1.1556, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (1.3245 => 1.3833, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.39% (1.3813 => 1.4419, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.3819 => 1.4410, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.22% (0.7506 => 0.7823, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.0594 => 1.1037, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.17% (0.7460 => 0.7771, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3755 => 0.3911, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.13% (16.6129 => 17.2982, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.11% (0.4791 => 0.4988, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.11% (0.6283 => 0.6541, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.06% (1.9270 => 2.0053, std. dev.: 0.0099) MultiSource/Applications/siod/siod: 3.91% (2.1791 => 2.2642, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.87% (0.2995 => 0.3111, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.61% (4.3801 => 4.5383, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (4.4433 => 4.6034, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (4.9865 => 5.1652, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (13.2842 => 13.7440, std. dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.41% (3.6692 => 3.7944, std. dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6135 => 0.6334, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.88% (3.1889 => 3.2806, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (1.1333 => 1.1656, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.72% (0.4113 => 0.4225, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (8.4961 => 8.7257, std. dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 2.61% (16.2614 => 16.6857, std. dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.5298 => 14.8904, std. dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 2.40% (6.5754 => 6.7335, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.8535 => 15.2052, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5188 => 1.5547, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.26% (3.2742 => 3.3483, std. dev.: 0.0157) MultiSource/Applications/oggenc/oggenc: 1.96% (4.6629 => 4.7543, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6250 => 0.6366, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.36% (1.0313 => 1.0453, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.17% (0.9108 => 0.9215, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.16% (3.7467 => 3.7902, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.45% (5.7573 => 7.5106, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/fbench: 28.41% (1.8175 => 2.3338, std. dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 9.71% (1.2998 => 1.4260, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7426, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8175, std. dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3832, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6000, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.99% (10.7476 => 10.9619, std. dev.: 0.0554) MultiSource/Applications/sqlite3/sqlite3: 1.79% (4.5928 => 4.6749, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3256, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5740, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.09% (26.5159 => 26.8042, std. dev.: 0.0542) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.03% (0.4657 => 0.3957, std. dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1582, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.47% (0.8818 => 0.8688, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.60% (1.1560 => 1.1028, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.30% (1.3780 => 1.3187, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0221, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5785, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.46% (1.9762 => 1.9276, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9636, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2391, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3562, std. dev.: 0.0112) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.14% (20.3410 => 20.1087, std. dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.09% (5.5401 => 5.4795, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 15:20:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 17:20:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120818222053.E43EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3024?compare_to=3021&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3024, Order: 162175, Start Time: 2012-08-18 21:03:26, End Time: 2012-08-18 22:21:42 To: 3021, Order: 162172, Start Time: 2012-08-18 19:17:05, End Time: 2012-08-18 20:35:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 4 (6 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (99 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (734 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.56% (13.7207 => 14.0718, std. dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.38% (54.6033 => 56.4477, std. dev.: 0.0908) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.73% (10.3673 => 14.0718, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3473 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.12% (0.3497 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.05% (0.3543 => 0.3970, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.95% (0.3516 => 0.3936, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 9.08% (0.1432 => 0.1562, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.35% (2.2022 => 2.3860, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.15% (0.3817 => 0.4090, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.08% (1.7609 => 1.8855, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.6030 => 0.6455, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.99% (10.4361 => 11.1661, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.95% (0.7326 => 0.7762, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.32% (0.3177 => 0.3346, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.20% (0.4615 => 0.4855, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.13% (7.0540 => 7.4160, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (0.7433 => 0.7805, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.4879 => 0.5112, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.49% (0.2271 => 0.2373, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8888, std. dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.05% (4.2646 => 4.4375, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.04% (0.8172 => 0.8502, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1444, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.01% (5.0018 => 5.2022, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5569 => 0.5785, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5860 => 0.6084, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.57% (0.3109 => 0.3220, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.55% (0.5105 => 0.5286, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.51% (0.3387 => 0.3506, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.49% (0.4103 => 0.4246, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.44% (1.3050 => 1.3499, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 3.44% (5.7591 => 5.9570, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.1363 => 8.4152, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 3.33% (0.7835 => 0.8096, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.26% (1.5415 => 1.5917, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.25% (0.6675 => 0.6892, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.4289 => 0.4427, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.21% (0.9765 => 1.0078, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.20% (0.3441 => 0.3551, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.05% (1.1642 => 1.1997, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.4636 => 0.4777, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3865 => 0.3980, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1861 => 1.2213, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.97% (3.3354 => 3.4343, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.85% (2.0273 => 2.0850, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.84% (2.0665 => 2.1251, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.74% (1.5603 => 1.6031, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (0.4064 => 0.4175, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.73% (0.6450 => 0.6626, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4620 => 0.4745, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.65% (3.8723 => 3.9750, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.6456 => 0.6627, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.55% (0.4203 => 0.4310, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.51% (1.5859 => 1.6257, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.38% (1.2842 => 1.3148, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/football/football: 2.34% (0.8921 => 0.9130, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.5020 => 0.5137, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.32% (2.2969 => 2.3502, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.4186 => 1.4509, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.26% (0.5981 => 0.6116, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.24% (17.1811 => 17.5663, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (14.3668 => 14.6883, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.2024 => 2.2458, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.89% (1.1840 => 1.2064, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.60% (0.7115 => 0.7229, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.47% (1.0722 => 1.0880, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.28% (4.2280 => 4.4514, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7488, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 2.93% (26.0924 => 26.8569, std. dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2494, std. dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (1.3045 => 1.3229, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.39% (5.2763 => 3.1452, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.14% (5.3855 => 3.7085, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7128, std. dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1136, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.47% (2.9384 => 2.5425, std. dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: -12.39% (22.1758 => 19.4284, std. dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1061, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -9.53% (1.5373 => 1.3908, std. dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.81% (5.0483 => 4.8053, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5117, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.25% (32.5116 => 31.4555, std. dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4248, std. dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.79% (1.3677 => 1.3295, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0119, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9573, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3406, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8128, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7068, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 16:55:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 18:55:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120818235543.3E14D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3025?compare_to=3023&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3025, Order: 162180, Start Time: 2012-08-18 22:42:48, End Time: 2012-08-18 23:56:32 To: 3023, Order: 162174, Start Time: 2012-08-18 20:52:27, End Time: 2012-08-18 22:05:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 4 (0 on baseline) Performance Regressions: 0 (150 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (705 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.99% (2.0176 => 2.2999, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: 10.67% (0.5818 => 0.6439, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.53% (0.5748 => 0.6353, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.01% (0.7061 => 0.7768, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.69% (0.3601 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.63% (0.3663 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3646 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.56% (0.3623 => 0.3933, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.50% (0.3789 => 0.4111, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3650 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.20% (0.3940 => 0.4263, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4328 => 0.4664, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.73% (0.2781 => 0.2996, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.48% (0.7710 => 0.8287, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.45% (1.3693 => 1.4713, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4062 => 0.4352, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.09% (0.7038 => 0.7537, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (3.9660 => 4.2460, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.2966 => 0.3173, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.80% (0.2765 => 0.2953, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.72% (1.9828 => 2.1160, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.63% (0.3485 => 0.3716, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.62% (0.3899 => 0.4157, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.46% (0.2988 => 0.3181, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.45% (0.3580 => 0.3811, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3192 => 0.3393, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.06% (0.9199 => 0.9756, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4390 => 0.4655, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.4379 => 0.4640, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.92% (1.2193 => 1.2915, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3534 => 0.3741, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.4016 => 0.4245, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.65% (0.5577 => 0.5892, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.3756 => 0.3966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.45% (0.3246 => 0.3423, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.16% (13.8202 => 14.5338, std. dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.15% (1.4563 => 1.5313, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 5.05% (1.2292 => 1.2913, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.93% (1.1364 => 1.1924, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.87% (1.3813 => 1.4486, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.86% (1.3819 => 1.4490, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.84% (7.2180 => 7.5675, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 4.77% (0.8310 => 0.8706, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.71% (0.3755 => 0.3932, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.56% (3.8646 => 4.0407, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.55% (0.4791 => 0.5009, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.55% (1.1061 => 1.1564, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (1.3245 => 1.3845, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.52% (1.0594 => 1.1073, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.38% (0.7460 => 0.7787, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.30% (0.6283 => 0.6553, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.29% (0.7506 => 0.7828, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.26% (16.6129 => 17.3202, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.13% (1.9270 => 2.0065, std. dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6180, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 3.93% (2.1791 => 2.2647, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.89% (4.3801 => 4.5503, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.80% (4.9865 => 5.1760, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (13.2842 => 13.7819, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.72% (0.8698 => 0.9022, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (3.6692 => 3.8055, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6135 => 0.6353, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.17% (3.1889 => 3.2899, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.05% (16.2614 => 16.7573, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 2.97% (8.4961 => 8.7483, std. dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.96% (1.1333 => 1.1668, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.67% (14.8535 => 15.2495, std. dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 2.65% (14.5298 => 14.9151, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7484, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.63% (3.2742 => 3.3603, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5188 => 1.5572, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.41% (4.6629 => 4.7752, std. dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/bigfib: 2.24% (0.6250 => 0.6390, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.1007 => 2.1425, std. dev.: 0.0140) MultiSource/Applications/minisat/minisat: 1.53% (0.6744 => 0.6847, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.49% (0.9108 => 0.9244, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.48% (1.0313 => 1.0466, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.30% (3.7467 => 3.7953, std. dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 1.21% (33.2944 => 33.6979, std. dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std. dev.: 0.0424) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.97% (1.2998 => 1.4294, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7422, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8164, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4271 => 7.6125, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.35% (10.7476 => 11.0001, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.89% (4.5928 => 4.6798, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3255, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std. dev.: 0.0072) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.19% (26.5159 => 26.8306, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1833, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.16% (1.5089 => 1.5264, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6469 => 3.6873, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.58% (0.4657 => 0.3978, std. dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.92% (22.5627 => 21.2259, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.17% (0.8818 => 0.8715, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2308 => 1.1035, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.20% (1.3780 => 1.3201, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0221, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5817, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9599, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2265, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3305 => 7.2018, std. dev.: 0.0330) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9932, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7922, std. dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3608, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.08% (5.5401 => 5.4804, std. dev.: 0.0206) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5640, std. dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 17:07:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 19:07:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120819000700.10F252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3026?compare_to=3024&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3026, Order: 162180, Start Time: 2012-08-18 22:49:05, End Time: 2012-08-19 00:07:47 To: 3024, Order: 162175, Start Time: 2012-08-18 21:03:26, End Time: 2012-08-18 22:21:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 4 (1 on baseline) Performance Regressions: 2 (97 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 928 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 New Passes - Execution Time --------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.32% (1.3908 => 1.4230, std. dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 2.05% (0.5354 => 0.5464, std. dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.87% (10.3673 => 14.0857, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.96% (1.1194 => 1.2421, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.83% (0.3473 => 0.3849, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3543 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.11% (0.3828 => 0.4215, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.52% (2.2022 => 2.3677, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.44% (0.3817 => 0.4101, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 6.70% (0.6030 => 0.6434, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.62% (0.5925 => 0.6317, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.56% (1.7609 => 1.8764, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.52% (10.4361 => 11.1170, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.00% (0.2065 => 0.2189, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7326 => 0.7732, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.19% (0.7433 => 0.7819, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.94% (0.3177 => 0.3334, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.72% (7.0540 => 7.3872, std. dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.45% (0.2271 => 0.2372, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 4.33% (0.3282 => 0.3424, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.20% (0.4879 => 0.5084, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (9.4845 => 9.8685, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.93% (4.2646 => 4.4320, std. dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.88% (0.8172 => 0.8489, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5569 => 0.5785, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.86% (0.5860 => 0.6086, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1934, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.9449 => 5.1326, std. dev.: 0.0104) MultiSource/Benchmarks/McCat/09-vor/vor: 3.74% (0.3180 => 0.3299, std. dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.43% (1.3050 => 1.3498, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.43% (0.3121 => 0.3228, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.1363 => 8.4059, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.4103 => 0.4237, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9765 => 1.0083, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.25% (1.5415 => 1.5916, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.22% (0.7835 => 0.8087, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.5105 => 0.5269, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.19% (0.3387 => 0.3495, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.18% (0.3650 => 0.3766, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3441 => 0.3550, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.16% (1.1642 => 1.2010, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 3.05% (0.4289 => 0.4420, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.03% (5.7591 => 5.9337, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.00% (3.3354 => 3.4356, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.00% (2.0273 => 2.0881, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.96% (1.5603 => 1.6065, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.8067 => 0.8305, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3865 => 0.3977, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.85% (0.4636 => 0.4768, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.77% (0.3826 => 0.3932, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.75% (3.8723 => 3.9787, std. dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4620 => 0.4743, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.63% (0.6456 => 0.6626, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.58% (1.5859 => 1.6268, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.56% (0.6450 => 0.6615, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.56% (2.2969 => 2.3556, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (0.4064 => 0.4165, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (14.3668 => 14.7238, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.47% (2.0665 => 2.1176, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.29% (1.2842 => 1.3136, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.26% (17.1811 => 17.5690, std. dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (1.4186 => 1.4505, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8921 => 0.9121, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.11% (0.5020 => 0.5126, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (2.2024 => 2.2489, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.74% (0.7115 => 0.7239, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.66% (1.1840 => 1.2036, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.56% (1.0722 => 1.0889, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.23% (4.2280 => 4.4492, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.85% (26.0924 => 26.8361, std. dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2127, std. dev.: 0.0061) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3338, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2418, std. dev.: 0.0144) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (1.5086 => 1.5265, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6820, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std. dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1241, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.75% (5.2763 => 3.1261, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6967, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6961, std. dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0915, std. dev.: 0.0260) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.89% (2.9384 => 2.5302, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -12.35% (22.1758 => 19.4375, std. dev.: 0.0225) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -11.67% (1.2373 => 1.0929, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: -7.44% (1.5373 => 1.4230, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4722, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4237, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.51% (10.2830 => 10.0252, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.28% (8.1563 => 7.9701, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3364, std. dev.: 0.0059) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 17:46:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 19:46:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120819004605.440672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3027?compare_to=3022&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3027, Order: 162177, Start Time: 2012-08-18 22:03:07, End Time: 2012-08-19 00:46:54 To: 3022, Order: 162172, Start Time: 2012-08-18 18:52:00, End Time: 2012-08-18 21:35:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.09% (2.8216 => 2.7909, std. dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.00% (0.3446 => 0.3894, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3488 => 0.3939, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 12.91% (0.3469 => 0.3917, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3442 => 0.3883, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3460 => 0.3903, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 12.79% (0.3496 => 0.3943, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 12.41% (0.3650 => 0.4103, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3643 => 0.4095, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 11.98% (0.3724 => 0.4170, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 7.60% (0.5826 => 0.6269, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.54% (0.5889 => 0.6333, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.30% (1.5932 => 1.6935, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.05% (1.6211 => 1.7192, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 5.93% (0.7171 => 0.7596, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.85% (1.3152 => 1.3921, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.75% (3.5627 => 3.7674, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (0.4994 => 0.5269, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.49% (0.4029 => 0.4250, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (0.4361 => 0.4598, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.37% (0.5026 => 0.5296, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.34% (0.3930 => 0.4140, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (0.5000 => 0.5264, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.18% (1.0781 => 1.1339, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.06% (0.2866 => 0.3011, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.99% (4.2109 => 4.4211, std. dev.: 0.0114) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.5900 => 0.6179, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.53% (0.2736 => 0.2860, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (0.4658 => 0.4868, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: 4.44% (0.2725 => 0.2846, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.31% (0.2875 => 0.2999, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.22% (5.5417 => 5.7755, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.13% (0.2566 => 0.2672, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.12% (0.2792 => 0.2907, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.10% (0.9909 => 1.0315, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.05% (0.2738 => 0.2849, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.05% (0.2813 => 0.2927, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.03% (0.3004 => 0.3125, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.03% (0.3625 => 0.3771, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (1.9694 => 2.0486, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.01% (0.3195 => 0.3323, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.96% (0.3890 => 0.4044, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.96% (0.2780 => 0.2890, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (1.9966 => 2.0751, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.92% (0.2729 => 0.2836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.92% (0.3267 => 0.3395, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.91% (0.2811 => 0.2921, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.90% (2.1013 => 2.1833, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.90% (0.3282 => 0.3410, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2823 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2803 => 0.2912, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.86% (2.0673 => 2.1470, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.80% (2.7292 => 2.8329, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 3.78% (0.6634 => 0.6885, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 3.78% (4.6177 => 4.7922, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (4.4195 => 4.5863, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3362 => 0.3488, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 3.69% (1.8794 => 1.9487, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 3.68% (0.3258 => 0.3378, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.66% (0.3060 => 0.3172, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.3903 => 0.4045, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.60% (0.3726 => 0.3860, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.58% (2.1653 => 2.2429, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 3.56% (0.3317 => 0.3435, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.53% (23.5202 => 24.3509, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/lists: 3.41% (0.3348 => 0.3462, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.35% (0.5546 => 0.5732, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 3.34% (0.7875 => 0.8138, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.25% (0.3845 => 0.3970, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.3271 => 0.3377, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4146 => 0.4280, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 3.18% (1.4269 => 1.4723, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3690 => 0.3806, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.13% (0.4251 => 0.4384, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (0.4139 => 0.4265, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 3.01% (0.9697 => 0.9989, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.99% (0.3981 => 0.4100, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.69% (0.6435 => 0.6608, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.57% (0.5012 => 0.5141, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.20% (2.0346 => 2.0794, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.44% (0.7426 => 0.7533, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.96% (0.2122 => 0.2291, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1718, std. dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6353, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std. dev.: 0.0089) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (41.7953 => 42.6090, std. dev.: 0.0167) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5115, std. dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5922, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2883, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5969, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.2451 => 1.2578, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.72% (2.4764 => 2.3843, std. dev.: 0.0227) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5394, std. dev.: 0.0302) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9781, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7830, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: -7.41% (0.2402 => 0.2224, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7961, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0049) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8296, std. dev.: 0.0528) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9601, std. dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 18:36:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 20:36:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120819013639.862722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3028?compare_to=3025&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3028, Order: 162181, Start Time: 2012-08-19 00:23:52, End Time: 2012-08-19 01:37:28 To: 3025, Order: 162180, Start Time: 2012-08-18 22:42:48, End Time: 2012-08-18 23:56:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.59% (54.9459 => 55.8192, std. dev.: 0.3328) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.00% (2.0176 => 2.3000, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 10.76% (0.5818 => 0.6444, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.98% (0.7061 => 0.7766, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.83% (0.3578 => 0.3894, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.69% (0.3601 => 0.3914, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3646 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.52% (0.3663 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.49% (0.3650 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.30% (0.3914 => 0.4239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.30% (0.3940 => 0.4267, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.75% (0.4062 => 0.4377, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.74% (0.4328 => 0.4663, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.44% (1.3693 => 1.4712, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2628 => 0.2818, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.20% (0.7038 => 0.7545, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.08% (0.3107 => 0.3327, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.01% (3.9660 => 4.2440, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.7710 => 0.8246, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.88% (0.2760 => 0.2950, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.75% (0.2696 => 0.2878, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.3899 => 0.4162, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.74% (1.9828 => 2.1165, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3580 => 0.3815, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4390 => 0.4655, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.03% (0.9199 => 0.9754, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.97% (1.2193 => 1.2921, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3534 => 0.3741, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.5577 => 0.5901, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.79% (0.6959 => 0.7362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.77% (0.3293 => 0.3483, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (0.3756 => 0.3967, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3246 => 0.3428, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.50% (0.2945 => 0.3107, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (1.4563 => 1.5339, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.22% (13.8202 => 14.5412, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.04% (0.5637 => 0.5921, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.04% (1.2292 => 1.2911, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.94% (1.1364 => 1.1925, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (1.3813 => 1.4492, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (7.2180 => 7.5694, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.82% (1.3819 => 1.4485, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.75% (0.8310 => 0.8705, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3755 => 0.3930, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.57% (1.0594 => 1.1078, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.55% (3.8646 => 4.0404, std. dev.: 0.0073) MultiSource/Applications/Burg/burg: 4.50% (1.1061 => 1.1559, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.48% (1.3245 => 1.3839, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.42% (0.6283 => 0.6561, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.40% (0.4791 => 0.5002, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.7460 => 0.7785, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.28% (0.7506 => 0.7827, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.23% (16.6129 => 17.3151, std. dev.: 0.0133) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.09% (1.9270 => 2.0058, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.94% (2.1791 => 2.2649, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5525, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6173, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.84% (4.9865 => 5.1778, std. dev.: 0.0212) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.75% (0.8698 => 0.9024, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (13.2842 => 13.7803, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.68% (3.6692 => 3.8044, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6135 => 0.6356, std. dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.21% (3.1889 => 3.2914, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.03% (16.2614 => 16.7542, std. dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 3.01% (8.4961 => 8.7519, std. dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.96% (1.1333 => 1.1669, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.68% (14.8535 => 15.2513, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9128, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (3.2742 => 3.3605, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7482, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5188 => 1.5564, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.37% (4.6629 => 4.7732, std. dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6250 => 0.6395, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (2.1007 => 2.1418, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.47% (1.0313 => 1.0465, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 1.30% (3.7467 => 3.7954, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.25% (33.2944 => 33.7117, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5158, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2587, std. dev.: 0.0458) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 10.66% (1.2998 => 1.4384, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7436, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.10% (1.7081 => 1.7781, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9637, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9837, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3835, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5987, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.12% (10.7476 => 10.9758, std. dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 1.87% (4.5928 => 4.6787, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0086) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (1.5089 => 1.5275, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5746, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.08% (26.5159 => 26.8012, std. dev.: 0.0338) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.96% (0.4657 => 0.4007, std. dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.87% (22.5627 => 21.2376, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (0.8818 => 0.8712, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.2308 => 1.0940, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5899, std. dev.: 0.0155) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9634, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2380, std. dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3305 => 7.1979, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (20.3410 => 20.0665, std. dev.: 0.0431) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7911, std. dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3625, std. dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.20% (5.5401 => 5.4735, std. dev.: 0.0071) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 18:53:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 20:53:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120819015310.1752C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3029?compare_to=3026&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3029, Order: 162182, Start Time: 2012-08-19 00:35:12, End Time: 2012-08-19 01:53:58 To: 3026, Order: 162180, Start Time: 2012-08-18 22:49:05, End Time: 2012-08-19 00:07:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (740 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.91% (10.3673 => 14.0899, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.91% (1.1194 => 1.2415, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.48% (2.2022 => 2.3669, std. dev.: 0.0177) SingleSource/UnitTests/ObjC++/property-reference-object: 6.73% (0.6030 => 0.6436, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.62% (0.5925 => 0.6317, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.59% (1.7609 => 1.8769, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.55% (10.4361 => 11.1194, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.54% (0.7326 => 0.7732, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 5.33% (0.7433 => 0.7829, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.13% (0.3177 => 0.3340, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (0.4615 => 0.4839, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3830, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.54% (0.2271 => 0.2374, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 4.30% (0.3282 => 0.3423, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.18% (0.4879 => 0.5083, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.99% (4.2646 => 4.4347, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (9.4845 => 9.8623, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5860 => 0.6093, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.93% (0.5569 => 0.5788, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.9449 => 5.1355, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1936, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8172 => 0.8482, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.4103 => 0.4249, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.48% (1.3050 => 1.3504, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4289 => 0.4432, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.31% (8.1363 => 8.4058, std. dev.: 0.0099) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.28% (0.3441 => 0.3554, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.5105 => 0.5272, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9765 => 1.0084, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.18% (1.1642 => 1.2012, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.6675 => 0.6887, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.16% (1.5415 => 1.5902, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.04% (0.8067 => 0.8312, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.02% (5.7591 => 5.9328, std. dev.: 0.0135) MultiSource/Applications/treecc/treecc: 2.98% (2.0273 => 2.0878, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.95% (1.5603 => 1.6063, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 2.94% (3.3354 => 3.4334, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.4636 => 0.4770, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.87% (1.1861 => 1.2201, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3865 => 0.3974, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.74% (3.8723 => 3.9785, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.71% (0.3684 => 0.3784, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4620 => 0.4745, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.6456 => 0.6630, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (14.3668 => 14.7401, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.56% (0.6450 => 0.6615, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (2.0665 => 2.1193, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.54% (2.2969 => 2.3552, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (0.4064 => 0.4166, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.43% (1.4186 => 1.4531, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.36% (17.1811 => 17.5863, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 2.30% (1.2842 => 1.3137, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8921 => 0.9120, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.2024 => 2.2513, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.01% (0.5020 => 0.5121, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.78% (0.7115 => 0.7242, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.63% (1.0722 => 1.0897, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.1840 => 1.2030, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.41% (4.2280 => 4.4568, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.97% (26.0924 => 26.8674, std. dev.: 0.0383) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (3.6395 => 3.7452, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 1.74% (3.1578 => 3.2127, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3338, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2367, std. dev.: 0.0259) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5086 => 1.5269, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.15% (19.9488 => 20.1775, std. dev.: 0.0249) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1242, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.77% (5.2763 => 3.1254, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6968, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6960, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0866, std. dev.: 0.0511) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.82% (2.9384 => 2.5324, std. dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: -12.36% (22.1758 => 19.4354, std. dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -11.25% (1.2373 => 1.0981, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -7.97% (1.5373 => 1.4148, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.00% (1.1396 => 1.0598, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.63% (1.5835 => 1.5102, std. dev.: 0.0020) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4699, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4339, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9959, std. dev.: 0.0224) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9617, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6833, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3436, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4194, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.02% (1.8329 => 1.8142, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 20:17:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 22:17:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120819031751.11E9D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3030?compare_to=3028&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3030, Order: 162182, Start Time: 2012-08-19 02:04:50, End Time: 2012-08-19 03:18:38 To: 3028, Order: 162181, Start Time: 2012-08-19 00:23:52, End Time: 2012-08-19 01:37:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (147 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.60% (77.7373 => 80.5354, std. dev.: 0.5070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.85% (1.4384 => 1.3974, std. dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.13% (2.0176 => 2.3026, std. dev.: 0.0137) SingleSource/UnitTests/ObjC++/property-reference-object: 10.67% (0.5818 => 0.6439, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 10.53% (0.5748 => 0.6353, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.50% (0.7061 => 0.7732, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 8.92% (0.3578 => 0.3897, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.67% (0.3646 => 0.3962, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3601 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3663 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.50% (0.3623 => 0.3931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 8.48% (0.3914 => 0.4246, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.47% (0.3650 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.22% (0.4003 => 0.4332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (0.4328 => 0.4670, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 7.49% (1.3693 => 1.4718, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.21% (0.4062 => 0.4355, std. dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 7.19% (0.7038 => 0.7544, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.15% (3.9660 => 4.2495, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.88% (0.3022 => 0.3230, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2696 => 0.2880, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.5265 => 0.5618, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.70% (1.9828 => 2.1156, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.69% (0.3899 => 0.4160, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.62% (0.3489 => 0.3720, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.57% (0.3485 => 0.3714, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.45% (0.3580 => 0.3811, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2988 => 0.3180, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3192 => 0.3393, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.22% (0.4390 => 0.4663, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.18% (1.2193 => 1.2947, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.09% (0.9199 => 0.9759, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.90% (0.5577 => 0.5906, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3534 => 0.3741, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.83% (0.4016 => 0.4250, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.77% (0.3293 => 0.3483, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.64% (0.3868 => 0.4086, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (0.3756 => 0.3967, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3246 => 0.3427, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.30% (13.8202 => 14.5528, std. dev.: 0.0242) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.16% (1.4563 => 1.5315, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 5.08% (1.2292 => 1.2916, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (1.1364 => 1.1931, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.90% (0.5637 => 0.5913, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.89% (3.8646 => 4.0535, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.87% (1.3813 => 1.4486, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (7.2180 => 7.5669, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.82% (1.3819 => 1.4485, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.75% (0.8310 => 0.8705, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3755 => 0.3931, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 4.66% (1.1061 => 1.1576, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.58% (1.0594 => 1.1079, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.51% (0.4791 => 0.5007, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.50% (1.3245 => 1.3841, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.7460 => 0.7795, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.42% (0.6283 => 0.6561, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.28% (16.6129 => 17.3242, std. dev.: 0.0183) MultiSource/Applications/treecc/treecc: 4.25% (1.9270 => 2.0089, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.03% (2.1791 => 2.2670, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (4.4433 => 4.6223, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.3801 => 4.5555, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1776, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.77% (0.8698 => 0.9026, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (13.2842 => 13.7797, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.67% (3.6692 => 3.8037, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.62% (0.6135 => 0.6357, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.23% (3.1889 => 3.2920, std. dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.15% (1.1333 => 1.1690, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.15% (16.2614 => 16.7734, std. dev.: 0.0148) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (8.4961 => 8.7526, std. dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 2.77% (14.8535 => 15.2649, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.72% (3.2742 => 3.3634, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9252, std. dev.: 0.0151) MultiSource/Applications/JM/ldecod/ldecod: 2.69% (6.5754 => 6.7524, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5188 => 1.5575, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.45% (4.6629 => 4.7772, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6250 => 0.6398, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.1007 => 2.1432, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.73% (0.6744 => 0.6861, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.66% (1.0313 => 1.0484, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.56% (0.9108 => 0.9250, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.44% (3.7467 => 3.8007, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.31% (33.2944 => 33.7310, std. dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5189, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.51% (1.2998 => 1.3974, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7416, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (2.8606 => 2.9628, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9873, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8180, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6009, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.98% (10.7476 => 10.9604, std. dev.: 0.0174) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6782, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.09% (26.5159 => 26.8045, std. dev.: 0.0224) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.90% (22.5627 => 21.2318, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.13% (0.8818 => 0.8718, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.2308 => 1.0970, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1022, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.41% (1.3780 => 1.3172, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0220, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5971, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.14% (3.0263 => 2.9616, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2242, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3305 => 7.2002, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7920, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3639, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4757, std. dev.: 0.0150) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (20.3410 => 20.1268, std. dev.: 0.0282) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 18 20:57:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 18 Aug 2012 22:57:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120819035707.E9D642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3031?compare_to=3027&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3031, Order: 162182, Start Time: 2012-08-19 01:14:27, End Time: 2012-08-19 03:57:56 To: 3027, Order: 162177, Start Time: 2012-08-18 22:03:07, End Time: 2012-08-19 00:46:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (115 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.44% (0.9989 => 1.0133, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.26% (2.1470 => 2.1740, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 1.07% (1.0315 => 1.0425, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.29% (54.1291 => 54.8276, std. dev.: 0.0560) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 12.21% (0.3465 => 0.3888, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/for-in: 12.16% (0.3496 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.11% (0.3460 => 0.3879, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3442 => 0.3858, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.05% (0.3469 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.04% (0.3488 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.78% (0.3650 => 0.4080, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.69% (0.3643 => 0.4069, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.84% (0.5826 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.56% (0.5889 => 0.6334, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.15% (1.5932 => 1.7071, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.1619 => 0.1726, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.15% (0.7171 => 0.7612, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.03% (1.3152 => 1.3945, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.94% (1.6211 => 1.7174, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (3.5627 => 3.7694, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.63% (0.2875 => 0.3037, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.52% (0.2792 => 0.2946, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (0.4994 => 0.5268, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2738 => 0.2888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2714 => 0.2862, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (0.5026 => 0.5294, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.31% (0.2729 => 0.2874, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.31% (0.2750 => 0.2896, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (0.2014 => 0.2120, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.26% (0.2813 => 0.2961, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.24% (0.2803 => 0.2950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.2823 => 0.2971, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.23% (0.3096 => 0.3258, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.23% (0.2811 => 0.2958, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.23% (0.3004 => 0.3161, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.21% (0.9909 => 1.0425, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.18% (0.5000 => 0.5259, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 5.18% (0.2780 => 0.2924, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.16% (2.0673 => 2.1740, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.10% (0.3195 => 0.3358, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3267 => 0.3433, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.07% (0.3060 => 0.3215, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.06% (4.2109 => 4.4238, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary: 5.03% (0.3258 => 0.3422, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3362 => 0.3531, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.02% (0.2911 => 0.3057, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.96% (0.4029 => 0.4229, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.95% (1.0781 => 1.1315, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.88% (0.3317 => 0.3479, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.83% (0.3124 => 0.3275, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.80% (0.3726 => 0.3905, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.75% (0.3282 => 0.3438, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3678 => 0.3850, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.63% (0.3477 => 0.3638, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.63% (0.3348 => 0.3503, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3625 => 0.3788, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.50% (0.9697 => 1.0133, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3690 => 0.3854, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 4.37% (0.4146 => 0.4327, std. dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 4.28% (5.5417 => 5.7791, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 4.26% (0.4251 => 0.4432, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.19% (0.3845 => 0.4006, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (0.4658 => 0.4853, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.18% (1.9694 => 2.0517, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (0.3890 => 0.4051, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 4.12% (23.5202 => 24.4901, std. dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.09% (0.3981 => 0.4144, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (1.9966 => 2.0769, std. dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (2.7292 => 2.8386, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.81% (0.6634 => 0.6887, std. dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 3.80% (2.1653 => 2.2476, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (1.8794 => 1.9504, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (2.1013 => 2.1806, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.69% (0.5012 => 0.5197, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.3903 => 0.4046, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (4.4195 => 4.5807, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.60% (0.3084 => 0.3195, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.60% (4.6177 => 4.7838, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 3.56% (1.4269 => 1.4777, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.56% (0.6435 => 0.6664, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.3271 => 0.3383, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.39% (0.7875 => 0.8142, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.30% (0.3336 => 0.3446, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.17% (0.4139 => 0.4270, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.14% (0.5546 => 0.5720, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.23% (2.0346 => 2.0800, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (0.7426 => 0.7557, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.19% (11.6398 => 11.7783, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6125, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6689, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std. dev.: 0.0334) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6394, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2110, std. dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.94% (41.7953 => 42.6060, std. dev.: 0.0197) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5126, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5910, std. dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2806, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5954, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.06% (105.3826 => 106.4968, std. dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.76% (2.4764 => 2.3833, std. dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5422, std. dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7991, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8039, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0054) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.64% (17.2379 => 16.7836, std. dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9630, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 04:49:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 06:49:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120819114913.D3A592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3032?compare_to=3029&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3032, Order: 162186, Start Time: 2012-08-19 10:30:42, End Time: 2012-08-19 11:50:04 To: 3029, Order: 162182, Start Time: 2012-08-19 00:35:12, End Time: 2012-08-19 01:53:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (740 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.35% (55.4052 => 56.1541, std. dev.: 0.1600) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.86% (10.3673 => 14.0852, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.93% (1.1194 => 1.2418, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3516 => 0.3894, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.11% (0.3927 => 0.4324, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.56% (2.2022 => 2.3687, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.73% (0.6030 => 0.6436, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 6.70% (0.5925 => 0.6322, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.63% (0.1584 => 0.1689, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 6.61% (10.4361 => 11.1264, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.59% (1.7609 => 1.8770, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.45% (0.7326 => 0.7725, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 5.39% (0.7433 => 0.7834, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.03% (0.4615 => 0.4847, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5569 => 0.5828, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.64% (7.0540 => 7.3811, std. dev.: 0.0182) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.49% (0.2271 => 0.2373, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.33% (0.5860 => 0.6114, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.32% (0.4879 => 0.5090, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.17% (4.2646 => 4.4424, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.8172 => 0.8510, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: 4.06% (0.7835 => 0.8153, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (9.4845 => 9.8621, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1380, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1948, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash: 3.68% (0.4289 => 0.4447, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.56% (1.3050 => 1.3515, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (1.5415 => 1.5952, std. dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (8.1363 => 8.4097, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.9765 => 1.0090, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.31% (0.5105 => 0.5274, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.28% (0.3441 => 0.3554, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.27% (0.8067 => 0.8331, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.4103 => 0.4236, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.21% (0.3865 => 0.3989, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.19% (1.5603 => 1.6100, std. dev.: 0.0086) MultiSource/Applications/Burg/burg: 3.15% (1.1642 => 1.2009, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6675 => 0.6880, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.07% (3.3354 => 3.4378, std. dev.: 0.0110) MultiSource/Applications/treecc/treecc: 3.06% (2.0273 => 2.0893, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1861 => 1.2223, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 3.01% (5.7591 => 5.9322, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.88% (0.6450 => 0.6636, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.88% (0.3650 => 0.3755, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.86% (3.8723 => 3.9829, std. dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.82% (0.3826 => 0.3934, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.6456 => 0.6636, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.71% (1.5859 => 1.6288, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.64% (2.2969 => 2.3575, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.62% (1.4186 => 1.4557, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.58% (14.3668 => 14.7379, std. dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.56% (0.4064 => 0.4168, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4620 => 0.4738, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.48% (2.0665 => 2.1178, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.48% (0.8921 => 0.9142, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.48% (1.2842 => 1.3160, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.38% (17.1811 => 17.5897, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.2024 => 2.2511, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.17% (0.5020 => 0.5129, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: 1.84% (0.7115 => 0.7246, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.69% (1.1840 => 1.2040, std. dev.: 0.0066) MultiSource/Applications/lemon/lemon: 1.62% (1.0722 => 1.0896, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.28% (4.2280 => 4.4511, std. dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7506, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.85% (26.0924 => 26.8356, std. dev.: 0.0448) SingleSource/Benchmarks/Shootout-C++/hash2: 1.82% (3.1578 => 3.2154, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3347, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2400, std. dev.: 0.0182) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7986, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (1.5086 => 1.5265, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 1.08% (2.2771 => 2.3016, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.05% (19.9488 => 20.1577, std. dev.: 0.0162) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1242, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.78% (5.2763 => 3.1248, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.29% (5.3855 => 3.7003, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7013, std. dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0526, std. dev.: 0.0265) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.85% (2.9384 => 2.5314, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -12.29% (22.1758 => 19.4496, std. dev.: 0.0417) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -7.51% (1.5373 => 1.4218, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4674, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4731, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4188, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: -2.80% (10.2830 => 9.9950, std. dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9598, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5091, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3341, std. dev.: 0.0079) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 04:52:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 06:52:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120819115217.4B47C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3033?compare_to=3030&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3033, Order: 162186, Start Time: 2012-08-19 10:30:39, End Time: 2012-08-19 11:44:35 To: 3030, Order: 162182, Start Time: 2012-08-19 02:04:50, End Time: 2012-08-19 03:18:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.06% (2.0176 => 2.3013, std. dev.: 0.0126) SingleSource/UnitTests/ObjC++/property-reference-object: 10.78% (0.5818 => 0.6445, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.53% (0.5748 => 0.6353, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.64% (0.7061 => 0.7742, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 8.86% (0.3578 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.72% (0.3601 => 0.3915, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.59% (0.3130 => 0.3399, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3663 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.47% (0.3623 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.45% (0.3789 => 0.4109, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.35% (0.3914 => 0.4241, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.74% (0.4328 => 0.4663, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.70% (0.2781 => 0.2995, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.44% (1.3693 => 1.4712, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 7.20% (0.7038 => 0.7545, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.19% (0.7710 => 0.8264, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4062 => 0.4349, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.02% (3.9660 => 4.2443, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.92% (0.3022 => 0.3231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.88% (0.2760 => 0.2950, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.84% (0.2966 => 0.3169, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.84% (0.2765 => 0.2954, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.70% (1.9828 => 2.1156, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.59% (0.3489 => 0.3719, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.57% (0.3485 => 0.3714, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.51% (0.3580 => 0.3813, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.10% (0.9199 => 0.9760, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.06% (0.4390 => 0.4656, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.94% (1.2193 => 1.2917, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.86% (0.3293 => 0.3486, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.6959 => 0.7366, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.4016 => 0.4245, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3246 => 0.3427, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.29% (1.4563 => 1.5333, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 5.19% (13.8202 => 14.5370, std. dev.: 0.0165) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 5.03% (1.2292 => 1.2910, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.95% (1.1364 => 1.1927, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.3819 => 1.4492, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.83% (1.3813 => 1.4480, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.82% (7.2180 => 7.5656, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 4.75% (0.8310 => 0.8705, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.70% (3.8646 => 4.0461, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3755 => 0.3931, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3860, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.59% (0.4791 => 0.5011, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.50% (0.2243 => 0.2344, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.47% (1.1061 => 1.1555, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7460 => 0.7793, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 4.46% (1.0594 => 1.1066, std. dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 4.32% (16.6129 => 17.3312, std. dev.: 0.0175) MultiSource/Applications/spiff/spiff: 4.28% (0.7506 => 0.7827, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.25% (0.6283 => 0.6550, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.22% (1.9270 => 2.0084, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.05% (2.1791 => 2.2674, std. dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 4.01% (0.2995 => 0.3115, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6173, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5512, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.88% (4.9865 => 5.1799, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8089, std. dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (13.2842 => 13.7818, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.69% (0.8698 => 0.9019, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.52% (0.6135 => 0.6351, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.19% (3.1889 => 3.2907, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 3.18% (16.2614 => 16.7786, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.99% (1.1333 => 1.1672, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.94% (8.4961 => 8.7456, std. dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: 2.79% (14.8535 => 15.2679, std. dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9254, std. dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7483, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.61% (3.2742 => 3.3597, std. dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.5188 => 1.5578, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.43% (4.6629 => 4.7763, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.26% (0.6250 => 0.6391, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.00% (2.1007 => 2.1428, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.75% (0.6744 => 0.6862, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.54% (0.9108 => 0.9248, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.48% (1.0313 => 1.0466, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.37% (3.7467 => 3.7981, std. dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 1.29% (33.2944 => 33.7225, std. dev.: 0.0208) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7410, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8175, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3835, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9937, std. dev.: 0.0401) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5967, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5928 => 4.6761, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 1.58% (3.2729 => 3.3246, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.36% (3.7731 => 3.8245, std. dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.12% (26.5159 => 26.8119, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5719, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.90% (22.5627 => 21.2308, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.13% (0.8818 => 0.8718, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.2308 => 1.0992, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.53% (1.1560 => 1.1036, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.41% (1.3780 => 1.3172, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6067, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -2.46% (1.9762 => 1.9276, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9597, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2256, std. dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2075, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3586, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.19% (5.5401 => 5.4744, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (20.3410 => 20.1268, std. dev.: 0.0207) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 06:13:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 08:13:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120819131316.E63B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3034?compare_to=3031&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3034, Order: 162186, Start Time: 2012-08-19 10:30:35, End Time: 2012-08-19 13:14:06 To: 3031, Order: 162182, Start Time: 2012-08-19 01:14:27, End Time: 2012-08-19 03:57:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (119 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.29% (0.2141 => 0.2297, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.41% (124.1409 => 130.8604, std. dev.: 0.6268) SingleSource/Benchmarks/Shootout-C++/ary2: 4.63% (0.2160 => 0.2260, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.80% (2.0685 => 2.1058, std. dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.58% (0.3465 => 0.3901, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 12.25% (0.3446 => 0.3868, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3460 => 0.3882, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 12.14% (0.3442 => 0.3860, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.14% (0.3469 => 0.3890, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3496 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.13% (0.3488 => 0.3911, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 11.84% (0.3650 => 0.4082, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.75% (0.3643 => 0.4071, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3724 => 0.4147, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.84% (0.5826 => 0.6283, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.69% (0.5889 => 0.6342, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.12% (1.5932 => 1.7067, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.1619 => 0.1730, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.09% (1.6211 => 1.7198, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 6.07% (0.7171 => 0.7606, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.83% (3.5627 => 3.7703, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2875 => 0.3042, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.69% (1.3152 => 1.3901, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (0.4994 => 0.5271, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.44% (0.2792 => 0.2944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (0.4361 => 0.4598, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.3004 => 0.3167, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.41% (0.2738 => 0.2886, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.35% (0.2729 => 0.2875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.35% (0.2750 => 0.2897, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.32% (0.3195 => 0.3365, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2803 => 0.2952, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 5.30% (0.9909 => 1.0434, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (0.3930 => 0.4138, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2780 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.27% (0.2811 => 0.2959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.26% (0.2813 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.2823 => 0.2971, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.23% (0.3096 => 0.3258, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.22% (0.2911 => 0.3063, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.22% (0.5000 => 0.5261, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.18% (2.0673 => 2.1743, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.16% (0.4029 => 0.4237, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.13% (0.3258 => 0.3425, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (0.5026 => 0.5283, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.10% (0.5900 => 0.6201, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 5.10% (4.2109 => 4.4257, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ary3: 5.08% (0.3267 => 0.3433, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.06% (1.0781 => 1.1327, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.96% (0.3124 => 0.3279, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.94% (0.3317 => 0.3481, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.94% (0.3726 => 0.3910, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.94% (0.3362 => 0.3528, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.80% (0.3060 => 0.3207, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3477 => 0.3642, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.72% (0.3282 => 0.3437, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3678 => 0.3850, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.66% (0.9697 => 1.0149, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.66% (0.3348 => 0.3504, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3625 => 0.3792, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.53% (0.2736 => 0.2860, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.49% (0.4146 => 0.4332, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 4.35% (0.4251 => 0.4436, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.33% (5.5417 => 5.7818, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3690 => 0.3849, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.29% (0.3890 => 0.4057, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.19% (0.3981 => 0.4148, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 4.14% (23.5202 => 24.4949, std. dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (0.4658 => 0.4849, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.09% (0.2566 => 0.2671, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.08% (1.9966 => 2.0781, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (1.9694 => 2.0490, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 3.99% (1.8794 => 1.9544, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.93% (0.3845 => 0.3996, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.89% (2.7292 => 2.8354, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.73% (0.6435 => 0.6675, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.69% (0.5012 => 0.5197, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.3903 => 0.4047, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 3.68% (2.1013 => 2.1787, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.64% (0.7875 => 0.8162, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.3084 => 0.3196, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.59% (4.6177 => 4.7835, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 3.59% (2.1653 => 2.2430, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 3.54% (1.4269 => 1.4774, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (4.4195 => 4.5754, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 3.36% (0.6634 => 0.6857, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.31% (0.4139 => 0.4276, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.3271 => 0.3377, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.23% (0.5546 => 0.5725, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.06% (0.3336 => 0.3438, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.27% (2.0346 => 2.0808, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (0.7426 => 0.7549, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.21% (11.6398 => 11.7808, std. dev.: 0.0133) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (4.6926 => 4.7405, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.25% (0.2122 => 0.2297, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1703, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6525, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1985, std. dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5024, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5914, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.72% (41.7953 => 42.5130, std. dev.: 0.0578) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2204, std. dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2810, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5906, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4403, std. dev.: 0.0296) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5829, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8041, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -5.91% (0.2402 => 0.2260, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7956, std. dev.: 0.0140) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.31% (17.2379 => 16.8400, std. dev.: 0.0494) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9700, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 07:56:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 09:56:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120819145634.322A22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3035?compare_to=3033&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3035, Order: 162187, Start Time: 2012-08-19 13:43:12, End Time: 2012-08-19 14:57:22 To: 3033, Order: 162186, Start Time: 2012-08-19 10:30:39, End Time: 2012-08-19 11:44:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (151 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.58% (1.3788 => 1.4281, std. dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.23% (54.6028 => 56.3675, std. dev.: 0.0888) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.60% (2.0176 => 2.3121, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: 10.74% (0.5818 => 0.6443, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.61% (0.5748 => 0.6358, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.52% (0.7061 => 0.7804, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.11% (0.3601 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3646 => 0.3974, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.98% (0.3130 => 0.3411, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.76% (0.3789 => 0.4121, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.40% (0.3940 => 0.4271, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.39% (0.4003 => 0.4339, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.12% (0.4062 => 0.4392, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.95% (0.4328 => 0.4672, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.94% (0.2782 => 0.3003, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (0.1413 => 0.1525, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 7.64% (1.3693 => 1.4739, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.47% (0.7038 => 0.7564, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 7.46% (0.2937 => 0.3156, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.35% (3.9660 => 4.2575, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3022 => 0.3244, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.30% (0.7710 => 0.8273, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2760 => 0.2961, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.3107 => 0.3328, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.11% (1.9828 => 2.1237, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.08% (0.3899 => 0.4175, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 7.06% (0.2761 => 0.2956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.97% (0.3485 => 0.3728, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.90% (0.3580 => 0.3827, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3489 => 0.3729, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.83% (0.3192 => 0.3410, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.46% (0.3453 => 0.3676, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.40% (0.4390 => 0.4671, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.31% (0.9199 => 0.9779, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 6.23% (0.3293 => 0.3498, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.20% (0.3534 => 0.3753, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (1.2193 => 1.2943, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.12% (0.4379 => 0.4647, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.08% (0.4016 => 0.4260, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 6.02% (0.3868 => 0.4101, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.6959 => 0.7378, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (0.3756 => 0.3980, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.87% (0.1789 => 0.1894, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.80% (13.8202 => 14.6212, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.74% (0.2127 => 0.2249, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.72% (0.5577 => 0.5896, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3246 => 0.3430, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.53% (1.2292 => 1.2972, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.40% (1.1364 => 1.1978, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.35% (1.4563 => 1.5342, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.34% (0.2023 => 0.2131, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 5.23% (0.2925 => 0.3078, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.23% (7.2180 => 7.5952, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 5.10% (0.8310 => 0.8734, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.5637 => 0.5924, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.04% (0.2914 => 0.3061, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.01% (0.3755 => 0.3943, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.95% (1.3819 => 1.4503, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.91% (1.3245 => 1.3895, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 4.85% (1.1061 => 1.1598, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.84% (1.3813 => 1.4481, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 4.83% (3.8646 => 4.0514, std. dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 4.80% (1.0594 => 1.1102, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (0.4791 => 0.5019, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.73% (0.6283 => 0.6580, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.70% (0.7506 => 0.7859, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.65% (0.7460 => 0.7807, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.62% (1.9270 => 2.0161, std. dev.: 0.0089) MultiSource/Applications/siod/siod: 4.49% (2.1791 => 2.2769, std. dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 4.48% (16.6129 => 17.3570, std. dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: 4.44% (0.2995 => 0.3128, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.35% (4.4433 => 4.6364, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.29% (0.6135 => 0.6398, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.26% (4.3801 => 4.5669, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (4.9865 => 5.1949, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.15% (13.2842 => 13.8351, std. dev.: 0.0212) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.05% (3.6692 => 3.8177, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (0.8698 => 0.9046, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.90% (0.3131 => 0.3253, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 3.55% (0.4113 => 0.4259, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 3.54% (3.1889 => 3.3017, std. dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 3.45% (8.4961 => 8.7888, std. dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1720, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.37% (16.2614 => 16.8091, std. dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: 3.17% (14.8535 => 15.3248, std. dev.: 0.0118) MultiSource/Applications/ClamAV/clamscan: 3.02% (14.5298 => 14.9688, std. dev.: 0.0196) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (6.5754 => 6.7699, std. dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.95% (3.2742 => 3.3709, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.81% (4.6629 => 4.7937, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.66% (1.5188 => 1.5592, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6250 => 0.6414, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.18% (0.6744 => 0.6891, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.1007 => 2.1460, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.92% (0.9108 => 0.9283, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.90% (1.0313 => 1.0509, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.80% (3.7467 => 3.8140, std. dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 1.59% (33.2944 => 33.8233, std. dev.: 0.0226) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 23.80% (1.8175 => 2.2500, std. dev.: 0.0269) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.87% (1.2998 => 1.4281, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7432, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3849, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5958, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.93% (10.7476 => 10.9549, std. dev.: 0.0604) MultiSource/Applications/sqlite3/sqlite3: 1.79% (4.5928 => 4.6749, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5117, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.5089 => 1.5273, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.00% (26.5159 => 26.7813, std. dev.: 0.0375) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.67% (22.5627 => 21.2832, std. dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.53% (1.2308 => 1.1012, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.22% (1.3780 => 1.3199, std. dev.: 0.0069) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5911, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.12% (3.0263 => 2.9622, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2286, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2039, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3575, std. dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.10% (5.5401 => 5.4791, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 08:01:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 10:01:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120819150133.26BED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3036?compare_to=3032&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3036, Order: 162187, Start Time: 2012-08-19 13:43:17, End Time: 2012-08-19 15:02:23 To: 3032, Order: 162186, Start Time: 2012-08-19 10:30:42, End Time: 2012-08-19 11:50:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (94 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (745 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.41% (78.5776 => 81.2599, std. dev.: 0.1256) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.71% (14.0852 => 13.5625, std. dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.82% (10.3673 => 13.5625, std. dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.43% (1.1194 => 1.2474, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3694 => 0.4078, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.88% (0.3927 => 0.4315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.01% (2.2022 => 2.3785, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.87% (1.7609 => 1.8818, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 6.62% (10.4361 => 11.1271, std. dev.: 0.0223) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.24% (0.6030 => 0.6406, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.14% (0.5925 => 0.6289, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 5.20% (0.7326 => 0.7707, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 5.15% (0.7433 => 0.7816, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.4615 => 0.4851, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2271 => 0.2382, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.77% (7.0540 => 7.3904, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.4879 => 0.5107, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.50% (0.8172 => 0.8540, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 4.36% (9.4845 => 9.8983, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.9449 => 5.1519, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2080, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.04% (4.2646 => 4.4370, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.70% (8.1363 => 8.4374, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (0.4636 => 0.4807, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.68% (0.3180 => 0.3297, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.49% (1.3050 => 1.3506, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.48% (0.7835 => 0.8108, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (1.5415 => 1.5951, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.35% (0.5105 => 0.5276, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.33% (5.7591 => 5.9510, std. dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 3.28% (0.3387 => 0.3498, std. dev.: 0.0042) MultiSource/Applications/Burg/burg: 3.27% (1.1642 => 1.2023, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.27% (0.6675 => 0.6893, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.25% (3.3354 => 3.4438, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.25% (0.9765 => 1.0082, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.8067 => 0.8328, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3441 => 0.3552, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1861 => 1.2224, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.04% (2.0273 => 2.0890, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.02% (0.4103 => 0.4227, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.95% (3.8723 => 3.9867, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.4289 => 0.4412, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 2.85% (1.5603 => 1.6048, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.78% (0.6450 => 0.6629, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.74% (17.1811 => 17.6514, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.58% (14.3668 => 14.7379, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.56% (1.5859 => 1.6265, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.52% (0.6456 => 0.6619, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4620 => 0.4734, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.44% (0.5981 => 0.6127, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.38% (2.2969 => 2.3515, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.31% (1.4186 => 1.4513, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.5020 => 0.5134, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.24% (2.0665 => 2.1127, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.17% (2.2024 => 2.2501, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.14% (1.2842 => 1.3117, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: 1.97% (0.7115 => 0.7255, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.94% (1.1840 => 1.2070, std. dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.66% (1.0722 => 1.0900, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.10% (4.2280 => 4.4438, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.82% (26.0924 => 26.8288, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2118, std. dev.: 0.0033) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3337, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0055) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2318, std. dev.: 0.0397) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.47% (5.2763 => 3.1410, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6992, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7009, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0541, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.79% (2.9384 => 2.5333, std. dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: -12.14% (22.1758 => 19.4834, std. dev.: 0.0309) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2373 => 1.1036, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -8.19% (1.5373 => 1.4114, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.25% (32.5116 => 31.4555, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4157, std. dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3293, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0111, std. dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.30% (8.1563 => 7.9687, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3393, std. dev.: 0.0072) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 09:25:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 11:25:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120819162524.322CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3037?compare_to=3034&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3037, Order: 162187, Start Time: 2012-08-19 13:43:00, End Time: 2012-08-19 16:26:14 To: 3034, Order: 162186, Start Time: 2012-08-19 10:30:35, End Time: 2012-08-19 13:14:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 3 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.42% (1.0149 => 1.0005, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.14% (2.1743 => 2.1496, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -1.10% (1.0434 => 1.0319, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.81% (0.3488 => 0.3900, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 11.80% (0.3442 => 0.3848, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3446 => 0.3852, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.75% (0.3465 => 0.3872, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.65% (0.3460 => 0.3863, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3496 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.56% (0.3469 => 0.3870, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3643 => 0.4055, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.29% (0.3650 => 0.4062, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.88% (0.3724 => 0.4129, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.31% (0.5826 => 0.6252, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.5889 => 0.6307, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1620 => 0.1730, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.52% (1.5932 => 1.6971, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.77% (0.7171 => 0.7585, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.71% (1.6211 => 1.7137, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.47% (3.5627 => 3.7577, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.41% (1.3152 => 1.3864, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.21% (0.4994 => 0.5254, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.16% (0.4361 => 0.4586, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.5900 => 0.6200, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.99% (0.3930 => 0.4126, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (0.5000 => 0.5247, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 4.93% (4.2109 => 4.4187, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.91% (0.5026 => 0.5273, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.78% (1.0781 => 1.1296, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.46% (0.3004 => 0.3138, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.45% (0.3890 => 0.4063, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.27% (5.5417 => 5.7781, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.2780 => 0.2898, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2803 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.19% (0.2792 => 0.2909, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2823 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.16% (0.2738 => 0.2852, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.15% (0.2750 => 0.2864, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.14% (0.9909 => 1.0319, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3195 => 0.3327, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.12% (0.2813 => 0.2929, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.98% (2.0673 => 2.1496, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.2866 => 0.2980, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.98% (0.2566 => 0.2668, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3124 => 0.3246, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.89% (0.3267 => 0.3394, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.85% (0.2911 => 0.3023, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3362 => 0.3491, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.78% (0.3726 => 0.3867, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.78% (0.4658 => 0.4834, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3060 => 0.3175, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0425, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.69% (0.3282 => 0.3403, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.65% (0.3317 => 0.3438, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.63% (1.9966 => 2.0691, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.62% (2.7292 => 2.8280, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (0.3625 => 0.3755, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 3.58% (0.3348 => 0.3468, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.58% (2.1013 => 2.1766, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 3.57% (0.3477 => 0.3601, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.3678 => 0.3808, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (4.4195 => 4.5751, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.51% (4.6177 => 4.7800, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.47% (2.1653 => 2.2405, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 3.45% (1.8794 => 1.9443, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.45% (23.5202 => 24.3317, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/hash2: 3.36% (0.4251 => 0.4394, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.36% (0.3903 => 0.4034, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.35% (0.4146 => 0.4285, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3690 => 0.3812, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.27% (0.6634 => 0.6851, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 3.20% (0.7875 => 0.8127, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 3.18% (0.9697 => 1.0005, std. dev.: 0.0055) MultiSource/Applications/lua/lua: 3.15% (1.4269 => 1.4718, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.3981 => 0.4106, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.09% (0.3336 => 0.3439, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.04% (0.4139 => 0.4265, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.92% (0.5546 => 0.5708, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.6435 => 0.6616, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.5012 => 0.5152, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.36% (2.0346 => 2.0826, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.47% (0.7426 => 0.7535, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 10.56% (0.2122 => 0.2346, std. dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6718, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6320, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2049, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (41.7953 => 42.6382, std. dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5068, std. dev.: 0.0196) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5907, std. dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.67% (2.4764 => 2.3855, std. dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5466, std. dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/ary2: -9.99% (0.2402 => 0.2162, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8014, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0048) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -1.93% (17.2379 => 16.9053, std. dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5727, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9565, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 16:03:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 18:03:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120819230341.37EE92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3038?compare_to=3035&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3038, Order: 162190, Start Time: 2012-08-19 21:50:43, End Time: 2012-08-19 23:04:29 To: 3035, Order: 162187, Start Time: 2012-08-19 13:43:12, End Time: 2012-08-19 14:57:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (149 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.28% (3.8417 => 3.7927, std. dev.: 0.0168) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.61% (2.0176 => 2.3123, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 10.71% (0.7061 => 0.7817, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 10.69% (0.5818 => 0.6440, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.25% (0.3578 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.05% (0.3601 => 0.3927, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.91% (0.3646 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3663 => 0.3987, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.78% (0.3623 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.38% (0.3940 => 0.4270, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4062 => 0.4388, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.95% (0.4328 => 0.4672, std. dev.: 0.0103) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.87% (0.2782 => 0.3001, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.36% (0.7038 => 0.7556, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.7710 => 0.8276, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.31% (3.9660 => 4.2561, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.30% (0.2726 => 0.2925, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.23% (1.3693 => 1.4683, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2721 => 0.2917, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3022 => 0.3238, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3107 => 0.3329, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.04% (1.9828 => 2.1224, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.3899 => 0.4169, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3485 => 0.3726, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.91% (0.5265 => 0.5629, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.81% (0.4390 => 0.4689, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3489 => 0.3725, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.76% (0.3580 => 0.3822, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.61% (0.3192 => 0.3403, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.44% (0.3756 => 0.3998, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.33% (0.9199 => 0.9781, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 6.29% (0.3293 => 0.3500, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.21% (1.2193 => 1.2950, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.17% (0.3534 => 0.3752, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.10% (0.4379 => 0.4646, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.4016 => 0.4256, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.6959 => 0.7373, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.76% (13.8202 => 14.6159, std. dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.5577 => 0.5883, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.38% (1.1364 => 1.1975, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.4563 => 1.5344, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.2292 => 1.2943, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.23% (0.2925 => 0.3078, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.15% (7.2180 => 7.5898, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.03% (0.3755 => 0.3944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.96% (0.8310 => 0.8722, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5637 => 0.5914, std. dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.87% (1.3819 => 1.4492, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 4.82% (3.8646 => 4.0507, std. dev.: 0.0132) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (1.3813 => 1.4470, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.74% (1.3245 => 1.3873, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.74% (0.4791 => 0.5018, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.68% (1.0594 => 1.1090, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.64% (1.1061 => 1.1574, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.60% (0.6283 => 0.6572, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.60% (0.7506 => 0.7851, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.50% (0.7460 => 0.7796, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.46% (1.9270 => 2.0130, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.46% (16.6129 => 17.3538, std. dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 4.31% (0.2995 => 0.3124, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.30% (2.1791 => 2.2729, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.28% (4.9865 => 5.1999, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.26% (4.4433 => 4.6326, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (4.3801 => 4.5657, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.11% (13.2842 => 13.8302, std. dev.: 0.0131) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.09% (3.6692 => 3.8194, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.99% (0.8698 => 0.9045, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.93% (0.6135 => 0.6376, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 3.80% (0.3131 => 0.3250, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.53% (3.1889 => 3.3014, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.38% (16.2614 => 16.8109, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (8.4961 => 8.7822, std. dev.: 0.0134) MultiSource/Benchmarks/McCat/05-eks/eks: 3.36% (0.4113 => 0.4251, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1333 => 1.1698, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.10% (14.8535 => 15.3133, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (6.5754 => 6.7770, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.98% (14.5298 => 14.9621, std. dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 2.97% (4.6629 => 4.8015, std. dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.95% (3.2742 => 3.3707, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5188 => 1.5585, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.48% (0.6250 => 0.6405, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.1007 => 2.1470, std. dev.: 0.0065) MultiSource/Applications/lemon/lemon: 1.93% (1.0313 => 1.0512, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.87% (0.9108 => 0.9278, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.66% (3.7467 => 3.8090, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.52% (33.2944 => 33.8007, std. dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.60% (1.8175 => 2.2646, std. dev.: 0.0472) SingleSource/Benchmarks/Misc/mandel-2: 10.88% (1.2998 => 1.4412, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7409, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3851, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5997, std. dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 2.26% (10.7476 => 10.9908, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.5928 => 4.6790, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3260, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0113) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (1.5089 => 1.5292, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.19% (26.5159 => 26.8304, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.71% (22.5627 => 21.2734, std. dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0972, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.58% (1.3780 => 1.3149, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4681, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5868, std. dev.: 0.0154) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9591, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2300, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2065, std. dev.: 0.0203) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3582, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.17% (5.5401 => 5.4753, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.12% (20.3410 => 20.1133, std. dev.: 0.0280) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 16:09:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 18:09:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120819230931.E68752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3039?compare_to=3036&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3039, Order: 162190, Start Time: 2012-08-19 21:51:17, End Time: 2012-08-19 23:10:20 To: 3036, Order: 162187, Start Time: 2012-08-19 13:43:17, End Time: 2012-08-19 15:02:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (103 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (734 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.82% (55.0589 => 56.6127, std. dev.: 0.0989) MultiSource/Benchmarks/llubenchmark/llu: 1.19% (3.7777 => 3.8227, std. dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.76% (10.3673 => 13.5559, std. dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.35% (1.1194 => 1.2464, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.72% (0.3516 => 0.3893, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 9.93% (0.3927 => 0.4317, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.09% (2.2022 => 2.3803, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/richards_benchmark: 7.34% (0.1622 => 0.1741, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.85% (1.7609 => 1.8815, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 6.69% (10.4361 => 11.1340, std. dev.: 0.0113) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 6.18% (0.5925 => 0.6291, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7433 => 0.7825, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7326 => 0.7706, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.90% (0.4879 => 0.5118, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.79% (7.0540 => 7.3921, std. dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.76% (0.2271 => 0.2379, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.44% (9.4845 => 9.9057, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.8172 => 0.8533, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.9449 => 5.1540, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.18% (4.2646 => 4.4430, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2079, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.02% (0.5569 => 0.5793, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 3.99% (0.2554 => 0.2656, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.97% (0.7835 => 0.8146, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.5860 => 0.6089, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 3.81% (0.3180 => 0.3301, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4291, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.58% (1.3050 => 1.3517, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.49% (1.5415 => 1.5953, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (0.4636 => 0.4797, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1861 => 1.2266, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.41% (0.5105 => 0.5279, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 3.36% (5.7591 => 5.9525, std. dev.: 0.0148) MultiSource/Applications/d/make_dparser: 3.35% (3.3354 => 3.4471, std. dev.: 0.0070) MultiSource/Applications/Burg/burg: 3.32% (1.1642 => 1.2029, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.32% (0.3136 => 0.3240, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.9765 => 1.0088, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.29% (0.4103 => 0.4238, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.25% (0.3441 => 0.3553, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.18% (2.0273 => 2.0918, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.17% (0.8067 => 0.8323, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.14% (0.3826 => 0.3946, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6675 => 0.6880, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (0.4064 => 0.4188, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.96% (3.8723 => 3.9870, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4289 => 0.4413, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.83% (1.5603 => 1.6045, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.83% (0.5020 => 0.5162, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.82% (17.1811 => 17.6658, std. dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.79% (0.6450 => 0.6630, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (1.5859 => 1.6285, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.68% (14.3668 => 14.7519, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.62% (0.4620 => 0.4741, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6456 => 0.6618, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.49% (1.4186 => 1.4539, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 2.45% (2.2969 => 2.3532, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.42% (0.5981 => 0.6126, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.29% (2.0665 => 2.1138, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2842 => 1.3125, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.2024 => 2.2499, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.05% (0.7115 => 0.7261, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.88% (1.1840 => 1.2062, std. dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.74% (1.0722 => 1.0909, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.41% (4.2280 => 4.4569, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7560, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.01% (26.0924 => 26.8780, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 1.65% (3.1578 => 3.2100, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3343, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2490, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.36% (1.5086 => 1.5291, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.33% (1.3045 => 1.3219, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std. dev.: 0.0047) MultiSource/Benchmarks/llubenchmark/llu: 1.18% (3.7781 => 3.8227, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5846, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.52% (5.2763 => 3.1385, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.33% (5.3855 => 3.6984, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7002, std. dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -15.02% (54.1659 => 46.0302, std. dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.65% (2.9384 => 2.5372, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -12.10% (22.1758 => 19.4918, std. dev.: 0.0356) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2373 => 1.1041, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -7.72% (1.5373 => 1.4186, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4682, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4205, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0100, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9601, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3409, std. dev.: 0.0070) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4241, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8133, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std. dev.: 0.0106) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 17:32:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 19:32:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120820003247.517EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3040?compare_to=3037&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3040, Order: 162190, Start Time: 2012-08-19 21:50:24, End Time: 2012-08-20 00:33:37 To: 3037, Order: 162187, Start Time: 2012-08-19 13:43:00, End Time: 2012-08-19 16:26:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (113 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.86% (0.3465 => 0.3876, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3496 => 0.3908, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3446 => 0.3852, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.68% (0.3460 => 0.3864, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.67% (0.3469 => 0.3874, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.62% (0.3442 => 0.3842, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.61% (0.3488 => 0.3893, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 11.56% (0.3650 => 0.4072, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3643 => 0.4056, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.96% (0.3724 => 0.4132, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5826 => 0.6259, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.22% (0.5889 => 0.6314, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.55% (1.5932 => 1.6976, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.76% (0.7171 => 0.7584, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (1.6211 => 1.7138, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.56% (1.3152 => 1.3883, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (3.5627 => 3.7602, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.34% (0.4361 => 0.4594, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.19% (0.4994 => 0.5253, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 5.01% (4.2109 => 4.4218, std. dev.: 0.0117) MultiSource/Applications/d/make_dparser: 4.96% (1.0781 => 1.1316, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (0.5000 => 0.5248, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.87% (0.5026 => 0.5271, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.5900 => 0.6184, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 4.72% (0.4029 => 0.4219, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.42% (0.2875 => 0.3002, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.28% (5.5417 => 5.7791, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.26% (0.2792 => 0.2911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.2866 => 0.2987, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 4.22% (0.2725 => 0.2840, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.13% (0.2566 => 0.2672, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.13% (0.9909 => 1.0318, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 4.09% (0.3004 => 0.3127, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2811 => 0.2926, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.07% (0.2823 => 0.2938, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2750 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3195 => 0.3325, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.2780 => 0.2893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.2736 => 0.2847, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.05% (0.2813 => 0.2927, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.04% (0.3890 => 0.4047, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (2.0673 => 2.1502, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.88% (0.2911 => 0.3024, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.86% (0.3267 => 0.3393, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (0.4658 => 0.4837, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (1.9694 => 2.0447, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 3.81% (2.1013 => 2.1814, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.81% (0.3726 => 0.3868, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.79% (0.3060 => 0.3176, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.3362 => 0.3489, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (1.9966 => 2.0718, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.75% (0.3124 => 0.3241, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.69% (2.7292 => 2.8299, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 3.68% (0.3317 => 0.3439, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.3625 => 0.3758, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.66% (0.3282 => 0.3402, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.62% (0.3678 => 0.3811, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.58% (4.6177 => 4.7828, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/lists1: 3.57% (0.3477 => 0.3601, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (4.4195 => 4.5768, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: 3.52% (0.3348 => 0.3466, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.52% (2.1653 => 2.2415, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4146 => 0.4291, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 3.44% (1.8794 => 1.9441, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.3903 => 0.4036, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.39% (0.7875 => 0.8142, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.39% (23.5202 => 24.3165, std. dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/hash2: 3.34% (0.4251 => 0.4393, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.30% (1.4269 => 1.4740, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3690 => 0.3811, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (0.4139 => 0.4274, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 3.24% (0.6634 => 0.6849, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.18% (0.9697 => 1.0005, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.3981 => 0.4106, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.09% (0.3845 => 0.3964, std. dev.: 0.0043) MultiSource/Applications/Burg/burg: 2.92% (0.5546 => 0.5708, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.6435 => 0.6617, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.59% (0.5012 => 0.5142, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.36% (2.0346 => 2.0827, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.58% (0.7426 => 0.7543, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.88% (0.2122 => 0.2268, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8907, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1648, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6355, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1997, std. dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.93% (41.7953 => 42.6030, std. dev.: 0.0242) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5098, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2206, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2790, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5907, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.62% (2.4764 => 2.3868, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5747, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary2: -9.83% (0.2402 => 0.2166, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7978, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8040, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0008) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.7996, std. dev.: 0.0920) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9652, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 17:45:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 19:45:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820004506.9DC5B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3041?compare_to=3038&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3041, Order: 162191, Start Time: 2012-08-19 23:32:01, End Time: 2012-08-20 00:45:56 To: 3038, Order: 162190, Start Time: 2012-08-19 21:50:43, End Time: 2012-08-19 23:04:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (149 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.56% (2.0176 => 2.3114, std. dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference-object: 10.73% (0.5818 => 0.6442, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.25% (0.7061 => 0.7785, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 9.20% (0.3578 => 0.3907, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3601 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.89% (0.3646 => 0.3970, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.85% (0.3130 => 0.3407, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.85% (0.3650 => 0.3973, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.82% (0.3663 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.81% (0.3789 => 0.4123, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.43% (0.3940 => 0.4272, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/parameter-passing: 8.39% (0.4003 => 0.4339, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.98% (0.4062 => 0.4386, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.97% (0.4328 => 0.4673, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.91% (0.1986 => 0.2143, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.87% (0.2782 => 0.3001, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.86% (0.1413 => 0.1524, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.61% (0.2655 => 0.2857, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.49% (0.2937 => 0.3157, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.45% (0.7038 => 0.7562, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.34% (3.9660 => 4.2572, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.31% (0.2721 => 0.2920, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.30% (0.2726 => 0.2925, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.24% (1.3693 => 1.4684, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.22% (1.9828 => 2.1259, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3022 => 0.3240, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.7710 => 0.8260, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.94% (0.3485 => 0.3727, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.89% (0.5265 => 0.5628, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.88% (0.4390 => 0.4692, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.3899 => 0.4167, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.87% (0.3580 => 0.3826, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.74% (0.3489 => 0.3724, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.34% (0.9199 => 0.9782, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.26% (0.3293 => 0.3499, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.23% (0.3534 => 0.3754, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.18% (1.2193 => 1.2947, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.10% (0.4379 => 0.4646, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3756 => 0.3985, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.08% (0.4016 => 0.4260, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.04% (0.6959 => 0.7379, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 5.97% (0.3868 => 0.4099, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.73% (0.3246 => 0.3432, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.69% (0.2127 => 0.2248, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.64% (13.8202 => 14.6002, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.5577 => 0.5885, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.41% (0.5637 => 0.5942, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.39% (1.2292 => 1.2955, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.32% (1.1364 => 1.1969, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.32% (1.4563 => 1.5338, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.16% (7.2180 => 7.5906, std. dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.2925 => 0.3075, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.98% (0.3755 => 0.3942, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.97% (0.8310 => 0.8723, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.96% (1.3819 => 1.4504, std. dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (1.3813 => 1.4490, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.89% (1.1061 => 1.1602, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.85% (0.7506 => 0.7870, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.82% (0.4791 => 0.5022, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.81% (3.8646 => 4.0503, std. dev.: 0.0138) MultiSource/Benchmarks/nbench/nbench: 4.79% (1.0594 => 1.1101, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.76% (1.3245 => 1.3876, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 4.61% (0.2995 => 0.3133, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.52% (0.7460 => 0.7797, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.47% (1.9270 => 2.0131, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.46% (0.6283 => 0.6563, std. dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 4.42% (16.6129 => 17.3475, std. dev.: 0.0195) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.31% (4.4433 => 4.6347, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.28% (2.1791 => 2.2723, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.27% (3.6692 => 3.8259, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.25% (4.3801 => 4.5663, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.23% (4.9865 => 5.1975, std. dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (13.2842 => 13.8293, std. dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.05% (0.8698 => 0.9050, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.6135 => 0.6379, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 3.90% (0.3131 => 0.3253, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.51% (3.1889 => 3.3009, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 3.40% (0.4113 => 0.4253, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.38% (16.2614 => 16.8115, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.37% (1.1333 => 1.1715, std. dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.4961 => 8.7786, std. dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 3.14% (14.8535 => 15.3203, std. dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (6.5754 => 6.7759, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (3.2742 => 3.3716, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 2.94% (14.5298 => 14.9573, std. dev.: 0.0146) MultiSource/Applications/oggenc/oggenc: 2.84% (4.6629 => 4.7953, std. dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (1.5188 => 1.5589, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.1007 => 2.1441, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.79% (1.0313 => 1.0498, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.62% (3.7467 => 3.8075, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.52% (33.2944 => 33.8017, std. dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2583, std. dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 10.45% (1.2998 => 1.4356, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7413, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.07% (1.7081 => 1.7776, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4271 => 7.6100, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 2.31% (10.7476 => 10.9963, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.90% (4.5928 => 4.6801, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.58% (3.2729 => 3.3247, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.25% (26.5159 => 26.8470, std. dev.: 0.0157) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5089 => 1.5277, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6876, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.05% (5.5130 => 5.5708, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.79% (22.5627 => 21.2569, std. dev.: 0.0226) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2308 => 1.1019, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0008) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5838, std. dev.: 0.0191) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9627, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2310, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2060, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3538, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.21% (5.5401 => 5.4731, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.11% (20.3410 => 20.1159, std. dev.: 0.0197) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 17:56:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 19:56:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820005609.F0C3B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3042?compare_to=3039&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3042, Order: 162191, Start Time: 2012-08-19 23:38:06, End Time: 2012-08-20 00:57:00 To: 3039, Order: 162190, Start Time: 2012-08-19 21:51:17, End Time: 2012-08-19 23:10:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.80% (10.3673 => 13.5609, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3497 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.70% (0.3543 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.59% (0.1432 => 0.1555, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.99% (2.2022 => 2.3781, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 7.34% (0.1622 => 0.1741, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.89% (1.7609 => 1.8823, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 6.69% (10.4361 => 11.1343, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 6.24% (0.5925 => 0.6295, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.12% (0.6030 => 0.6399, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.27% (0.4615 => 0.4858, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 5.21% (0.7326 => 0.7708, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 5.02% (0.7433 => 0.7806, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2271 => 0.2384, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.78% (7.0540 => 7.3914, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.3282 => 0.3433, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.8172 => 0.8535, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.40% (4.9449 => 5.1623, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (9.4845 => 9.8968, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2080, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.04% (4.2646 => 4.4368, std. dev.: 0.0157) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.99% (0.5569 => 0.5791, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5860 => 0.6093, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.78% (1.5415 => 1.5998, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.62% (8.1363 => 8.4308, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0031) MultiSource/Applications/spiff/spiff: 3.51% (0.7835 => 0.8110, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4636 => 0.4798, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.48% (1.3050 => 1.3504, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.34% (0.3441 => 0.3556, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 3.33% (5.7591 => 5.9511, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.33% (0.5105 => 0.5275, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.28% (0.3387 => 0.3498, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9765 => 1.0083, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.23% (3.3354 => 3.4433, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.19% (0.6675 => 0.6888, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.16% (2.0273 => 2.0913, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.8067 => 0.8321, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.06% (0.3826 => 0.3943, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2221, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4289 => 0.4419, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.89% (3.8723 => 3.9843, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6037, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.78% (0.6450 => 0.6629, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.72% (17.1811 => 17.6476, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.58% (2.2969 => 2.3562, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.56% (14.3668 => 14.7350, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.51% (0.5981 => 0.6131, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.49% (0.6456 => 0.6617, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5859 => 1.6250, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4620 => 0.4732, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.38% (1.4186 => 1.4523, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.5020 => 0.5138, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.23% (2.0665 => 2.1125, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.2024 => 2.2498, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.04% (1.2842 => 1.3104, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.96% (1.1840 => 1.2072, std. dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.73% (1.0722 => 1.0907, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (4.2280 => 4.4399, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 3.06% (26.0924 => 26.8904, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (3.6395 => 3.7488, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 1.78% (3.1578 => 3.2140, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2369, std. dev.: 0.0144) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5086 => 1.5268, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5816, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.49% (5.2763 => 3.1399, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6978, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7034, std. dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0603, std. dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.80% (2.9384 => 2.5328, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -12.13% (22.1758 => 19.4867, std. dev.: 0.0219) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2373 => 1.1029, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -8.10% (1.5373 => 1.4128, std. dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.99% (1.1396 => 1.0599, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5039, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4723, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4264, std. dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.54% (10.2830 => 10.0221, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9569, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3504, std. dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8128, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 19:26:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 21:26:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820022632.8D7EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3043?compare_to=3041&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3043, Order: 162192, Start Time: 2012-08-20 01:13:30, End Time: 2012-08-20 02:27:21 To: 3041, Order: 162191, Start Time: 2012-08-19 23:32:01, End Time: 2012-08-20 00:45:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (149 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.61% (2.0176 => 2.3124, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.66% (0.5818 => 0.6438, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 10.57% (0.7061 => 0.7807, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.94% (0.3646 => 0.3972, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.89% (0.3601 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.82% (0.3650 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.82% (0.3663 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.80% (0.3623 => 0.3942, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.68% (0.3789 => 0.4118, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.37% (0.4003 => 0.4338, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.35% (0.3940 => 0.4269, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.91% (0.2781 => 0.3001, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (0.4328 => 0.4670, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 7.46% (0.2937 => 0.3156, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.40% (0.2607 => 0.2800, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.28% (0.3022 => 0.3242, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.26% (0.7710 => 0.8270, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 7.26% (0.7038 => 0.7549, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (3.9660 => 4.2537, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.24% (1.3693 => 1.4684, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3107 => 0.3331, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2966 => 0.3178, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.09% (1.9828 => 2.1234, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.03% (0.3485 => 0.3730, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3580 => 0.3831, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.3899 => 0.4167, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3489 => 0.3726, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.69% (0.5265 => 0.5617, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.46% (0.3453 => 0.3676, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.32% (0.3293 => 0.3501, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.29% (0.4390 => 0.4666, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.15% (0.9199 => 0.9765, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.08% (1.2193 => 1.2934, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (0.3756 => 0.3980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.4016 => 0.4255, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.92% (0.3868 => 0.4097, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.88% (0.6959 => 0.7368, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.79% (0.5577 => 0.5900, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.74% (0.2127 => 0.2249, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.67% (13.8202 => 14.6044, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.64% (0.3246 => 0.3429, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.4563 => 1.5343, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.32% (1.1364 => 1.1969, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.31% (1.2292 => 1.2945, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.29% (0.2023 => 0.2130, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.20% (0.2925 => 0.3077, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.15% (7.2180 => 7.5900, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.14% (0.3755 => 0.3948, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 5.04% (0.8310 => 0.8729, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (1.3813 => 1.4490, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (1.3819 => 1.4484, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.81% (1.1061 => 1.1593, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 4.78% (1.0594 => 1.1100, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.74% (0.4791 => 0.5018, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.71% (1.3245 => 1.3869, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.69% (3.8646 => 4.0457, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 4.58% (0.7506 => 0.7850, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.55% (0.6283 => 0.6569, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.49% (4.4433 => 4.6429, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7460 => 0.7793, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.45% (16.6129 => 17.3525, std. dev.: 0.0103) MultiSource/Applications/treecc/treecc: 4.40% (1.9270 => 2.0117, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2995 => 0.3126, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.36% (2.1791 => 2.2740, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.35% (4.3801 => 4.5706, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.21% (4.9865 => 5.1965, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.13% (13.2842 => 13.8333, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (3.6692 => 3.8189, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.02% (0.8698 => 0.9048, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.93% (0.6135 => 0.6376, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.80% (0.3131 => 0.3250, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.50% (3.1889 => 3.3006, std. dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 3.37% (16.2614 => 16.8096, std. dev.: 0.0158) MultiSource/Benchmarks/mafft/pairlocalalign: 3.34% (8.4961 => 8.7800, std. dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (1.1333 => 1.1710, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4113 => 0.4245, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (6.5754 => 6.7817, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 3.12% (14.8535 => 15.3173, std. dev.: 0.0153) MultiSource/Applications/ClamAV/clamscan: 2.98% (14.5298 => 14.9631, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.88% (3.2742 => 3.3686, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 2.78% (4.6629 => 4.7926, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.71% (1.5188 => 1.5600, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.6250 => 0.6411, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.1007 => 2.1467, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.02% (0.6744 => 0.6880, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.97% (1.0313 => 1.0516, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.55% (3.7467 => 3.8048, std. dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 1.51% (33.2944 => 33.7977, std. dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (6.2785 => 6.3449, std. dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2668, std. dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.81% (1.2998 => 1.4273, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8173, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4271 => 7.6179, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.17% (10.7476 => 10.9804, std. dev.: 0.0336) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6778, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3256, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.13% (26.5159 => 26.8166, std. dev.: 0.0248) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5749, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.78% (22.5627 => 21.2593, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5117, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.66% (1.3780 => 1.3275, std. dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5960, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9612, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2307, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2041, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7922, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3613, std. dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4352, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.00% (6.6320 => 6.5654, std. dev.: 0.0112) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 19:42:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 21:42:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820024249.B31EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3044?compare_to=3042&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3044, Order: 162192, Start Time: 2012-08-20 01:24:37, End Time: 2012-08-20 02:43:39 To: 3042, Order: 162191, Start Time: 2012-08-19 23:38:06, End Time: 2012-08-20 00:57:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (101 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (739 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.21% (77.9384 => 79.6575, std. dev.: 0.5729) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.84% (10.3673 => 13.5649, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.31% (0.3694 => 0.4075, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.3927 => 0.4314, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.04% (2.2022 => 2.3793, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.45% (0.1892 => 0.2033, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.82% (1.7609 => 1.8810, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 6.69% (10.4361 => 11.1338, std. dev.: 0.0143) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.16% (0.5925 => 0.6290, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.20% (0.4615 => 0.4855, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.19% (0.7326 => 0.7706, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (0.7433 => 0.7807, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.90% (7.0540 => 7.3994, std. dev.: 0.0236) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.76% (0.4879 => 0.5111, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.67% (0.2271 => 0.2377, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.39% (0.2758 => 0.2879, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 4.39% (9.4845 => 9.9005, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.8172 => 0.8528, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.17% (4.2646 => 4.4426, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2081, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.9449 => 5.1487, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: 3.99% (0.7835 => 0.8148, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.93% (0.5569 => 0.5788, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.91% (0.5860 => 0.6089, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 3.74% (0.3180 => 0.3299, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.8067 => 0.8367, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.69% (8.1363 => 8.4367, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.62% (0.3121 => 0.3234, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.56% (0.4636 => 0.4801, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.54% (1.3050 => 1.3512, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5105 => 0.5284, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.44% (1.5415 => 1.5946, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.38% (5.7591 => 5.9538, std. dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.31% (0.3441 => 0.3555, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.28% (3.3354 => 3.4449, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.9765 => 1.0085, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.26% (1.1642 => 1.2022, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.19% (0.6675 => 0.6888, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0085) MultiSource/Applications/treecc/treecc: 3.06% (2.0273 => 2.0894, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.02% (0.4103 => 0.4227, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.02% (3.8723 => 3.9892, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.4289 => 0.4413, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 2.86% (1.5603 => 1.6049, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.85% (0.3650 => 0.3754, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6450 => 0.6633, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.76% (17.1811 => 17.6557, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5859 => 1.6276, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.61% (0.3826 => 0.3926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.59% (0.3865 => 0.3965, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.56% (14.3668 => 14.7351, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4620 => 0.4738, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.52% (2.2969 => 2.3547, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5981 => 0.6129, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.6456 => 0.6614, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (1.4186 => 1.4533, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.5020 => 0.5134, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (2.0665 => 2.1134, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.2024 => 2.2522, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3110, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 2.00% (0.7115 => 0.7257, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.82% (1.1840 => 1.2055, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.67% (1.0722 => 1.0901, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.26% (4.2280 => 4.4504, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7556, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 3.06% (26.0924 => 26.8908, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2117, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2437, std. dev.: 0.0386) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (1.5086 => 1.5288, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7975, std. dev.: 0.0047) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6815, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.50% (5.2763 => 3.1395, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.6997, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.79% (5.3526 => 3.7045, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0270, std. dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.75% (2.9384 => 2.5345, std. dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: -12.10% (22.1758 => 19.4918, std. dev.: 0.0214) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2373 => 1.1027, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -7.55% (1.5373 => 1.4212, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4659, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: -2.92% (10.2830 => 9.9823, std. dev.: 0.0245) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.6802 => 8.4331, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.31% (8.1563 => 7.9679, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3400, std. dev.: 0.0059) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 19 20:43:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 19 Aug 2012 22:43:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120820034328.8F9172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3045?compare_to=3040&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3045, Order: 162192, Start Time: 2012-08-20 01:00:50, End Time: 2012-08-20 03:44:19 To: 3040, Order: 162190, Start Time: 2012-08-19 21:50:24, End Time: 2012-08-20 00:33:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (112 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 4.71% (0.2166 => 0.2268, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.80% (125.8237 => 130.6101, std. dev.: 0.4788) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.18% (54.1643 => 54.8043, std. dev.: 0.0909) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.09% (2.0885 => 2.1113, std. dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.86% (0.3465 => 0.3876, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3446 => 0.3854, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.71% (0.3460 => 0.3865, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.65% (0.3442 => 0.3843, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3469 => 0.3873, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3496 => 0.3903, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.64% (0.3488 => 0.3894, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.45% (0.3650 => 0.4068, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3643 => 0.4058, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.04% (0.3724 => 0.4135, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5826 => 0.6256, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.22% (0.5889 => 0.6314, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.48% (1.5932 => 1.6965, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 5.79% (0.7171 => 0.7586, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.79% (1.6211 => 1.7149, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.53% (3.5627 => 3.7596, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.45% (1.3152 => 1.3869, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (0.4361 => 0.4596, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (0.3930 => 0.4134, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.14% (4.2109 => 4.4275, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (0.4994 => 0.5247, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (0.5000 => 0.5246, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.5900 => 0.6186, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.84% (1.0781 => 1.1303, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.72% (0.4029 => 0.4219, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.56% (0.2875 => 0.3006, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.35% (0.2738 => 0.2857, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.33% (0.2792 => 0.2913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.29% (0.9909 => 1.0334, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.28% (0.2736 => 0.2853, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.2866 => 0.2988, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.23% (0.3004 => 0.3131, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.20% (5.5417 => 5.7744, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 4.19% (0.2813 => 0.2931, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.18% (0.2729 => 0.2843, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.14% (0.2780 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3195 => 0.3327, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.12% (2.0673 => 2.1524, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.2750 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2803 => 0.2918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.07% (0.3096 => 0.3222, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.06% (0.3890 => 0.4048, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.03% (0.3726 => 0.3876, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3124 => 0.3246, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.90% (0.2566 => 0.2666, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.85% (0.2911 => 0.3023, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (0.3625 => 0.3764, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.78% (0.4658 => 0.4834, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.78% (0.3258 => 0.3381, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.77% (0.3317 => 0.3442, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (1.9966 => 2.0715, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3362 => 0.3488, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.74% (1.9694 => 2.0430, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (0.3348 => 0.3473, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.73% (0.3060 => 0.3174, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.70% (0.3678 => 0.3814, std. dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 3.66% (4.6177 => 4.7865, std. dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (2.7292 => 2.8289, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.60% (0.3282 => 0.3400, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (2.1013 => 2.1763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.54% (0.3477 => 0.3600, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.53% (23.5202 => 24.3507, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (4.4195 => 4.5753, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4146 => 0.4291, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (2.1653 => 2.2402, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 3.43% (0.4251 => 0.4397, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3690 => 0.3816, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (1.8794 => 1.9429, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.20% (0.3903 => 0.4028, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.20% (0.9697 => 1.0007, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.3981 => 0.4108, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.17% (1.4269 => 1.4722, std. dev.: 0.0095) MultiSource/Applications/siod/siod: 3.14% (0.6634 => 0.6842, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.10% (0.7875 => 0.8119, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.99% (0.3845 => 0.3960, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.98% (0.5546 => 0.5711, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.88% (0.4139 => 0.4258, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.6435 => 0.6619, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.85% (0.5012 => 0.5155, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.33% (2.0346 => 2.0821, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.52% (0.7426 => 0.7539, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6132, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6756, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std. dev.: 0.0306) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6403, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2128, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (41.7953 => 42.6171, std. dev.: 0.0192) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5032, std. dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2267, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (2.0820 => 2.1113, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.29% (7.1849 => 7.2778, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5835, std. dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.82% (2.4764 => 2.4065, std. dev.: 0.0267) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5677, std. dev.: 0.0112) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8058, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: -5.58% (0.2402 => 0.2268, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8075, std. dev.: 0.0012) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7760, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7663, std. dev.: 0.0543) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5752, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9591, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 00:55:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 02:55:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820075527.1E5EA3524008@llvm.org> http://llvm.org/perf/db_default/v4/nts/3046?compare_to=3043&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3046, Order: 162193, Start Time: 2012-08-20 06:39:06, End Time: 2012-08-20 07:56:15 To: 3043, Order: 162192, Start Time: 2012-08-20 01:13:30, End Time: 2012-08-20 02:27:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (146 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.16% (54.6201 => 56.3471, std. dev.: 0.0737) SingleSource/Benchmarks/Misc/mandel-2: 1.49% (1.4273 => 1.4485, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.63% (2.0176 => 2.3127, std. dev.: 0.0469) SingleSource/UnitTests/ObjC++/property-reference-object: 10.81% (0.5818 => 0.6447, std. dev.: 0.0106) SingleSource/UnitTests/ObjC++/Hello: 10.63% (0.5748 => 0.6359, std. dev.: 0.0139) SingleSource/UnitTests/ObjC++/property-reference: 10.48% (0.7061 => 0.7801, std. dev.: 0.0211) SingleSource/UnitTests/ObjC/trivial-interface: 9.08% (0.3578 => 0.3903, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-2: 9.05% (0.3601 => 0.3927, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.04% (0.3130 => 0.3413, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.99% (0.3650 => 0.3978, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions-3: 8.86% (0.3623 => 0.3944, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions: 8.74% (0.3914 => 0.4256, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/parameter-passing: 8.67% (0.4003 => 0.4350, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/property: 8.53% (0.3940 => 0.4276, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.05% (0.2782 => 0.3006, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.02% (0.4328 => 0.4675, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.00% (0.1413 => 0.1526, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.64% (0.7038 => 0.7576, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2607 => 0.2803, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.46% (0.4062 => 0.4365, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.46% (0.2655 => 0.2853, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 7.46% (0.2937 => 0.3156, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.46% (3.9660 => 4.2617, std. dev.: 0.0052) MultiSource/Applications/hbd/hbd: 7.43% (1.3693 => 1.4710, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 7.42% (0.2628 => 0.2823, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.7710 => 0.8280, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.38% (1.9828 => 2.1291, std. dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.30% (0.2726 => 0.2925, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3107 => 0.3332, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.12% (0.3485 => 0.3733, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.02% (0.3489 => 0.3734, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.01% (0.2696 => 0.2885, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.2596 => 0.2777, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.2988 => 0.3190, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.60% (0.3453 => 0.3681, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.56% (0.3293 => 0.3509, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.47% (0.6959 => 0.7409, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.39% (0.9199 => 0.9787, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.31% (0.3534 => 0.3757, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.30% (0.4379 => 0.4655, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.27% (1.2193 => 1.2957, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.02% (0.3868 => 0.4101, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.94% (0.3756 => 0.3979, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.83% (0.2127 => 0.2251, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.83% (1.1364 => 1.2026, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.80% (13.8202 => 14.6223, std. dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5577 => 0.5895, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (1.4563 => 1.5360, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 5.47% (0.2925 => 0.3085, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.47% (1.2292 => 1.2964, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.44% (0.2023 => 0.2133, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.30% (7.2180 => 7.6002, std. dev.: 0.0129) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.25% (0.2914 => 0.3067, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 5.21% (0.8310 => 0.8743, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.18% (0.5637 => 0.5929, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2243 => 0.2359, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.15% (3.8646 => 4.0637, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.11% (0.3755 => 0.3947, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.0594 => 1.1121, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 4.94% (1.1061 => 1.1607, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.90% (1.3819 => 1.4496, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (1.3813 => 1.4487, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (1.3245 => 1.3888, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.78% (0.7506 => 0.7865, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.78% (0.4791 => 0.5020, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.76% (16.6129 => 17.4036, std. dev.: 0.0278) MultiSource/Applications/sgefa/sgefa: 4.71% (0.2995 => 0.3136, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.71% (0.7460 => 0.7811, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 4.70% (1.9270 => 2.0176, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 4.69% (2.1791 => 2.2812, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.63% (0.6283 => 0.6574, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.43% (4.4433 => 4.6401, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.41% (4.9865 => 5.2066, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.39% (4.3801 => 4.5722, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.23% (3.6692 => 3.8244, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.15% (13.2842 => 13.8352, std. dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.11% (0.6135 => 0.6387, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.8698 => 0.9053, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.90% (0.3131 => 0.3253, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.70% (0.4113 => 0.4265, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 3.62% (3.1889 => 3.3043, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1720, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.40% (16.2614 => 16.8150, std. dev.: 0.0196) MultiSource/Applications/JM/lencod/lencod: 3.21% (14.8535 => 15.3305, std. dev.: 0.0262) MultiSource/Applications/JM/ldecod/ldecod: 3.14% (6.5754 => 6.7818, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.09% (3.2742 => 3.3753, std. dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 2.98% (14.5298 => 14.9625, std. dev.: 0.0431) MultiSource/Applications/oggenc/oggenc: 2.89% (4.6629 => 4.7978, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.88% (1.5188 => 1.5626, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6250 => 0.6414, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1510, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.4805 => 0.4911, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (0.9108 => 0.9298, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 2.06% (1.0313 => 1.0525, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.89% (3.7467 => 3.8176, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.88% (0.6744 => 0.6871, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (6.2785 => 6.3449, std. dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std. dev.: 0.0303) SingleSource/Benchmarks/Misc/mandel-2: 11.44% (1.2998 => 1.4485, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7412, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8179, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3833, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5958, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.89% (10.7476 => 10.9510, std. dev.: 0.0655) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5928 => 4.6753, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3260, std. dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.20% (1.5089 => 1.5270, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 1.10% (26.5159 => 26.8083, std. dev.: 0.0279) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6866, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.50% (22.5627 => 21.3207, std. dev.: 0.4601) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1037, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0440) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0253) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5157, std. dev.: 0.0168) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.02% (1.3780 => 1.3226, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6036, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9634, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2262, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (20.3410 => 20.0564, std. dev.: 0.0530) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.11% (5.5401 => 5.4785, std. dev.: 0.0167) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2378, std. dev.: 0.0081) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 00:59:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 02:59:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820075940.08F7C3524008@llvm.org> http://llvm.org/perf/db_default/v4/nts/3047?compare_to=3044&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3047, Order: 162193, Start Time: 2012-08-20 06:39:06, End Time: 2012-08-20 08:00:28 To: 3044, Order: 162192, Start Time: 2012-08-20 01:24:37, End Time: 2012-08-20 02:43:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (95 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.12% (3.7712 => 3.8134, std. dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 31.28% (0.3817 => 0.5011, std. dev.: 0.0353) MultiSource/Benchmarks/PAQ8p/paq8p: 30.87% (10.3673 => 13.5673, std. dev.: 0.1793) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.33% (1.1194 => 1.2462, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.01% (0.3927 => 0.4320, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 9.75% (0.3886 => 0.4265, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (2.2022 => 2.3791, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.24% (0.1906 => 0.2044, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.87% (1.7609 => 1.8818, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 6.77% (10.4361 => 11.1426, std. dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 6.24% (0.5925 => 0.6295, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7326 => 0.7777, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.10% (0.7433 => 0.7812, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.85% (7.0540 => 7.3964, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.76% (0.2271 => 0.2379, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.75% (0.2107 => 0.2207, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.35% (0.2758 => 0.2878, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 4.30% (0.7835 => 0.8172, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.29% (4.9449 => 5.1572, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.21% (4.2646 => 4.4442, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.16% (5.0018 => 5.2100, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.09% (0.5569 => 0.5797, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.96% (0.5860 => 0.6092, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 3.81% (0.3180 => 0.3301, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.8067 => 0.8367, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.5415 => 1.5980, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.66% (8.1363 => 8.4338, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 3.61% (0.4289 => 0.4444, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.56% (0.3423 => 0.3545, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.56% (1.1642 => 1.2056, std. dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.52% (0.4636 => 0.4799, std. dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 3.48% (0.3387 => 0.3505, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.45% (1.3050 => 1.3500, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.43% (0.5105 => 0.5280, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.41% (3.3354 => 3.4491, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.35% (5.7591 => 5.9521, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.34% (0.3441 => 0.3556, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9765 => 1.0081, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 3.21% (2.0273 => 2.0924, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6675 => 0.6880, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1861 => 1.2224, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 3.04% (3.8723 => 3.9902, std. dev.: 0.0109) MultiSource/Applications/hbd/hbd: 2.97% (1.5603 => 1.6066, std. dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6450 => 0.6635, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3865 => 0.3974, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.80% (17.1811 => 17.6625, std. dev.: 0.0182) MultiSource/Applications/siod/siod: 2.75% (2.2969 => 2.3601, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.6456 => 0.6630, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (14.3668 => 14.7448, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (1.5859 => 1.6274, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.56% (0.5981 => 0.6134, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 2.49% (0.4620 => 0.4735, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.41% (0.5020 => 0.5141, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.40% (1.4186 => 1.4527, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 2.37% (0.8921 => 0.9132, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.24% (1.2842 => 1.3130, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.2024 => 2.2491, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 1.97% (1.1840 => 1.2073, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: 1.94% (0.7115 => 0.7253, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.77% (1.0722 => 1.0912, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (4.2280 => 4.4452, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.08% (26.0924 => 26.8957, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7462, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 1.75% (3.1578 => 3.2131, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.58% (9.1159 => 9.2597, std. dev.: 0.0336) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.47% (1.3045 => 1.3237, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5807, std. dev.: 0.0239) SingleSource/Benchmarks/Misc/fbench: 1.08% (2.2771 => 2.3018, std. dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.47% (5.2763 => 3.1412, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6977, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6988, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0343, std. dev.: 0.4800) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.88% (2.9384 => 2.5305, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -11.97% (22.1758 => 19.5204, std. dev.: 0.0384) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1077, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -8.38% (1.5373 => 1.4084, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0192) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5120, std. dev.: 0.0007) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.24% (32.5116 => 31.4582, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4283, std. dev.: 0.0664) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0037, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9591, std. dev.: 0.0176) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3469, std. dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4232, std. dev.: 0.0382) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.14% (1.8329 => 1.8120, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 02:24:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 04:24:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120820092401.A83BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3048?compare_to=3045&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3048, Order: 162193, Start Time: 2012-08-20 06:38:53, End Time: 2012-08-20 09:24:51 To: 3045, Order: 162192, Start Time: 2012-08-20 01:00:50, End Time: 2012-08-20 03:44:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.25% (2.1113 => 2.0639, std. dev.: 0.0178) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.93% (0.3446 => 0.3857, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.92% (0.3465 => 0.3878, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.70% (0.3488 => 0.3896, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.62% (0.3442 => 0.3842, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.58% (0.3496 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.53% (0.3469 => 0.3869, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.29% (0.3650 => 0.4062, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.20% (0.3643 => 0.4051, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 10.88% (0.3724 => 0.4129, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5826 => 0.6251, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.11% (0.5889 => 0.6308, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.79% (1.5932 => 1.7014, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.80% (0.7171 => 0.7587, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.72% (1.6211 => 1.7138, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.63% (0.5026 => 0.5309, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.63% (1.0781 => 1.1388, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.52% (1.3152 => 1.3878, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.47% (0.5900 => 0.6223, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.44% (3.5627 => 3.7565, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.41% (0.4994 => 0.5264, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 5.25% (4.2109 => 4.4319, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.16% (0.4361 => 0.4586, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.06% (0.3930 => 0.4129, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (0.5000 => 0.5245, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.89% (0.4029 => 0.4226, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 4.67% (0.9909 => 1.0372, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.45% (0.2875 => 0.3003, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.43% (0.2911 => 0.3040, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.2866 => 0.2992, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 4.39% (5.5417 => 5.7849, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.31% (0.2738 => 0.2856, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.21% (0.2780 => 0.2897, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.19% (0.2792 => 0.2909, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.13% (0.3195 => 0.3327, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 4.13% (0.2714 => 0.2826, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.10% (0.2729 => 0.2841, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.10% (0.3124 => 0.3252, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2750 => 0.2862, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.07% (0.6634 => 0.6904, std. dev.: 0.0058) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.3004 => 0.3126, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.06% (0.2811 => 0.2925, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2823 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.03% (0.2803 => 0.2916, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2813 => 0.2926, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.01% (0.3890 => 0.4046, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.96% (0.3362 => 0.3495, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.94% (0.2566 => 0.2667, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.93% (2.0673 => 2.1486, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (2.1013 => 2.1827, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (1.9694 => 2.0456, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 3.86% (0.3267 => 0.3393, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.81% (1.9966 => 2.0726, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3258 => 0.3382, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.79% (0.3060 => 0.3176, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 3.72% (4.6177 => 4.7894, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 3.70% (0.3726 => 0.3864, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.70% (0.3625 => 0.3759, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (4.4195 => 4.5817, std. dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 3.64% (2.1653 => 2.2441, std. dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (2.7292 => 2.8272, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3282 => 0.3399, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.56% (0.3678 => 0.3809, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.55% (0.3348 => 0.3467, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.54% (1.8794 => 1.9460, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.3903 => 0.4041, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.46% (23.5202 => 24.3336, std. dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3690 => 0.3816, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 3.38% (0.4146 => 0.4286, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.36% (0.4139 => 0.4278, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.35% (0.9697 => 1.0022, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 3.28% (1.4269 => 1.4737, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.3845 => 0.3971, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4251 => 0.4389, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 3.24% (0.7875 => 0.8130, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.18% (0.3271 => 0.3375, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.01% (0.3981 => 0.4101, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.6435 => 0.6619, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.83% (0.5546 => 0.5703, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.5012 => 0.5147, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.27% (2.0346 => 2.0807, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.64% (0.7426 => 0.7548, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.59% (0.2122 => 0.2283, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-2: 5.13% (1.8057 => 1.8984, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1715, std. dev.: 0.0806) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6418, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2058, std. dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5068, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std. dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4414, std. dev.: 0.0885) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2825, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5859, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.12% (2.4764 => 2.3992, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5612, std. dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9786, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7982, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.54% (0.2402 => 0.2269, std. dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7877, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/fldry: -2.88% (17.2379 => 16.7416, std. dev.: 0.0724) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5699, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9594, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 02:37:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 04:37:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820093714.72FEB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3049?compare_to=3046&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3049, Order: 162194, Start Time: 2012-08-20 08:24:10, End Time: 2012-08-20 09:38:04 To: 3046, Order: 162193, Start Time: 2012-08-20 06:39:06, End Time: 2012-08-20 07:56:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (150 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.28% (0.7801 => 0.7701, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.90% (2.0176 => 2.2981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.21% (0.5818 => 0.6412, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 10.02% (0.5748 => 0.6324, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7061 => 0.7701, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.59% (0.3130 => 0.3399, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3578 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.28% (0.3601 => 0.3899, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3663 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.17% (0.3623 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.95% (0.3914 => 0.4225, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.4003 => 0.4315, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.79% (0.4328 => 0.4665, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.73% (1.3693 => 1.4751, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.60% (0.7710 => 0.8296, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.29% (0.7038 => 0.7551, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.05% (0.2937 => 0.3144, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.01% (3.9660 => 4.2439, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4062 => 0.4346, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.77% (0.3899 => 0.4163, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.68% (1.9828 => 2.1153, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3580 => 0.3816, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.51% (0.3489 => 0.3716, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.43% (0.3485 => 0.3709, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.2988 => 0.3179, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.19% (0.9199 => 0.9768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3453 => 0.3666, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.6959 => 0.7382, std. dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.04% (0.4390 => 0.4655, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4379 => 0.4641, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.95% (1.2193 => 1.2918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.83% (0.3534 => 0.3740, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3293 => 0.3480, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.66% (0.3868 => 0.4087, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.3756 => 0.3966, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.42% (13.8202 => 14.5689, std. dev.: 0.0158) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (0.2945 => 0.3099, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 5.07% (1.2292 => 1.2915, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.06% (1.4563 => 1.5300, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.5637 => 0.5920, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.02% (1.1364 => 1.1934, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.97% (1.1061 => 1.1611, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.92% (7.2180 => 7.5732, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.89% (1.3813 => 1.4488, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.8310 => 0.8704, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.71% (0.3755 => 0.3932, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.68% (3.8646 => 4.0456, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.66% (1.3819 => 1.4463, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.52% (1.3245 => 1.3844, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7460 => 0.7793, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.46% (0.7506 => 0.7841, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.31% (1.0594 => 1.1051, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.28% (0.4791 => 0.4996, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.22% (1.9270 => 2.0084, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.21% (0.2995 => 0.3121, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.19% (16.6129 => 17.3090, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.15% (0.6283 => 0.6544, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.14% (2.1791 => 2.2693, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6218, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.96% (4.3801 => 4.5536, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (13.2842 => 13.7848, std. dev.: 0.0251) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.74% (3.6692 => 3.8063, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.8698 => 0.9015, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (4.9865 => 5.1680, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6135 => 0.6353, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 3.16% (3.1889 => 3.2898, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.05% (1.1333 => 1.1679, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.95% (16.2614 => 16.7407, std. dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7437, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.85% (6.5754 => 6.7630, std. dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.73% (14.8535 => 15.2591, std. dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9086, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.2742 => 3.3582, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5188 => 1.5555, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 2.39% (4.6629 => 4.7743, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6250 => 0.6389, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.1007 => 2.1405, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.47% (1.0313 => 1.0465, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.43% (3.7467 => 3.8001, std. dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 1.06% (33.2944 => 33.6475, std. dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2692, std. dev.: 0.0426) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.88% (1.2998 => 1.4282, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.32% (11.2619 => 11.7482, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (2.8606 => 2.9627, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3860, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5969, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.13% (10.7476 => 10.9765, std. dev.: 0.0499) MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.5928 => 4.6790, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3248, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.15% (26.5159 => 26.8201, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6867, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1875, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.2308 => 1.0970, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std. dev.: 0.0103) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.57% (1.1560 => 1.1032, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.98% (3.1476 => 3.0222, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5887, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9628, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2268, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2067, std. dev.: 0.0220) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8678, std. dev.: 0.0122) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3684, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.18% (20.3410 => 20.1011, std. dev.: 0.0310) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 02:46:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 04:46:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820094639.039382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3050?compare_to=3047&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3050, Order: 162194, Start Time: 2012-08-20 08:28:21, End Time: 2012-08-20 09:47:29 To: 3047, Order: 162193, Start Time: 2012-08-20 06:39:06, End Time: 2012-08-20 08:00:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (97 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.00% (13.5673 => 14.2452, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.80% (54.4859 => 56.5565, std. dev.: 0.0958) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.32% (11.1426 => 10.9959, std. dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.41% (10.3673 => 14.2452, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-2: 11.24% (0.3497 => 0.3890, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.20% (1.1194 => 1.2448, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.15% (0.3543 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.80% (0.1432 => 0.1558, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.44% (2.2022 => 2.3661, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5925 => 0.6342, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.55% (1.7609 => 1.8763, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.34% (0.2065 => 0.2196, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.34% (0.1892 => 0.2012, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.91% (0.7326 => 0.7759, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 5.36% (10.4361 => 10.9959, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.3177 => 0.3344, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.89% (0.8172 => 0.8572, std. dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 4.88% (0.7433 => 0.7796, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.3121 => 0.3269, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.67% (0.2271 => 0.2377, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.64% (7.0540 => 7.3810, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.43% (0.4879 => 0.5095, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.20% (0.5569 => 0.5803, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.5860 => 0.6106, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.08% (4.2646 => 4.4385, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (9.4845 => 9.8677, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (5.0018 => 5.2016, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 3.95% (0.2554 => 0.2655, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.88% (0.7835 => 0.8139, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.8067 => 0.8377, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 3.84% (0.3282 => 0.3408, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.9449 => 5.1318, std. dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4288, std. dev.: 0.0069) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.43% (1.5415 => 1.5944, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3180 => 0.3286, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (1.3050 => 1.3483, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.29% (0.4103 => 0.4238, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.9765 => 1.0085, std. dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 3.19% (5.7591 => 5.9430, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3441 => 0.3550, std. dev.: 0.0019) MultiSource/Applications/Burg/burg: 3.14% (1.1642 => 1.2008, std. dev.: 0.0070) MultiSource/Benchmarks/sim/sim: 3.10% (0.3387 => 0.3492, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.4289 => 0.4421, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 3.06% (3.3354 => 3.4375, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.96% (0.5105 => 0.5256, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.89% (1.1861 => 1.2204, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3826 => 0.3936, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.87% (0.3865 => 0.3976, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.86% (2.0665 => 2.1255, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.83% (2.0273 => 2.0847, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.83% (1.5603 => 1.6044, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.73% (0.6675 => 0.6857, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (0.4064 => 0.4174, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.69% (0.3935 => 0.4041, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.62% (0.4620 => 0.4741, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.54% (3.8723 => 3.9706, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (14.3668 => 14.7312, std. dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.50% (0.6450 => 0.6611, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.4186 => 1.4540, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.6456 => 0.6614, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.42% (0.5981 => 0.6126, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.40% (0.4203 => 0.4304, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.30% (1.2842 => 1.3138, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8921 => 0.9123, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.24% (17.1811 => 17.5668, std. dev.: 0.0230) MultiSource/Applications/siod/siod: 2.21% (2.2969 => 2.3476, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.75% (2.2024 => 2.2410, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2024, std. dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.45% (1.0722 => 1.0878, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (4.2280 => 4.4517, std. dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.63% (0.2944 => 0.3051, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7564, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8635, std. dev.: 0.0254) SingleSource/Regression/C/uint64_to_float: 2.12% (0.5413 => 0.5528, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2162, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2227, std. dev.: 0.0172) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.09% (1.3045 => 1.3187, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1263, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.61% (5.2763 => 3.1335, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6877, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.10% (5.3526 => 3.6878, std. dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0714, std. dev.: 0.0489) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -14.00% (2.9384 => 2.5270, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.33% (22.1758 => 19.4420, std. dev.: 0.0323) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.2373 => 1.0973, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -7.99% (1.5373 => 1.4145, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4680, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5645, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std. dev.: 0.0024) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4671, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4160, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9937, std. dev.: 0.0213) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.30% (8.1563 => 7.9683, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3350, std. dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8130, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 04:18:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 06:18:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820111828.74C0F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3051?compare_to=3049&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3051, Order: 162198, Start Time: 2012-08-20 10:05:34, End Time: 2012-08-20 11:19:19 To: 3049, Order: 162194, Start Time: 2012-08-20 08:24:10, End Time: 2012-08-20 09:38:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (148 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.32% (3.7689 => 3.8562, std. dev.: 0.0240) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.25% (1.3080 => 1.3243, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.07% (2.0176 => 2.3014, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 10.69% (0.5818 => 0.6440, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 10.51% (0.5748 => 0.6352, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.67% (0.7061 => 0.7744, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.16% (0.3601 => 0.3895, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.05% (0.3650 => 0.3944, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.95% (0.4328 => 0.4672, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.79% (0.3914 => 0.4219, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.66% (0.4062 => 0.4373, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.64% (0.3940 => 0.4241, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.35% (1.3693 => 1.4699, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.25% (0.2937 => 0.3150, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2628 => 0.2818, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.23% (0.2726 => 0.2923, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3022 => 0.3240, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (3.9660 => 4.2491, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.10% (0.2760 => 0.2956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.03% (0.3485 => 0.3730, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.02% (0.7038 => 0.7532, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3149 => 0.3369, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.99% (1.9828 => 2.1213, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.3899 => 0.4169, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.91% (0.7710 => 0.8243, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3580 => 0.3824, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3489 => 0.3725, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 6.43% (0.3453 => 0.3675, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.24% (0.9199 => 0.9773, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4390 => 0.4657, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.6959 => 0.7380, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 6.03% (0.3534 => 0.3747, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.02% (1.2193 => 1.2927, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.92% (0.3868 => 0.4097, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (0.3756 => 0.3978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.85% (0.4016 => 0.4251, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.50% (0.5577 => 0.5884, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 5.40% (13.8202 => 14.5666, std. dev.: 0.0114) MultiSource/Applications/hexxagon/hexxagon: 5.25% (1.2292 => 1.2937, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.20% (1.1364 => 1.1955, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.19% (1.4563 => 1.5319, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.07% (0.5637 => 0.5923, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.04% (7.2180 => 7.5817, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.92% (1.3813 => 1.4493, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.88% (1.1061 => 1.1601, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.3755 => 0.3937, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.77% (0.8310 => 0.8706, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.71% (3.8646 => 4.0468, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.69% (1.3819 => 1.4467, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3859, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.54% (0.7506 => 0.7847, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.0594 => 1.1062, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.38% (0.7460 => 0.7787, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.37% (2.1791 => 2.2743, std. dev.: 0.0131) MultiSource/Applications/kimwitu++/kc: 4.31% (16.6129 => 17.3290, std. dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.22% (0.4791 => 0.4993, std. dev.: 0.0061) MultiSource/Applications/treecc/treecc: 4.16% (1.9270 => 2.0071, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.06% (0.6283 => 0.6538, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (4.4433 => 4.6210, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (4.3801 => 4.5498, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.80% (13.2842 => 13.7893, std. dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.74% (3.6692 => 3.8066, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.71% (4.9865 => 5.1714, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.68% (0.8698 => 0.9018, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (0.6135 => 0.6354, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.24% (3.1889 => 3.2923, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1333 => 1.1694, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7585, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.92% (16.2614 => 16.7359, std. dev.: 0.0213) MultiSource/Applications/JM/lencod/lencod: 2.76% (14.8535 => 15.2632, std. dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7567, std. dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.5298 => 14.9116, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.46% (3.2742 => 3.3547, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.5188 => 1.5561, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.38% (4.6629 => 4.7741, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6250 => 0.6395, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.1007 => 2.1415, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.57% (1.0313 => 1.0475, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.56% (0.6744 => 0.6849, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.38% (3.7467 => 3.7983, std. dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 1.31% (33.2944 => 33.7308, std. dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 25.25% (1.8175 => 2.2765, std. dev.: 0.0440) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.94% (1.2998 => 1.4290, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7424, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.27% (1.9199 => 1.9827, std. dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8183, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5948, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.20% (3.7731 => 3.8562, std. dev.: 0.0240) MultiSource/Applications/SPASS/SPASS: 2.12% (10.7476 => 10.9754, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6782, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3254, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (1.5089 => 1.5293, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.12% (26.5159 => 26.8139, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5740, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.5627 => 21.1604, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.30% (1.2308 => 1.0917, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5109, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.60% (1.1560 => 1.1028, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.90% (1.3780 => 1.3243, std. dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6107, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.15% (3.0263 => 2.9612, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std. dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2009, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3641, std. dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.18% (20.3410 => 20.1019, std. dev.: 0.0350) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 04:33:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 06:33:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820113320.CA66E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3052?compare_to=3050&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3052, Order: 162198, Start Time: 2012-08-20 10:15:08, End Time: 2012-08-20 11:34:12 To: 3050, Order: 162194, Start Time: 2012-08-20 08:28:21, End Time: 2012-08-20 09:47:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (112 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (726 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.05% (14.2452 => 14.6794, std. dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.59% (10.3673 => 14.6794, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.65% (1.1194 => 1.2498, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.37% (0.3561 => 0.3966, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.3927 => 0.4342, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.42% (0.3886 => 0.4291, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.09% (2.2022 => 2.3803, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.05% (1.7609 => 1.8850, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 6.25% (0.7326 => 0.7784, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (10.4361 => 11.0350, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.42% (7.0540 => 7.4362, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.74% (0.7433 => 0.7785, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.65% (0.4879 => 0.5106, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.62% (0.2271 => 0.2376, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.43% (0.8172 => 0.8534, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 4.42% (0.3282 => 0.3427, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.26% (4.9449 => 5.1554, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.18% (4.2646 => 4.4427, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.11% (0.5569 => 0.5798, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8728, std. dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5860 => 0.6093, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (5.0018 => 5.1987, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.80% (1.5415 => 1.6001, std. dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.2905 => 0.3015, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.76% (8.1363 => 8.4423, std. dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2891 => 0.2999, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.63% (0.2756 => 0.2856, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.62% (0.3422 => 0.3546, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.62% (0.3098 => 0.3210, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.61% (0.4289 => 0.4444, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.57% (1.3050 => 1.3516, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.52% (0.7835 => 0.8111, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.42% (0.3387 => 0.3503, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3423 => 0.3540, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.41% (5.7591 => 5.9556, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.41% (0.3052 => 0.3156, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.4103 => 0.4241, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.32% (2.0665 => 2.1351, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3232 => 0.3339, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.27% (0.9765 => 1.0084, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.23% (0.3865 => 0.3990, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.22% (0.3136 => 0.3237, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.21% (0.3826 => 0.3949, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.19% (3.3354 => 3.4418, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3441 => 0.3550, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.15% (0.5105 => 0.5266, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.14% (1.1642 => 1.2007, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3283 => 0.3385, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.05% (0.3935 => 0.4055, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.04% (0.8067 => 0.8312, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2221, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.00% (0.4064 => 0.4186, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 2.99% (0.3684 => 0.3794, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.96% (1.5603 => 1.6065, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4620 => 0.4755, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.86% (0.6675 => 0.6866, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.85% (2.0273 => 2.0850, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7601, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6456 => 0.6632, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.72% (0.4048 => 0.4158, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.68% (0.6450 => 0.6623, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.68% (1.2842 => 1.3186, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.66% (0.5981 => 0.6140, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.56% (3.8723 => 3.9715, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.34% (1.4186 => 1.4518, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.32% (17.1811 => 17.5791, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (1.5859 => 1.6211, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.8921 => 0.9110, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.10% (2.2969 => 2.3452, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5020 => 0.5124, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.84% (2.2024 => 2.2430, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.78% (1.1840 => 1.2051, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.63% (0.7115 => 0.7231, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.48% (1.0722 => 1.0881, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (4.2280 => 4.4466, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7540, std. dev.: 0.0050) MultiSource/Applications/lua/lua: 3.03% (26.0924 => 26.8841, std. dev.: 0.0617) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2150, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3345, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2384, std. dev.: 0.0336) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (1.5086 => 1.5273, std. dev.: 0.0053) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5742, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.52% (5.2763 => 3.1384, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.96% (5.3855 => 3.7183, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.49% (5.3526 => 3.7208, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1169, std. dev.: 0.0249) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.37% (2.9384 => 2.5456, std. dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: -12.09% (22.1758 => 19.4951, std. dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2373 => 1.0999, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -8.94% (1.5373 => 1.3998, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.01% (1.1396 => 1.0597, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std. dev.: 0.0007) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4707, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4173, std. dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 9.9998, std. dev.: 0.0148) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9650, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5130, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (12.5348 => 12.3444, std. dev.: 0.0036) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7057, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 05:35:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 07:35:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120820123527.550922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3053?compare_to=3048&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3053, Order: 162198, Start Time: 2012-08-20 09:52:33, End Time: 2012-08-20 12:36:17 To: 3048, Order: 162193, Start Time: 2012-08-20 06:38:53, End Time: 2012-08-20 09:24:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (108 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (769 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.90% (2.0639 => 2.1032, std. dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.42% (54.1228 => 54.8908, std. dev.: 0.0420) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -1.01% (1.1388 => 1.1273, std. dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3446 => 0.3848, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3465 => 0.3869, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3496 => 0.3903, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 11.53% (0.3442 => 0.3839, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.53% (0.3460 => 0.3859, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.50% (0.3469 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.44% (0.3488 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.21% (0.3650 => 0.4059, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.17% (0.3643 => 0.4050, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.71% (0.3724 => 0.4123, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.34% (1.5932 => 1.7102, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5826 => 0.6239, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.79% (0.5889 => 0.6289, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (1.6211 => 1.7141, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.55% (0.5026 => 0.5305, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.53% (0.4994 => 0.5270, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.45% (3.5627 => 3.7568, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 5.37% (0.7171 => 0.7556, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.36% (1.3152 => 1.3857, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.5900 => 0.6200, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.98% (0.4361 => 0.4578, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.88% (0.5000 => 0.5244, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 4.70% (4.2109 => 4.4089, std. dev.: 0.0134) MultiSource/Applications/d/make_dparser: 4.56% (1.0781 => 1.1273, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 4.44% (0.4029 => 0.4208, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.17% (0.2736 => 0.2850, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.13% (0.2738 => 0.2851, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.93% (0.3004 => 0.3122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.88% (0.2729 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.80% (0.4658 => 0.4835, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.79% (0.9909 => 1.0285, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2803 => 0.2909, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (1.9966 => 2.0714, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.72% (5.5417 => 5.7480, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2750 => 0.2852, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.68% (0.2823 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.3096 => 0.3210, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (1.9694 => 2.0417, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.59% (0.2813 => 0.2914, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 3.56% (0.2811 => 0.2911, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.52% (2.0673 => 2.1400, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (2.1653 => 2.2403, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.43% (0.3124 => 0.3231, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.39% (2.7292 => 2.8217, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.39% (2.1013 => 2.1725, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3267 => 0.3376, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.33% (0.3060 => 0.3162, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 3.30% (4.6177 => 4.7703, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 3.29% (1.8794 => 1.9412, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3317 => 0.3426, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (0.3625 => 0.3741, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3726 => 0.3845, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.18% (0.4146 => 0.4278, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.17% (0.3348 => 0.3454, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.3903 => 0.4026, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3477 => 0.3585, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (4.4195 => 4.5543, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 3.05% (23.5202 => 24.2373, std. dev.: 0.0160) MultiSource/Applications/treecc/treecc: 3.05% (0.7875 => 0.8115, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3678 => 0.3790, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.3845 => 0.3961, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.4139 => 0.4260, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3690 => 0.3797, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.85% (0.4251 => 0.4372, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.80% (1.4269 => 1.4668, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.63% (0.9697 => 0.9952, std. dev.: 0.0074) MultiSource/Applications/siod/siod: 2.62% (0.6634 => 0.6808, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.61% (0.3981 => 0.4085, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.5012 => 0.5129, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.6435 => 0.6577, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.71% (2.0346 => 2.0694, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.73% (0.2122 => 0.2286, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6747, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1728, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-2: 4.40% (1.8057 => 1.8851, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6404, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2066, std. dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.02% (41.7953 => 42.6405, std. dev.: 0.0131) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5027, std. dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5927, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2265, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2813, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5954, std. dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.78% (2.4764 => 2.3827, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -1.26% (11.9555 => 11.8045, std. dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5907, std. dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7837, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8048, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0061) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.73% (17.2379 => 16.7669, std. dev.: 0.0826) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5726, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9586, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 05:59:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 07:59:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820125951.7A53F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3054?compare_to=3051&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3054, Order: 162201, Start Time: 2012-08-20 11:46:51, End Time: 2012-08-20 13:00:40 To: 3051, Order: 162198, Start Time: 2012-08-20 10:05:34, End Time: 2012-08-20 11:19:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 1.84% (2.2765 => 2.3184, std. dev.: 0.0148) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.22% (2.0176 => 2.3045, std. dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 10.81% (0.5818 => 0.6447, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 10.59% (0.5748 => 0.6357, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.70% (0.7061 => 0.7746, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.98% (0.3130 => 0.3411, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.30% (0.3578 => 0.3875, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.20% (0.2781 => 0.3009, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.14% (0.3601 => 0.3894, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.02% (0.2782 => 0.3005, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 8.01% (0.3646 => 0.3938, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 7.99% (0.4328 => 0.4674, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.92% (0.3789 => 0.4089, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.4003 => 0.4315, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.72% (0.3940 => 0.4244, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2607 => 0.2802, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.37% (0.7710 => 0.8278, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.35% (1.3693 => 1.4700, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.31% (0.4062 => 0.4359, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.26% (0.7038 => 0.7549, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (3.9660 => 4.2503, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.99% (1.9828 => 2.1213, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.3899 => 0.4166, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3580 => 0.3824, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3489 => 0.3726, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.77% (0.3485 => 0.3721, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.60% (0.3453 => 0.3681, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.16% (0.9199 => 0.9766, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4390 => 0.4657, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.06% (0.6959 => 0.7381, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.04% (1.2193 => 1.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.02% (0.3756 => 0.3982, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 5.98% (0.3293 => 0.3490, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.92% (0.3868 => 0.4097, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.83% (0.4016 => 0.4250, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.82% (0.3246 => 0.3435, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.5577 => 0.5883, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.46% (0.2914 => 0.3073, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 5.44% (13.8202 => 14.5720, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 5.27% (1.2292 => 1.2940, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.20% (1.4563 => 1.5321, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.15% (1.1364 => 1.1949, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.02% (7.2180 => 7.5800, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.5637 => 0.5918, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.89% (0.7506 => 0.7873, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.88% (3.8646 => 4.0533, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.79% (0.8310 => 0.8708, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.76% (1.3813 => 1.4470, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.68% (1.1061 => 1.1579, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.64% (1.3819 => 1.4460, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.3245 => 1.3858, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.0594 => 1.1072, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.48% (0.7460 => 0.7794, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.42% (16.6129 => 17.3480, std. dev.: 0.0060) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0113, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 4.27% (2.1791 => 2.2722, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.26% (0.4791 => 0.4995, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.11% (0.6283 => 0.6541, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.3801 => 4.5558, std. dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6192, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1769, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8089, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (13.2842 => 13.7817, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.8698 => 0.9015, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6135 => 0.6356, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.32% (3.1889 => 3.2947, std. dev.: 0.0123) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4113 => 0.4240, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (8.4961 => 8.7531, std. dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 2.97% (16.2614 => 16.7440, std. dev.: 0.0256) MultiSource/Applications/JM/lencod/lencod: 2.83% (14.8535 => 15.2738, std. dev.: 0.0178) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7582, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9253, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (3.2742 => 3.3620, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.59% (1.5188 => 1.5581, std. dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 2.53% (4.6629 => 4.7810, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6250 => 0.6395, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.1007 => 2.1424, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.71% (1.0313 => 1.0489, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.65% (0.6744 => 0.6855, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.47% (3.7467 => 3.8019, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.9108 => 0.9241, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.36% (33.2944 => 33.7480, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 27.56% (1.8175 => 2.3184, std. dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.99% (1.2998 => 1.4297, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7409, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9837, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8184, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6007, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.06% (10.7476 => 10.9689, std. dev.: 0.0606) MultiSource/Applications/sqlite3/sqlite3: 1.91% (4.5928 => 4.6807, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3263, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5281, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1838, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6879, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.08% (26.5159 => 26.8011, std. dev.: 0.0307) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.08% (22.5627 => 21.1913, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.19% (0.8818 => 0.8713, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2308 => 1.0969, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3174, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5836, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.26% (0.6589 => 0.6440, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: -2.07% (3.0263 => 2.9638, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2310, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2064, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3706, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.20% (5.5401 => 5.4736, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2312, std. dev.: 0.0177) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 06:19:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 08:19:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820131945.EAB032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3055?compare_to=3052&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3055, Order: 162201, Start Time: 2012-08-20 12:01:44, End Time: 2012-08-20 13:20:36 To: 3052, Order: 162198, Start Time: 2012-08-20 10:15:08, End Time: 2012-08-20 11:34:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (111 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (727 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.21% (54.7884 => 56.5479, std. dev.: 0.0584) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.60% (10.3673 => 14.6800, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std. dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.72% (1.1194 => 1.2506, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.41% (0.3497 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3543 => 0.3943, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.50% (0.1432 => 0.1568, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.05% (2.2022 => 2.3795, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5925 => 0.6346, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.02% (1.7609 => 1.8845, std. dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.6030 => 0.6448, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.92% (0.7326 => 0.7760, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.72% (10.4361 => 11.0330, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.36% (7.0540 => 7.4322, std. dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.09% (0.8172 => 0.8588, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.4879 => 0.5109, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.68% (0.7433 => 0.7781, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.29% (4.2646 => 4.4476, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 4.10% (9.4845 => 9.8733, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (4.9449 => 5.1449, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (5.0018 => 5.1975, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5860 => 0.6084, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.80% (0.2891 => 0.3001, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.2905 => 0.3015, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.72% (8.1363 => 8.4392, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 3.64% (0.4289 => 0.4445, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (0.4636 => 0.4800, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 3.54% (0.3422 => 0.3543, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (1.3050 => 1.3511, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.52% (0.3098 => 0.3207, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.49% (0.4103 => 0.4246, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.42% (0.7835 => 0.8103, std. dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 3.41% (5.7591 => 5.9554, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 3.40% (0.3232 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.37% (0.3052 => 0.3155, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.5415 => 1.5935, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.37% (0.3387 => 0.3501, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.26% (0.3865 => 0.3991, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.24% (0.9765 => 1.0081, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.23% (0.5105 => 0.5270, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.22% (0.3136 => 0.3237, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.18% (0.3684 => 0.3801, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.17% (2.0665 => 2.1320, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.16% (0.3826 => 0.3947, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.14% (0.3283 => 0.3386, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.09% (1.1642 => 1.2002, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 3.07% (3.3354 => 3.4379, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.8067 => 0.8314, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.05% (0.3603 => 0.3713, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.05% (0.3935 => 0.4055, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.97% (1.1861 => 1.2213, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 2.95% (2.0273 => 2.0872, std. dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/bigfib: 2.90% (0.6456 => 0.6643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.88% (0.4620 => 0.4753, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6675 => 0.6867, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.85% (1.5603 => 1.6048, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2842 => 1.3192, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.73% (14.3668 => 14.7583, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4203 => 0.4317, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.70% (0.6450 => 0.6624, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.58% (3.8723 => 3.9721, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.53% (1.4186 => 1.4545, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5981 => 0.6125, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.41% (17.1811 => 17.5945, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/football/football: 2.29% (0.8921 => 0.9125, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5859 => 1.6218, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.25% (2.2969 => 2.3485, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5020 => 0.5128, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.88% (2.2024 => 2.2437, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.85% (1.1840 => 1.2059, std. dev.: 0.0051) MultiSource/Applications/minisat/minisat: 1.67% (0.7115 => 0.7234, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.55% (1.0722 => 1.0888, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (4.2280 => 4.4399, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 2.85% (26.0924 => 26.8372, std. dev.: 0.0386) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2134, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3346, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.55% (0.9540 => 0.9688, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 1.53% (2.2771 => 2.3119, std. dev.: 0.0111) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2419, std. dev.: 0.0252) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5086 => 1.5268, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.57% (5.2763 => 3.1356, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7174, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.53% (5.3526 => 3.7182, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0911, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5433, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.02% (22.1758 => 19.5108, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2373 => 1.1013, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -7.49% (1.5373 => 1.4222, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4681, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std. dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4713, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4211, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0126, std. dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9616, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3337, std. dev.: 0.0079) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.16% (1.8329 => 1.8116, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 08:46:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 10:46:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120820154616.A13872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3056?compare_to=3053&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3056, Order: 162201, Start Time: 2012-08-20 13:03:47, End Time: 2012-08-20 15:47:08 To: 3053, Order: 162198, Start Time: 2012-08-20 09:52:33, End Time: 2012-08-20 12:36:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (772 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3446 => 0.3845, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3465 => 0.3865, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.53% (0.3460 => 0.3859, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3496 => 0.3899, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.45% (0.3442 => 0.3836, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.44% (0.3488 => 0.3887, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.42% (0.3469 => 0.3865, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.21% (0.3650 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3643 => 0.4047, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.71% (0.3724 => 0.4123, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.23% (1.5932 => 1.7084, std. dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: 7.11% (0.5826 => 0.6240, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 6.84% (0.5889 => 0.6292, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7171 => 0.7605, std. dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.2014 => 0.2133, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.57% (3.5627 => 3.7613, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.36% (1.6211 => 1.7080, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (1.3152 => 1.3822, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.05% (0.5900 => 0.6198, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.01% (0.4994 => 0.5244, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (0.5000 => 0.5248, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.95% (0.4361 => 0.4577, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 4.66% (1.0781 => 1.1283, std. dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 4.56% (4.2109 => 4.4029, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.46% (0.5026 => 0.5250, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.24% (0.2738 => 0.2854, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.2866 => 0.2980, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.2736 => 0.2844, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.88% (0.2729 => 0.2835, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.3004 => 0.3118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2792 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.75% (0.2750 => 0.2853, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (0.3890 => 0.4035, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 3.71% (0.2803 => 0.2907, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.70% (0.9909 => 1.0276, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.63% (5.5417 => 5.7429, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.57% (2.0673 => 2.1412, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.57% (1.9966 => 2.0679, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2813 => 0.2913, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0391, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (0.4658 => 0.4822, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.39% (0.3124 => 0.3230, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.33% (0.3060 => 0.3162, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.32% (2.7292 => 2.8197, std. dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3267 => 0.3375, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.3903 => 0.4032, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.29% (0.3317 => 0.3426, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3726 => 0.3846, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (2.1653 => 2.2350, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 3.16% (0.7875 => 0.8124, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.15% (2.1013 => 2.1675, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (4.4195 => 4.5574, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3625 => 0.3738, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 3.12% (4.6177 => 4.7616, std. dev.: 0.0106) MultiSource/Applications/Burg/burg: 3.10% (0.5546 => 0.5718, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.09% (23.5202 => 24.2472, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 3.08% (0.3477 => 0.3584, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.07% (0.3678 => 0.3791, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.05% (0.3348 => 0.3450, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.4139 => 0.4264, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (1.8794 => 1.9361, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3690 => 0.3799, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.94% (0.4146 => 0.4268, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.87% (1.4269 => 1.4679, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.87% (0.9697 => 0.9975, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 2.80% (0.4251 => 0.4370, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.3981 => 0.4084, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.50% (0.6634 => 0.6800, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.22% (0.6435 => 0.6578, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.17% (0.5012 => 0.5121, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.70% (2.0346 => 2.0692, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6773, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std. dev.: 0.0173) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6314, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1929, std. dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5013, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.71% (41.7953 => 42.5093, std. dev.: 0.0669) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2900, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5847, std. dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.84% (2.4764 => 2.3812, std. dev.: 0.0228) MultiSource/Applications/kimwitu++/kc: -1.12% (11.9555 => 11.8219, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5777, std. dev.: 0.0222) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7984, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -3.80% (11.2080 => 10.7816, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0069) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.72% (17.2379 => 16.7690, std. dev.: 0.0970) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9625, std. dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 11:23:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 13:23:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820182356.06ABC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3057?compare_to=3054&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3057, Order: 162205, Start Time: 2012-08-20 17:10:55, End Time: 2012-08-20 18:24:46 To: 3054, Order: 162201, Start Time: 2012-08-20 11:46:51, End Time: 2012-08-20 13:00:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.16% (2.0176 => 2.3032, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: 10.66% (0.5818 => 0.6438, std. dev.: 0.0110) SingleSource/UnitTests/ObjC++/Hello: 10.54% (0.5748 => 0.6354, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 9.73% (0.7061 => 0.7748, std. dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.3130 => 0.3404, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: 8.16% (0.3601 => 0.3895, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: 8.16% (0.3663 => 0.3962, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3650 => 0.3943, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: 8.00% (0.3789 => 0.4092, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1986 => 0.2144, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.93% (0.4062 => 0.4384, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3623 => 0.3910, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 7.88% (0.4328 => 0.4669, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.82% (0.3914 => 0.4220, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.71% (0.1413 => 0.1522, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.56% (0.3940 => 0.4238, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.36% (1.3693 => 1.4701, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2628 => 0.2818, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (3.9660 => 4.2511, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.2937 => 0.3148, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3022 => 0.3238, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.7710 => 0.8255, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7038 => 0.7534, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.95% (1.9828 => 2.1207, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (0.3149 => 0.3366, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.86% (0.5265 => 0.5626, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.77% (0.3899 => 0.4163, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.74% (0.3489 => 0.3724, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.69% (0.3485 => 0.3718, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.68% (0.3580 => 0.3819, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.34% (0.3453 => 0.3672, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.14% (0.9199 => 0.9764, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.10% (0.4390 => 0.4658, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.07% (0.3293 => 0.3493, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.07% (1.2193 => 1.2933, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.98% (0.6959 => 0.7375, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 5.92% (0.3868 => 0.4097, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.3756 => 0.3977, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.82% (0.3246 => 0.3435, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.80% (0.4016 => 0.4249, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.69% (0.2127 => 0.2248, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5577 => 0.5887, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.37% (13.8202 => 14.5626, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.32% (1.4563 => 1.5338, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 5.17% (1.2292 => 1.2927, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.06% (1.1364 => 1.1939, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.03% (7.2180 => 7.5809, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.5637 => 0.5918, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3755 => 0.3936, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (1.3813 => 1.4468, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8310 => 0.8701, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.70% (0.7506 => 0.7859, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.69% (1.1061 => 1.1580, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.68% (1.3245 => 1.3865, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 4.67% (3.8646 => 4.0450, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.67% (1.3819 => 1.4464, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.64% (0.7460 => 0.7806, std. dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 4.52% (1.0594 => 1.1073, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3400, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.26% (0.4791 => 0.4995, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.25% (1.9270 => 2.0089, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.07% (0.6283 => 0.6539, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.05% (2.1791 => 2.2674, std. dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (4.4433 => 4.6198, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.3801 => 4.5516, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8088, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.74% (4.9865 => 5.1731, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (13.2842 => 13.7805, std. dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.60% (0.8698 => 0.9011, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6135 => 0.6353, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.36% (3.1889 => 3.2959, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.1333 => 1.1702, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4113 => 0.4245, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7588, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.04% (16.2614 => 16.7561, std. dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 2.82% (14.8535 => 15.2730, std. dev.: 0.0155) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.5754 => 6.7603, std. dev.: 0.0129) MultiSource/Applications/ClamAV/clamscan: 2.66% (14.5298 => 14.9165, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.55% (3.2742 => 3.3578, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5188 => 1.5560, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.43% (4.6629 => 4.7764, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6250 => 0.6393, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.1007 => 2.1433, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.65% (0.6744 => 0.6855, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.62% (1.0313 => 1.0480, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.45% (3.7467 => 3.8010, std. dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7323, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.60% (1.8175 => 2.2646, std. dev.: 0.0253) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 9.69% (1.2998 => 1.4258, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7442, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8174, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.45% (10.7476 => 11.0107, std. dev.: 0.0375) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5985, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6776, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3255, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (26.5159 => 26.7937, std. dev.: 0.0314) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6839, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1790, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.20% (0.8818 => 0.8712, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2308 => 1.0947, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5154, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.34% (1.3780 => 1.3182, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5850, std. dev.: 0.0182) MultiSource/Benchmarks/Olden/bh/bh: -2.49% (1.9762 => 1.9270, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9623, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2394, std. dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2010, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3588, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8726, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.07% (20.3410 => 20.1231, std. dev.: 0.0297) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 11:29:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 13:29:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820182908.A6E452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3058?compare_to=3055&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3058, Order: 162205, Start Time: 2012-08-20 17:10:46, End Time: 2012-08-20 18:29:59 To: 3055, Order: 162201, Start Time: 2012-08-20 12:01:44, End Time: 2012-08-20 13:20:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (724 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 41.66% (10.3673 => 14.6861, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3543 => 0.3952, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.47% (0.3817 => 0.4255, std. dev.: 0.0119) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 11.37% (0.3561 => 0.3966, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 9.50% (0.1432 => 0.1568, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.11% (2.2022 => 2.3807, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5925 => 0.6345, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.98% (1.7609 => 1.8838, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.97% (0.6030 => 0.6450, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 5.94% (0.7326 => 0.7761, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 5.68% (10.4361 => 11.0285, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.39% (7.0540 => 7.4343, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.4615 => 0.4846, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.56% (0.7433 => 0.7772, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.52% (0.8172 => 0.8541, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 4.36% (0.3282 => 0.3425, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.19% (4.2646 => 4.4434, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8726, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (4.9449 => 5.1445, std. dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (5.0018 => 5.2006, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.96% (0.5860 => 0.6092, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.82% (0.2905 => 0.3016, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.82% (0.4636 => 0.4813, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.72% (8.1363 => 8.4389, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.70% (1.3050 => 1.3533, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: 3.68% (0.7835 => 0.8123, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 3.64% (0.2831 => 0.2934, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4289 => 0.4442, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.48% (5.7591 => 5.9596, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.46% (0.4103 => 0.4245, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.42% (0.9765 => 1.0099, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.5415 => 1.5941, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 3.41% (0.3052 => 0.3156, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.39% (0.3098 => 0.3203, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.34% (0.3387 => 0.3500, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.31% (0.3109 => 0.3212, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.27% (0.3422 => 0.3534, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.25% (2.0665 => 2.1336, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.23% (0.3865 => 0.3990, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.17% (0.3283 => 0.3387, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.14% (3.3354 => 3.4401, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 3.14% (0.3603 => 0.3716, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.13% (0.5105 => 0.5265, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.11% (0.3441 => 0.3548, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 3.07% (0.3684 => 0.3797, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.07% (1.1642 => 1.1999, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.8067 => 0.8314, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2222, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std. dev.: 0.0042) MultiSource/Applications/hbd/hbd: 2.98% (1.5603 => 1.6068, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 2.97% (0.4620 => 0.4757, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.93% (0.4064 => 0.4183, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.84% (2.0273 => 2.0849, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.76% (14.3668 => 14.7634, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.4203 => 0.4319, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.67% (0.4048 => 0.4156, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.2842 => 1.3184, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.64% (0.6450 => 0.6620, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.62% (3.8723 => 3.9739, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.51% (0.5981 => 0.6131, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.32% (0.8921 => 0.9128, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 2.31% (17.1811 => 17.5776, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.4186 => 1.4509, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.26% (2.2969 => 2.3487, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.25% (1.5859 => 1.6216, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.09% (0.5020 => 0.5125, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.84% (1.1840 => 1.2058, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.82% (2.2024 => 2.2425, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.78% (0.7115 => 0.7242, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.63% (1.0722 => 1.0897, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (4.2280 => 4.4406, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7513, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8650, std. dev.: 0.0345) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3344, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.53% (3.1578 => 3.2060, std. dev.: 0.0071) MultiSource/Applications/minisat/minisat: 1.50% (9.1159 => 9.2524, std. dev.: 0.0350) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.20% (1.5086 => 1.5267, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5764, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 1.03% (2.2771 => 2.3005, std. dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1247, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.60% (5.2763 => 3.1340, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7169, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.52% (5.3526 => 3.7188, std. dev.: 0.0066) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0932, std. dev.: 0.1343) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.41% (2.9384 => 2.5445, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -12.13% (22.1758 => 19.4861, std. dev.: 0.0224) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -11.56% (1.2373 => 1.0943, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -8.31% (1.5373 => 1.4095, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4637, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4105, std. dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.59% (10.2830 => 10.0165, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9608, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6780, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (12.5348 => 12.3327, std. dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 12:53:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 14:53:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120820195314.2DB372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3059?compare_to=3056&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3059, Order: 162205, Start Time: 2012-08-20 17:10:43, End Time: 2012-08-20 19:54:03 To: 3056, Order: 162201, Start Time: 2012-08-20 13:03:47, End Time: 2012-08-20 15:47:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (770 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.45% (54.1458 => 54.9304, std. dev.: 0.0314) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3446 => 0.3855, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3465 => 0.3869, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.53% (0.3469 => 0.3869, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.50% (0.3460 => 0.3858, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.50% (0.3488 => 0.3889, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 11.48% (0.3442 => 0.3837, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.47% (0.3496 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.15% (0.3650 => 0.4057, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.06% (0.3643 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.66% (0.3724 => 0.4121, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.63% (0.1063 => 0.1176, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.06% (1.5932 => 1.7057, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.93% (0.5826 => 0.6230, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.76% (0.5889 => 0.6287, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.59% (1.3152 => 1.3887, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (1.6211 => 1.7110, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.1968 => 0.2075, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.40% (0.7171 => 0.7558, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.34% (3.5627 => 3.7531, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.5900 => 0.6206, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (0.4994 => 0.5250, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.09% (0.4361 => 0.4583, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.07% (0.5026 => 0.5281, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (0.5000 => 0.5248, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (0.3930 => 0.4121, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.71% (4.2109 => 4.4093, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 4.57% (0.4029 => 0.4213, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 4.52% (1.0781 => 1.1268, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.24% (0.2736 => 0.2852, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2875 => 0.2995, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.02% (0.9909 => 1.0307, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 3.93% (0.3004 => 0.3122, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.88% (0.2729 => 0.2835, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2803 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.72% (0.2792 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.72% (0.3195 => 0.3314, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.70% (1.9966 => 2.0705, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (1.9694 => 2.0419, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.65% (5.5417 => 5.7440, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.63% (0.4658 => 0.4827, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 3.63% (0.2813 => 0.2915, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.62% (0.3096 => 0.3208, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.2823 => 0.2925, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.61% (0.2911 => 0.3016, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0673 => 2.1418, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.56% (0.2811 => 0.2911, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.55% (0.3890 => 0.4028, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.49% (0.3124 => 0.3233, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.3903 => 0.4033, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.32% (2.7292 => 2.8199, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3282 => 0.3391, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3267 => 0.3375, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 3.29% (1.8794 => 1.9413, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.3362 => 0.3472, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3258 => 0.3364, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 3.25% (0.3726 => 0.3847, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3317 => 0.3423, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.16% (4.6177 => 4.7634, std. dev.: 0.0176) MultiSource/Applications/JM/ldecod/ldecod: 3.15% (2.1653 => 2.2336, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 3.15% (0.3678 => 0.3794, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 3.13% (2.1013 => 2.1670, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3625 => 0.3737, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.08% (23.5202 => 24.2451, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (4.4195 => 4.5556, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.08% (0.3477 => 0.3584, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.4146 => 0.4273, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.05% (0.3348 => 0.3450, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.4139 => 0.4263, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.99% (0.3845 => 0.3960, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3690 => 0.3799, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.86% (0.7875 => 0.8100, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.80% (0.4251 => 0.4370, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.71% (1.4269 => 1.4656, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 2.69% (0.9697 => 0.9958, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.3981 => 0.4087, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 2.61% (0.5546 => 0.5691, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.56% (0.6634 => 0.6804, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.6435 => 0.6584, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.72% (2.0346 => 2.0695, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.29% (0.2122 => 0.2298, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6772, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std. dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6320, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2028, std. dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.94% (41.7953 => 42.6046, std. dev.: 0.0210) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4989, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5910, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2268, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2805, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5883, std. dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.69% (2.4764 => 2.3850, std. dev.: 0.0252) MultiSource/Applications/kimwitu++/kc: -1.17% (11.9555 => 11.8159, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5652, std. dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2402 => 0.2210, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7950, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7976, std. dev.: 0.0119) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7726, std. dev.: 0.0660) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.02% (0.6293 => 0.6166, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5779, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9597, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4964, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 13:05:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 15:05:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820200513.2A7762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3060?compare_to=3057&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3060, Order: 162214, Start Time: 2012-08-20 18:52:10, End Time: 2012-08-20 20:06:03 To: 3057, Order: 162205, Start Time: 2012-08-20 17:10:55, End Time: 2012-08-20 18:24:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (143 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.15% (54.6198 => 56.3410, std. dev.: 0.2126) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.16% (2.0176 => 2.3032, std. dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference-object: 10.62% (0.5818 => 0.6436, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 10.33% (0.5748 => 0.6342, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.10% (0.7061 => 0.7774, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.18% (0.3650 => 0.3985, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3663 => 0.3993, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.69% (0.3914 => 0.4254, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.57% (0.4003 => 0.4346, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.55% (0.3940 => 0.4277, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.15% (1.3693 => 1.4672, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.2781 => 0.2979, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (0.4328 => 0.4632, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.01% (3.9660 => 4.2439, std. dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: 6.93% (0.7038 => 0.7526, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.83% (0.2782 => 0.2972, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.40% (0.2937 => 0.3125, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.37% (0.2655 => 0.2824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2628 => 0.2795, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2760 => 0.2934, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.3022 => 0.3211, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.22% (0.2765 => 0.2937, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.13% (0.3899 => 0.4138, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.12% (0.3107 => 0.3297, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.10% (0.3489 => 0.3702, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.10% (1.9828 => 2.1038, std. dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.06% (0.4390 => 0.4656, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2761 => 0.2928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.01% (0.2696 => 0.2858, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.97% (0.9199 => 0.9748, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4379 => 0.4636, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.86% (1.2193 => 1.2907, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5577 => 0.5895, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.6959 => 0.7355, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.67% (0.3192 => 0.3373, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3246 => 0.3427, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3453 => 0.3643, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.38% (0.3293 => 0.3470, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.26% (1.4563 => 1.5329, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 5.12% (13.8202 => 14.5277, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.90% (1.1364 => 1.1921, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.87% (1.3813 => 1.4486, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5637 => 0.5909, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.76% (7.2180 => 7.5619, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.72% (1.2292 => 1.2872, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.3819 => 1.4462, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.57% (0.8310 => 0.8690, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (1.3245 => 1.3842, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (3.8646 => 4.0369, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 4.41% (1.0594 => 1.1061, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.7460 => 0.7788, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.26% (0.7506 => 0.7826, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3755 => 0.3911, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.15% (16.6129 => 17.3025, std. dev.: 0.0122) MultiSource/Applications/treecc/treecc: 4.11% (1.9270 => 2.0062, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.4791 => 0.4985, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.89% (2.1791 => 2.2639, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (4.4433 => 4.6149, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.3801 => 4.5470, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.6283 => 0.6521, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (3.6692 => 3.8017, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (13.2842 => 13.7608, std. dev.: 0.0141) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.9865 => 5.1582, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.37% (0.6135 => 0.6342, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.23% (0.8698 => 0.8979, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.09% (3.1889 => 3.2873, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4113 => 0.4239, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.98% (1.1333 => 1.1671, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.83% (16.2614 => 16.7219, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.4961 => 8.7355, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.65% (14.8535 => 15.2471, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 2.59% (14.5298 => 14.9067, std. dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 2.55% (6.5754 => 6.7434, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.55% (3.2742 => 3.3576, std. dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 2.32% (4.6629 => 4.7711, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.1007 => 2.1417, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6250 => 0.6367, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.32% (0.9108 => 0.9228, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7899, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 27.22% (1.8175 => 2.3123, std. dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.53% (1.2998 => 1.4237, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7415, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (2.8606 => 2.9628, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.31% (1.9199 => 1.9835, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.37% (10.7476 => 11.0022, std. dev.: 0.0439) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6002, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.84% (4.5928 => 4.6774, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3251, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.24% (26.5159 => 26.8447, std. dev.: 0.0171) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1300, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.52% (0.8818 => 0.8684, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2308 => 1.1008, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.57% (1.1560 => 1.1032, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.18% (1.3780 => 1.3204, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.8259 => 8.5657, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.22% (3.0263 => 2.9590, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2331, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2043, std. dev.: 0.0169) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std. dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3599, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.17% (5.5401 => 5.4752, std. dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.04% (20.3410 => 20.1295, std. dev.: 0.0240) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2416, std. dev.: 0.0300) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 13:15:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 15:15:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820201537.95B2E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3061?compare_to=3058&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3061, Order: 162214, Start Time: 2012-08-20 18:57:31, End Time: 2012-08-20 20:16:28 To: 3058, Order: 162205, Start Time: 2012-08-20 17:10:46, End Time: 2012-08-20 18:29:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (103 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (736 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.82% (14.6861 => 14.9540, std. dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.60% (54.5111 => 55.9258, std. dev.: 0.3875) SingleSource/Benchmarks/Misc/mandel-2: 1.83% (1.4095 => 1.4353, std. dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.24% (10.3673 => 14.9540, std. dev.: 0.0120) SingleSource/UnitTests/ObjC/trivial-interface: 13.42% (0.3473 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.24% (0.3497 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.17% (0.3516 => 0.3979, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 13.12% (0.3543 => 0.4008, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.12% (0.3543 => 0.4008, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3694 => 0.4163, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.36% (0.3828 => 0.4301, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 9.99% (0.1432 => 0.1575, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.91% (2.2022 => 2.3763, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.48% (0.6030 => 0.6481, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.48% (0.5925 => 0.6368, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.83% (1.7609 => 1.8811, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.38% (0.1584 => 0.1685, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.27% (0.7326 => 0.7785, std. dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 6.13% (10.4361 => 11.0762, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.29% (0.4615 => 0.4859, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.26% (7.0540 => 7.4247, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2271 => 0.2381, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 4.78% (0.7433 => 0.7788, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.53% (0.8172 => 0.8542, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.48% (4.2646 => 4.4555, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.43% (4.9449 => 5.1640, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8886, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (5.0018 => 5.2095, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.11% (0.5569 => 0.5798, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5860 => 0.6093, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.87% (8.1363 => 8.4513, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.71% (0.4636 => 0.4808, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (1.3050 => 1.3532, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 3.68% (0.3180 => 0.3297, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.64% (1.5415 => 1.5976, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.63% (0.3441 => 0.3566, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.56% (5.7591 => 5.9644, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 3.53% (0.3423 => 0.3544, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9765 => 1.0109, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.51% (0.7835 => 0.8110, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 3.41% (0.3109 => 0.3215, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.38% (3.3354 => 3.4482, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.34% (0.3387 => 0.3500, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.4289 => 0.4429, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.20% (1.1861 => 1.2240, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.19% (0.5105 => 0.5268, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.19% (0.4103 => 0.4234, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.18% (1.1642 => 1.2012, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.14% (0.8067 => 0.8320, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.10% (0.3422 => 0.3528, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.09% (2.0273 => 2.0899, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.04% (1.5603 => 1.6078, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.04% (2.0665 => 2.1294, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3865 => 0.3982, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (14.3668 => 14.7876, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6675 => 0.6869, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3826 => 0.3936, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6450 => 0.6635, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4620 => 0.4746, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.72% (3.8723 => 3.9777, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists1: 2.71% (0.3684 => 0.3784, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.57% (0.5981 => 0.6135, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.57% (0.6456 => 0.6622, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.52% (0.4203 => 0.4309, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.48% (1.2842 => 1.3161, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.43% (17.1811 => 17.5987, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.41% (1.4186 => 1.4528, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.40% (0.8921 => 0.9135, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.32% (2.2969 => 2.3503, std. dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 2.02% (1.1840 => 1.2079, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.2024 => 2.2450, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.65% (1.0722 => 1.0899, std. dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (4.2280 => 4.4406, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7504, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 2.93% (26.0924 => 26.8576, std. dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2161, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2376, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.20% (1.5086 => 1.5267, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5760, std. dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.54% (5.2763 => 3.1371, std. dev.: 0.0111) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7046, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7055, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0755, std. dev.: 0.0639) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.73% (2.9384 => 2.5350, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -12.02% (22.1758 => 19.5107, std. dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.71% (1.6925 => 1.4266, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1062, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -6.64% (1.5373 => 1.4353, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std. dev.: 0.0017) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4680, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4241, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0056, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9646, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std. dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3468, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7068, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std. dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 14:46:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 16:46:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820214620.913C22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3062?compare_to=3060&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3062, Order: 162219, Start Time: 2012-08-20 20:33:27, End Time: 2012-08-20 21:47:10 To: 3060, Order: 162214, Start Time: 2012-08-20 18:52:10, End Time: 2012-08-20 20:06:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.68% (2.0176 => 2.2936, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 10.23% (0.5818 => 0.6413, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.09% (0.5748 => 0.6328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.83% (0.7061 => 0.7755, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.71% (0.3578 => 0.3854, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3623 => 0.3896, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.50% (0.3601 => 0.3871, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.43% (0.3646 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.42% (0.3789 => 0.4070, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.40% (0.1986 => 0.2133, std. dev.: 0.0036) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4703, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4062 => 0.4361, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.35% (0.4328 => 0.4646, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.34% (0.3663 => 0.3932, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.34% (0.2781 => 0.2985, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.32% (0.3650 => 0.3917, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.28% (0.3914 => 0.4199, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.15% (0.2782 => 0.2981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.4003 => 0.4288, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.00% (0.7038 => 0.7531, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.95% (0.2690 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.89% (3.9660 => 4.2391, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.74% (0.2655 => 0.2834, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.68% (0.7710 => 0.8225, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2765 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.59% (0.2760 => 0.2942, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.51% (0.5265 => 0.5608, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.43% (0.3485 => 0.3709, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.42% (0.2726 => 0.2901, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.39% (0.2596 => 0.2762, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.38% (1.9828 => 2.1094, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary3: 6.32% (0.3149 => 0.3348, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.28% (0.3899 => 0.4144, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.22% (0.4390 => 0.4663, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2761 => 0.2932, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3489 => 0.3704, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.16% (0.2988 => 0.3172, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3580 => 0.3798, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.91% (1.2193 => 1.2914, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sieve: 5.88% (0.3453 => 0.3656, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.86% (0.9199 => 0.9738, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3192 => 0.3376, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.74% (0.5577 => 0.5897, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.69% (0.4379 => 0.4628, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.51% (0.3246 => 0.3425, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.50% (0.4016 => 0.4237, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 5.38% (0.3868 => 0.4076, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.36% (0.2127 => 0.2241, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 5.34% (0.3293 => 0.3469, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (0.3756 => 0.3951, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.02% (13.8202 => 14.5142, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.96% (1.4563 => 1.5286, std. dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (1.1364 => 1.1919, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 4.86% (0.2945 => 0.3088, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.73% (1.2292 => 1.2873, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (7.2180 => 7.5522, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 4.62% (0.8310 => 0.8694, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.62% (1.3813 => 1.4451, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.57% (1.3819 => 1.4450, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.49% (3.8646 => 4.0382, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.48% (1.1061 => 1.1556, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.46% (1.3245 => 1.3836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3755 => 0.3917, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.7460 => 0.7781, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.23% (16.6129 => 17.3163, std. dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 4.19% (1.0594 => 1.1038, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.09% (0.4791 => 0.4987, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.06% (0.7506 => 0.7811, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 4.02% (1.9270 => 2.0045, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.6283 => 0.6529, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.91% (2.1791 => 2.2642, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.68% (4.9865 => 5.1699, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 3.66% (0.3220 => 0.3338, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.64% (4.3801 => 4.5395, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (3.6692 => 3.8016, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (4.4433 => 4.6034, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (13.2842 => 13.7548, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.8698 => 0.9005, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.46% (0.6135 => 0.6347, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.14% (3.1889 => 3.2889, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.90% (1.1333 => 1.1662, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (8.4961 => 8.7372, std. dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.70% (16.2614 => 16.7007, std. dev.: 0.0127) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4113 => 0.4222, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.55% (3.2742 => 3.3577, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 2.49% (14.5298 => 14.8920, std. dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 2.48% (14.8535 => 15.2222, std. dev.: 0.0160) MultiSource/Applications/JM/ldecod/ldecod: 2.47% (6.5754 => 6.7377, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.5188 => 1.5561, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 2.26% (4.6629 => 4.7681, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 1.97% (0.6250 => 0.6373, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.1007 => 2.1412, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.57% (0.6744 => 0.6850, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.41% (1.0313 => 1.0458, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.38% (0.9108 => 0.9234, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.21% (33.2944 => 33.6971, std. dev.: 0.0080) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7896, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fbench: 25.68% (1.8175 => 2.2842, std. dev.: 0.0378) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.05% (1.2998 => 1.4174, std. dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7415, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.49% (10.7476 => 11.0153, std. dev.: 0.0439) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3851, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6030, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5928 => 4.6759, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3262, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6876, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5722, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.14% (0.4657 => 0.4045, std. dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.5627 => 21.1297, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.16% (0.8818 => 0.8716, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.2308 => 1.0941, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.60% (1.1560 => 1.1028, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5958, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9287, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9624, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2320, std. dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2046, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8594, std. dev.: 0.0175) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3649, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.22% (20.3410 => 20.0935, std. dev.: 0.0445) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.13% (5.5401 => 5.4774, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 15:02:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 17:02:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820220204.AAB492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3063?compare_to=3061&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3063, Order: 162221, Start Time: 2012-08-20 20:43:59, End Time: 2012-08-20 22:02:55 To: 3061, Order: 162214, Start Time: 2012-08-20 18:57:31, End Time: 2012-08-20 20:16:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (108 on baseline) Performance Improvements: 2 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (730 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.00% (1.3152 => 1.3284, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -6.33% (14.9540 => 14.0080, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.76% (1.4353 => 1.3957, std. dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.12% (10.3673 => 14.0080, std. dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.88% (0.3473 => 0.3851, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.58% (0.3543 => 0.3918, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.83% (0.3927 => 0.4313, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.47% (2.2022 => 2.3888, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.55% (1.7609 => 1.8939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5925 => 0.6335, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.83% (0.6030 => 0.6442, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.77% (0.7326 => 0.7749, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (10.4361 => 11.0348, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.43% (7.0540 => 7.4367, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.09% (0.4615 => 0.4850, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.02% (0.4879 => 0.5124, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.95% (0.7433 => 0.7801, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 4.78% (0.3282 => 0.3439, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.76% (0.2271 => 0.2379, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.39% (9.4845 => 9.9005, std. dev.: 0.0121) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.09% (4.2646 => 4.4390, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.04% (0.5569 => 0.5794, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.04% (0.8172 => 0.8502, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.9449 => 5.1397, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.92% (0.5860 => 0.6090, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (5.0018 => 5.1956, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.73% (0.4636 => 0.4809, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.72% (8.1363 => 8.4386, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 3.64% (5.7591 => 5.9689, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 3.60% (0.3109 => 0.3221, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3180 => 0.3294, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.53% (1.3050 => 1.3511, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.45% (0.7835 => 0.8105, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.44% (0.9765 => 1.0101, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.34% (0.4103 => 0.4240, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.28% (0.3441 => 0.3554, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.23% (0.5105 => 0.5270, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.17% (1.5415 => 1.5904, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.16% (1.1642 => 1.2010, std. dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3232 => 0.3333, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4289 => 0.4423, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.12% (3.3354 => 3.4395, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.11% (0.8067 => 0.8318, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.10% (0.3865 => 0.3985, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.05% (2.0273 => 2.0891, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6675 => 0.6878, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 3.03% (1.5603 => 1.6075, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.02% (0.3307 => 0.3407, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.02% (1.1861 => 1.2219, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.98% (2.0665 => 2.1281, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3826 => 0.3938, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.4064 => 0.4182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4620 => 0.4749, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.76% (3.8723 => 3.9791, std. dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 2.60% (0.6456 => 0.6624, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.4203 => 0.4312, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 2.52% (0.4048 => 0.4150, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3165, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.51% (0.5981 => 0.6131, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7258, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5859 => 1.6247, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.4186 => 1.4530, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.33% (17.1811 => 17.5817, std. dev.: 0.0075) MultiSource/Applications/siod/siod: 2.26% (2.2969 => 2.3488, std. dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.5020 => 0.5131, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.16% (0.8921 => 0.9114, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (2.2024 => 2.2455, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.90% (0.7115 => 0.7250, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.74% (1.1840 => 1.2046, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.55% (1.0722 => 1.0888, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (4.2280 => 4.4411, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7496, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 3.00% (26.0924 => 26.8740, std. dev.: 0.0227) MultiSource/Applications/minisat/minisat: 1.85% (9.1159 => 9.2846, std. dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.83% (1.3045 => 1.3284, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 1.60% (2.2771 => 2.3135, std. dev.: 0.0129) MultiSource/Applications/siod/siod: 1.54% (3.2827 => 3.3333, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 1.51% (3.1578 => 3.2056, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5086 => 1.5280, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5785, std. dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1462, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.86% (5.3855 => 3.7235, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.35% (5.3526 => 3.7281, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1261, std. dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.09% (2.9384 => 2.5537, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.15% (22.1758 => 19.4809, std. dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.2373 => 1.0973, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: -9.21% (1.5373 => 1.3957, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.1396 => 1.0596, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4746, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.6802 => 8.4422, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0015, std. dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9617, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3345, std. dev.: 0.0092) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0083) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8124, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 16:03:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 18:03:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120820230351.8A45C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3064?compare_to=3059&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3064, Order: 162216, Start Time: 2012-08-20 20:21:45, End Time: 2012-08-20 23:04:41 To: 3059, Order: 162205, Start Time: 2012-08-20 17:10:43, End Time: 2012-08-20 19:54:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (108 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (770 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.08% (2.0629 => 2.1058, std. dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.35% (0.3465 => 0.3893, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.31% (0.3469 => 0.3896, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.21% (0.3488 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3496 => 0.3922, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3460 => 0.3881, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.14% (0.3442 => 0.3860, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 11.89% (0.3650 => 0.4084, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3643 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.66% (0.5826 => 0.6272, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 7.40% (0.5889 => 0.6325, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.96% (1.5932 => 1.7041, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.1620 => 0.1728, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.75% (0.7171 => 0.7583, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.59% (3.5627 => 3.7618, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.46% (1.6211 => 1.7096, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.36% (1.3152 => 1.3857, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.09% (0.4994 => 0.5248, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.5900 => 0.6200, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.97% (0.2014 => 0.2114, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 4.81% (1.0781 => 1.1300, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.80% (0.5026 => 0.5267, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.78% (0.3930 => 0.4118, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.72% (0.4029 => 0.4219, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.65% (4.2109 => 4.4067, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (0.5000 => 0.5230, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.38% (0.9909 => 1.0343, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.19% (0.2792 => 0.2909, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.17% (0.2736 => 0.2850, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.16% (0.3004 => 0.3129, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3124 => 0.3253, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.13% (0.2811 => 0.2927, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 4.07% (0.2750 => 0.2862, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.07% (0.2729 => 0.2840, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.04% (2.0673 => 2.1508, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 4.04% (0.3096 => 0.3221, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.2911 => 0.3028, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.02% (0.2813 => 0.2926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.00% (0.2823 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.97% (0.3195 => 0.3322, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.92% (0.3267 => 0.3395, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3258 => 0.3382, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.81% (4.4195 => 4.5877, std. dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.74% (5.5417 => 5.7491, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: 3.73% (0.3726 => 0.3865, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3362 => 0.3486, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.68% (0.3890 => 0.4033, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.66% (0.3060 => 0.3172, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 3.62% (0.3317 => 0.3437, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (2.7292 => 2.8276, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (1.9694 => 2.0396, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (1.9966 => 2.0675, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 3.51% (0.3477 => 0.3599, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.50% (0.3625 => 0.3752, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.49% (0.3348 => 0.3465, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.3678 => 0.3806, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.3903 => 0.4037, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.42% (0.4146 => 0.4288, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.35% (23.5202 => 24.3078, std. dev.: 0.0184) MultiSource/Benchmarks/mafft/pairlocalalign: 3.30% (2.1013 => 2.1706, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3690 => 0.3811, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.27% (0.6634 => 0.6851, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 3.24% (2.1653 => 2.2354, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (0.4658 => 0.4808, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.4139 => 0.4271, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.18% (0.4251 => 0.4386, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.17% (1.4269 => 1.4722, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.17% (0.9697 => 1.0004, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 3.16% (1.8794 => 1.9388, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 3.14% (4.6177 => 4.7627, std. dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.04% (0.3981 => 0.4102, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.93% (0.7875 => 0.8106, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.59% (0.5012 => 0.5142, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.56% (0.6435 => 0.6600, std. dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 1.64% (2.0346 => 2.0679, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6746, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8965, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1719, std. dev.: 0.0849) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6419, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2030, std. dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.94% (41.7953 => 42.6058, std. dev.: 0.0189) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5026, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2255, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2813, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5794, std. dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.20% (2.4764 => 2.3972, std. dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5631, std. dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/ary2: -10.37% (0.2402 => 0.2153, std. dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7947, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7969, std. dev.: 0.0022) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -2.71% (17.2379 => 16.7716, std. dev.: 0.0431) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9667, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 16:27:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 18:27:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120820232727.8E2C12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3065?compare_to=3062&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3065, Order: 162229, Start Time: 2012-08-20 22:14:39, End Time: 2012-08-20 23:28:18 To: 3062, Order: 162219, Start Time: 2012-08-20 20:33:27, End Time: 2012-08-20 21:47:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.40% (2.0176 => 2.3081, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 10.45% (0.5818 => 0.6426, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.19% (0.5748 => 0.6334, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3578 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.36% (0.7061 => 0.7722, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 9.33% (0.3601 => 0.3937, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.31% (0.3663 => 0.4004, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.30% (0.3646 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3650 => 0.3988, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.25% (0.3623 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.11% (0.3789 => 0.4134, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.83% (0.3940 => 0.4288, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.26% (0.4328 => 0.4642, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 7.25% (0.7038 => 0.7548, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.19% (1.3693 => 1.4677, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.12% (3.9660 => 4.2483, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.7710 => 0.8255, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.87% (0.2781 => 0.2972, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.83% (0.2782 => 0.2972, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2607 => 0.2778, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.43% (0.2690 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.37% (0.2937 => 0.3124, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.3899 => 0.4147, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2696 => 0.2865, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.19% (0.9199 => 0.9768, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.16% (0.2726 => 0.2894, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.10% (0.2966 => 0.3147, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.04% (1.2193 => 1.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.03% (0.3485 => 0.3695, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.6959 => 0.7377, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.00% (1.9828 => 2.1017, std. dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2761 => 0.2925, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.93% (0.3489 => 0.3696, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.87% (0.3149 => 0.3334, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.84% (0.3580 => 0.3789, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3246 => 0.3431, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.69% (0.2988 => 0.3158, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.5577 => 0.5887, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2127 => 0.2245, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.52% (0.3534 => 0.3729, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.48% (13.8202 => 14.5781, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.38% (0.4016 => 0.4232, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.38% (0.4390 => 0.4626, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.25% (1.4563 => 1.5327, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.22% (0.3293 => 0.3465, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.12% (1.1364 => 1.1946, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.04% (7.2180 => 7.5817, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.03% (1.3819 => 1.4514, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.96% (1.3813 => 1.4498, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 4.84% (3.8646 => 4.0517, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.75% (1.1061 => 1.1586, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (1.3245 => 1.3868, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 4.66% (0.8310 => 0.8697, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.64% (1.2292 => 1.2862, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.7460 => 0.7801, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.51% (1.0594 => 1.1072, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.49% (0.7506 => 0.7843, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.39% (1.9270 => 2.0116, std. dev.: 0.0054) MultiSource/Applications/siod/siod: 4.24% (2.1791 => 2.2715, std. dev.: 0.0154) MultiSource/Applications/kimwitu++/kc: 4.19% (16.6129 => 17.3088, std. dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3755 => 0.3912, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.15% (0.4791 => 0.4990, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.98% (13.2842 => 13.8133, std. dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3220 => 0.3347, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (4.4433 => 4.6172, std. dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.3801 => 4.5480, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.82% (0.6283 => 0.6523, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8085, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (4.9865 => 5.1656, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.55% (0.3131 => 0.3242, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6135 => 0.6349, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.43% (3.1889 => 3.2983, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.38% (0.8698 => 0.8992, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.21% (1.1333 => 1.1697, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.05% (8.4961 => 8.7550, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 3.02% (16.2614 => 16.7520, std. dev.: 0.0171) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (6.5754 => 6.7608, std. dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2664, std. dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 2.75% (14.5298 => 14.9288, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.72% (3.2742 => 3.3632, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.60% (0.4113 => 0.4220, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.59% (1.5188 => 1.5581, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.40% (4.6629 => 4.7749, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.1007 => 2.1445, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 1.92% (0.6250 => 0.6370, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.64% (1.0313 => 1.0482, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9108 => 0.9252, std. dev.: 0.0041) MultiSource/Applications/lua/lua: 1.44% (3.7467 => 3.8005, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2654, std. dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 8.86% (1.2998 => 1.4150, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7423, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.06% (1.7081 => 1.7774, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6011, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.92% (10.7476 => 10.9543, std. dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6763, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3254, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (1.5089 => 1.5291, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.18% (26.5159 => 26.8298, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.95% (0.4657 => 0.4054, std. dev.: 0.0182) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.01% (22.5627 => 21.2064, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -4.52% (1.1560 => 1.1038, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3183, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6032, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.14% (3.0263 => 2.9616, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2270, std. dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: -1.99% (7.3305 => 7.1844, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.30% (9.9194 => 9.7909, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3631, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.12% (20.3410 => 20.1140, std. dev.: 0.0415) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 16:48:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 18:48:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120820234853.57AB32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3066?compare_to=3063&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3066, Order: 162232, Start Time: 2012-08-20 22:30:45, End Time: 2012-08-20 23:49:44 To: 3063, Order: 162221, Start Time: 2012-08-20 20:43:59, End Time: 2012-08-20 22:02:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (93 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (746 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.16% (14.0080 => 14.3112, std. dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.04% (10.3673 => 14.3112, std. dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.41% (1.1194 => 1.2471, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.67% (0.3497 => 0.3870, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3694 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.78% (0.3927 => 0.4311, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.21% (2.2022 => 2.3829, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.21% (1.7609 => 1.8878, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.60% (0.5925 => 0.6316, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.47% (0.6030 => 0.6420, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 6.30% (10.4361 => 11.0934, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.86% (0.2065 => 0.2186, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: 5.45% (0.7326 => 0.7725, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.83% (7.0540 => 7.3946, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.79% (0.4615 => 0.4836, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 4.66% (0.3282 => 0.3435, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.8172 => 0.8547, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 4.57% (0.7433 => 0.7773, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.40% (0.2271 => 0.2371, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (9.4845 => 9.8687, std. dev.: 0.0165) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.01% (0.3121 => 0.3246, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.97% (4.2646 => 4.4341, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5569 => 0.5785, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.78% (4.9449 => 5.1319, std. dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (5.0018 => 5.1888, std. dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.55% (8.1363 => 8.4254, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.49% (1.3050 => 1.3506, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 3.37% (5.7591 => 5.9533, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.31% (0.3441 => 0.3555, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 3.14% (0.7835 => 0.8081, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.13% (0.9765 => 1.0071, std. dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.13% (1.5415 => 1.5897, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.8067 => 0.8317, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 3.08% (3.3354 => 3.4380, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.08% (0.5105 => 0.5262, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1986, std. dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.93% (1.1861 => 1.2208, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.87% (2.0273 => 2.0854, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.82% (0.3650 => 0.3753, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.69% (3.8723 => 3.9763, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.59% (1.5603 => 1.6007, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (2.0665 => 2.1200, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.56% (0.6675 => 0.6846, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4620 => 0.4738, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4636 => 0.4754, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.53% (17.1811 => 17.6157, std. dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.51% (0.6450 => 0.6612, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6456 => 0.6618, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.49% (14.3668 => 14.7245, std. dev.: 0.0294) MultiSource/Applications/siod/siod: 2.39% (2.2969 => 2.3519, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.5981 => 0.6121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8921 => 0.9120, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.20% (1.4186 => 1.4498, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.18% (1.2842 => 1.3122, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5020 => 0.5122, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2050, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (2.2024 => 2.2389, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.54% (1.0722 => 1.0887, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.95% (4.2280 => 4.4371, std. dev.: 0.0096) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7556, std. dev.: 0.0051) MultiSource/Applications/lua/lua: 3.03% (26.0924 => 26.8839, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash2: 1.78% (3.1578 => 3.2141, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3342, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2352, std. dev.: 0.0081) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5818, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.00% (2.6546 => 2.6812, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.56% (5.2763 => 3.1360, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7129, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7103, std. dev.: 0.0104) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1195, std. dev.: 0.0302) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.78% (2.9384 => 2.5335, std. dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -12.05% (22.1758 => 19.5029, std. dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2373 => 1.1031, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -9.13% (1.5373 => 1.3969, std. dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.07% (1.5835 => 1.5032, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4682, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4336, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9941, std. dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9655, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3342, std. dev.: 0.0092) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 18:08:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 20:08:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821010835.E2A8E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3067?compare_to=3065&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3067, Order: 162238, Start Time: 2012-08-20 23:55:42, End Time: 2012-08-21 01:09:25 To: 3065, Order: 162229, Start Time: 2012-08-20 22:14:39, End Time: 2012-08-20 23:28:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.84% (77.8450 => 80.0523, std. dev.: 0.6646) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.81% (2.0176 => 2.2963, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.68% (0.5818 => 0.6381, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5748 => 0.6297, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7061 => 0.7682, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.30% (0.3578 => 0.3875, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.17% (0.3646 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.14% (0.3601 => 0.3894, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.00% (0.3650 => 0.3942, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3623 => 0.3912, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.94% (0.3789 => 0.4090, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.66% (0.3940 => 0.4242, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.37% (0.4328 => 0.4647, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4674, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7038 => 0.7542, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (3.9660 => 4.2493, std. dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 7.08% (0.2781 => 0.2978, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.05% (0.2782 => 0.2978, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.7710 => 0.8251, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.89% (0.5265 => 0.5628, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.2721 => 0.2908, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4062 => 0.4333, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2726 => 0.2905, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.47% (0.2765 => 0.2944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.2966 => 0.3158, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.43% (0.2628 => 0.2797, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.38% (0.2760 => 0.2936, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.37% (0.3485 => 0.3707, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.3899 => 0.4147, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.32% (0.3149 => 0.3348, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.31% (1.9828 => 2.1079, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3107 => 0.3303, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.31% (0.3489 => 0.3709, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.20% (0.3580 => 0.3802, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.10% (0.9199 => 0.9760, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.09% (1.2193 => 1.2936, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4379 => 0.4644, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.2988 => 0.3166, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.92% (0.6959 => 0.7371, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.91% (0.3453 => 0.3657, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3192 => 0.3378, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.4390 => 0.4641, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3246 => 0.3431, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.60% (0.3534 => 0.3732, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2127 => 0.2246, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.54% (0.5577 => 0.5886, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.53% (0.4016 => 0.4238, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.50% (0.3293 => 0.3474, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 5.45% (13.8202 => 14.5736, std. dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (0.3756 => 0.3959, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (1.4563 => 1.5325, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3868 => 0.4070, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.19% (0.2023 => 0.2128, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.15% (1.1364 => 1.1949, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.2925 => 0.3075, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.09% (7.2180 => 7.5853, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 4.85% (1.2292 => 1.2888, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.81% (1.3813 => 1.4477, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 4.79% (0.8310 => 0.8708, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.77% (3.8646 => 4.0490, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.73% (1.3245 => 1.3872, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 4.73% (1.1061 => 1.1584, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.72% (1.3819 => 1.4471, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.53% (0.7460 => 0.7798, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.47% (1.0594 => 1.1068, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.44% (0.7506 => 0.7839, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3755 => 0.3918, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.29% (1.9270 => 2.0096, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 4.25% (2.1791 => 2.2718, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.20% (0.4791 => 0.4992, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.10% (16.6129 => 17.2935, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.07% (0.3220 => 0.3351, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (4.4433 => 4.6232, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.04% (4.3801 => 4.5571, std. dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (13.2842 => 13.7992, std. dev.: 0.0298) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.6283 => 0.6521, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.78% (3.6692 => 3.8079, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.68% (0.6135 => 0.6361, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.67% (0.3131 => 0.3246, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.52% (4.9865 => 5.1620, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.8698 => 0.9002, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.42% (3.1889 => 3.2979, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1333 => 1.1692, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.06% (16.2614 => 16.7593, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (8.4961 => 8.7559, std. dev.: 0.0136) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.89% (14.8535 => 15.2827, std. dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: 2.87% (6.5754 => 6.7644, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5188 => 1.5603, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 2.71% (14.5298 => 14.9240, std. dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 2.68% (4.6629 => 4.7877, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (3.2742 => 3.3607, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.12% (2.1007 => 2.1452, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (0.9108 => 0.9273, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.76% (0.6744 => 0.6863, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.54% (3.7467 => 3.8043, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7648, std. dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5118, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.13% (1.8175 => 2.2560, std. dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 8.79% (1.2998 => 1.4141, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7426, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.30% (1.9199 => 1.9833, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.77% (1.7688 => 1.8178, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5959, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.13% (10.7476 => 10.9760, std. dev.: 0.0181) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5928 => 4.6730, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5089 => 1.5295, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.20% (26.5159 => 26.8338, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1837, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -14.00% (0.4657 => 0.4005, std. dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.03% (22.5627 => 21.2030, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.23% (1.2308 => 1.1049, std. dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.61% (1.1560 => 1.1027, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.88% (0.4867 => 0.4678, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5932, std. dev.: 0.0119) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9285, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9632, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2265, std. dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2036, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9918, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (84.4286 => 83.3470, std. dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.18% (5.5401 => 5.4750, std. dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.14% (20.3410 => 20.1086, std. dev.: 0.0304) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 18:35:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 20:35:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821013524.0E2DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3068?compare_to=3066&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3068, Order: 162245, Start Time: 2012-08-21 00:17:15, End Time: 2012-08-21 01:36:14 To: 3066, Order: 162232, Start Time: 2012-08-20 22:30:45, End Time: 2012-08-20 23:49:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (88 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (749 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.47% (14.3112 => 13.8147, std. dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: -1.02% (11.0934 => 10.9802, std. dev.: 0.0113) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.25% (10.3673 => 13.8147, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.64% (1.1194 => 1.2497, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.23% (0.3473 => 0.3863, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.01% (0.3497 => 0.3882, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.17% (0.1432 => 0.1549, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.67% (2.2022 => 2.3712, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.01% (1.7609 => 1.8843, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.55% (0.5925 => 0.6313, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.6030 => 0.6418, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.98% (0.7326 => 0.7764, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.29% (0.3177 => 0.3345, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.21% (10.4361 => 10.9802, std. dev.: 0.0113) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.8172 => 0.8578, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.61% (7.0540 => 7.3793, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.49% (0.4615 => 0.4822, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.09% (0.7433 => 0.7737, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 4.02% (0.3282 => 0.3414, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5569 => 0.5775, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.58% (9.4845 => 9.8241, std. dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.57% (4.9449 => 5.1213, std. dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.5860 => 0.6062, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.45% (5.0018 => 5.1742, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.44% (4.2646 => 4.4112, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 3.29% (0.4289 => 0.4430, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.4636 => 0.4788, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.25% (8.1363 => 8.4005, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.07% (1.3050 => 1.3450, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 3.01% (0.3423 => 0.3526, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.88% (5.7591 => 5.9252, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.82% (0.7835 => 0.8056, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.78% (0.9765 => 1.0036, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.76% (1.5415 => 1.5841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3865 => 0.3969, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.62% (2.0665 => 2.1206, std. dev.: 0.0052) MultiSource/Applications/Burg/burg: 2.60% (1.1642 => 1.1945, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (0.4064 => 0.4169, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.53% (0.5105 => 0.5234, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4196, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4620 => 0.4732, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.40% (1.5603 => 1.5977, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.34% (1.1861 => 1.2139, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.34% (2.0273 => 2.0748, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6456 => 0.6607, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6450 => 0.6596, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.24% (0.5981 => 0.6115, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 2.13% (1.2842 => 1.3116, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (14.3668 => 14.6627, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 2.06% (3.8723 => 3.9519, std. dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 1.83% (17.1811 => 17.4962, std. dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.4186 => 1.4439, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.70% (1.5859 => 1.6129, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.55% (2.2969 => 2.3326, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.22% (1.1840 => 1.1985, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.14% (2.2024 => 2.2276, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9573, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.99% (4.2280 => 4.4391, std. dev.: 0.0142) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.04% (26.0924 => 26.8844, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7485, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2118, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2398, std. dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.35% (1.3045 => 1.3221, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.5086 => 1.5270, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2067, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1239, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1466, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7030, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7069, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1421, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.55% (2.9384 => 2.5402, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -12.51% (22.1758 => 19.4021, std. dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.36% (3.8922 => 3.8392, std. dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2373 => 1.1054, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -8.63% (1.5373 => 1.4047, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.07% (1.5835 => 1.5032, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4617, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4255, std. dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0128, std. dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (8.1563 => 7.9532, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3467, std. dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0084) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8126, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (1.6805 => 1.6632, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 19:14:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 21:14:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120821021447.E67DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3069?compare_to=3064&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3069, Order: 162238, Start Time: 2012-08-20 23:32:14, End Time: 2012-08-21 02:15:36 To: 3064, Order: 162216, Start Time: 2012-08-20 20:21:45, End Time: 2012-08-20 23:04:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (113 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 949 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 243.62% (2.8920 => 9.9376, std. dev.: 0.0229) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 31.55% (56.9399 => 74.9038, std. dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/ary: 7.98% (0.2104 => 0.2272, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/treeadd/treeadd: 1.58% (10.7585 => 10.9285, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.26% (1.7041 => 1.6826, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3496 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.19% (0.3446 => 0.3866, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.14% (0.3442 => 0.3860, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.12% (0.3465 => 0.3885, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.11% (0.3460 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.04% (0.3488 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3469 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.62% (0.3650 => 0.4074, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.56% (0.3643 => 0.4064, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3724 => 0.4141, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.47% (0.5826 => 0.6261, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 7.18% (0.5889 => 0.6312, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.08% (1.6211 => 1.7196, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.72% (0.7171 => 0.7581, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 5.61% (1.5932 => 1.6826, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.56% (3.5627 => 3.7609, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.28% (1.3152 => 1.3847, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (0.4361 => 0.4590, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (0.5900 => 0.6202, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (0.5026 => 0.5276, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.76% (0.3930 => 0.4117, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (0.4994 => 0.5226, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 4.61% (1.0781 => 1.1278, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 4.59% (4.2109 => 4.4043, std. dev.: 0.0197) MultiSource/Applications/spiff/spiff: 4.49% (0.4029 => 0.4210, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (0.5000 => 0.5220, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.09% (0.2813 => 0.2928, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 4.05% (0.2714 => 0.2824, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 4.00% (0.2823 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.98% (0.2792 => 0.2903, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.97% (0.4658 => 0.4843, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3195 => 0.3321, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.92% (0.2729 => 0.2836, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.92% (0.9909 => 1.0297, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 3.89% (0.3004 => 0.3121, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2750 => 0.2856, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2803 => 0.2911, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.83% (5.5417 => 5.7542, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.80% (2.0673 => 2.1458, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3060 => 0.3175, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 3.70% (0.2811 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.68% (0.3096 => 0.3210, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.68% (0.2911 => 0.3018, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (2.1013 => 2.1772, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (0.3890 => 0.4029, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 3.56% (0.3317 => 0.3435, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.54% (0.3362 => 0.3481, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.53% (0.3258 => 0.3373, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3267 => 0.3382, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.51% (1.9694 => 2.0386, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.50% (23.5202 => 24.3427, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.50% (1.9966 => 2.0664, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (1.8794 => 1.9448, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3348 => 0.3464, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.44% (0.3282 => 0.3395, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.35% (0.3726 => 0.3851, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.34% (2.7292 => 2.8203, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.34% (0.3625 => 0.3746, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.3271 => 0.3380, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 3.32% (4.6177 => 4.7710, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3477 => 0.3592, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.3678 => 0.3797, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.18% (0.3903 => 0.4027, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 3.17% (2.1653 => 2.2340, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (4.4195 => 4.5595, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4251 => 0.4380, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.4146 => 0.4271, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3690 => 0.3801, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.99% (1.4269 => 1.4696, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.97% (0.9697 => 0.9985, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 2.87% (0.7875 => 0.8101, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.79% (0.6634 => 0.6819, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.78% (0.4139 => 0.4254, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.74% (0.3981 => 0.4090, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.3845 => 0.3949, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 2.56% (0.5546 => 0.5688, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.5012 => 0.5129, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.32% (0.6435 => 0.6584, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.83% (2.0346 => 2.0719, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.07% (0.2122 => 0.2272, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6707, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 5.09% (1.8057 => 1.8976, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1679, std. dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 4.08% (14.0481 => 14.6207, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1979, std. dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.89% (41.7953 => 42.5873, std. dev.: 0.0322) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5066, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.74% (2.0820 => 2.1182, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5922, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2853, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5967, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.31% (2.4764 => 2.3696, std. dev.: 0.0175) MultiSource/Applications/kimwitu++/kc: -1.11% (11.9555 => 11.8225, std. dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5749, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.69% (3.3665 => 3.2422, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8005, std. dev.: 0.0041) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8339, std. dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9689, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 4.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 19:50:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 21:50:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821025006.4FB032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3070?compare_to=3067&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3070, Order: 162249, Start Time: 2012-08-21 01:36:58, End Time: 2012-08-21 02:50:56 To: 3067, Order: 162238, Start Time: 2012-08-20 23:55:42, End Time: 2012-08-21 01:09:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (155 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (703 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.19% (1.4141 => 1.4309, std. dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.34% (2.0176 => 2.3069, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 12.35% (0.0826 => 0.0928, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.48% (0.5818 => 0.6428, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.39% (0.5748 => 0.6345, std. dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 9.53% (0.7061 => 0.7734, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.23% (0.3130 => 0.3419, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.06% (0.3578 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.71% (0.3650 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.68% (0.3789 => 0.4118, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.49% (0.4003 => 0.4343, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.30% (0.3940 => 0.4267, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.26% (0.1986 => 0.2150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.04% (0.4328 => 0.4676, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.98% (0.2782 => 0.3004, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (0.1413 => 0.1525, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.78% (1.3693 => 1.4759, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4062 => 0.4368, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2607 => 0.2803, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.43% (0.2690 => 0.2890, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.42% (0.2628 => 0.2823, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 7.42% (0.7038 => 0.7560, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.40% (3.9660 => 4.2595, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.7710 => 0.8276, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.31% (0.2721 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.19% (0.2726 => 0.2922, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2765 => 0.2963, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.14% (1.9828 => 2.1243, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2696 => 0.2886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3489 => 0.3732, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3899 => 0.4168, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.83% (0.3485 => 0.3723, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.79% (0.3580 => 0.3823, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.55% (0.3192 => 0.3401, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.43% (0.3453 => 0.3675, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.42% (0.9199 => 0.9790, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.36% (0.4390 => 0.4669, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.34% (1.2193 => 1.2966, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4379 => 0.4656, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.23% (0.3293 => 0.3498, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.20% (0.3756 => 0.3989, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.16% (0.6959 => 0.7388, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.13% (0.4016 => 0.4262, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.84% (0.3868 => 0.4094, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.82% (13.8202 => 14.6239, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.74% (0.5577 => 0.5897, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.74% (0.2127 => 0.2249, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.52% (0.1865 => 0.1968, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.50% (1.2292 => 1.2968, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2023 => 0.2134, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (1.4563 => 1.5360, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.36% (1.1364 => 1.1973, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/09-vor/vor: 5.33% (0.2925 => 0.3081, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.2914 => 0.3069, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.32% (7.2180 => 7.6017, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.30% (0.5637 => 0.5936, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.16% (3.8646 => 4.0639, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.11% (0.3755 => 0.3947, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.11% (1.3813 => 1.4519, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 5.11% (1.1061 => 1.1626, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 5.04% (0.2243 => 0.2356, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.03% (1.3819 => 1.4514, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.8310 => 0.8726, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.96% (0.7460 => 0.7830, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.89% (1.3245 => 1.3893, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.0594 => 1.1096, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.63% (1.9270 => 2.0163, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.52% (16.6129 => 17.3638, std. dev.: 0.0095) MultiSource/Applications/siod/siod: 4.47% (2.1791 => 2.2764, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.45% (0.4791 => 0.5004, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (13.2842 => 13.8692, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 4.32% (0.3220 => 0.3359, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.25% (4.4433 => 4.6322, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.3801 => 4.5653, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.07% (0.6283 => 0.6539, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.07% (3.6692 => 3.8187, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.04% (0.2995 => 0.3116, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.99% (4.9865 => 5.1854, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.90% (0.8698 => 0.9037, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.85% (0.6135 => 0.6371, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.83% (0.3131 => 0.3251, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.75% (3.1889 => 3.3085, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.37% (8.4961 => 8.7823, std. dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1712, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.12% (16.2614 => 16.7680, std. dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 3.09% (14.8535 => 15.3119, std. dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: 3.07% (6.5754 => 6.7770, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/05-eks/eks: 3.01% (0.4113 => 0.4237, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.97% (4.6629 => 4.8014, std. dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 2.93% (14.5298 => 14.9558, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.87% (1.5188 => 1.5624, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.2742 => 3.3642, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.1007 => 2.1522, std. dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/bigfib: 2.42% (0.6250 => 0.6401, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.97% (0.6744 => 0.6877, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.95% (1.0313 => 1.0514, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.90% (0.9108 => 0.9281, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.81% (3.7467 => 3.8145, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 1.31% (33.2944 => 33.7294, std. dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.02% (6.2785 => 6.3425, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5148, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.81% (1.8175 => 2.2685, std. dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 10.09% (1.2998 => 1.4309, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7423, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 3.52% (1.9199 => 1.9875, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0168) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5977, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.02% (10.7476 => 10.9645, std. dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5928 => 4.6757, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3249, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.28% (26.5159 => 26.8548, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (1.5089 => 1.5269, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.86% (22.5627 => 21.2395, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2308 => 1.1027, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3100, std. dev.: 0.0105) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1022, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5892, std. dev.: 0.0152) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9604, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2404, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2059, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3686, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4760, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 20:22:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 22:22:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821032207.E27182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3071?compare_to=3068&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3071, Order: 162249, Start Time: 2012-08-21 02:03:55, End Time: 2012-08-21 03:22:57 To: 3068, Order: 162245, Start Time: 2012-08-21 00:17:15, End Time: 2012-08-21 01:36:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (90 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (747 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.18% (10.9802 => 11.1100, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.36% (54.4333 => 55.7165, std. dev.: 0.4146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.07% (29.0658 => 29.6683, std. dev.: 0.0133) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.40% (10.3673 => 13.7263, std. dev.: 0.0314) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.11% (1.1194 => 1.2438, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.38% (0.1432 => 0.1552, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.59% (2.2022 => 2.3693, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.45% (0.1892 => 0.2033, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.68% (1.7609 => 1.8785, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.46% (10.4361 => 11.1100, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 5.90% (0.6030 => 0.6386, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.29% (0.3177 => 0.3345, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.01% (0.7326 => 0.7693, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.79% (0.4615 => 0.4836, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.8172 => 0.8560, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.57% (0.4879 => 0.5102, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.55% (7.0540 => 7.3748, std. dev.: 0.0245) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.54% (0.2271 => 0.2374, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (0.7433 => 0.7765, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 4.20% (0.3282 => 0.3420, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.90% (0.5569 => 0.5786, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (9.4845 => 9.8519, std. dev.: 0.0160) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.84% (5.0018 => 5.1940, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.9449 => 5.1341, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.2758 => 0.2861, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (4.2646 => 4.4209, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (0.3121 => 0.3230, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.40% (8.1363 => 8.4128, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.39% (1.3050 => 1.3492, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9446, std. dev.: 0.0121) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4636 => 0.4783, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.4103 => 0.4231, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 3.10% (0.3423 => 0.3529, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.08% (0.3441 => 0.3547, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.06% (0.9765 => 1.0064, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.5415 => 1.5865, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2195, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.81% (3.3354 => 3.4292, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3865 => 0.3973, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.79% (0.8067 => 0.8292, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.77% (1.1642 => 1.1965, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 2.74% (1.5603 => 1.6031, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.64% (0.3826 => 0.3927, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.60% (0.6450 => 0.6618, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0795, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.55% (0.5105 => 0.5235, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.49% (2.0665 => 2.1179, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.47% (0.5981 => 0.6129, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4620 => 0.4734, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6456 => 0.6609, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.35% (3.8723 => 3.9634, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.28% (0.6675 => 0.6827, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8921 => 0.9121, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.3668 => 14.6866, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2842 => 1.3125, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (1.4186 => 1.4491, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.10% (1.5859 => 1.6192, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.99% (17.1811 => 17.5225, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (2.2024 => 2.2339, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.34% (1.1840 => 1.1999, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.12% (1.0722 => 1.0842, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.88% (4.2280 => 4.4344, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (3.6395 => 3.7596, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.93% (26.0924 => 26.8579, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3342, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7990, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2371, std. dev.: 0.0245) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.18% (1.5086 => 1.5264, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.15% (6.6874 => 0.1238, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1464, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6903, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.11% (5.3526 => 3.6876, std. dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0964, std. dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.81% (2.9384 => 2.5326, std. dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: -12.42% (22.1758 => 19.4225, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.23% (3.8922 => 3.8442, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.75% (0.0400 => 0.0205, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -10.27% (1.2373 => 1.1102, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -8.15% (1.5373 => 1.4120, std. dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5046, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4655, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4315, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0011, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9608, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3451, std. dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8125, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 21:31:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 20 Aug 2012 23:31:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821043153.7742D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3072?compare_to=3070&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3072, Order: 162251, Start Time: 2012-08-21 03:18:30, End Time: 2012-08-21 04:32:42 To: 3070, Order: 162249, Start Time: 2012-08-21 01:36:58, End Time: 2012-08-21 02:50:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (704 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5785 => 56.5526, std. dev.: 0.0926) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.37% (2.0176 => 2.3075, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 12.35% (0.0826 => 0.0928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.42% (0.5818 => 0.6424, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.19% (0.5748 => 0.6334, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.52% (0.7061 => 0.7733, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.36% (0.3130 => 0.3423, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.89% (0.3601 => 0.3921, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.82% (0.3650 => 0.3972, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 8.78% (0.3623 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 8.53% (0.3914 => 0.4248, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.47% (0.4003 => 0.4342, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.93% (0.4328 => 0.4671, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.81% (1.3693 => 1.4762, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.57% (0.2655 => 0.2856, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.54% (0.7038 => 0.7569, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.52% (3.9660 => 4.2644, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4062 => 0.4366, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.46% (0.2628 => 0.2824, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.41% (0.2765 => 0.2970, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.35% (0.7710 => 0.8277, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.35% (0.2721 => 0.2921, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5265 => 0.5645, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.18% (1.9828 => 2.1251, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2966 => 0.3178, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.08% (0.3107 => 0.3327, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3489 => 0.3732, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.95% (0.3899 => 0.4170, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.94% (0.3485 => 0.3727, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.79% (0.3580 => 0.3823, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3453 => 0.3677, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.47% (0.4390 => 0.4674, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.39% (0.6959 => 0.7404, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.37% (0.9199 => 0.9785, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.33% (0.4379 => 0.4656, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.32% (1.2193 => 1.2963, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.28% (0.3246 => 0.3450, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.23% (0.3293 => 0.3498, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.20% (0.3756 => 0.3989, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.13% (0.4016 => 0.4262, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.5577 => 0.5907, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.92% (13.8202 => 14.6379, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.88% (0.2127 => 0.2252, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.79% (0.3868 => 0.4092, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.65% (0.1789 => 0.1890, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.54% (1.2292 => 1.2973, std. dev.: 0.0089) MultiSource/Benchmarks/McCat/09-vor/vor: 5.54% (0.2925 => 0.3087, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.49% (0.2023 => 0.2134, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.48% (1.4563 => 1.5361, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.41% (1.1364 => 1.1979, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.41% (7.2180 => 7.6082, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1865 => 0.1965, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.32% (0.5637 => 0.5937, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3755 => 0.3954, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.3813 => 1.4527, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.2914 => 0.3064, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.14% (0.8310 => 0.8737, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.11% (1.3245 => 1.3922, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.08% (1.1061 => 1.1623, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 5.05% (3.8646 => 4.0598, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.04% (1.3819 => 1.4516, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.80% (0.7460 => 0.7818, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.76% (1.0594 => 1.1098, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.75% (1.9270 => 2.0185, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.59% (16.6129 => 17.3762, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.55% (0.4791 => 0.5009, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.54% (2.1791 => 2.2780, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (13.2842 => 13.8741, std. dev.: 0.0179) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.37% (4.4433 => 4.6375, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 4.29% (0.3220 => 0.3358, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.26% (4.3801 => 4.5668, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.14% (0.6283 => 0.6543, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.08% (3.6692 => 3.8188, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1869, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.89% (0.8698 => 0.9036, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6135 => 0.6372, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.83% (0.3131 => 0.3251, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.73% (3.1889 => 3.3080, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.36% (8.4961 => 8.7815, std. dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 3.15% (16.2614 => 16.7730, std. dev.: 0.0258) MultiSource/Applications/JM/lencod/lencod: 3.12% (14.8535 => 15.3163, std. dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 3.09% (6.5754 => 6.7789, std. dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 2.99% (4.6629 => 4.8025, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.99% (14.5298 => 14.9638, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (1.5188 => 1.5630, std. dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.74% (3.2742 => 3.3639, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.48% (0.6250 => 0.6405, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1007 => 2.1517, std. dev.: 0.0119) MultiSource/Applications/lemon/lemon: 2.09% (1.0313 => 1.0529, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.96% (0.6744 => 0.6876, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.91% (3.7467 => 3.8184, std. dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.89% (0.9108 => 0.9280, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.36% (33.2944 => 33.7456, std. dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 24.92% (1.8175 => 2.2705, std. dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.36% (1.2998 => 1.4214, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8176, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5936, std. dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: 2.07% (10.7476 => 10.9706, std. dev.: 0.0439) MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.5928 => 4.6792, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3251, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.14% (1.5089 => 1.5261, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.10% (26.5159 => 26.8079, std. dev.: 0.0340) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.81% (22.5627 => 21.2514, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.54% (1.1560 => 1.1035, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5727, std. dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9283, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.25% (6.3560 => 6.2130, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: -2.14% (3.0263 => 2.9616, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2059, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3596, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.19% (5.5401 => 5.4741, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8709, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.11% (20.3410 => 20.1160, std. dev.: 0.0373) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2348, std. dev.: 0.0181) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 22:08:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 00:08:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821050853.257B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3073?compare_to=3071&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3073, Order: 162253, Start Time: 2012-08-21 03:50:31, End Time: 2012-08-21 05:09:42 To: 3071, Order: 162249, Start Time: 2012-08-21 02:03:55, End Time: 2012-08-21 03:22:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (733 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (13.7263 => 14.0684, std. dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.70% (10.3673 => 14.0684, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.00% (0.3516 => 0.3938, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.91% (0.3543 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.88% (0.3543 => 0.3964, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 8.59% (0.1432 => 0.1555, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.99% (2.2022 => 2.3782, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.31% (0.2065 => 0.2216, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.27% (1.7609 => 1.8889, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1892 => 0.2024, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.04% (0.6030 => 0.6394, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.88% (10.4361 => 11.0498, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference: 5.71% (0.7326 => 0.7744, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.95% (7.0540 => 7.4034, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.81% (0.4615 => 0.4837, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.49% (0.2271 => 0.2373, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.41% (0.7433 => 0.7761, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 4.39% (0.3282 => 0.3426, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (9.4845 => 9.8618, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3826 => 0.3978, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (4.9449 => 5.1390, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.83% (0.8172 => 0.8485, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (5.0018 => 5.1909, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.75% (0.3650 => 0.3787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.74% (0.2891 => 0.2999, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 3.72% (0.2714 => 0.2815, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (4.2646 => 4.4214, std. dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.4636 => 0.4806, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.58% (0.2905 => 0.3009, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.3136 => 0.3248, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4289 => 0.4440, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.1363 => 8.4150, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.42% (0.3865 => 0.3997, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.4103 => 0.4242, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.36% (1.3050 => 1.3488, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.29% (5.7591 => 5.9486, std. dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/ary2: 3.17% (0.3379 => 0.3486, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.17% (0.7835 => 0.8083, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 3.10% (0.3422 => 0.3528, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 3.10% (0.3423 => 0.3529, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (2.0665 => 2.1285, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 3.00% (0.3603 => 0.3711, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.99% (0.3441 => 0.3544, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 2.95% (0.3387 => 0.3487, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.94% (0.5105 => 0.5255, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.5415 => 1.5865, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.92% (0.9765 => 1.0050, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.4064 => 0.4182, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.90% (0.8067 => 0.8301, std. dev.: 0.0032) MultiSource/Applications/Burg/burg: 2.83% (1.1642 => 1.1971, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 2.82% (3.3354 => 3.4293, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4620 => 0.4748, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.6456 => 0.6630, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.1861 => 1.2171, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.60% (2.0273 => 2.0801, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.58% (0.6675 => 0.6847, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.58% (1.5603 => 1.6005, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 2.52% (0.4048 => 0.4150, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.42% (3.8723 => 3.9661, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 2.41% (1.2842 => 1.3151, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.31% (0.5981 => 0.6119, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5020 => 0.5128, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.09% (14.3668 => 14.6676, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (1.5859 => 1.6181, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.03% (17.1811 => 17.5298, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.4186 => 1.4473, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 1.97% (0.8921 => 0.9097, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.88% (2.2969 => 2.3400, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.2024 => 2.2369, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.47% (1.1840 => 1.2014, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.20% (4.2280 => 4.4479, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7505, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 2.97% (26.0924 => 26.8666, std. dev.: 0.0393) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2158, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.54% (3.2827 => 3.3334, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2489, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.28% (5.2763 => 3.1509, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7043, std. dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.73% (5.3526 => 3.7075, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0973, std. dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5470, std. dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: -12.35% (22.1758 => 19.4366, std. dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -10.78% (1.2373 => 1.1039, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -8.44% (1.5373 => 1.4075, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std. dev.: 0.0046) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4711, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4141, std. dev.: 0.0246) SingleSource/Benchmarks/Misc/salsa20: -2.89% (10.2830 => 9.9857, std. dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9594, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6778, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3459, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4239, std. dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.19% (1.8329 => 1.8110, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 22:25:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 00:25:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120821052555.74D442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3074?compare_to=3069&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3074, Order: 162249, Start Time: 2012-08-21 02:43:11, End Time: 2012-08-21 05:26:47 To: 3069, Order: 162238, Start Time: 2012-08-20 23:32:14, End Time: 2012-08-21 02:15:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.83% (1.6826 => 1.7134, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.04% (0.3496 => 0.3917, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3446 => 0.3859, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.95% (0.3465 => 0.3879, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3469 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.88% (0.3460 => 0.3871, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.87% (0.3488 => 0.3902, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3442 => 0.3849, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.42% (0.3650 => 0.4067, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3643 => 0.4057, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.06% (0.3724 => 0.4136, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.54% (1.5932 => 1.7134, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5826 => 0.6229, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.74% (0.5889 => 0.6286, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.1620 => 0.1726, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.41% (0.3792 => 0.4035, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 6.36% (0.1619 => 0.1722, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.93% (1.6211 => 1.7173, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.90% (1.3152 => 1.3928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (3.5627 => 3.7600, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 5.47% (0.7171 => 0.7563, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.42% (0.5900 => 0.6220, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.41% (0.5026 => 0.5298, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 5.28% (1.0781 => 1.1350, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.21% (0.4361 => 0.4588, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (0.3930 => 0.4128, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.03% (0.4994 => 0.5245, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 4.93% (4.2109 => 4.4187, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.90% (0.5000 => 0.5245, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.69% (0.4029 => 0.4218, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.55% (0.2792 => 0.2919, std. dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 4.43% (0.3004 => 0.3137, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.40% (0.2725 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.38% (0.2714 => 0.2833, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.29% (0.3195 => 0.3332, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 4.24% (5.5417 => 5.7764, std. dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 4.22% (0.9909 => 1.0327, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 4.22% (0.2750 => 0.2866, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.2823 => 0.2941, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.16% (2.0673 => 2.1534, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.16% (0.3124 => 0.3254, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.14% (0.2803 => 0.2919, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.14% (0.3625 => 0.3775, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.13% (0.2566 => 0.2672, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 4.12% (0.2813 => 0.2929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.10% (0.2780 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.09% (0.2811 => 0.2926, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.04% (0.3096 => 0.3221, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.02% (0.3282 => 0.3414, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.2911 => 0.3028, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.96% (0.3890 => 0.4044, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (1.9966 => 2.0749, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary2: 3.89% (0.3317 => 0.3446, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.89% (0.3060 => 0.3179, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.89% (0.9697 => 1.0074, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.89% (0.3267 => 0.3394, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (2.1013 => 2.1828, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3258 => 0.3384, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (0.4658 => 0.4837, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sieve: 3.78% (0.3726 => 0.3867, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.3362 => 0.3489, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.73% (0.3348 => 0.3473, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3678 => 0.3815, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.71% (1.9694 => 2.0425, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3477 => 0.3606, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.67% (2.1653 => 2.2447, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.66% (4.4195 => 4.5812, std. dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.61% (2.7292 => 2.8278, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4146 => 0.4292, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.3903 => 0.4040, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (1.8794 => 1.9447, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 3.42% (4.6177 => 4.7757, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3690 => 0.3815, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 3.36% (0.4251 => 0.4394, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.29% (23.5202 => 24.2941, std. dev.: 0.0236) MultiSource/Applications/lua/lua: 3.26% (1.4269 => 1.4734, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.21% (0.4139 => 0.4272, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.15% (0.6634 => 0.6843, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.12% (0.7875 => 0.8121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.3271 => 0.3372, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.3845 => 0.3961, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.86% (0.6435 => 0.6619, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.85% (0.5012 => 0.5155, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 2.81% (0.5546 => 0.5702, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.36% (2.0346 => 2.0827, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.52% (0.7426 => 0.7539, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6712, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 5.11% (1.8057 => 1.8980, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1655, std. dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6432, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1981, std. dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (41.7953 => 42.6120, std. dev.: 0.0094) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5072, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2800, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5999, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4478, std. dev.: 0.0939) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.80% (2.4764 => 2.3822, std. dev.: 0.0271) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5403, std. dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ary2: -10.24% (0.2402 => 0.2156, std. dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.56% (35.5013 => 32.8181, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7964, std. dev.: 0.0050) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.37% (0.6293 => 0.6144, std. dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -2.30% (17.2379 => 16.8411, std. dev.: 0.0847) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5710, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9569, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 23:14:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 01:14:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821061413.836B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3075?compare_to=3072&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3075, Order: 162254, Start Time: 2012-08-21 05:00:29, End Time: 2012-08-21 06:15:03 To: 3072, Order: 162251, Start Time: 2012-08-21 03:18:30, End Time: 2012-08-21 04:32:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (150 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.70% (81.0105 => 79.6320, std. dev.: 0.3521) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.41% (2.0176 => 2.3084, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.30% (0.5818 => 0.6417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.09% (0.5748 => 0.6328, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.67% (0.7061 => 0.7744, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.11% (1.3693 => 1.4803, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.91% (0.3601 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.84% (0.3789 => 0.4086, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.84% (0.3663 => 0.3950, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.78% (0.3650 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.66% (0.3914 => 0.4214, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.4003 => 0.4307, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.51% (0.4328 => 0.4653, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2782 => 0.2987, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7038 => 0.7554, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash: 7.29% (0.4062 => 0.4358, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.21% (0.7710 => 0.8266, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.10% (0.5265 => 0.5639, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (3.9660 => 4.2474, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.90% (0.2607 => 0.2787, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.84% (0.2765 => 0.2954, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.78% (0.3022 => 0.3227, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.59% (1.9828 => 2.1135, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.52% (0.2761 => 0.2941, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.51% (0.3489 => 0.3716, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.2988 => 0.3182, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (0.3149 => 0.3351, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.40% (0.3580 => 0.3809, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.20% (0.9199 => 0.9769, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.11% (0.3192 => 0.3387, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.05% (0.3453 => 0.3662, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.98% (0.6959 => 0.7375, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.97% (1.2193 => 1.2921, std. dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 5.89% (0.3293 => 0.3487, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.85% (0.3246 => 0.3436, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.78% (0.4016 => 0.4248, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.69% (13.8202 => 14.6066, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (0.3756 => 0.3969, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2127 => 0.2247, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.63% (0.2914 => 0.3078, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.58% (0.5577 => 0.5888, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (1.4563 => 1.5362, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 5.40% (0.3868 => 0.4077, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.1364 => 1.1951, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.13% (1.2292 => 1.2923, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (0.2945 => 0.3095, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (1.3813 => 1.4495, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.91% (7.2180 => 7.5722, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.5637 => 0.5912, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.85% (1.3819 => 1.4489, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3755 => 0.3936, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.81% (0.8310 => 0.8710, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.3245 => 1.3880, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 4.77% (1.1061 => 1.1589, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.74% (3.8646 => 4.0479, std. dev.: 0.0128) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.44% (1.0594 => 1.1064, std. dev.: 0.0022) MultiSource/Applications/spiff/spiff: 4.44% (0.7506 => 0.7839, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.7460 => 0.7788, std. dev.: 0.0043) MultiSource/Applications/treecc/treecc: 4.33% (1.9270 => 2.0105, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.26% (0.4791 => 0.4995, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.23% (16.6129 => 17.3164, std. dev.: 0.0138) MultiSource/Applications/siod/siod: 4.21% (2.1791 => 2.2709, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (13.2842 => 13.8215, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.94% (4.3801 => 4.5525, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.92% (0.6283 => 0.6529, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.88% (4.9865 => 5.1798, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8085, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.78% (4.4433 => 4.6113, std. dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.67% (0.6135 => 0.6360, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.64% (0.3131 => 0.3245, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.52% (0.8698 => 0.9004, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.51% (0.3245 => 0.3359, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.33% (3.1889 => 3.2950, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1333 => 1.1689, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7468, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.86% (16.2614 => 16.7265, std. dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 2.79% (4.6629 => 4.7930, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 2.79% (6.5754 => 6.7586, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 2.71% (14.8535 => 15.2563, std. dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: 2.71% (14.5298 => 14.9233, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5188 => 1.5593, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.66% (3.2742 => 3.3614, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1471, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.18% (0.6250 => 0.6386, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.72% (0.6744 => 0.6860, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (0.9108 => 0.9247, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.50% (3.7467 => 3.8030, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 1.06% (33.2944 => 33.6481, std. dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2687, std. dev.: 0.0509) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.26% (1.2998 => 1.4331, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (0.2093 => 0.2212, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7435, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.49% (10.7476 => 11.0156, std. dev.: 0.0370) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5984, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.84% (4.5928 => 4.6771, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3261, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.23% (26.5159 => 26.8426, std. dev.: 0.0194) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6866, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.68% (22.5627 => 21.2804, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2308 => 1.1034, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5107, std. dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.79% (1.3780 => 1.3120, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5800, std. dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9625, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2361, std. dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2047, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7923, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3580, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4758, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2329, std. dev.: 0.0169) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.06% (20.3410 => 20.1245, std. dev.: 0.0221) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 20 23:55:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 01:55:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821065548.3CBD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3076?compare_to=3073&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3076, Order: 162254, Start Time: 2012-08-21 05:37:23, End Time: 2012-08-21 06:56:37 To: 3073, Order: 162253, Start Time: 2012-08-21 03:50:31, End Time: 2012-08-21 05:09:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (101 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (736 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.98% (10.3673 => 13.9933, std. dev.: 0.0122) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 11.52% (0.3516 => 0.3921, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.28% (1.1194 => 1.2457, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std. dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions: 10.97% (0.3828 => 0.4248, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 8.66% (0.1432 => 0.1556, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.17% (2.2022 => 2.3821, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.85% (1.7609 => 1.8816, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.80% (0.6030 => 0.6440, std. dev.: 0.0071) SingleSource/UnitTests/ObjC++/Hello: 6.73% (0.5925 => 0.6324, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (10.4361 => 11.0282, std. dev.: 0.0144) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 5.66% (0.7326 => 0.7741, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3307 => 0.3475, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.01% (7.0540 => 7.4073, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.75% (0.4615 => 0.4834, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.53% (0.7433 => 0.7770, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.26% (0.8172 => 0.8520, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (9.4845 => 9.8705, std. dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.9449 => 5.1339, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.70% (0.5569 => 0.5775, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.70% (5.0018 => 5.1868, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.65% (0.2905 => 0.3011, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.64% (4.2646 => 4.4199, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.58% (0.4636 => 0.4802, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.57% (0.5860 => 0.6069, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.46% (0.4103 => 0.4245, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.44% (5.7591 => 5.9574, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.38% (8.1363 => 8.4111, std. dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (0.3121 => 0.3225, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.25% (1.3050 => 1.3474, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.19% (0.4289 => 0.4426, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.09% (0.7835 => 0.8077, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.08% (0.3865 => 0.3984, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.07% (0.3423 => 0.3528, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (2.0665 => 2.1285, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 2.97% (0.3603 => 0.3710, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.95% (0.3826 => 0.3939, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.91% (1.5415 => 1.5863, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.90% (0.5105 => 0.5253, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.85% (1.5603 => 1.6048, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (0.4064 => 0.4179, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.81% (0.9765 => 1.0039, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (0.4620 => 0.4748, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.75% (1.1642 => 1.1962, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (0.3935 => 0.4043, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4261, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.6456 => 0.6630, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.64% (0.6675 => 0.6851, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.1861 => 1.2170, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3175, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.43% (2.0273 => 2.0766, std. dev.: 0.0046) MultiSource/Applications/lua/lua: 2.32% (3.8723 => 3.9623, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.29% (0.6450 => 0.6598, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (14.3668 => 14.6688, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.06% (1.4186 => 1.4478, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.04% (0.8921 => 0.9103, std. dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 2.00% (17.1811 => 17.5246, std. dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.94% (1.5859 => 1.6167, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 1.83% (2.2969 => 2.3389, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (2.2024 => 2.2367, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.40% (1.1840 => 1.2006, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.16% (1.0722 => 1.0846, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.84% (4.2280 => 4.4326, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7585, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 2.88% (26.0924 => 26.8433, std. dev.: 0.0214) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3347, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2500, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.28% (1.5086 => 1.5279, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 1.26% (3.1578 => 3.1976, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6826, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1241, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.41% (5.2763 => 3.1443, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7074, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.79% (5.3526 => 3.7046, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0919, std. dev.: 0.0796) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.63% (2.9384 => 2.5380, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.37% (22.1758 => 19.4321, std. dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (3.8922 => 3.8466, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -11.15% (1.2373 => 1.0994, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -8.01% (1.5373 => 1.4142, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0012) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.25% (32.5116 => 31.4563, std. dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4268, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/salsa20: -2.92% (10.2830 => 9.9830, std. dev.: 0.0243) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9623, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3455, std. dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 00:58:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 02:58:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821075844.402022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/3077?compare_to=3075&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3077, Order: 162257, Start Time: 2012-08-21 06:42:30, End Time: 2012-08-21 07:59:31 To: 3075, Order: 162254, Start Time: 2012-08-21 05:00:29, End Time: 2012-08-21 06:15:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 2 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (745 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.84% (3.9397 => 3.7885, std. dev.: 0.0479) SingleSource/Benchmarks/Misc/mandel-2: -2.84% (1.4331 => 1.3924, std. dev.: 0.0142) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3060, std. dev.: 0.0604) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.5818 => 0.6359, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.12% (0.5748 => 0.6272, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7061 => 0.7692, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/trivial-interface: 7.97% (0.3578 => 0.3863, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.89% (0.3601 => 0.3885, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.86% (0.2721 => 0.2935, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-4: 7.73% (0.3646 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.67% (0.3623 => 0.3901, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3663 => 0.3943, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.64% (0.3650 => 0.3929, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 7.60% (0.3789 => 0.4077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.46% (1.3693 => 1.4715, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.31% (0.5265 => 0.5650, std. dev.: 0.0132) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.25% (0.7038 => 0.7548, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (3.9660 => 4.2474, std. dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/hash2: 7.07% (0.4328 => 0.4634, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4062 => 0.4332, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.14% (0.2607 => 0.2767, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 6.13% (0.2690 => 0.2855, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4390 => 0.4657, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.04% (0.2765 => 0.2932, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2655 => 0.2814, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2760 => 0.2922, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.80% (0.2726 => 0.2884, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2696 => 0.2851, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.72% (0.2761 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.62% (0.3149 => 0.3326, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.55% (13.8202 => 14.5877, std. dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.30% (0.3453 => 0.3636, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.29% (0.3192 => 0.3361, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.15% (0.3534 => 0.3716, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 5.04% (0.3293 => 0.3459, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.88% (1.1061 => 1.1601, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.3756 => 0.3939, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.81% (0.3868 => 0.4054, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.56% (0.7506 => 0.7848, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 4.48% (1.2292 => 1.2843, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.48% (0.7460 => 0.7794, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.2945 => 0.3074, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.29% (1.9270 => 2.0097, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.26% (0.4791 => 0.4995, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.22% (2.1791 => 2.2711, std. dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 4.05% (16.6129 => 17.2858, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.99% (0.3755 => 0.3905, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.9865 => 5.1752, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.77% (0.6283 => 0.6520, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.70% (0.6135 => 0.6362, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.67% (0.2995 => 0.3105, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.45% (3.1889 => 3.2990, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8698 => 0.8985, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.07% (1.1333 => 1.1681, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.99% (16.2614 => 16.7471, std. dev.: 0.0194) MultiSource/Benchmarks/mafft/pairlocalalign: 2.90% (8.4961 => 8.7425, std. dev.: 0.0393) MultiSource/Applications/oggenc/oggenc: 2.90% (4.6629 => 4.7980, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2706, std. dev.: 0.0146) MultiSource/Applications/JM/ldecod/ldecod: 2.71% (6.5754 => 6.7537, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5188 => 1.5594, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9129, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.63% (3.2742 => 3.3603, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (2.1007 => 2.1455, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.6250 => 0.6364, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.75% (0.6744 => 0.6862, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.72% (1.0313 => 1.0490, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.59% (0.9108 => 0.9253, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.50% (3.7467 => 3.8030, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2728, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.12% (1.2998 => 1.3924, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.00% (1.5824 => 1.6615, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.77% (1.7688 => 1.8178, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6026, std. dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 2.25% (10.7476 => 10.9892, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.5928 => 4.6790, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3257, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0390) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.22% (26.5159 => 26.8403, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1836, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5726, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.83% (22.5627 => 21.2467, std. dev.: 0.4923) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.53% (1.3780 => 1.3156, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.21% (0.4366 => 0.4182, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6077, std. dev.: 0.0783) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.34% (0.8342 => 0.8147, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9619, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2349, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std. dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7918, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (20.3410 => 20.1279, std. dev.: 0.0073) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2384, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 01:39:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 03:39:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120821083952.05FF22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3078?compare_to=3074&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3078, Order: 162254, Start Time: 2012-08-21 05:54:37, End Time: 2012-08-21 08:40:43 To: 3074, Order: 162249, Start Time: 2012-08-21 02:43:11, End Time: 2012-08-21 05:26:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (115 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 949 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.28% (2.8278 => 2.8639, std. dev.: 0.0074) MultiSource/Applications/ClamAV/clamscan: 1.21% (4.4187 => 4.4722, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.15% (2.0425 => 2.0660, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 1.11% (4.7757 => 4.8286, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.11% (54.2272 => 54.8303, std. dev.: 0.0287) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.17% (0.3446 => 0.3900, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3442 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3465 => 0.3917, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.00% (0.3469 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.98% (0.3460 => 0.3909, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.49% (0.3650 => 0.4106, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 12.43% (0.3643 => 0.4096, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.08% (0.3724 => 0.4174, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5826 => 0.6319, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.29% (0.5889 => 0.6377, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.41% (0.1619 => 0.1739, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.29% (1.5932 => 1.7093, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.82% (0.5026 => 0.5369, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.75% (1.6211 => 1.7306, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.75% (0.7171 => 0.7655, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.59% (3.5627 => 3.7974, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.50% (1.3152 => 1.4007, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.37% (0.4994 => 0.5312, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.23% (0.4029 => 0.4280, std. dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 6.21% (4.2109 => 4.4722, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.19% (0.4361 => 0.4631, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.17% (0.5900 => 0.6264, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.16% (0.5000 => 0.5308, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.15% (1.0781 => 1.1444, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (0.2014 => 0.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.06% (0.3930 => 0.4168, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2738 => 0.2899, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2875 => 0.3031, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.30% (0.2566 => 0.2702, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.2736 => 0.2877, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.09% (0.9909 => 1.0413, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2725 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2792 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.2780 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.01% (0.2714 => 0.2850, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.99% (0.2866 => 0.3009, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.98% (0.2750 => 0.2887, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.96% (5.5417 => 5.8168, std. dev.: 0.0108) SingleSource/Regression/C++/ofstream_ctor: 4.96% (0.3004 => 0.3153, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.95% (0.2729 => 0.2864, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.94% (2.7292 => 2.8639, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.91% (1.9694 => 2.0660, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.2823 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.89% (0.2803 => 0.2940, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.86% (1.9966 => 2.0936, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (0.4658 => 0.4884, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (0.3890 => 0.4078, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 4.76% (0.2813 => 0.2947, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.76% (2.0673 => 2.1657, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 4.73% (0.2811 => 0.2944, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.71% (2.1013 => 2.2003, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 4.65% (0.3096 => 0.3240, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.61% (2.1653 => 2.2651, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.61% (0.3060 => 0.3201, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.59% (0.3267 => 0.3417, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.3124 => 0.3267, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.57% (0.2911 => 0.3044, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.57% (4.6177 => 4.8286, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3362 => 0.3515, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3258 => 0.3406, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.48% (0.3348 => 0.3498, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3726 => 0.3892, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 4.40% (0.9697 => 1.0124, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.3282 => 0.3425, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.34% (0.3317 => 0.3461, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.30% (0.3678 => 0.3836, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.29% (0.3477 => 0.3626, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (1.8794 => 1.9592, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (4.4195 => 4.6071, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4146 => 0.4318, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 4.13% (1.4269 => 1.4859, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3690 => 0.3840, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.04% (0.3981 => 0.4142, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.04% (0.7875 => 0.8193, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.3903 => 0.4060, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.98% (0.6634 => 0.6898, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 3.98% (0.4251 => 0.4420, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.97% (0.2969 => 0.3087, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.84% (0.4139 => 0.4298, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.80% (0.5546 => 0.5757, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.77% (0.3845 => 0.3990, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.63% (0.3336 => 0.3457, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.38% (23.5202 => 24.3157, std. dev.: 0.0250) MultiSource/Applications/sqlite3/sqlite3: 2.61% (2.0346 => 2.0878, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (0.5361 => 0.5464, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (0.7426 => 0.7567, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.18% (11.6398 => 11.7773, std. dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0293, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6136, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6643, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1689, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6403, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2023, std. dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5055, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.77% (3.1722 => 3.2284, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4445, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2834, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5928, std. dev.: 0.0255) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5785, std. dev.: 0.0175) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8035, std. dev.: 0.1397) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std. dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7895, std. dev.: 0.0167) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0050) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/fldry: -2.38% (17.2379 => 16.8271, std. dev.: 0.0284) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5721, std. dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9590, std. dev.: 0.0676) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 01:46:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 03:46:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821084634.A84702A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3079?compare_to=3076&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3079, Order: 162257, Start Time: 2012-08-21 07:27:59, End Time: 2012-08-21 08:47:24 To: 3076, Order: 162254, Start Time: 2012-08-21 05:37:23, End Time: 2012-08-21 06:56:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (88 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.53% (0.5464 => 0.5326, std. dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.02% (10.3673 => 13.9979, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.78% (1.1194 => 1.2513, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 8.80% (0.1432 => 0.1558, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.41% (2.2022 => 2.3875, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.30% (1.7609 => 1.8894, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.20% (0.2065 => 0.2193, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5925 => 0.6285, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 5.92% (0.6030 => 0.6387, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.84% (10.4361 => 11.0452, std. dev.: 0.0304) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.11% (7.0540 => 7.4146, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.4879 => 0.5128, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 5.05% (0.7326 => 0.7696, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 4.94% (0.3282 => 0.3444, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.88% (0.4615 => 0.4840, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.84% (0.3307 => 0.3467, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.41% (0.8172 => 0.8532, std. dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (0.7433 => 0.7751, std. dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (9.4845 => 9.8691, std. dev.: 0.0168) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (5.0018 => 5.1978, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (4.9449 => 5.1363, std. dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.76% (4.2646 => 4.4250, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.70% (0.5860 => 0.6077, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 3.68% (0.7835 => 0.8123, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 3.50% (5.7591 => 5.9606, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.48% (8.1363 => 8.4191, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.3050 => 1.3475, std. dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.21% (0.8067 => 0.8326, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.10% (0.3423 => 0.3529, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.4289 => 0.4417, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.96% (0.3650 => 0.3758, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.95% (0.4103 => 0.4224, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.94% (0.5105 => 0.5255, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.92% (1.5415 => 1.5865, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9765 => 1.0049, std. dev.: 0.0069) MultiSource/Applications/d/make_dparser: 2.86% (3.3354 => 3.4308, std. dev.: 0.0044) MultiSource/Applications/Burg/burg: 2.78% (1.1642 => 1.1966, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.76% (0.6675 => 0.6859, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (1.1861 => 1.2177, std. dev.: 0.0044) MultiSource/Applications/treecc/treecc: 2.66% (2.0273 => 2.0813, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4636 => 0.4758, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 2.61% (1.5603 => 1.6010, std. dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.46% (2.0665 => 2.1174, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.40% (3.8723 => 3.9651, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.37% (0.6450 => 0.6603, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6456 => 0.6606, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (0.4620 => 0.4724, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (14.3668 => 14.6822, std. dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.18% (1.4186 => 1.4495, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.11% (17.1811 => 17.5428, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.06% (1.2842 => 1.3106, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.94% (2.2969 => 2.3415, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8921 => 0.9094, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.51% (2.2024 => 2.2357, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.41% (1.1840 => 1.2007, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.16% (1.0722 => 1.0846, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.00% (4.2280 => 4.4396, std. dev.: 0.0087) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7555, std. dev.: 0.0075) MultiSource/Applications/lua/lua: 3.02% (26.0924 => 26.8796, std. dev.: 0.0496) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3338, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2422, std. dev.: 0.0300) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7979, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.12% (1.3045 => 1.3191, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 1.09% (3.1578 => 3.1923, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1244, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.26% (5.2763 => 3.1520, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7169, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.49% (5.3526 => 3.7207, std. dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1325, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.25% (2.9384 => 2.5490, std. dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -12.32% (22.1758 => 19.4430, std. dev.: 0.0592) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.06% (3.8922 => 3.8510, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2373 => 1.1063, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.1396 => 1.0596, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -7.01% (1.5373 => 1.4296, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8485, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4736, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4066, std. dev.: 0.0202) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9928, std. dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (8.1563 => 7.9674, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3412, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 02:40:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 04:40:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821094044.00AA72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3080?compare_to=3077&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3080, Order: 162261, Start Time: 2012-08-21 08:27:25, End Time: 2012-08-21 09:41:33 To: 3077, Order: 162257, Start Time: 2012-08-21 06:42:30, End Time: 2012-08-21 07:59:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (145 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.13% (1.3924 => 1.4220, std. dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.26% (2.0176 => 2.3053, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 9.68% (0.5818 => 0.6381, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5748 => 0.6297, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.71% (0.7061 => 0.7676, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 7.97% (0.3578 => 0.3863, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 7.80% (0.3601 => 0.3882, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.73% (0.3646 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3650 => 0.3932, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.69% (0.7038 => 0.7579, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.59% (0.3623 => 0.3898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3789 => 0.4072, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.38% (1.3693 => 1.4704, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.29% (3.9660 => 4.2550, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4328 => 0.4641, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2781 => 0.2980, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.01% (0.2782 => 0.2977, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.99% (0.7710 => 0.8249, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.77% (0.4062 => 0.4337, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 6.62% (0.2628 => 0.2802, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.62% (0.3022 => 0.3222, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.48% (0.6959 => 0.7410, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.46% (0.3899 => 0.4151, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.46% (0.5577 => 0.5937, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.44% (0.2655 => 0.2826, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.40% (0.2937 => 0.3125, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.29% (0.2765 => 0.2939, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.24% (1.9828 => 2.1065, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3485 => 0.3701, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2696 => 0.2863, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.16% (0.9199 => 0.9766, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.16% (1.2193 => 1.2944, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.13% (0.3489 => 0.3703, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3580 => 0.3799, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2761 => 0.2928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3149 => 0.3337, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.91% (0.3246 => 0.3438, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 5.67% (13.8202 => 14.6036, std. dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/ary2: 5.61% (0.3192 => 0.3371, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.59% (0.3453 => 0.3646, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.52% (1.4563 => 1.5367, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.38% (0.3293 => 0.3470, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.35% (0.4016 => 0.4231, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.2914 => 0.3070, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3756 => 0.3955, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.25% (1.1364 => 1.1961, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.14% (0.8310 => 0.8737, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.09% (0.2023 => 0.2126, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.04% (0.5637 => 0.5921, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.03% (1.3813 => 1.4508, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.01% (1.1061 => 1.1615, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.01% (7.2180 => 7.5794, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.3245 => 1.3906, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/moments: 4.99% (0.3868 => 0.4061, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.98% (3.8646 => 4.0569, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 4.83% (1.2292 => 1.2886, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.80% (1.3819 => 1.4482, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2945 => 0.3085, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.73% (0.7506 => 0.7861, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.66% (0.7460 => 0.7808, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.57% (1.0594 => 1.1078, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 4.42% (2.1791 => 2.2755, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 4.40% (1.9270 => 2.0118, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.38% (0.4791 => 0.5001, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.37% (0.3755 => 0.3919, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.22% (16.6129 => 17.3146, std. dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (4.9865 => 5.1918, std. dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.09% (0.6135 => 0.6386, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (13.2842 => 13.8236, std. dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8162, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.3801 => 4.5552, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (4.4433 => 4.6198, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.88% (0.6283 => 0.6527, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.80% (0.3131 => 0.3250, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.8698 => 0.9002, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.46% (3.1889 => 3.2993, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.39% (0.3245 => 0.3355, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.20% (16.2614 => 16.7823, std. dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (8.4961 => 8.7672, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.1333 => 1.1692, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (6.5754 => 6.7698, std. dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: 2.91% (14.5298 => 14.9530, std. dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 2.84% (4.6629 => 4.7953, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 2.84% (14.8535 => 15.2748, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.74% (3.2742 => 3.3640, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5188 => 1.5603, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.1007 => 2.1486, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.19% (0.6744 => 0.6892, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6250 => 0.6371, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.77% (1.0313 => 1.0496, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 1.66% (3.7467 => 3.8088, std. dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5119, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2623, std. dev.: 0.0497) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.40% (1.2998 => 1.4220, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7437, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6011, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.23% (10.7476 => 10.9872, std. dev.: 0.0498) MultiSource/Applications/sqlite3/sqlite3: 1.83% (4.5928 => 4.6767, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3254, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5116, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (1.5089 => 1.5291, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.63% (22.5627 => 21.2933, std. dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3159, std. dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0219, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.74% (0.4867 => 0.4685, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5862, std. dev.: 0.0192) MultiSource/Benchmarks/Olden/bh/bh: -2.46% (1.9762 => 1.9276, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9603, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2297, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2069, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (84.4286 => 83.3732, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.05% (5.5401 => 5.4822, std. dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4358, std. dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 03:33:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 05:33:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821103318.27B142A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3081?compare_to=3079&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3081, Order: 162270, Start Time: 2012-08-21 09:15:08, End Time: 2012-08-21 10:34:08 To: 3079, Order: 162257, Start Time: 2012-08-21 07:27:59, End Time: 2012-08-21 08:47:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (731 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.16% (0.5326 => 0.5441, std. dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.88% (10.3673 => 13.9832, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3497 => 0.3909, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.37% (1.1194 => 1.2467, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.97% (0.3828 => 0.4248, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 8.94% (0.1432 => 0.1560, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.58% (2.2022 => 2.3692, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.13% (1.7609 => 1.8864, std. dev.: 0.0112) SingleSource/UnitTests/ObjC++/Hello: 6.43% (0.5925 => 0.6306, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 6.22% (0.6030 => 0.6405, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.53% (10.4361 => 11.0137, std. dev.: 0.0236) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.41% (0.7326 => 0.7722, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.22% (0.4615 => 0.4856, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.02% (0.3307 => 0.3473, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (7.0540 => 7.3846, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.58% (0.2271 => 0.2375, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.51% (0.4879 => 0.5099, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.31% (0.8172 => 0.8524, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 4.14% (0.3282 => 0.3418, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (9.4845 => 9.8703, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.5860 => 0.6098, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.04% (0.5569 => 0.5794, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.94% (0.2891 => 0.3005, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (5.0018 => 5.1987, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.91% (4.2646 => 4.4315, std. dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.9449 => 5.1350, std. dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.2905 => 0.3015, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.65% (1.3050 => 1.3526, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.62% (8.1363 => 8.4305, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/methcall: 3.51% (0.2877 => 0.2978, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.49% (0.3441 => 0.3561, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.45% (0.4289 => 0.4437, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 3.42% (0.3098 => 0.3204, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.41% (0.3052 => 0.3156, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3865 => 0.3996, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.9765 => 1.0092, std. dev.: 0.0064) MultiSource/Applications/spiff/spiff: 3.31% (0.7835 => 0.8094, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 3.30% (0.3422 => 0.3535, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.29% (0.3162 => 0.3266, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.27% (0.3180 => 0.3284, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3650 => 0.3769, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.21% (2.0665 => 2.1329, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.3423 => 0.3531, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9397, std. dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 3.10% (0.3387 => 0.3492, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 3.05% (0.3603 => 0.3713, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3283 => 0.3383, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.03% (1.5415 => 1.5882, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 3.01% (1.1642 => 1.1992, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.01% (0.3826 => 0.3941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.97% (3.3354 => 3.4345, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3684 => 0.3791, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.4064 => 0.4182, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 2.84% (2.0273 => 2.0848, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.83% (0.4203 => 0.4322, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2196, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (0.5105 => 0.5249, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.81% (0.8067 => 0.8294, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 2.81% (0.4620 => 0.4750, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6036, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 2.71% (3.8723 => 3.9773, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.6456 => 0.6627, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.62% (0.6675 => 0.6850, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.59% (0.6450 => 0.6617, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.58% (1.2842 => 1.3173, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.57% (0.4048 => 0.4152, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.52% (0.5981 => 0.6132, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.47% (14.3668 => 14.7219, std. dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.45% (1.4186 => 1.4533, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.25% (17.1811 => 17.5675, std. dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.5020 => 0.5131, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.15% (0.8921 => 0.9113, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0070) MultiSource/Applications/siod/siod: 2.03% (2.2969 => 2.3435, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2049, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.52% (0.7115 => 0.7223, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.41% (1.0722 => 1.0873, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.16% (4.2280 => 4.4460, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 2.94% (26.0924 => 26.8599, std. dev.: 0.0286) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2412, std. dev.: 0.0149) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (1.3045 => 1.3209, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 1.25% (3.1578 => 3.1972, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.51% (5.2763 => 3.1391, std. dev.: 0.0132) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.33% (5.3855 => 3.6982, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.84% (5.3526 => 3.7017, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1447, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5436, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4544, std. dev.: 0.0411) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -10.63% (1.2373 => 1.1058, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -6.99% (1.5373 => 1.4298, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4724, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4130, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9895, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9649, std. dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3509, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4234, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8129, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 04:22:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 06:22:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821112256.686F32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3082?compare_to=3080&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3082, Order: 162271, Start Time: 2012-08-21 10:09:22, End Time: 2012-08-21 11:23:48 To: 3080, Order: 162261, Start Time: 2012-08-21 08:27:25, End Time: 2012-08-21 09:41:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (147 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5820 => 56.4917, std. dev.: 0.0577) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.46% (79.1538 => 81.0995, std. dev.: 0.1909) SingleSource/Benchmarks/Misc/fbench: 1.64% (2.2623 => 2.2995, std. dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.77% (2.0176 => 2.2955, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.5818 => 0.6340, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.77% (0.5748 => 0.6252, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.3130 => 0.3404, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.61% (0.7061 => 0.7669, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3578 => 0.3881, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.28% (0.3646 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 8.20% (0.3623 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.11% (0.3650 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/property: 7.87% (0.3940 => 0.4250, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5265 => 0.5661, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.31% (1.3693 => 1.4694, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 7.30% (0.4328 => 0.4644, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.26% (0.7710 => 0.8270, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (3.9660 => 4.2471, std. dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 7.08% (0.7038 => 0.7536, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.97% (0.2782 => 0.2976, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.90% (0.2781 => 0.2973, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.82% (0.4062 => 0.4339, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.61% (0.2937 => 0.3131, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.58% (0.2690 => 0.2867, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2607 => 0.2777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2765 => 0.2945, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.51% (0.2628 => 0.2799, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3022 => 0.3215, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.37% (0.9199 => 0.9785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.31% (1.9828 => 2.1080, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.27% (0.6959 => 0.7395, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.3899 => 0.4143, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.24% (0.2726 => 0.2896, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2696 => 0.2863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.18% (0.3107 => 0.3299, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3489 => 0.3704, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4390 => 0.4657, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.05% (0.3485 => 0.3696, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2761 => 0.2928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3149 => 0.3339, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.2193 => 1.2924, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3580 => 0.3793, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3192 => 0.3379, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.3756 => 0.3975, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.64% (1.4563 => 1.5384, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.54% (13.8202 => 14.5861, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.49% (0.5577 => 0.5883, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.44% (0.2023 => 0.2133, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 5.43% (0.3534 => 0.3726, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.41% (0.3293 => 0.3471, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.33% (0.4016 => 0.4230, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.31% (0.2127 => 0.2240, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.11% (1.1364 => 1.1945, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.09% (0.8310 => 0.8733, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.07% (0.3868 => 0.4064, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 4.95% (1.2292 => 1.2901, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (7.2180 => 7.5755, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5637 => 0.5915, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 4.90% (0.2243 => 0.2353, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.90% (1.3245 => 1.3894, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 4.87% (3.8646 => 4.0528, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.85% (1.3813 => 1.4483, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.79% (1.3819 => 1.4481, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.79% (0.7460 => 0.7817, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.72% (0.2945 => 0.3084, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0025) MultiSource/Applications/Burg/burg: 4.62% (1.1061 => 1.1572, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.0594 => 1.1069, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 4.45% (1.9270 => 2.0127, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3755 => 0.3920, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 4.15% (2.1791 => 2.2696, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.06% (0.6135 => 0.6384, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.97% (4.3801 => 4.5538, std. dev.: 0.0202) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (4.4433 => 4.6177, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.4791 => 0.4977, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.88% (13.2842 => 13.7990, std. dev.: 0.0242) MultiSource/Applications/kimwitu++/kc: 3.86% (16.6129 => 17.2538, std. dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.84% (3.6692 => 3.8101, std. dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.69% (0.6283 => 0.6515, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.40% (0.8698 => 0.8994, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (4.9865 => 5.1543, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 3.33% (3.1889 => 3.2950, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.10% (16.2614 => 16.7648, std. dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1333 => 1.1682, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7506, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 2.79% (4.6629 => 4.7930, std. dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.5754 => 6.7570, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.75% (1.5188 => 1.5606, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 2.72% (14.5298 => 14.9253, std. dev.: 0.0148) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4113 => 0.4224, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.69% (14.8535 => 15.2535, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.69% (3.2742 => 3.3623, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.23% (2.1007 => 2.1475, std. dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/bigfib: 1.87% (0.6250 => 0.6367, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.69% (1.0313 => 1.0487, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9108 => 0.9252, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.54% (3.7467 => 3.8045, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 26.52% (1.8175 => 2.2995, std. dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 10.07% (1.2998 => 1.4307, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7422, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6020, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9784, std. dev.: 0.0783) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6778, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.58% (3.2729 => 3.3247, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (1.5089 => 1.5285, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.11% (26.5159 => 26.8101, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.10% (22.5627 => 21.1867, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2308 => 1.0913, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.25% (1.3780 => 1.3195, std. dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5738, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.12% (3.0263 => 2.9622, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2300, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2043, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std. dev.: 0.0179) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3628, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.25% (20.3410 => 20.0862, std. dev.: 0.0270) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.5254 => 2.4965, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.08% (5.5401 => 5.4805, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 04:51:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 06:51:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120821115157.AB26C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3083?compare_to=3078&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3083, Order: 162270, Start Time: 2012-08-21 09:09:26, End Time: 2012-08-21 11:52:50 To: 3078, Order: 162254, Start Time: 2012-08-21 05:54:37, End Time: 2012-08-21 08:40:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (109 on baseline) Performance Improvements: 11 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 942 (769 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.2128 => 0.2282, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.93% (0.6319 => 0.6197, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.88% (0.6377 => 0.6257, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.75% (0.7655 => 0.7521, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: -1.60% (1.0124 => 0.9962, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: -1.32% (4.4722 => 4.4132, std. dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.28% (2.8639 => 2.8271, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -1.25% (1.0413 => 1.0283, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.17% (2.1657 => 2.1404, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: -1.14% (1.1444 => 1.1314, std. dev.: 0.0037) MultiSource/Applications/lua/lua: -1.07% (1.4859 => 1.4700, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.17% (2.1025 => 2.0780, std. dev.: 0.0083) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.98% (0.3465 => 0.3880, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.96% (0.3496 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.96% (0.3488 => 0.3905, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3446 => 0.3856, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3442 => 0.3851, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3469 => 0.3879, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.76% (0.3460 => 0.3867, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3643 => 0.4058, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.34% (0.3650 => 0.4064, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.06% (0.3724 => 0.4136, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 8.21% (1.5932 => 1.7240, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.1619 => 0.1724, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.37% (0.5826 => 0.6197, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.5889 => 0.6257, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.74% (1.6211 => 1.7142, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.59% (3.5627 => 3.7618, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (1.3152 => 1.3877, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (0.5026 => 0.5289, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.15% (0.4994 => 0.5251, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.14% (0.4361 => 0.4585, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.11% (0.2014 => 0.2117, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.5900 => 0.6200, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (0.5000 => 0.5253, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.94% (1.0781 => 1.1314, std. dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: 4.88% (0.7171 => 0.7521, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 4.80% (4.2109 => 4.4132, std. dev.: 0.0069) MultiSource/Applications/spiff/spiff: 4.67% (0.4029 => 0.4217, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.35% (0.2736 => 0.2855, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.30% (5.5417 => 5.7798, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.01% (0.2566 => 0.2669, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (0.3890 => 0.4042, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.87% (1.9694 => 2.0457, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2792 => 0.2899, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.81% (2.1653 => 2.2479, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.80% (0.2738 => 0.2842, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.3903 => 0.4051, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.77% (0.9909 => 1.0283, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.76% (1.9966 => 2.0717, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.70% (2.1013 => 2.1791, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/objinst: 3.65% (0.2823 => 0.2926, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.63% (0.4658 => 0.4827, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (2.7292 => 2.8271, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.3271 => 0.3388, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 3.56% (4.6177 => 4.7821, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.54% (2.0673 => 2.1404, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 3.52% (0.3096 => 0.3205, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.41% (0.3317 => 0.3430, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (4.4195 => 4.5685, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.33% (0.3124 => 0.3228, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.27% (0.3060 => 0.3160, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (0.4139 => 0.4274, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (1.8794 => 1.9402, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 3.19% (0.3258 => 0.3362, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.19% (0.7875 => 0.8126, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 3.18% (0.4146 => 0.4278, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.17% (0.3726 => 0.3844, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.12% (0.6634 => 0.6841, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 3.11% (0.3348 => 0.3452, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.08% (0.5546 => 0.5717, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (0.3625 => 0.3736, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.02% (1.4269 => 1.4700, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 3.02% (0.3477 => 0.3582, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3678 => 0.3789, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3690 => 0.3801, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (0.4251 => 0.4371, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.79% (0.3981 => 0.4092, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.73% (0.9697 => 0.9962, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 2.73% (23.5202 => 24.1615, std. dev.: 0.0220) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.65% (0.3845 => 0.3947, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.6435 => 0.6590, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.24% (2.0346 => 2.0802, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.23% (0.5012 => 0.5124, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0301, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.54% (0.2122 => 0.2282, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6769, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8934, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6454, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1960, std. dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5049, std. dev.: 0.0240) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5919, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2247, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4444, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5122, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5997, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.09% (11.9555 => 11.8249, std. dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5589, std. dev.: 0.0183) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7990, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -4.75% (0.2402 => 0.2288, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7960, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0048) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.93% (3.6262 => 3.5199, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.89% (17.2379 => 16.7405, std. dev.: 0.1047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5711, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9694, std. dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 05:20:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 07:20:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821122005.38D5D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3084?compare_to=3081&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3084, Order: 162271, Start Time: 2012-08-21 11:01:54, End Time: 2012-08-21 12:20:56 To: 3081, Order: 162270, Start Time: 2012-08-21 09:15:08, End Time: 2012-08-21 10:34:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (115 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (723 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.87% (13.9832 => 14.2450, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.33% (54.9486 => 56.2289, std. dev.: 0.1766) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.00% (2.3191 => 2.2959, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.40% (10.3673 => 14.2450, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.39% (1.1194 => 1.2469, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 9.22% (0.1432 => 0.1564, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (2.2022 => 2.3721, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.53% (1.7609 => 1.8935, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.50% (0.1584 => 0.1687, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.6030 => 0.6407, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.98% (10.4361 => 11.0602, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.59% (0.4615 => 0.4873, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.43% (0.7326 => 0.7724, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.20% (0.3307 => 0.3479, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.02% (0.2271 => 0.2385, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.4879 => 0.5114, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.79% (7.0540 => 7.3918, std. dev.: 0.0185) MultiSource/Applications/lambda-0_1_3/lambda: 4.75% (0.7433 => 0.7786, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.44% (0.5860 => 0.6120, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.44% (9.4845 => 9.9052, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.27% (0.8172 => 0.8521, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 4.27% (0.3282 => 0.3422, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.26% (4.2646 => 4.4462, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.24% (0.5569 => 0.5805, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.9449 => 5.1521, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (5.0018 => 5.2046, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4636 => 0.4823, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.02% (0.7835 => 0.8150, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.94% (0.2891 => 0.3005, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 3.92% (0.2554 => 0.2654, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.83% (1.3050 => 1.3550, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.72% (8.1363 => 8.4393, std. dev.: 0.0123) SingleSource/Regression/C++/ofstream_ctor: 3.72% (0.2905 => 0.3013, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.4103 => 0.4253, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 3.65% (0.3423 => 0.3548, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 3.57% (0.3387 => 0.3508, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2877 => 0.2979, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3109 => 0.3219, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.5415 => 1.5950, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9765 => 1.0097, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.39% (0.3098 => 0.3203, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.38% (0.4289 => 0.4434, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.35% (5.7591 => 5.9523, std. dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.32% (1.1861 => 1.2255, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.31% (0.3441 => 0.3555, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3826 => 0.3951, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.26% (2.0665 => 2.1338, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (0.4064 => 0.4196, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.22% (1.1642 => 1.2017, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.16% (0.4620 => 0.4766, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.14% (3.3354 => 3.4400, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.12% (0.8067 => 0.8319, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3283 => 0.3385, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.08% (0.3603 => 0.3714, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.08% (0.5105 => 0.5262, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.06% (2.0273 => 2.0893, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.01% (0.6675 => 0.6876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.93% (0.3684 => 0.3792, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.93% (0.6456 => 0.6645, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.91% (1.5603 => 1.6057, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.90% (0.4203 => 0.4325, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.85% (0.6450 => 0.6634, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.84% (1.2842 => 1.3207, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.77% (3.8723 => 3.9794, std. dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.76% (0.5981 => 0.6146, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (14.3668 => 14.7561, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 2.62% (0.4048 => 0.4154, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.58% (1.4186 => 1.4552, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5859 => 1.6250, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.45% (0.5020 => 0.5143, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.38% (17.1811 => 17.5896, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8921 => 0.9133, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.33% (2.2969 => 2.3505, std. dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 2.15% (1.1840 => 1.2095, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.2024 => 2.2482, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.87% (0.7115 => 0.7248, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.52% (1.0722 => 1.0885, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (4.2280 => 4.4412, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 3.01% (26.0924 => 26.8767, std. dev.: 0.0129) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3338, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1981, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2306, std. dev.: 0.0090) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.5086 => 1.5270, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std. dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.56% (5.2763 => 3.1364, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6978, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.89% (5.3526 => 3.6994, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0592, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.82% (2.9384 => 2.5322, std. dev.: 0.0168) MultiSource/Applications/ClamAV/clamscan: -12.07% (22.1758 => 19.5000, std. dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1061, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.86% (1.5373 => 1.4319, std. dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8478, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4653, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9896, std. dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.6802 => 8.4375, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9616, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3342, std. dev.: 0.0069) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.8329 => 1.8143, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 07:32:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 09:32:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821143257.5302F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3085?compare_to=3082&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3085, Order: 162276, Start Time: 2012-08-21 13:19:37, End Time: 2012-08-21 14:33:48 To: 3082, Order: 162271, Start Time: 2012-08-21 10:09:22, End Time: 2012-08-21 11:23:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.80% (2.0176 => 2.2960, std. dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7061 => 0.7701, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.90% (0.5818 => 0.6336, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.70% (0.5748 => 0.6248, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.24% (0.3663 => 0.3965, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3914 => 0.4229, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.82% (0.3940 => 0.4248, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.55% (0.7710 => 0.8292, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.4328 => 0.4643, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 7.21% (1.3693 => 1.4680, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 7.19% (0.7038 => 0.7544, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4062 => 0.4354, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (3.9660 => 4.2471, std. dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 6.94% (0.2781 => 0.2974, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.90% (0.2782 => 0.2974, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.86% (0.5265 => 0.5626, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.65% (0.4390 => 0.4682, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.59% (0.2655 => 0.2830, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3022 => 0.3216, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.34% (0.2966 => 0.3154, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.30% (0.2937 => 0.3122, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.29% (0.6959 => 0.7397, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2726 => 0.2897, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2760 => 0.2932, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.23% (1.9828 => 2.1063, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2761 => 0.2932, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.12% (0.9199 => 0.9762, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.10% (0.3489 => 0.3702, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.00% (1.2193 => 1.2924, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.95% (0.3580 => 0.3793, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.95% (0.3246 => 0.3439, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3149 => 0.3336, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.86% (0.2988 => 0.3163, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.83% (0.5577 => 0.5902, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3192 => 0.3377, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3293 => 0.3473, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.45% (0.4016 => 0.4235, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.42% (13.8202 => 14.5689, std. dev.: 0.0178) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (1.4563 => 1.5348, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3756 => 0.3955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.2925 => 0.3072, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.01% (1.1364 => 1.1933, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.90% (7.2180 => 7.5720, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.84% (0.5637 => 0.5910, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.84% (1.3819 => 1.4488, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.81% (0.8310 => 0.8710, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.80% (1.3813 => 1.4476, std. dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.77% (1.2292 => 1.2878, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.72% (1.1061 => 1.1583, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.68% (3.8646 => 4.0455, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3860, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.53% (0.7460 => 0.7798, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.46% (1.0594 => 1.1067, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.46% (0.7506 => 0.7841, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 4.37% (1.9270 => 2.0113, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.19% (2.1791 => 2.2704, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3755 => 0.3911, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.99% (0.6135 => 0.6380, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (3.6692 => 3.8130, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.86% (0.4791 => 0.4976, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (4.4433 => 4.6129, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 3.80% (16.6129 => 17.2449, std. dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.80% (4.3801 => 4.5467, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (13.2842 => 13.7846, std. dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.55% (0.6283 => 0.6506, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (4.9865 => 5.1568, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.22% (0.8698 => 0.8978, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 3.21% (3.1889 => 3.2914, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.14% (0.3245 => 0.3347, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.1333 => 1.1688, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7547, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 2.96% (16.2614 => 16.7427, std. dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: 2.75% (14.5298 => 14.9300, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2575, std. dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 2.72% (4.6629 => 4.7897, std. dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 2.72% (6.5754 => 6.7542, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.60% (1.5188 => 1.5583, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 2.58% (0.4113 => 0.4219, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.55% (3.2742 => 3.3578, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.1007 => 2.1459, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 1.79% (0.6250 => 0.6362, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.64% (1.0313 => 1.0482, std. dev.: 0.0059) MultiSource/Applications/lua/lua: 1.46% (3.7467 => 3.8015, std. dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.45% (0.9108 => 0.9240, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5186, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2679, std. dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.23% (1.2998 => 1.3938, std. dev.: 0.0231) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7424, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.57% (2.8606 => 2.9628, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3852, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5966, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.17% (10.7476 => 10.9812, std. dev.: 0.0476) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.79% (4.5928 => 4.6750, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.43% (1.9433 => 1.9710, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.26% (1.5089 => 1.5279, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 1.10% (26.5159 => 26.8081, std. dev.: 0.0244) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.5627 => 21.1789, std. dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.25% (0.8818 => 0.8708, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2308 => 1.0971, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.90% (1.3780 => 1.3105, std. dev.: 0.0127) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.8259 => 8.5652, std. dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9624, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2298, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2054, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3640, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.21% (5.5401 => 5.4733, std. dev.: 0.0259) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std. dev.: 0.0179) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.00% (6.6320 => 6.5654, std. dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 07:37:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 09:37:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821143743.D4C7C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3086?compare_to=3084&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3086, Order: 162276, Start Time: 2012-08-21 13:19:26, End Time: 2012-08-21 14:38:36 To: 3084, Order: 162271, Start Time: 2012-08-21 11:01:54, End Time: 2012-08-21 12:20:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (117 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (721 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.89% (78.4137 => 79.8996, std. dev.: 0.5119) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 37.14% (10.3673 => 14.2176, std. dev.: 0.0088) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.48% (0.3543 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.37% (0.3694 => 0.4114, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.34% (1.1194 => 1.2463, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.74% (2.2022 => 2.3726, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.50% (1.7609 => 1.8930, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.63% (0.1584 => 0.1689, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.41% (0.5925 => 0.6305, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.25% (0.6030 => 0.6407, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.06% (0.7326 => 0.7770, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.85% (10.4361 => 11.0463, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.63% (0.3177 => 0.3356, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.4615 => 0.4860, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.20% (0.3307 => 0.3479, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.4879 => 0.5115, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.83% (7.0540 => 7.3946, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 4.82% (0.7433 => 0.7791, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2271 => 0.2380, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.8172 => 0.8560, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.43% (9.4845 => 9.9050, std. dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.19% (4.2646 => 4.4434, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.17% (0.5569 => 0.5801, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (4.9449 => 5.1457, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (5.0018 => 5.2041, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.4636 => 0.4822, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.98% (0.2891 => 0.3006, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.98% (0.5860 => 0.6093, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2905 => 0.3019, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.3121 => 0.3240, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.80% (0.4103 => 0.4259, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (8.1363 => 8.4412, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (1.3050 => 1.3536, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 3.71% (0.3180 => 0.3298, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 3.65% (0.2877 => 0.2982, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.62% (0.7835 => 0.8119, std. dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 3.57% (0.3109 => 0.3220, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4289 => 0.4442, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.52% (0.3098 => 0.3207, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3865 => 0.4000, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.49% (0.9765 => 1.0106, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.43% (0.3092 => 0.3198, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 3.39% (0.3422 => 0.3538, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.5415 => 1.5937, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.38% (0.3162 => 0.3269, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.34% (0.3650 => 0.3772, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.33% (5.7591 => 5.9509, std. dev.: 0.0187) MultiSource/Applications/Burg/burg: 3.31% (1.1642 => 1.2027, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.28% (0.3136 => 0.3239, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (2.0665 => 2.1343, std. dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 3.28% (0.3387 => 0.3498, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3826 => 0.3951, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.23% (0.3441 => 0.3552, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.22% (0.3232 => 0.3336, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.16% (0.3603 => 0.3717, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.14% (3.3354 => 3.4402, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.10% (0.3935 => 0.4057, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.10% (0.8067 => 0.8317, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2228, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (0.4064 => 0.4189, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.08% (0.5105 => 0.5262, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.01% (0.6675 => 0.6876, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.95% (0.4203 => 0.4327, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.91% (0.6456 => 0.6644, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 2.91% (1.5603 => 1.6057, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.90% (2.0273 => 2.0861, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.89% (1.2842 => 1.3213, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (0.6450 => 0.6633, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.80% (3.8723 => 3.9806, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (14.3668 => 14.7433, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.56% (1.5859 => 1.6265, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5981 => 0.6133, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.53% (0.5020 => 0.5147, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.51% (0.4299 => 0.4407, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.44% (0.8921 => 0.9139, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.44% (17.1811 => 17.6009, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.4186 => 1.4529, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 2.37% (2.2969 => 2.3513, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.2024 => 2.2497, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.09% (1.1840 => 1.2088, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.76% (0.7115 => 0.7240, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.62% (1.0722 => 1.0896, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4595, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7500, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.98% (26.0924 => 26.8707, std. dev.: 0.0387) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.44% (1.5086 => 1.5303, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2389, std. dev.: 0.0289) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.26% (3.1578 => 3.1977, std. dev.: 0.0053) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5748, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.63% (5.2763 => 3.1326, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6952, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6987, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0804, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.87% (2.9384 => 2.5307, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -12.15% (22.1758 => 19.4807, std. dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2373 => 1.1004, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -7.48% (1.5373 => 1.4223, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0504, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4701, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4225, std. dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0053, std. dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9640, std. dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -1.85% (2.5528 => 2.5056, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4199, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3486, std. dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.21% (1.8329 => 1.8108, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 08:03:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 10:03:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120821150301.2774B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3087?compare_to=3083&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3087, Order: 162271, Start Time: 2012-08-21 12:20:15, End Time: 2012-08-21 15:03:53 To: 3083, Order: 162270, Start Time: 2012-08-21 09:09:26, End Time: 2012-08-21 11:52:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (113 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.11% (123.8668 => 131.4301, std. dev.: 0.1495) SingleSource/Benchmarks/Misc/whetstone: 1.68% (2.7821 => 2.8289, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.41% (0.3496 => 0.3930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.41% (0.3465 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.39% (0.3446 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3442 => 0.3867, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.31% (0.3469 => 0.3896, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.18% (0.3488 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.89% (0.3650 => 0.4084, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions: 11.72% (0.3643 => 0.4070, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3724 => 0.4149, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.69% (1.5932 => 1.7157, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.55% (0.1619 => 0.1725, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.39% (0.5826 => 0.6198, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.28% (0.5889 => 0.6259, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.82% (3.5627 => 3.7701, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (1.6211 => 1.7154, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.62% (1.3152 => 1.3891, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.54% (0.1968 => 0.2077, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.31% (0.4994 => 0.5259, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (0.5000 => 0.5263, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.15% (0.5026 => 0.5285, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 5.10% (1.0781 => 1.1331, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.07% (0.4361 => 0.4582, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.95% (4.2109 => 4.4192, std. dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7171 => 0.7522, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.84% (0.4029 => 0.4224, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.64% (0.5900 => 0.6174, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.22% (5.5417 => 5.7753, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.2866 => 0.2983, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.2736 => 0.2847, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.98% (0.2566 => 0.2668, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.91% (0.2738 => 0.2845, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.90% (0.2792 => 0.2901, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.88% (0.3890 => 0.4041, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.3004 => 0.3120, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.83% (0.9909 => 1.0289, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.2823 => 0.2931, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (1.9694 => 2.0446, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.81% (0.2729 => 0.2833, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.75% (0.2750 => 0.2853, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.74% (1.9966 => 2.0713, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.2780 => 0.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.70% (0.2813 => 0.2917, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (2.7292 => 2.8301, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (0.4658 => 0.4830, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 3.66% (0.2811 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.65% (2.0673 => 2.1428, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/wc: 3.62% (0.3096 => 0.3208, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 3.60% (4.6177 => 4.7840, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.58% (2.1653 => 2.2428, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (2.1013 => 2.1762, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2911 => 0.3014, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.3903 => 0.4041, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.49% (0.3267 => 0.3381, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.49% (0.3124 => 0.3233, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.48% (0.3362 => 0.3479, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (4.4195 => 4.5727, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.43% (0.3060 => 0.3165, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.38% (0.3258 => 0.3368, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.35% (0.3726 => 0.3851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3317 => 0.3428, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.35% (0.3348 => 0.3460, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.25% (1.4269 => 1.4733, std. dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (1.8794 => 1.9401, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.23% (0.3625 => 0.3742, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.21% (0.4146 => 0.4279, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.3845 => 0.3967, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.17% (0.4139 => 0.4270, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.15% (0.7875 => 0.8123, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.06% (0.6634 => 0.6837, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.01% (0.3690 => 0.3801, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 2.96% (0.4251 => 0.4377, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.87% (23.5202 => 24.1952, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.74% (0.9697 => 0.9963, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 2.74% (0.5546 => 0.5698, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (0.6435 => 0.6585, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.08% (2.0346 => 2.0769, std. dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.04% (0.2162 => 0.3525, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 9.10% (0.2122 => 0.2315, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6712, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8961, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std. dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6468, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2080, std. dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5038, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std. dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4489, std. dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2877, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5867, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4772, std. dev.: 0.0198) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.90% (2.4764 => 2.3799, std. dev.: 0.0315) MultiSource/Applications/kimwitu++/kc: -1.09% (11.9555 => 11.8247, std. dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5662, std. dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -7.62% (0.2402 => 0.2219, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7948, std. dev.: 0.0009) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.46% (17.2379 => 16.8134, std. dev.: 0.0390) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9613, std. dev.: 0.0121) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 09:15:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 11:15:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821161504.3E1DE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3088?compare_to=3085&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3088, Order: 162277, Start Time: 2012-08-21 15:01:35, End Time: 2012-08-21 16:15:51 To: 3085, Order: 162276, Start Time: 2012-08-21 13:19:37, End Time: 2012-08-21 14:33:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5886 => 56.4901, std. dev.: 0.0550) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.90% (2.0176 => 2.2981, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 10.12% (0.5818 => 0.6407, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.99% (0.5748 => 0.6322, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.94% (0.7061 => 0.7763, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.31% (0.2781 => 0.3012, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.30% (0.3650 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3663 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.00% (0.3914 => 0.4227, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.87% (0.3940 => 0.4250, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (0.4328 => 0.4655, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.43% (0.1413 => 0.1518, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.40% (1.3693 => 1.4706, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.13% (0.7038 => 0.7540, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.7710 => 0.8255, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.02% (3.9660 => 4.2444, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.84% (0.4062 => 0.4340, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.76% (1.9828 => 2.1168, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.66% (0.3485 => 0.3717, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.61% (0.4390 => 0.4680, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.53% (0.3489 => 0.3717, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.48% (0.3149 => 0.3353, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.41% (0.3899 => 0.4149, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.37% (0.3580 => 0.3808, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.27% (0.9199 => 0.9776, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.20% (0.3453 => 0.3667, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.12% (0.6959 => 0.7385, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3246 => 0.3443, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.05% (0.3192 => 0.3385, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.03% (1.2193 => 1.2928, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.93% (0.4016 => 0.4254, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 5.83% (0.3293 => 0.3485, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.51% (13.8202 => 14.5816, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 5.46% (0.3868 => 0.4079, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.42% (0.5577 => 0.5879, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.36% (1.4563 => 1.5343, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.16% (1.2292 => 1.2926, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.15% (1.1364 => 1.1949, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.2925 => 0.3073, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.99% (7.2180 => 7.5779, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5637 => 0.5915, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (1.3819 => 1.4484, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.80% (0.8310 => 0.8709, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.73% (1.3245 => 1.3872, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.71% (1.3813 => 1.4463, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.60% (0.7460 => 0.7803, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 4.57% (1.1061 => 1.1566, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (3.8646 => 4.0401, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.50% (1.0594 => 1.1071, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3755 => 0.3924, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.26% (2.1791 => 2.2720, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 4.23% (1.9270 => 2.0085, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.11% (0.4791 => 0.4988, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.06% (16.6129 => 17.2870, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.01% (0.6135 => 0.6381, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6191, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.90% (3.6692 => 3.8124, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (13.2842 => 13.8008, std. dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.88% (0.6283 => 0.6527, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5476, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (4.9865 => 5.1651, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.55% (0.8698 => 0.9007, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.45% (0.3245 => 0.3357, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.31% (3.1889 => 3.2945, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.10% (1.1333 => 1.1684, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.07% (16.2614 => 16.7612, std. dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (8.4961 => 8.7523, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/05-eks/eks: 2.92% (0.4113 => 0.4233, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.85% (3.2742 => 3.3674, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.81% (4.6629 => 4.7939, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.76% (14.5298 => 14.9315, std. dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 2.75% (14.8535 => 15.2622, std. dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 2.68% (6.5754 => 6.7516, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.63% (1.5188 => 1.5587, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: 2.16% (0.6250 => 0.6385, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.10% (2.1007 => 2.1449, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.64% (3.7467 => 3.8081, std. dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.61% (1.0313 => 1.0479, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/fbench: 24.85% (1.8175 => 2.2691, std. dev.: 0.0243) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.60% (1.2998 => 1.4116, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7418, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5945, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9783, std. dev.: 0.0436) MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.5928 => 4.6791, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3262, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std. dev.: 0.0050) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (1.5089 => 1.5285, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.12% (26.5159 => 26.8140, std. dev.: 0.0238) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.00% (22.5627 => 21.2096, std. dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.13% (0.8818 => 0.8718, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2308 => 1.0908, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5120, std. dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.78% (1.3780 => 1.3259, std. dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.8259 => 8.5725, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9639, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2310, std. dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2056, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9919, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3606, std. dev.: 0.0167) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4769, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.04% (20.3410 => 20.1285, std. dev.: 0.0202) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 09:24:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 11:24:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821162421.0FEC22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3089?compare_to=3086&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3089, Order: 162277, Start Time: 2012-08-21 15:06:12, End Time: 2012-08-21 16:25:12 To: 3086, Order: 162276, Start Time: 2012-08-21 13:19:26, End Time: 2012-08-21 14:38:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.91% (54.2968 => 56.4196, std. dev.: 0.1630) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.37% (14.2176 => 13.8800, std. dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.88% (10.3673 => 13.8800, std. dev.: 0.0110) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3473 => 0.3929, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 12.90% (0.3543 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.90% (0.3497 => 0.3948, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3516 => 0.3965, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.72% (0.3561 => 0.4014, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3828 => 0.4285, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2493, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 9.08% (0.1432 => 0.1562, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.85% (2.2022 => 2.3751, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 7.81% (0.5925 => 0.6388, std. dev.: 0.0086) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.6030 => 0.6483, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.33% (1.7609 => 1.8899, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.17% (0.7326 => 0.7851, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.50% (0.1584 => 0.1687, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.02% (0.1695 => 0.1797, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 5.84% (10.4361 => 11.0457, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.44% (0.3307 => 0.3487, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4615 => 0.4866, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.14% (0.4879 => 0.5130, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.02% (0.2271 => 0.2385, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.02% (0.2891 => 0.3036, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.00% (7.0540 => 7.4067, std. dev.: 0.0186) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.75% (0.2107 => 0.2207, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.72% (0.2905 => 0.3042, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.70% (0.2831 => 0.2964, std. dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 4.65% (0.7433 => 0.7779, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.65% (0.8172 => 0.8552, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.54% (0.2756 => 0.2881, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.51% (0.2725 => 0.2848, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.45% (0.2877 => 0.3005, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.3052 => 0.3186, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.39% (0.2872 => 0.2998, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.38% (0.4636 => 0.4839, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.37% (0.2793 => 0.2915, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (9.4845 => 9.8972, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/random: 4.32% (0.2802 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.27% (0.2554 => 0.2663, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.26% (0.3098 => 0.3230, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.25% (0.2871 => 0.2993, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.22% (0.5860 => 0.6107, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.17% (0.3865 => 0.4026, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4289 => 0.4467, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.12% (4.2646 => 4.4405, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.9449 => 5.1484, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.11% (0.5569 => 0.5798, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.10% (5.0018 => 5.2070, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.09% (2.0665 => 2.1510, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3232 => 0.3363, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.3136 => 0.3263, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.99% (0.3283 => 0.3414, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.97% (0.3650 => 0.3795, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.90% (8.1363 => 8.4540, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.89% (0.3162 => 0.3285, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.89% (0.3935 => 0.4088, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3603 => 0.3743, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3826 => 0.3973, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.83% (1.3050 => 1.3550, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.3121 => 0.3240, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.80% (0.3684 => 0.3824, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.79% (0.4064 => 0.4218, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.64% (0.3379 => 0.3502, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.61% (0.4620 => 0.4787, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.60% (0.3109 => 0.3221, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.56% (5.7591 => 5.9644, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: 3.56% (0.7835 => 0.8114, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.55% (0.4203 => 0.4352, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.52% (1.5603 => 1.6153, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3423 => 0.3540, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9765 => 1.0098, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 3.36% (0.6456 => 0.6673, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.32% (1.2842 => 1.3268, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.4048 => 0.4182, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.28% (0.3441 => 0.3554, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.25% (0.3387 => 0.3497, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (1.5415 => 1.5915, std. dev.: 0.0098) MultiSource/Applications/Burg/burg: 3.20% (1.1642 => 1.2015, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.16% (3.3354 => 3.4409, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.16% (1.1861 => 1.2236, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.01% (0.8067 => 0.8310, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.98% (0.5105 => 0.5257, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6675 => 0.6867, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.84% (2.0273 => 2.0848, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.80% (3.8723 => 3.9807, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.76% (0.6450 => 0.6628, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.69% (0.5981 => 0.6142, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.61% (0.4299 => 0.4411, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (14.3668 => 14.7326, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.52% (1.4186 => 1.4543, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.47% (1.5859 => 1.6251, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 2.44% (17.1811 => 17.6006, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.41% (0.5020 => 0.5141, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.26% (0.8921 => 0.9123, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.14% (2.2969 => 2.3461, std. dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 2.04% (1.1840 => 1.2081, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.2024 => 2.2468, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.76% (0.7115 => 0.7240, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.97% (4.2280 => 4.4380, std. dev.: 0.0144) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7472, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.95% (26.0924 => 26.8619, std. dev.: 0.0200) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3349, std. dev.: 0.0055) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2433, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.15% (1.5086 => 1.5260, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.12% (3.1578 => 3.1931, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6813, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1242, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.35% (5.2763 => 3.1473, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.33% (5.3855 => 3.6980, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.83% (5.3526 => 3.7025, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0672, std. dev.: 0.0371) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.32% (2.9384 => 2.5471, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: -12.23% (22.1758 => 19.4646, std. dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2373 => 1.1067, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -6.96% (1.5373 => 1.4303, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0011) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4648, std. dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4272, std. dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0139, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9627, std. dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -1.80% (2.5528 => 2.5069, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3338, std. dev.: 0.0078) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 11:05:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 13:05:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821180530.42CC92A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/3090?compare_to=3088&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3090, Order: 162283, Start Time: 2012-08-21 16:43:37, End Time: 2012-08-21 17:57:49 To: 3088, Order: 162277, Start Time: 2012-08-21 15:01:35, End Time: 2012-08-21 16:15:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (147 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.53% (78.3394 => 80.3224, std. dev.: 0.4355) SingleSource/Benchmarks/McGill/chomp: 1.13% (1.0908 => 1.1031, std. dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.92% (2.0176 => 2.2985, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.16% (0.5818 => 0.6409, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.97% (0.5748 => 0.6321, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.91% (0.7061 => 0.7761, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.35% (0.3663 => 0.3969, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.22% (0.3650 => 0.3950, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3914 => 0.4229, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.4003 => 0.4319, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.82% (0.3940 => 0.4248, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.73% (0.2781 => 0.2996, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (0.4328 => 0.4654, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4062 => 0.4366, std. dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 7.35% (0.7038 => 0.7555, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.7710 => 0.8276, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 7.24% (1.3693 => 1.4684, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.02% (3.9660 => 4.2445, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.91% (0.5265 => 0.5629, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.2937 => 0.3136, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (1.9828 => 2.1170, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.51% (0.2596 => 0.2765, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.46% (0.3485 => 0.3710, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.45% (0.3489 => 0.3714, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.39% (0.3899 => 0.4148, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.33% (0.4390 => 0.4668, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.28% (0.3580 => 0.3805, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.20% (0.3453 => 0.3667, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.19% (0.2988 => 0.3173, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.12% (0.9199 => 0.9762, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 6.11% (0.3192 => 0.3387, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.05% (1.2193 => 1.2931, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.90% (0.4016 => 0.4253, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.6959 => 0.7363, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.77% (0.3534 => 0.3738, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 5.77% (0.3293 => 0.3483, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.50% (0.5577 => 0.5884, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.44% (13.8202 => 14.5719, std. dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (0.3756 => 0.3959, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 5.35% (0.3868 => 0.4075, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.32% (1.4563 => 1.5338, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.2945 => 0.3101, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.18% (1.2292 => 1.2929, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.14% (1.1364 => 1.1948, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.95% (0.5637 => 0.5916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.93% (7.2180 => 7.5736, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: 4.91% (0.8310 => 0.8718, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.82% (1.3813 => 1.4479, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.79% (1.3245 => 1.3879, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 4.65% (3.8646 => 4.0444, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.60% (1.3819 => 1.4455, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.59% (1.1061 => 1.1569, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3755 => 0.3926, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.53% (1.0594 => 1.1074, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.52% (0.7460 => 0.7797, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.37% (0.7506 => 0.7834, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 4.26% (2.1791 => 2.2719, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0087, std. dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 3.94% (16.6129 => 17.2681, std. dev.: 0.0135) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5512, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (13.2842 => 13.8023, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.85% (0.6283 => 0.6525, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (4.4433 => 4.6129, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8082, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.72% (0.6135 => 0.6363, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (4.9865 => 5.1655, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.52% (0.8698 => 0.9004, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.37% (3.1889 => 3.2965, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.36% (0.3245 => 0.3354, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1333 => 1.1678, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.03% (16.2614 => 16.7539, std. dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7494, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.88% (3.2742 => 3.3685, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 2.82% (0.4113 => 0.4229, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 2.79% (14.5298 => 14.9359, std. dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 2.79% (4.6629 => 4.7932, std. dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.5754 => 6.7551, std. dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2568, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5188 => 1.5590, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.16% (0.6250 => 0.6385, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.10% (2.1007 => 2.1449, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.76% (0.6744 => 0.6863, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.45% (0.9108 => 0.9240, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.38% (3.7467 => 3.7985, std. dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 27.38% (1.8175 => 2.3152, std. dev.: 0.0257) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.72% (1.2998 => 1.4262, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.94% (1.5824 => 1.6606, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7412, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8175, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5948, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.14% (10.7476 => 10.9777, std. dev.: 0.0524) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6777, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5173, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.17% (1.5089 => 1.5266, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.16% (26.5159 => 26.8247, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6859, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.01% (22.5627 => 21.2059, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2308 => 1.1031, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3118, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0220, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5787, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9639, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2358, std. dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2054, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7911, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std. dev.: 0.0132) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3571, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.20% (20.3410 => 20.0965, std. dev.: 0.0350) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.11% (5.5401 => 5.4788, std. dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 11:11:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 13:11:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821181120.2D0552A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3091?compare_to=3089&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3091, Order: 162285, Start Time: 2012-08-21 16:53:13, End Time: 2012-08-21 18:12:11 To: 3089, Order: 162277, Start Time: 2012-08-21 15:06:12, End Time: 2012-08-21 16:25:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (111 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (726 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.14% (1.3067 => 1.3216, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.87% (10.3673 => 13.8784, std. dev.: 0.0094) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3473 => 0.3918, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.75% (0.3497 => 0.3943, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.59% (0.3543 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.56% (0.3543 => 0.3988, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.55% (0.3561 => 0.4008, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3516 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.07% (0.3694 => 0.4140, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3828 => 0.4279, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.64% (0.3927 => 0.4384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.61% (0.3886 => 0.4337, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.54% (1.1194 => 1.2486, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 8.94% (0.1432 => 0.1560, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.05% (2.2022 => 2.3794, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.20% (1.7609 => 1.8876, std. dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 7.00% (0.5925 => 0.6340, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 6.85% (0.6030 => 0.6443, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 5.94% (10.4361 => 11.0558, std. dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference: 5.87% (0.7326 => 0.7756, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.4615 => 0.4883, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.38% (0.3307 => 0.3485, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (7.0540 => 7.4180, std. dev.: 0.0219) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (0.7433 => 0.7794, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 4.84% (0.3282 => 0.3441, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2271 => 0.2380, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.60% (0.8172 => 0.8548, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.27% (4.9449 => 5.1559, std. dev.: 0.0126) MultiSource/Benchmarks/McCat/08-main/main: 4.23% (0.2554 => 0.2662, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.5569 => 0.5804, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.14% (4.2646 => 4.4411, std. dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 4.12% (9.4845 => 9.8750, std. dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.11% (0.5860 => 0.6101, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.00% (5.0018 => 5.2020, std. dev.: 0.0195) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4636 => 0.4821, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.84% (0.3121 => 0.3241, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.81% (0.3441 => 0.3572, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (1.3050 => 1.3543, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (8.1363 => 8.4414, std. dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: 3.68% (0.2905 => 0.3012, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 3.66% (0.4289 => 0.4446, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.61% (0.7835 => 0.8118, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3180 => 0.3292, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.4103 => 0.4247, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.48% (0.9765 => 1.0105, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 3.48% (0.3422 => 0.3541, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.46% (1.5415 => 1.5949, std. dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 3.39% (5.7591 => 5.9545, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.32% (1.1642 => 1.2029, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3650 => 0.3770, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.23% (0.5105 => 0.5270, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.18% (3.3354 => 3.4416, std. dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.14% (0.8067 => 0.8320, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.14% (2.0665 => 2.1313, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.13% (2.0273 => 2.0907, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.03% (0.3826 => 0.3942, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.98% (0.4064 => 0.4185, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.97% (0.6675 => 0.6873, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.95% (0.4203 => 0.4327, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.91% (0.6450 => 0.6638, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.90% (0.4620 => 0.4754, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.89% (3.8723 => 3.9843, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 2.88% (1.5603 => 1.6052, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.83% (0.6456 => 0.6639, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.76% (0.5981 => 0.6146, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2842 => 1.3193, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.57% (1.4186 => 1.4551, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (14.3668 => 14.7321, std. dev.: 0.1139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.5859 => 1.6262, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.36% (2.2969 => 2.3512, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 2.35% (0.4299 => 0.4400, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.35% (17.1811 => 17.5841, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.5020 => 0.5137, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8921 => 0.9126, std. dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 2.03% (1.1840 => 1.2080, std. dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.2024 => 2.2448, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: 1.62% (0.7115 => 0.7230, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (4.2280 => 4.4426, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7543, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8654, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3350, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2500, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.31% (1.3045 => 1.3216, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5086 => 1.5274, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 1.16% (3.1578 => 3.1945, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.41% (5.2763 => 3.1440, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.29% (5.3855 => 3.7004, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7054, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1273, std. dev.: 0.0304) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.13% (2.9384 => 2.5526, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -12.12% (22.1758 => 19.4874, std. dev.: 0.0349) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2373 => 1.1051, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -7.59% (1.5373 => 1.4206, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.1396 => 1.0596, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5042, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0011) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.27% (8.6802 => 8.3966, std. dev.: 0.0179) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.24% (32.5116 => 31.4589, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.61% (10.2830 => 10.0141, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9606, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3458, std. dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 11:14:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 13:14:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120821181409.189C22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3092?compare_to=3087&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3092, Order: 162277, Start Time: 2012-08-21 15:31:23, End Time: 2012-08-21 18:15:01 To: 3087, Order: 162271, Start Time: 2012-08-21 12:20:15, End Time: 2012-08-21 15:03:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (110 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (768 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (2.0709 => 2.1043, std. dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.32% (2.8289 => 2.7915, std. dev.: 0.0106) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.28% (0.3446 => 0.3869, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.27% (0.3496 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.21% (0.3465 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3442 => 0.3859, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3469 => 0.3888, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.04% (0.3488 => 0.3908, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.67% (0.3650 => 0.4076, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.64% (0.3643 => 0.4067, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 11.22% (0.3724 => 0.4142, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.39% (1.5932 => 1.7268, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.97% (0.1619 => 0.1748, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5826 => 0.6236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5889 => 0.6300, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.02% (1.6211 => 1.7187, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.98% (1.3152 => 1.3938, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (3.5627 => 3.7650, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (0.4994 => 0.5276, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 5.48% (0.7171 => 0.7564, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.39% (0.5026 => 0.5297, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.39% (0.4361 => 0.4596, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.31% (0.5900 => 0.6213, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.19% (0.2738 => 0.2880, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.06% (1.0781 => 1.1327, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.02% (0.5000 => 0.5251, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.2014 => 0.2115, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 5.01% (4.2109 => 4.4220, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.97% (0.2875 => 0.3018, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.86% (0.4029 => 0.4225, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.64% (0.9909 => 1.0369, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: 4.57% (0.2714 => 0.2838, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.50% (0.2803 => 0.2929, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.3004 => 0.3139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2792 => 0.2917, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.43% (0.2729 => 0.2850, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.36% (0.2866 => 0.2991, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3195 => 0.3334, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.33% (0.2750 => 0.2869, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.28% (0.2780 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.27% (0.2811 => 0.2931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.27% (2.0673 => 2.1555, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 4.26% (5.5417 => 5.7780, std. dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (0.3890 => 0.4055, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3096 => 0.3227, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.23% (0.2813 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.2823 => 0.2942, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (1.9966 => 2.0799, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3060 => 0.3183, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.2911 => 0.3028, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.01% (0.3267 => 0.3398, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.00% (0.3124 => 0.3249, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3258 => 0.3387, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (0.2691 => 0.2797, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.94% (0.2566 => 0.2667, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.93% (0.3362 => 0.3494, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (1.9694 => 2.0463, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 3.86% (0.3317 => 0.3445, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.79% (0.3348 => 0.3475, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3282 => 0.3406, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.73% (0.3726 => 0.3865, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (0.4658 => 0.4830, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.3903 => 0.4047, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.67% (2.7292 => 2.8294, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (0.3625 => 0.3757, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.58% (0.3690 => 0.3822, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (2.1013 => 2.1756, std. dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 3.52% (4.6177 => 4.7801, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.51% (2.1653 => 2.2412, std. dev.: 0.0031) MultiSource/Applications/treecc/treecc: 3.47% (0.7875 => 0.8148, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.43% (0.4139 => 0.4281, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.42% (0.9697 => 1.0029, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (4.4195 => 4.5706, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.41% (0.4251 => 0.4396, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.35% (0.6634 => 0.6856, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (1.8794 => 1.9420, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.3981 => 0.4106, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.10% (1.4269 => 1.4712, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.93% (23.5202 => 24.2088, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: 2.69% (0.5012 => 0.5147, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.69% (0.5546 => 0.5695, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.98% (2.0346 => 2.0749, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.2122 => 0.2327, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6720, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1700, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8885, std. dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6381, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1962, std. dev.: 0.0466) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5038, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5920, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4579, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2830, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5965, std. dev.: 0.0291) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.82% (2.4764 => 2.3818, std. dev.: 0.0327) MultiSource/Applications/kimwitu++/kc: -1.03% (11.9555 => 11.8323, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5634, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std. dev.: 0.0059) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7771, std. dev.: 0.0607) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9638, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 12:47:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 14:47:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821194719.C7C1D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3093?compare_to=3090&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3093, Order: 162294, Start Time: 2012-08-21 18:34:06, End Time: 2012-08-21 19:48:09 To: 3090, Order: 162283, Start Time: 2012-08-21 16:43:37, End Time: 2012-08-21 17:57:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (149 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.23% (0.5464 => 0.5342, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3048, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 12.23% (0.0826 => 0.0927, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.90% (0.5818 => 0.6394, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5748 => 0.6301, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.36% (0.7061 => 0.7722, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.36% (0.3601 => 0.3902, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.22% (0.3663 => 0.3964, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3789 => 0.4100, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 8.00% (0.3914 => 0.4227, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 7.82% (0.3940 => 0.4248, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.78% (0.1413 => 0.1523, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 7.27% (0.7038 => 0.7550, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.26% (3.9660 => 4.2541, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 7.21% (0.4062 => 0.4355, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4328 => 0.4639, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.16% (0.5265 => 0.5642, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.7710 => 0.8260, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.08% (0.2781 => 0.2978, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.08% (1.3693 => 1.4662, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.74% (0.2655 => 0.2834, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.62% (0.2628 => 0.2802, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2765 => 0.2946, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.54% (0.2937 => 0.3129, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.52% (0.3022 => 0.3219, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2607 => 0.2776, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.47% (0.9199 => 0.9794, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 6.45% (0.2760 => 0.2938, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.31% (0.3899 => 0.4145, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.30% (1.2193 => 1.2961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.26% (0.3149 => 0.3346, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.25% (0.6959 => 0.7394, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.20% (1.9828 => 2.1058, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.17% (0.3485 => 0.3700, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3489 => 0.3704, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.08% (0.2696 => 0.2860, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4379 => 0.4645, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3246 => 0.3443, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.06% (0.3580 => 0.3797, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.71% (0.3453 => 0.3650, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.70% (13.8202 => 14.6085, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.5577 => 0.5895, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.69% (0.2127 => 0.2248, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (0.3756 => 0.3969, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.65% (0.4390 => 0.4638, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.53% (1.4563 => 1.5368, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.48% (0.4016 => 0.4236, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.34% (0.2023 => 0.2131, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.29% (1.1364 => 1.1965, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.2925 => 0.3075, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.5637 => 0.5924, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.07% (0.8310 => 0.8731, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.04% (0.3868 => 0.4063, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.04% (7.2180 => 7.5816, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.01% (0.2914 => 0.3060, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.97% (1.3245 => 1.3903, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.89% (3.8646 => 4.0536, std. dev.: 0.0062) MultiSource/Applications/Burg/burg: 4.87% (1.1061 => 1.1600, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.75% (1.0594 => 1.1097, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.70% (1.2292 => 1.2870, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.69% (1.3819 => 1.4467, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.65% (0.7506 => 0.7855, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (1.3813 => 1.4454, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.61% (0.7460 => 0.7804, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 4.56% (2.1791 => 2.2784, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.49% (1.9270 => 2.0136, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3755 => 0.3917, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.31% (0.2995 => 0.3124, std. dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 4.25% (16.6129 => 17.3184, std. dev.: 0.0276) MultiSource/Benchmarks/McCat/18-imp/imp: 4.22% (0.3220 => 0.3356, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.17% (0.6283 => 0.6545, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (4.4433 => 4.6196, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (3.6692 => 3.8147, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.93% (13.2842 => 13.8064, std. dev.: 0.0250) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.91% (0.6135 => 0.6375, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5513, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.87% (4.9865 => 5.1793, std. dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 3.74% (0.3131 => 0.3248, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (0.8698 => 0.9003, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.44% (3.2742 => 3.3869, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 3.44% (3.1889 => 3.2985, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.33% (1.1333 => 1.1710, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (8.4961 => 8.7757, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.27% (0.3245 => 0.3351, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4113 => 0.4247, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.20% (16.2614 => 16.7810, std. dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.00% (1.5188 => 1.5644, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.5298 => 14.9504, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 2.79% (4.6629 => 4.7932, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.79% (14.8535 => 15.2673, std. dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7565, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.1007 => 2.1523, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.10% (0.6250 => 0.6381, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.91% (1.0313 => 1.0510, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.68% (0.6744 => 0.6857, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.65% (3.7467 => 3.8087, std. dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: 1.14% (33.2944 => 33.6754, std. dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5141, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2562, std. dev.: 0.0421) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.12% (1.2998 => 1.4313, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7421, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8179, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3841, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6028, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.12% (10.7476 => 10.9754, std. dev.: 0.0161) MultiSource/Applications/sqlite3/sqlite3: 1.79% (4.5928 => 4.6751, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3254, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.54% (2.0200 => 2.0511, std. dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std. dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 1.50% (8.3908 => 8.5164, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (1.5089 => 1.5275, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6870, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.86% (22.5627 => 21.2405, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.22% (1.2308 => 1.0927, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0116) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.8259 => 8.5798, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9287, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9625, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2303, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2076, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3548, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4762, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 12:57:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 14:57:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821195753.E410F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3094?compare_to=3091&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3094, Order: 162294, Start Time: 2012-08-21 18:39:50, End Time: 2012-08-21 19:58:45 To: 3091, Order: 162285, Start Time: 2012-08-21 16:53:13, End Time: 2012-08-21 18:12:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (103 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (735 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.15% (1.3216 => 1.3064, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.44% (10.3673 => 13.8344, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2492, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3543 => 0.3952, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.26% (0.3694 => 0.4110, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.94% (0.1432 => 0.1560, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.11% (2.2022 => 2.3809, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.27% (1.7609 => 1.8890, std. dev.: 0.0108) SingleSource/UnitTests/ObjC++/Hello: 6.92% (0.5925 => 0.6335, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.82% (0.6030 => 0.6441, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.14% (10.4361 => 11.0767, std. dev.: 0.0164) SingleSource/UnitTests/ObjC++/property-reference: 5.92% (0.7326 => 0.7760, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.24% (0.4615 => 0.4857, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.93% (0.3307 => 0.3470, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.92% (0.4879 => 0.5119, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.90% (7.0540 => 7.3994, std. dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 4.67% (0.7433 => 0.7780, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 4.57% (0.3282 => 0.3432, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.54% (0.2271 => 0.2374, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.8172 => 0.8531, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5569 => 0.5802, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.07% (0.2554 => 0.2658, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (9.4845 => 9.8705, std. dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5860 => 0.6091, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.9449 => 5.1389, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.92% (0.2758 => 0.2866, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.88% (4.2646 => 4.4299, std. dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.84% (0.4636 => 0.4814, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (5.0018 => 5.1935, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.70% (1.3050 => 1.3533, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.63% (8.1363 => 8.4319, std. dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 3.47% (0.3109 => 0.3217, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.35% (5.7591 => 5.9523, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 3.32% (0.7835 => 0.8095, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.25% (0.3441 => 0.3553, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.22% (0.4103 => 0.4235, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.15% (0.9765 => 1.0073, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 3.10% (0.3387 => 0.3492, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.09% (1.5415 => 1.5892, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.01% (3.3354 => 3.4359, std. dev.: 0.0077) MultiSource/Applications/Burg/burg: 2.99% (1.1642 => 1.1990, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 2.95% (0.3422 => 0.3523, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.93% (0.3650 => 0.3757, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.8067 => 0.8303, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.92% (0.3865 => 0.3978, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3826 => 0.3936, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (0.5105 => 0.5251, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.84% (2.0273 => 2.0849, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.1861 => 1.2196, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.82% (2.0665 => 2.1248, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.73% (0.6675 => 0.6857, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4203 => 0.4317, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.6456 => 0.6630, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4620 => 0.4743, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 2.61% (1.5603 => 1.6010, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.61% (0.4064 => 0.4170, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.56% (0.6450 => 0.6615, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.56% (3.8723 => 3.9713, std. dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3165, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.35% (1.4186 => 1.4519, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (14.3668 => 14.6968, std. dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 2.29% (17.1811 => 17.5751, std. dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.29% (1.5859 => 1.6222, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.26% (0.5981 => 0.6116, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.5020 => 0.5132, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.05% (2.2969 => 2.3441, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.04% (0.8921 => 0.9103, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.79% (2.2024 => 2.2419, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.66% (1.1840 => 1.2036, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.40% (1.0722 => 1.0872, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.88% (4.2280 => 4.4343, std. dev.: 0.0141) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.13% (26.0924 => 26.9092, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7506, std. dev.: 0.0039) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3336, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2325, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 1.27% (3.1578 => 3.1979, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.16% (1.5086 => 1.5261, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6820, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1243, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.37% (5.2763 => 3.1460, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.7000, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.74% (5.3526 => 3.7073, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1592, std. dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.22% (2.9384 => 2.5500, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.31% (22.1758 => 19.4470, std. dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2373 => 1.1082, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -7.31% (1.5373 => 1.4250, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std. dev.: 0.0018) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0511, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4659, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4176, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0120, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9657, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3475, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8124, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 14:25:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 16:25:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120821212517.469072A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3095?compare_to=3092&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3095, Order: 162294, Start Time: 2012-08-21 18:42:31, End Time: 2012-08-21 21:26:03 To: 3092, Order: 162277, Start Time: 2012-08-21 15:31:23, End Time: 2012-08-21 18:15:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3496 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.25% (0.3446 => 0.3868, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.24% (0.3465 => 0.3889, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3460 => 0.3882, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.18% (0.3488 => 0.3913, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 12.17% (0.3442 => 0.3861, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3469 => 0.3888, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.73% (0.3650 => 0.4078, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.72% (0.3643 => 0.4070, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.39% (0.3724 => 0.4148, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.66% (1.5932 => 1.7152, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.02% (0.5826 => 0.6235, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.1619 => 0.1730, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.72% (0.5889 => 0.6285, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.06% (1.3152 => 1.3949, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.00% (1.6211 => 1.7183, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (3.5627 => 3.7753, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.96% (0.4361 => 0.4621, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.71% (0.5026 => 0.5313, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.43% (0.4994 => 0.5265, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 5.41% (0.7171 => 0.7559, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 5.21% (1.0781 => 1.1343, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.5900 => 0.6207, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (0.3930 => 0.4134, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.18% (4.2109 => 4.4291, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.16% (0.2014 => 0.2118, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (0.5000 => 0.5257, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.2866 => 0.3005, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.68% (5.5417 => 5.8012, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.50% (0.2736 => 0.2859, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (0.3890 => 0.4053, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (0.4658 => 0.4849, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (1.9694 => 2.0499, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (1.9966 => 2.0772, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (2.1653 => 2.2518, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 3.99% (2.1013 => 2.1852, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2803 => 0.2914, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.94% (4.6177 => 4.7996, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 3.93% (0.2725 => 0.2832, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.86% (0.6634 => 0.6890, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.83% (0.9909 => 1.0289, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.82% (0.3195 => 0.3317, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2792 => 0.2898, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.75% (0.2750 => 0.2853, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.74% (4.4195 => 4.5849, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.74% (0.2729 => 0.2831, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.73% (0.3004 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (1.8794 => 1.9492, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/objinst: 3.65% (0.2823 => 0.2926, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.63% (2.0673 => 2.1424, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wc: 3.62% (0.3096 => 0.3208, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.59% (2.7292 => 2.8272, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 3.56% (0.2811 => 0.2911, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2813 => 0.2913, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.2911 => 0.3014, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.3903 => 0.4041, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.53% (0.4139 => 0.4285, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.52% (0.7875 => 0.8152, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 3.51% (1.4269 => 1.4770, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 3.46% (0.3267 => 0.3380, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.46% (0.3124 => 0.3232, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.3271 => 0.3384, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.45% (0.3362 => 0.3478, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.44% (0.3258 => 0.3370, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.41% (0.3726 => 0.3853, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.37% (0.3060 => 0.3163, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.37% (23.5202 => 24.3117, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash: 3.33% (0.4146 => 0.4284, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3317 => 0.3424, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (0.3625 => 0.3741, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.20% (0.3348 => 0.3455, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3690 => 0.3806, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 3.13% (0.3477 => 0.3586, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.13% (0.3678 => 0.3793, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.03% (0.3336 => 0.3437, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.3845 => 0.3961, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4251 => 0.4375, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.90% (0.5546 => 0.5707, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.54% (0.9697 => 0.9943, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.6435 => 0.6595, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.46% (2.0346 => 2.0846, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.5012 => 0.5135, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.08% (0.4847 => 0.4948, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (0.7426 => 0.7526, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6730, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1713, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.44% (1.8057 => 1.8858, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6369, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1958, std. dev.: 0.0079) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5082, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2256, std. dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.61% (41.7953 => 42.4681, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.25% (7.1849 => 7.2748, std. dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5882, std. dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4454, std. dev.: 0.0242) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5711, std. dev.: 0.0172) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8015, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.79% (0.2402 => 0.2263, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7940, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0056) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.21% (17.2379 => 16.8577, std. dev.: 0.0326) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5814, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (16.2163 => 15.9768, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 6.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 14:29:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 16:29:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821212909.53AE32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3096?compare_to=3093&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3096, Order: 162307, Start Time: 2012-08-21 20:15:46, End Time: 2012-08-21 21:29:59 To: 3093, Order: 162294, Start Time: 2012-08-21 18:34:06, End Time: 2012-08-21 19:48:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.52% (41.7954 => 42.4325, std. dev.: 0.1582) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.87% (2.0176 => 2.2974, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 9.64% (0.7061 => 0.7742, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5818 => 0.6373, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5748 => 0.6284, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3578 => 0.3853, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.60% (0.3646 => 0.3923, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.55% (0.3601 => 0.3873, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.53% (0.3663 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.51% (0.3650 => 0.3924, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.46% (0.7038 => 0.7563, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3789 => 0.4067, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 7.28% (0.3914 => 0.4199, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.7710 => 0.8268, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2781 => 0.2981, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.16% (1.3693 => 1.4673, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.13% (0.2721 => 0.2915, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.12% (3.9660 => 4.2483, std. dev.: 0.0118) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.01% (0.2596 => 0.2778, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.49% (0.3022 => 0.3218, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.44% (0.2607 => 0.2775, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2690 => 0.2862, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.33% (0.2655 => 0.2823, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3580 => 0.3806, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.28% (0.6959 => 0.7396, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2628 => 0.2793, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.24% (0.2966 => 0.3151, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.2937 => 0.3120, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.21% (1.9828 => 2.1060, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.21% (0.3899 => 0.4141, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.20% (0.2726 => 0.2895, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3489 => 0.3704, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.16% (0.2761 => 0.2931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.09% (0.9199 => 0.9759, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.3107 => 0.3296, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.08% (0.4390 => 0.4657, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.08% (1.2193 => 1.2934, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 6.07% (0.3149 => 0.3340, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.01% (0.2696 => 0.2858, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.76% (0.3453 => 0.3652, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.76% (0.3246 => 0.3433, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.55% (0.3192 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.54% (0.5577 => 0.5886, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 5.45% (13.8202 => 14.5739, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.43% (0.4016 => 0.4234, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.41% (0.2127 => 0.2242, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.28% (1.4563 => 1.5332, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 5.23% (0.3534 => 0.3719, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.16% (0.2925 => 0.3076, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 5.13% (0.3293 => 0.3462, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (0.3756 => 0.3946, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.04% (1.1364 => 1.1937, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 5.00% (3.8646 => 4.0579, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.3868 => 0.4059, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.90% (0.5637 => 0.5913, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.84% (7.2180 => 7.5676, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 4.81% (0.2243 => 0.2351, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.81% (0.8310 => 0.8710, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (1.3813 => 1.4473, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.76% (1.3245 => 1.3876, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.73% (1.3819 => 1.4473, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.69% (1.1061 => 1.1580, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.64% (1.2292 => 1.2862, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.62% (0.7460 => 0.7805, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.44% (1.9270 => 2.0125, std. dev.: 0.0132) MultiSource/Benchmarks/nbench/nbench: 4.34% (1.0594 => 1.1054, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.32% (0.7506 => 0.7830, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 4.25% (2.1791 => 2.2717, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 4.11% (16.6129 => 17.2956, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.90% (0.4791 => 0.4978, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.82% (13.2842 => 13.7920, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.79% (0.6283 => 0.6521, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6100, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (3.6692 => 3.8060, std. dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.72% (4.3801 => 4.5429, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.59% (0.6135 => 0.6355, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (4.9865 => 5.1623, std. dev.: 0.0071) MultiSource/Benchmarks/sim/sim: 3.48% (0.3131 => 0.3240, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8698 => 0.8985, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.27% (0.3245 => 0.3351, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.23% (3.1889 => 3.2919, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 3.15% (4.6629 => 4.8100, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.1333 => 1.1674, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.89% (8.4961 => 8.7417, std. dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 2.89% (16.2614 => 16.7313, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 2.87% (0.4113 => 0.4231, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.77% (3.2742 => 3.3648, std. dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9258, std. dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2463, std. dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: 2.59% (6.5754 => 6.7455, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.5188 => 1.5578, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.1007 => 2.1433, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/bigfib: 1.71% (0.6250 => 0.6357, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.58% (1.0313 => 1.0476, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.50% (0.6744 => 0.6845, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9108 => 0.9243, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.45% (3.7467 => 3.8012, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std. dev.: 0.0520) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 7.78% (1.2998 => 1.4009, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 4.78% (1.9144 => 2.0059, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7444, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8173, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4271 => 7.6096, std. dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3856, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.03% (10.7476 => 10.9659, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6779, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3255, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5183, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5280, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.15% (26.5159 => 26.8221, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.99% (22.5627 => 21.2103, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.27% (0.8818 => 0.8706, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.25% (1.2308 => 1.0923, std. dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.29% (1.3780 => 1.3189, std. dev.: 0.0071) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5842, std. dev.: 0.0189) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.27% (0.8342 => 0.8153, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9623, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2310, std. dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2045, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3624, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8679, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.26% (5.5401 => 5.4704, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 14:44:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 16:44:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821214444.7A0582A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3097?compare_to=3094&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3097, Order: 162307, Start Time: 2012-08-21 20:26:35, End Time: 2012-08-21 21:45:36 To: 3094, Order: 162294, Start Time: 2012-08-21 18:39:50, End Time: 2012-08-21 19:58:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (100 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (737 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.40% (2.3271 => 2.2946, std. dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.20% (10.3673 => 13.8089, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.95% (1.1194 => 1.2532, std. dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3543 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.52% (0.3516 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.35% (2.2022 => 2.3860, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.30% (1.7609 => 1.8895, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.63% (0.1584 => 0.1689, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.16% (10.4361 => 11.0793, std. dev.: 0.0150) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 5.82% (0.5925 => 0.6270, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.75% (0.6030 => 0.6377, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.4615 => 0.4860, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.4879 => 0.5136, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (7.0540 => 7.4130, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.3282 => 0.3446, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.89% (0.7326 => 0.7684, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.76% (0.2271 => 0.2379, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.67% (0.7433 => 0.7780, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.5860 => 0.6130, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.8172 => 0.8533, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.36% (9.4845 => 9.8980, std. dev.: 0.0121) MultiSource/Benchmarks/McCat/08-main/main: 4.23% (0.2554 => 0.2662, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.22% (0.5569 => 0.5804, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.20% (5.0018 => 5.2118, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.15% (4.9449 => 5.1501, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.12% (4.2646 => 4.4403, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.82% (1.3050 => 1.3549, std. dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 3.74% (5.7591 => 5.9747, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.74% (8.1363 => 8.4408, std. dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3121 => 0.3236, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.55% (0.3180 => 0.3293, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: 3.55% (0.7835 => 0.8113, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4636 => 0.4798, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.41% (1.5415 => 1.5941, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.41% (0.9765 => 1.0098, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.37% (0.3441 => 0.3557, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 3.25% (1.1642 => 1.2020, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.23% (3.3354 => 3.4430, std. dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.5105 => 0.5269, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.8067 => 0.8325, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.4103 => 0.4231, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.05% (2.0273 => 2.0891, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.4289 => 0.4417, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.97% (0.6675 => 0.6873, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.87% (0.3865 => 0.3976, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.84% (3.8723 => 3.9821, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.81% (0.6450 => 0.6631, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.67% (0.3826 => 0.3928, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 2.65% (1.5603 => 1.6016, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.64% (0.5981 => 0.6139, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5859 => 1.6273, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.59% (0.6456 => 0.6623, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (0.4064 => 0.4169, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (14.3668 => 14.7311, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.54% (2.0665 => 2.1189, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.52% (1.4186 => 1.4544, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.47% (0.4620 => 0.4734, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.46% (17.1811 => 17.6044, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4299 => 0.4402, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.31% (2.2969 => 2.3500, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.5020 => 0.5135, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.20% (1.2842 => 1.3124, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.2024 => 2.2466, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.87% (1.1840 => 1.2061, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.65% (1.0722 => 1.0899, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.64% (0.7115 => 0.7232, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.83% (4.2280 => 4.4321, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7550, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 2.94% (26.0924 => 26.8588, std. dev.: 0.0088) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3344, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2506, std. dev.: 0.0357) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 1.21% (3.1578 => 3.1960, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (1.3045 => 1.3199, std. dev.: 0.0059) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6822, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1514, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7068, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.63% (5.3526 => 3.7129, std. dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1281, std. dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5534, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -11.98% (22.1758 => 19.5189, std. dev.: 0.0195) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1078, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -8.05% (1.5373 => 1.4136, std. dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4691, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4232, std. dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.61% (10.2830 => 10.0145, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.46% (8.1563 => 7.9555, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3422, std. dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 16:11:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 18:11:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120821231127.9E3612A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3098?compare_to=3096&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3098, Order: 162315, Start Time: 2012-08-21 21:57:43, End Time: 2012-08-21 23:12:15 To: 3096, Order: 162307, Start Time: 2012-08-21 20:15:46, End Time: 2012-08-21 21:29:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (151 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (705 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.58% (54.5642 => 55.9716, std. dev.: 0.3328) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.82% (2.0176 => 2.2965, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 10.21% (0.5818 => 0.6412, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.18% (0.7061 => 0.7780, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.07% (0.5748 => 0.6327, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.89% (0.3578 => 0.3896, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.69% (0.3601 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.63% (0.3650 => 0.3965, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3646 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.60% (0.3663 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.58% (0.3623 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3789 => 0.4110, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.33% (0.3914 => 0.4240, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.15% (0.3940 => 0.4261, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (0.1413 => 0.1521, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (0.4328 => 0.4652, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.7710 => 0.8280, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 7.23% (0.7038 => 0.7547, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 7.13% (1.3693 => 1.4669, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.05% (3.9660 => 4.2458, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.93% (0.5265 => 0.5630, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.84% (0.4062 => 0.4340, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.2937 => 0.3136, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.73% (0.3107 => 0.3316, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.72% (1.9828 => 2.1161, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.53% (0.3489 => 0.3717, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.42% (0.3580 => 0.3810, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.38% (0.4390 => 0.4670, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.32% (0.6959 => 0.7399, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.19% (0.2988 => 0.3173, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.08% (0.9199 => 0.9758, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 6.05% (0.3192 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.04% (1.2193 => 1.2930, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.91% (0.3246 => 0.3438, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4379 => 0.4637, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.85% (0.5577 => 0.5903, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.4016 => 0.4247, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3293 => 0.3480, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.66% (0.3534 => 0.3734, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2127 => 0.2244, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (0.3756 => 0.3962, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.40% (13.8202 => 14.5671, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/moments: 5.40% (0.3868 => 0.4077, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.28% (1.4563 => 1.5332, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (0.2945 => 0.3100, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.23% (0.2925 => 0.3078, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 5.21% (1.2292 => 1.2932, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.02% (1.1364 => 1.1935, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.94% (7.2180 => 7.5749, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.93% (0.5637 => 0.5915, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (0.8310 => 0.8715, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (3.8646 => 4.0448, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.3819 => 1.4461, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (1.3245 => 1.3860, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.62% (1.3813 => 1.4451, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.57% (1.1061 => 1.1566, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3755 => 0.3926, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.7460 => 0.7789, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 4.38% (0.7506 => 0.7835, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.38% (1.0594 => 1.1058, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 4.30% (2.1791 => 2.2729, std. dev.: 0.0147) MultiSource/Applications/treecc/treecc: 4.29% (1.9270 => 2.0096, std. dev.: 0.0100) MultiSource/Benchmarks/McCat/18-imp/imp: 4.19% (0.3220 => 0.3355, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.12% (16.6129 => 17.2973, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.94% (0.4791 => 0.4980, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.4433 => 4.6154, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.85% (0.6283 => 0.6525, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.3801 => 4.5482, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8090, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (13.2842 => 13.7847, std. dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.61% (0.8698 => 0.9012, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 3.58% (0.3131 => 0.3243, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6135 => 0.6353, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (4.9865 => 5.1626, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.30% (0.3245 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4113 => 0.4245, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2886, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1333 => 1.1680, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (8.4961 => 8.7531, std. dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7091, std. dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.68% (1.5188 => 1.5595, std. dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.66% (6.5754 => 6.7500, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.65% (3.2742 => 3.3610, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.62% (14.5298 => 14.9098, std. dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 2.59% (14.8535 => 15.2377, std. dev.: 0.0181) MultiSource/Applications/oggenc/oggenc: 2.36% (4.6629 => 4.7730, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 1.95% (0.6250 => 0.6372, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.1007 => 2.1415, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 1.62% (0.6744 => 0.6853, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.58% (1.0313 => 1.0476, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.49% (3.7467 => 3.8027, std. dev.: 0.0103) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.47% (0.9108 => 0.9242, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.21% (33.2944 => 33.6984, std. dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.42% (5.7573 => 7.5086, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.80% (1.2998 => 1.4142, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.16% (0.2093 => 0.2222, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7451, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8173, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6016, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.97% (10.7476 => 10.9593, std. dev.: 0.0174) MultiSource/Applications/sqlite3/sqlite3: 1.84% (4.5928 => 4.6771, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3255, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.42% (1.5089 => 1.5303, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.02% (26.5159 => 26.7864, std. dev.: 0.0451) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.06% (22.5627 => 21.1946, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2308 => 1.1019, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.46% (1.3780 => 1.3166, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5889, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: -2.44% (1.9762 => 1.9279, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2204, std. dev.: 0.0093) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9632, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2046, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8675, std. dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3641, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4771, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.09% (20.3410 => 20.1192, std. dev.: 0.0193) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 16:31:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 18:31:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120821233123.4CD912A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3099?compare_to=3097&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3099, Order: 162316, Start Time: 2012-08-21 22:13:22, End Time: 2012-08-21 23:32:15 To: 3097, Order: 162307, Start Time: 2012-08-21 20:26:35, End Time: 2012-08-21 21:45:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (100 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (737 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (13.8089 => 13.5127, std. dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.34% (10.3673 => 13.5127, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.46% (0.3543 => 0.3949, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.15% (1.1194 => 1.2442, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.99% (0.3694 => 0.4100, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (2.2022 => 2.3753, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.87% (0.6030 => 0.6444, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.73% (1.7609 => 1.8794, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.55% (0.5925 => 0.6313, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.44% (0.1584 => 0.1686, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 5.92% (10.4361 => 11.0540, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 5.53% (0.7326 => 0.7731, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.44% (0.4615 => 0.4866, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.12% (0.5860 => 0.6160, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.90% (0.3307 => 0.3469, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.75% (7.0540 => 7.3894, std. dev.: 0.0160) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.4879 => 0.5109, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 4.67% (0.7433 => 0.7780, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.67% (0.2271 => 0.2377, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.36% (0.5569 => 0.5812, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (9.4845 => 9.8846, std. dev.: 0.0119) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.21% (0.8172 => 0.8516, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.03% (4.9449 => 5.1440, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (5.0018 => 5.2015, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.97% (4.2646 => 4.4341, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.97% (0.3121 => 0.3245, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.81% (0.3180 => 0.3301, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.69% (1.3050 => 1.3531, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3441 => 0.3564, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.57% (0.3109 => 0.3220, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.55% (8.1363 => 8.4255, std. dev.: 0.0207) MultiSource/Applications/spiff/spiff: 3.52% (0.7835 => 0.8111, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.9765 => 1.0103, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.4636 => 0.4795, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.26% (5.7591 => 5.9467, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.21% (0.8067 => 0.8326, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.19% (1.5415 => 1.5906, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 3.15% (1.1642 => 1.2009, std. dev.: 0.0066) MultiSource/Applications/treecc/treecc: 3.14% (2.0273 => 2.0909, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 3.09% (3.3354 => 3.4385, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.04% (0.3387 => 0.3490, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.00% (0.5105 => 0.5258, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.4103 => 0.4225, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.91% (0.4289 => 0.4414, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.91% (1.1861 => 1.2206, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.74% (0.3650 => 0.3750, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.73% (0.6450 => 0.6626, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.72% (0.3826 => 0.3930, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 2.68% (1.5603 => 1.6021, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.65% (3.8723 => 3.9749, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5859 => 1.6264, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.5981 => 0.6133, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.52% (0.6456 => 0.6619, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4620 => 0.4732, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (14.3668 => 14.7123, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.39% (2.0665 => 2.1159, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.39% (1.4186 => 1.4525, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.24% (17.1811 => 17.5653, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/football/football: 2.23% (0.8921 => 0.9120, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.23% (1.2842 => 1.3128, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.15% (2.2969 => 2.3462, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.13% (0.5020 => 0.5127, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2470, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2050, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.69% (0.7115 => 0.7235, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (4.2280 => 4.4400, std. dev.: 0.0149) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (3.6395 => 3.7471, std. dev.: 0.0057) MultiSource/Applications/lua/lua: 2.86% (26.0924 => 26.8399, std. dev.: 0.0494) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.71% (1.3045 => 1.3268, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3335, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2374, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1982, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (1.5086 => 1.5273, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5769, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6813, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1245, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.63% (5.2763 => 3.1327, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.49% (5.3855 => 3.6898, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.93% (5.3526 => 3.6971, std. dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0539, std. dev.: 0.0402) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.73% (2.9384 => 2.5350, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -12.30% (22.1758 => 19.4482, std. dev.: 0.0296) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std. dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2373 => 1.1030, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -9.54% (1.5373 => 1.3906, std. dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std. dev.: 0.0022) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4730, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4188, std. dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9837, std. dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.29% (8.1563 => 7.9694, std. dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.78% (2.5528 => 2.5074, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3475, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 17:36:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 19:36:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120822003627.E75392A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3100?compare_to=3095&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3100, Order: 162315, Start Time: 2012-08-21 21:53:45, End Time: 2012-08-22 00:37:18 To: 3095, Order: 162294, Start Time: 2012-08-21 18:42:31, End Time: 2012-08-21 21:26:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (113 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.99% (109.6562 => 118.4125, std. dev.: 0.0925) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.02% (73.4558 => 74.9360, std. dev.: 0.0116) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3446 => 0.3845, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3465 => 0.3864, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.39% (0.3469 => 0.3864, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.36% (0.3442 => 0.3833, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.36% (0.3496 => 0.3893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.30% (0.3488 => 0.3882, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.90% (0.3643 => 0.4040, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.85% (0.3650 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.55% (0.3724 => 0.4117, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.43% (1.5932 => 1.7116, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5826 => 0.6236, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.91% (0.5889 => 0.6296, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (1.6211 => 1.7164, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (0.4361 => 0.4613, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.64% (3.5627 => 3.7636, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.48% (1.3152 => 1.3873, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.35% (0.7171 => 0.7555, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (0.5026 => 0.5289, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.23% (0.4994 => 0.5255, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.11% (0.3930 => 0.4131, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.09% (4.2109 => 4.4251, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.08% (0.5000 => 0.5254, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.05% (1.0781 => 1.1325, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.5900 => 0.6192, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.72% (0.4029 => 0.4219, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (0.2738 => 0.2867, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.40% (0.2566 => 0.2679, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (0.3890 => 0.4053, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.18% (5.5417 => 5.7731, std. dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: 3.99% (0.9909 => 1.0304, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.94% (0.2792 => 0.2902, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.93% (1.9694 => 2.0467, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.89% (2.1013 => 2.1831, std. dev.: 0.0071) SingleSource/Regression/C++/ofstream_ctor: 3.86% (0.3004 => 0.3120, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.86% (0.3060 => 0.3178, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.85% (0.3195 => 0.3318, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.84% (0.4658 => 0.4837, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (0.3625 => 0.3764, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.82% (0.2750 => 0.2855, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.77% (2.1653 => 2.2470, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (1.9966 => 2.0714, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.74% (0.2729 => 0.2831, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.74% (0.2811 => 0.2916, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.72% (0.2823 => 0.2928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.71% (0.2803 => 0.2907, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (2.0673 => 2.1436, std. dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.67% (2.7292 => 2.8294, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 3.63% (0.2780 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.63% (0.2813 => 0.2915, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.60% (0.3362 => 0.3483, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.59% (0.3903 => 0.4043, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 3.58% (0.3267 => 0.3384, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.55% (0.3096 => 0.3206, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 3.51% (4.6177 => 4.7797, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3258 => 0.3372, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.47% (0.2911 => 0.3012, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (4.4195 => 4.5702, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.38% (0.3282 => 0.3393, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.35% (0.3726 => 0.3851, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.35% (1.8794 => 1.9423, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 3.35% (0.3317 => 0.3428, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.32% (0.3348 => 0.3459, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.3845 => 0.3972, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.29% (0.4139 => 0.4275, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.27% (0.6634 => 0.6851, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.22% (1.4269 => 1.4728, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.3678 => 0.3796, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.19% (0.3477 => 0.3588, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.19% (0.7875 => 0.8126, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.17% (23.5202 => 24.2658, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.14% (0.3690 => 0.3806, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.06% (0.4146 => 0.4273, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.99% (0.3981 => 0.4100, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.99% (0.4251 => 0.4378, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 2.92% (0.5546 => 0.5708, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 2.77% (0.9697 => 0.9966, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.6435 => 0.6597, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.24% (2.0346 => 2.0802, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.73% (0.2122 => 0.2286, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6824, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1650, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: 4.36% (14.0481 => 14.6608, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2020, std. dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5025, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5902, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std. dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4651, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2894, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (8.4155 => 8.5108, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5919, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.62% (2.4764 => 2.3868, std. dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5843, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7974, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8039, std. dev.: 0.0011) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7784, std. dev.: 0.0798) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.37% (0.6293 => 0.6144, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5719, std. dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9634, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 17:53:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 19:53:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822005323.59FD22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3101?compare_to=3098&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3101, Order: 162325, Start Time: 2012-08-21 23:40:05, End Time: 2012-08-22 00:54:13 To: 3098, Order: 162315, Start Time: 2012-08-21 21:57:43, End Time: 2012-08-21 23:12:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.21% (1.3166 => 1.3325, std. dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.91% (2.0176 => 2.2982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.86% (0.5818 => 0.6450, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.85% (0.7061 => 0.7827, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 10.51% (0.5748 => 0.6352, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.14% (0.3578 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 8.91% (0.3601 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3646 => 0.3969, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.78% (0.3623 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.74% (0.3650 => 0.3969, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (0.4328 => 0.4654, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.50% (0.1413 => 0.1519, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4062 => 0.4362, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2781 => 0.2986, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.25% (0.7710 => 0.8269, std. dev.: 0.0023) MultiSource/Applications/hbd/hbd: 7.15% (1.3693 => 1.4672, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.10% (3.9660 => 4.2475, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7038 => 0.7525, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.90% (0.2607 => 0.2787, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.80% (0.5265 => 0.5623, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.74% (0.2655 => 0.2834, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.67% (0.2760 => 0.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2765 => 0.2949, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.60% (0.2726 => 0.2906, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.59% (0.3022 => 0.3221, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.49% (1.9828 => 2.1114, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3107 => 0.3305, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.37% (0.3485 => 0.3707, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.32% (0.3149 => 0.3348, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.27% (0.2761 => 0.2934, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3489 => 0.3704, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.15% (0.3580 => 0.3800, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.13% (0.3899 => 0.4138, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 5.91% (0.3453 => 0.3657, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.88% (0.9199 => 0.9740, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.88% (1.2193 => 1.2910, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.73% (0.3192 => 0.3375, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.6959 => 0.7357, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.62% (0.4379 => 0.4625, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.60% (0.4390 => 0.4636, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (0.3756 => 0.3961, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.45% (0.2127 => 0.2243, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.38% (1.4563 => 1.5346, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.15% (13.8202 => 14.5326, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.97% (0.5637 => 0.5917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2945 => 0.3090, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.89% (1.1364 => 1.1920, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.84% (1.2292 => 1.2887, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.82% (7.2180 => 7.5660, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.63% (0.2914 => 0.3049, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.56% (0.8310 => 0.8689, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: 4.56% (0.7506 => 0.7848, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3755 => 0.3924, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2243 => 0.2343, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (1.3819 => 1.4434, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3834, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.42% (1.3813 => 1.4424, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.7460 => 0.7788, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.38% (1.1061 => 1.1546, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (3.8646 => 4.0321, std. dev.: 0.0111) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0088, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.23% (1.0594 => 1.1042, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.01% (2.1791 => 2.2665, std. dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 3.87% (16.6129 => 17.2563, std. dev.: 0.0127) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.72% (13.2842 => 13.7783, std. dev.: 0.0189) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (4.4433 => 4.6082, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (4.3801 => 4.5413, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.68% (0.6283 => 0.6514, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.54% (3.6692 => 3.7990, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.50% (0.6135 => 0.6350, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.44% (0.8698 => 0.8997, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.33% (0.3245 => 0.3353, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.27% (4.9865 => 5.1497, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 3.02% (3.1889 => 3.2853, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.92% (1.1333 => 1.1664, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 2.80% (16.2614 => 16.7174, std. dev.: 0.0433) MultiSource/Benchmarks/mafft/pairlocalalign: 2.78% (8.4961 => 8.7322, std. dev.: 0.0111) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.4113 => 0.4227, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.59% (14.5298 => 14.9054, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 2.54% (14.8535 => 15.2303, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.2742 => 3.3557, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 2.43% (6.5754 => 6.7354, std. dev.: 0.0203) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5188 => 1.5539, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 1.98% (4.6629 => 4.7553, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.93% (2.1007 => 2.1412, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.37% (1.0313 => 1.0454, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.24% (3.7467 => 3.7930, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.20% (0.9108 => 0.9217, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5136, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 9.27% (1.2998 => 1.4203, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7414, std. dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.33% (10.7476 => 10.9977, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5868, std. dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6766, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std. dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9702, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5281, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (26.5159 => 26.8033, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5713, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1618, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.21% (0.8818 => 0.8711, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.2308 => 1.0941, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.27% (2.6470 => 2.5074, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.30% (1.3780 => 1.3325, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5963, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: -2.44% (1.9762 => 1.9279, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9641, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2318, std. dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3305 => 7.2080, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3563, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.18% (5.5401 => 5.4749, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout/heapsort: -1.15% (3.9173 => 3.8721, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (20.3410 => 20.1211, std. dev.: 0.0263) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 18:22:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 20:22:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822012201.260B32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3102?compare_to=3099&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3102, Order: 162329, Start Time: 2012-08-22 00:03:54, End Time: 2012-08-22 01:22:52 To: 3099, Order: 162316, Start Time: 2012-08-21 22:13:22, End Time: 2012-08-21 23:32:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (100 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (738 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.61% (13.5127 => 13.8655, std. dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.06% (11.0540 => 10.9363, std. dev.: 0.0155) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.74% (10.3673 => 13.8655, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3473 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3516 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3694 => 0.4129, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.37% (1.1194 => 1.2467, std. dev.: 0.0195) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 8.52% (0.1432 => 0.1554, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.66% (2.2022 => 2.3709, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.02% (0.3817 => 0.4085, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1892 => 0.2022, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.41% (1.7609 => 1.8737, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.6030 => 0.6412, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 6.33% (0.5925 => 0.6300, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.45% (0.7326 => 0.7725, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.17% (0.3307 => 0.3478, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.00% (0.8172 => 0.8581, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (0.4615 => 0.4842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.82% (7.0540 => 7.3942, std. dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 4.79% (10.4361 => 10.9363, std. dev.: 0.0155) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.63% (0.4879 => 0.5105, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.63% (0.7433 => 0.7777, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.49% (0.2271 => 0.2373, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 4.11% (0.3282 => 0.3417, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.06% (0.5569 => 0.5795, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.93% (9.4845 => 9.8574, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (5.0018 => 5.1968, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.86% (4.9449 => 5.1359, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5860 => 0.6084, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (4.2646 => 4.4260, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.8067 => 0.8372, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.60% (5.7591 => 5.9662, std. dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.4103 => 0.4247, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.49% (1.3050 => 1.3506, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.49% (8.1363 => 8.4199, std. dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (0.4636 => 0.4792, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.31% (1.5415 => 1.5925, std. dev.: 0.0085) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.17% (0.9765 => 1.0075, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.17% (0.3441 => 0.3550, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.05% (0.3865 => 0.3983, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4289 => 0.4419, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 2.99% (1.1642 => 1.1990, std. dev.: 0.0021) MultiSource/Applications/d/make_dparser: 2.99% (3.3354 => 3.4351, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.99% (0.3650 => 0.3759, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 2.92% (0.3422 => 0.3522, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.89% (2.0665 => 2.1263, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (0.4064 => 0.4180, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.84% (1.1861 => 1.2198, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 2.74% (2.0273 => 2.0828, std. dev.: 0.0055) MultiSource/Applications/hbd/hbd: 2.74% (1.5603 => 1.6030, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5105 => 0.5244, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (0.3935 => 0.4042, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.68% (0.6675 => 0.6854, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.60% (0.6456 => 0.6624, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.53% (0.4620 => 0.4737, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.50% (0.4203 => 0.4308, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.50% (3.8723 => 3.9690, std. dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.42% (0.6450 => 0.6606, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.37% (0.5981 => 0.6123, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.34% (1.2842 => 1.3142, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.24% (1.4186 => 1.4504, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.18% (17.1811 => 17.5562, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (14.3668 => 14.6801, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (1.5859 => 1.6203, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.09% (2.2969 => 2.3450, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8921 => 0.9105, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.77% (2.2024 => 2.2413, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.39% (1.1840 => 1.2005, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.43% (2.6778 => 2.9572, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.25% (4.2280 => 4.4499, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.63% (0.2944 => 0.3051, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7520, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8644, std. dev.: 0.0243) MultiSource/Applications/minisat/minisat: 1.52% (9.1159 => 9.2546, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 1.52% (3.2827 => 3.3325, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5086 => 1.5268, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5805, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1415, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.52% (5.3855 => 3.6882, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.94% (5.3526 => 3.6965, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1183, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.67% (2.9384 => 2.5368, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -12.44% (22.1758 => 19.4172, std. dev.: 0.0316) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: -11.64% (1.2373 => 1.0933, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -8.65% (1.5373 => 1.4043, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5119, std. dev.: 0.0025) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4686, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4137, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0004, std. dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9616, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3425, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.01% (1.0313 => 1.0209, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 19:35:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 21:35:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822023525.E09BB2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3103?compare_to=3101&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3103, Order: 162333, Start Time: 2012-08-22 01:21:55, End Time: 2012-08-22 02:36:15 To: 3101, Order: 162325, Start Time: 2012-08-21 23:40:05, End Time: 2012-08-22 00:54:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 30 (159 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 923 (698 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.22% (0.8711 => 0.9253, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 2.70% (0.4227 => 0.4341, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.05% (0.9217 => 0.9406, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 2.03% (15.2303 => 15.5398, std. dev.: 0.0157) MultiSource/Applications/oggenc/oggenc: 2.00% (4.7553 => 4.8504, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (6.3125 => 6.4310, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 1.87% (1.2754 => 1.2993, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.78% (0.6514 => 0.6630, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.77% (3.7990 => 3.8663, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.59% (4.5413 => 4.6136, std. dev.: 0.0051) MultiSource/Applications/hbd/hbd: 1.52% (1.4672 => 1.4895, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.49% (4.6082 => 4.6770, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 1.45% (6.7354 => 6.8329, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.42% (1.1920 => 1.2089, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.38% (2.1114 => 2.1405, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1664 => 1.1824, std. dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (8.7322 => 8.8427, std. dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.2910 => 1.3072, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (3.3557 => 3.3959, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.19% (0.9740 => 0.9856, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.16% (0.8997 => 0.9101, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.14% (14.5326 => 14.6976, std. dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (13.7783 => 13.9342, std. dev.: 0.0110) MultiSource/Applications/d/make_dparser: 1.10% (3.2853 => 3.3215, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 1.09% (4.0321 => 4.0760, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.06% (1.4434 => 1.4587, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.06% (3.7930 => 3.8331, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 1.03% (17.2563 => 17.4333, std. dev.: 0.0131) MultiSource/Applications/Burg/burg: 1.01% (1.1546 => 1.1663, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.80% (79.3601 => 80.7920, std. dev.: 0.0489) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3325 => 1.3094, std. dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.49% (2.0176 => 2.3099, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 12.47% (0.0826 => 0.0929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.33% (0.5748 => 0.6399, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.82% (0.7061 => 0.7825, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 10.76% (0.3578 => 0.3963, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: 10.62% (0.3663 => 0.4052, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 10.50% (0.3601 => 0.3979, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.48% (0.3646 => 0.4028, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3650 => 0.4031, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3623 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3789 => 0.4182, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.17% (0.3914 => 0.4312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.97% (0.4003 => 0.4402, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.92% (0.3940 => 0.4331, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 8.78% (1.3693 => 1.4895, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.78% (0.1413 => 0.1537, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.74% (0.1819 => 0.1978, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.67% (0.2781 => 0.3022, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.45% (0.2782 => 0.3017, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.21% (0.2607 => 0.2821, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.15% (0.2760 => 0.2985, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.14% (0.2765 => 0.2990, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.12% (0.4062 => 0.4392, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2690 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.10% (0.2655 => 0.2870, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (0.7710 => 0.8334, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.04% (3.9660 => 4.2847, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 8.00% (0.2937 => 0.3172, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.99% (0.2628 => 0.2838, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.95% (1.9828 => 2.1405, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/strcat: 7.85% (0.2726 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.83% (0.2696 => 0.2907, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 7.82% (0.2761 => 0.2977, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.79% (0.2966 => 0.3197, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.74% (0.4390 => 0.4730, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.66% (0.3107 => 0.3345, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.62% (0.3149 => 0.3389, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3485 => 0.3750, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.60% (0.2988 => 0.3215, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.57% (0.3899 => 0.4194, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.56% (0.7038 => 0.7570, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.51% (0.2596 => 0.2791, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.48% (0.5265 => 0.5659, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.46% (0.3580 => 0.3847, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.36% (0.3192 => 0.3427, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 7.33% (0.3453 => 0.3706, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.21% (1.2193 => 1.3072, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.14% (0.9199 => 0.9856, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.99% (0.4379 => 0.4685, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3293 => 0.3522, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.85% (0.3534 => 0.3776, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.77% (0.4016 => 0.4288, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.74% (0.6959 => 0.7428, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.71% (0.3756 => 0.4008, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.3868 => 0.4124, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.45% (0.2945 => 0.3135, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 6.42% (0.1589 => 0.1691, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.5577 => 0.5934, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.38% (1.1364 => 1.2089, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 6.35% (13.8202 => 14.6976, std. dev.: 0.0208) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.2914 => 0.3098, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.28% (1.4563 => 1.5478, std. dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.18% (0.2023 => 0.2148, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 6.04% (1.2292 => 1.3035, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3246 => 0.3442, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.01% (0.1865 => 0.1977, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.00% (0.5637 => 0.5975, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.86% (7.2180 => 7.6411, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 5.81% (0.2925 => 0.3095, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 5.78% (0.2995 => 0.3168, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.68% (0.8310 => 0.8782, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.57% (0.7506 => 0.7924, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.56% (0.7460 => 0.7875, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.56% (1.3819 => 1.4587, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4113 => 0.4341, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.52% (0.6283 => 0.6630, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.47% (3.8646 => 4.0760, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2140 => 0.2257, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.45% (0.4791 => 0.5052, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.44% (1.1061 => 1.1663, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (1.3813 => 1.4564, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.43% (1.3245 => 1.3964, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.37% (3.6692 => 3.8663, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6136, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (4.4433 => 4.6770, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 5.13% (1.9270 => 2.0258, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.09% (1.0594 => 1.1133, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.09% (0.6135 => 0.6447, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 4.98% (2.1791 => 2.2876, std. dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 4.94% (16.6129 => 17.4333, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.93% (0.8818 => 0.9253, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (13.2842 => 13.9342, std. dev.: 0.0110) MultiSource/Benchmarks/McCat/18-imp/imp: 4.84% (0.3220 => 0.3376, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.63% (0.8698 => 0.9101, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 4.62% (14.8535 => 15.5398, std. dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.33% (1.1333 => 1.1824, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.3245 => 0.3383, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.25% (0.3131 => 0.3264, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.16% (3.1889 => 3.3215, std. dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (8.4961 => 8.8427, std. dev.: 0.0200) MultiSource/Applications/oggenc/oggenc: 4.02% (4.6629 => 4.8504, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.97% (4.9865 => 5.1846, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 3.92% (6.5754 => 6.8329, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.2859 => 0.2970, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.72% (3.2742 => 3.3959, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.36% (16.2614 => 16.8083, std. dev.: 0.0179) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.27% (0.9108 => 0.9406, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 3.25% (14.5298 => 15.0025, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 3.17% (0.6250 => 0.6448, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.83% (1.5188 => 1.5618, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (2.1007 => 2.1530, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.43% (6.2785 => 6.4310, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.31% (0.4805 => 0.4916, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.31% (3.7467 => 3.8331, std. dev.: 0.0035) MultiSource/Applications/minisat/minisat: 2.25% (0.6744 => 0.6896, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.91% (1.2749 => 1.2993, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.37% (33.2944 => 33.7517, std. dev.: 0.0217) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.14% (1.2998 => 1.3926, std. dev.: 0.0216) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7411, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8179, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6001, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.02% (10.7476 => 10.9647, std. dev.: 0.0192) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6762, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3267, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.26% (1.5089 => 1.5279, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.18% (26.5159 => 26.8299, std. dev.: 0.0241) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.27% (22.5627 => 21.3729, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2308 => 1.0931, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.52% (1.1560 => 1.1037, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5916, std. dev.: 0.0172) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.16% (3.0263 => 2.9608, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2265, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2059, std. dev.: 0.0218) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3656, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4758, std. dev.: 0.0135) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 20:08:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 22:08:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822030837.A98C62A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3104?compare_to=3102&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3104, Order: 162337, Start Time: 2012-08-22 01:50:23, End Time: 2012-08-22 03:09:27 To: 3102, Order: 162329, Start Time: 2012-08-22 00:03:54, End Time: 2012-08-22 01:22:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 18 (128 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 915 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.32% (1.8737 => 1.9547, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.08% (2.3709 => 2.4202, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.87% (7.9508 => 8.0991, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.81% (3.1415 => 3.1983, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (3.6882 => 3.7433, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.33% (3.6965 => 3.7455, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.30% (7.3942 => 7.4906, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.5368 => 2.5677, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.21% (5.1359 => 5.1980, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (9.8574 => 9.9687, std. dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 1.10% (21.9495 => 22.1909, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (10.9363 => 11.0541, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.07% (1.2467 => 1.2600, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.06% (1.6030 => 1.6200, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.04% (1.3506 => 1.3646, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (5.1968 => 5.2498, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.03% (54.8457 => 56.5078, std. dev.: 0.1436) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.0933 => 1.1051, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.79% (19.4172 => 19.0691, std. dev.: 0.0140) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.36% (10.3673 => 13.9297, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 13.94% (0.3473 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3497 => 0.3977, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.69% (0.3543 => 0.4028, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.65% (0.3516 => 0.3996, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 13.63% (0.3543 => 0.4026, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.59% (0.3561 => 0.4045, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.18% (0.3694 => 0.4181, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.88% (0.3828 => 0.4321, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.68% (0.3927 => 0.4425, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.56% (1.1194 => 1.2600, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.56% (0.3886 => 0.4374, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.01% (1.7609 => 1.9547, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.90% (2.2022 => 2.4202, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 9.71% (0.1432 => 0.1571, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.88% (0.3817 => 0.4156, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.51% (0.1892 => 0.2034, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.46% (0.6030 => 0.6480, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5925 => 0.6365, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.26% (0.1584 => 0.1699, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.02% (0.3177 => 0.3400, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 6.31% (0.3282 => 0.3489, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.21% (0.7326 => 0.7781, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.19% (7.0540 => 7.4906, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.07% (0.4879 => 0.5175, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.4615 => 0.4890, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.92% (10.4361 => 11.0541, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.47% (0.3307 => 0.3488, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.15% (0.2271 => 0.2388, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.12% (4.9449 => 5.1980, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 5.11% (9.4845 => 9.9687, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 4.99% (0.7433 => 0.7804, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.98% (0.2107 => 0.2212, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.96% (5.0018 => 5.2498, std. dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: 4.82% (0.2554 => 0.2677, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.5569 => 0.5835, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.74% (0.8172 => 0.8559, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (4.2646 => 4.4628, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.57% (1.3050 => 1.3646, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.52% (0.3121 => 0.3262, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.51% (0.5860 => 0.6124, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.46% (8.1363 => 8.4988, std. dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 4.44% (0.3109 => 0.3247, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.37% (0.2905 => 0.3032, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.36% (5.7591 => 6.0100, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.29% (0.2891 => 0.3015, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.27% (0.3423 => 0.3569, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4289 => 0.4467, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3422 => 0.3564, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.15% (0.7835 => 0.8160, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3232 => 0.3365, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.10% (0.2831 => 0.2947, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.07% (0.2700 => 0.2810, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.07% (0.4299 => 0.4474, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.03% (0.3098 => 0.3223, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.98% (0.3441 => 0.3578, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.96% (0.3180 => 0.3306, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.94% (0.5105 => 0.5306, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.93% (0.3865 => 0.4017, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 3.87% (0.3283 => 0.3410, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.85% (0.2802 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.85% (0.2756 => 0.2862, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2872 => 0.2982, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.83% (0.4103 => 0.4260, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.83% (1.5603 => 1.6200, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3650 => 0.3789, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2871 => 0.2980, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.77% (0.3052 => 0.3167, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.76% (0.9765 => 1.0132, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.72% (0.2793 => 0.2897, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.70% (0.3136 => 0.3252, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.69% (2.0665 => 2.1428, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1861 => 1.2298, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3603 => 0.3735, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.64% (0.3379 => 0.3502, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6450 => 0.6684, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 3.61% (0.2877 => 0.2981, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.60% (0.6675 => 0.6915, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3826 => 0.3963, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.57% (1.5415 => 1.5965, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3162 => 0.3273, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (0.4064 => 0.4204, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.43% (1.1642 => 1.2041, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.8067 => 0.8343, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 3.40% (3.3354 => 3.4488, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3684 => 0.3807, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.34% (0.3387 => 0.3500, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.4048 => 0.4181, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.26% (2.0273 => 2.0934, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.25% (0.6456 => 0.6666, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4620 => 0.4770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.4203 => 0.4339, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.17% (3.8723 => 3.9952, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.2842 => 1.3247, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5981 => 0.6169, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7943, std. dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.4186 => 1.4590, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8921 => 0.9169, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.60% (2.2969 => 2.3567, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.49% (0.5020 => 0.5145, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.41% (17.1811 => 17.5960, std. dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 2.08% (1.1840 => 1.2086, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.2024 => 2.2453, std. dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.73% (7.9617 => 8.0991, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.55% (1.0722 => 1.0888, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.16% (21.9371 => 22.1909, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2172, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (4.2280 => 4.4329, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7574, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 3.03% (26.0924 => 26.8831, std. dev.: 0.0134) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3339, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.49% (9.1159 => 9.2515, std. dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.29% (3.1578 => 3.1984, std. dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.38% (5.2763 => 3.1983, std. dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.49% (5.3855 => 3.7433, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.02% (5.3526 => 3.7455, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0502, std. dev.: 0.0425) MultiSource/Applications/ClamAV/clamscan: -14.01% (22.1758 => 19.0691, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.62% (2.9384 => 2.5677, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2373 => 1.1051, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -7.38% (1.5373 => 1.4238, std. dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5046, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4741, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4183, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0026, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9583, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3417, std. dev.: 0.0059) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std. dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 20:47:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 22:47:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120822034753.F194A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3105?compare_to=3100&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3105, Order: 162331, Start Time: 2012-08-22 01:05:00, End Time: 2012-08-22 03:48:44 To: 3100, Order: 162315, Start Time: 2012-08-21 21:53:45, End Time: 2012-08-22 00:37:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 17 (113 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 937 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 3.40% (0.3882 => 0.4014, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: 3.33% (2.3868 => 2.4663, std. dev.: 0.0224) SingleSource/UnitTests/ObjC/for-in: 3.31% (0.3893 => 0.4022, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 3.29% (0.4040 => 0.4173, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 3.29% (0.3833 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 3.23% (0.4117 => 0.4250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 3.21% (0.4046 => 0.4176, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 3.17% (0.3845 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 3.16% (0.3864 => 0.3986, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 3.08% (0.3864 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 3.03% (0.3862 => 0.3979, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.46% (2.8294 => 2.8706, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 1.37% (0.9966 => 1.0103, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.18% (1.3873 => 1.4037, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (2.1436 => 2.1677, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.10% (1.0304 => 1.0417, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.56% (54.0512 => 54.8923, std. dev.: 0.0655) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.12% (0.3446 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.08% (0.3488 => 0.4014, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.05% (0.3496 => 0.4022, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 15.02% (0.3442 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.00% (0.3460 => 0.3979, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.95% (0.3465 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.90% (0.3469 => 0.3986, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.55% (0.3643 => 0.4173, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.41% (0.3650 => 0.4176, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.12% (0.3724 => 0.4250, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.70% (0.5826 => 0.6333, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.5889 => 0.6368, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.41% (0.1619 => 0.1739, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.19% (1.5932 => 1.7078, std. dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 6.74% (0.7171 => 0.7654, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.73% (1.3152 => 1.4037, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.55% (3.5627 => 3.7959, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (1.6211 => 1.7261, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.45% (0.1968 => 0.2095, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.03% (0.4994 => 0.5295, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (0.5000 => 0.5298, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.94% (0.4361 => 0.4620, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.92% (0.2738 => 0.2900, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.86% (0.2014 => 0.2132, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.85% (0.5026 => 0.5320, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.75% (0.3930 => 0.4156, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.64% (0.5900 => 0.6233, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 5.62% (4.2109 => 4.4475, std. dev.: 0.0084) MultiSource/Applications/d/make_dparser: 5.57% (1.0781 => 1.1381, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2875 => 0.3033, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.26% (0.3004 => 0.3162, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2725 => 0.2868, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.22% (0.2566 => 0.2700, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.18% (2.7292 => 2.8706, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.2823 => 0.2969, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.13% (0.9909 => 1.0417, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 5.12% (0.2714 => 0.2853, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.12% (0.2813 => 0.2957, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.08% (0.2736 => 0.2875, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.06% (0.2866 => 0.3011, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2792 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.04% (0.3195 => 0.3356, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.02% (0.2729 => 0.2866, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.96% (0.2803 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2750 => 0.2886, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 4.91% (0.2811 => 0.2949, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.89% (0.4658 => 0.4886, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 4.88% (0.3096 => 0.3247, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.87% (5.5417 => 5.8118, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.87% (0.3124 => 0.3276, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.86% (2.0673 => 2.1677, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2780 => 0.2914, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.67% (0.3258 => 0.3410, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.66% (1.9694 => 2.0611, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 4.65% (0.3267 => 0.3419, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (1.9966 => 2.0889, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.62% (2.1013 => 2.1983, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 4.61% (0.4146 => 0.4337, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3362 => 0.3513, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.48% (0.3060 => 0.3197, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.46% (0.3477 => 0.3632, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.43% (0.3678 => 0.3841, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.43% (0.3317 => 0.3464, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.42% (4.6177 => 4.8219, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.42% (0.3890 => 0.4062, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.42% (0.3282 => 0.3427, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.3845 => 0.4014, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3690 => 0.3849, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 4.29% (0.3726 => 0.3886, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.19% (0.9697 => 1.0103, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 4.15% (0.3348 => 0.3487, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 4.09% (2.1653 => 2.2539, std. dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 4.04% (1.8794 => 1.9553, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.4139 => 0.4306, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (4.4195 => 4.5977, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.3903 => 0.4060, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.98% (0.4251 => 0.4420, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.92% (0.3981 => 0.4137, std. dev.: 0.0058) MultiSource/Applications/siod/siod: 3.84% (0.6634 => 0.6889, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 3.82% (0.5546 => 0.5758, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.3271 => 0.3396, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 3.79% (1.4269 => 1.4810, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.3084 => 0.3200, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.70% (0.7875 => 0.8166, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.30% (23.5202 => 24.2958, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 3.11% (0.5012 => 0.5168, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.6435 => 0.6631, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.27% (2.0346 => 2.0807, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6137, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6775, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1681, std. dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6380, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1927, std. dev.: 0.0095) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4976, std. dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2249, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4374, std. dev.: 0.0079) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4745, std. dev.: 0.0219) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5807, std. dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5427, std. dev.: 0.0257) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8043, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8026, std. dev.: 0.0043) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (17.2379 => 16.7738, std. dev.: 0.0595) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4966, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9712, std. dev.: 0.0093) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 21:17:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 23:17:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822041711.F16452A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3106?compare_to=3103&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3106, Order: 162338, Start Time: 2012-08-22 03:03:52, End Time: 2012-08-22 04:18:01 To: 3103, Order: 162333, Start Time: 2012-08-22 01:21:55, End Time: 2012-08-22 02:36:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (159 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.56% (2.0176 => 2.3114, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.35% (0.0826 => 0.0928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.50% (0.5818 => 0.6487, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.38% (0.3578 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.14% (0.3601 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.14% (0.3646 => 0.4052, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.13% (0.5748 => 0.6388, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.10% (0.3650 => 0.4055, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3663 => 0.4068, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3623 => 0.4022, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.98% (0.7061 => 0.7836, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 10.93% (0.3789 => 0.4203, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3914 => 0.4332, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.4003 => 0.4430, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.48% (0.3940 => 0.4353, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.1819 => 0.1973, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.42% (1.3693 => 1.4846, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 8.39% (0.4328 => 0.4691, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.20% (0.2781 => 0.3009, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.17% (0.7710 => 0.8340, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.05% (0.2782 => 0.3006, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (3.9660 => 4.2836, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.89% (0.2966 => 0.3200, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.80% (0.4062 => 0.4379, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 7.75% (0.2607 => 0.2809, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.70% (0.2765 => 0.2978, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.68% (0.2760 => 0.2972, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.59% (0.2937 => 0.3160, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.55% (0.2596 => 0.2792, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.55% (0.2690 => 0.2893, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.53% (0.2655 => 0.2855, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.52% (0.7038 => 0.7567, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.50% (0.5265 => 0.5660, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2761 => 0.2968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.50% (0.2628 => 0.2825, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.47% (1.9828 => 2.1309, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2726 => 0.2929, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3022 => 0.3247, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3580 => 0.3845, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.34% (0.3899 => 0.4185, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.23% (0.2696 => 0.2891, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3107 => 0.3331, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2988 => 0.3202, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.11% (0.3149 => 0.3373, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.03% (0.3485 => 0.3730, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.01% (0.9199 => 0.9844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.99% (1.2193 => 1.3045, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.89% (0.3453 => 0.3691, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.89% (0.3192 => 0.3412, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.4379 => 0.4679, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.6959 => 0.7424, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.58% (0.4390 => 0.4679, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.54% (0.3534 => 0.3765, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.49% (0.2127 => 0.2265, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.47% (0.4016 => 0.4276, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 6.44% (0.3293 => 0.3505, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.30% (0.1588 => 0.1688, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.29% (0.5577 => 0.5928, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.27% (13.8202 => 14.6870, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.26% (1.1364 => 1.2075, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.26% (0.3868 => 0.4110, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.23% (0.3756 => 0.3990, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.11% (0.2914 => 0.3092, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.08% (0.2023 => 0.2146, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.05% (0.5637 => 0.5978, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.04% (0.2945 => 0.3123, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.80% (1.4563 => 1.5408, std. dev.: 0.0101) MultiSource/Benchmarks/McCat/09-vor/vor: 5.78% (0.2925 => 0.3094, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.77% (7.2180 => 7.6342, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.75% (0.2243 => 0.2372, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.75% (0.2140 => 0.2263, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 5.64% (1.2292 => 1.2985, std. dev.: 0.0058) MultiSource/Applications/spiff/spiff: 5.52% (0.7506 => 0.7920, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 5.44% (0.8310 => 0.8762, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.42% (1.1061 => 1.1660, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.39% (0.7460 => 0.7862, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.38% (1.3245 => 1.3957, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 5.37% (3.8646 => 4.0720, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (1.3819 => 1.4545, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 5.24% (0.2995 => 0.3152, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.22% (0.3755 => 0.3951, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.22% (3.6692 => 3.8606, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.20% (4.3801 => 4.6079, std. dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.18% (4.4433 => 4.6736, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.18% (0.4791 => 0.5039, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.13% (1.3813 => 1.4522, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 5.11% (1.0594 => 1.1135, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 5.09% (1.9270 => 2.0250, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3220 => 0.3381, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 4.96% (0.4113 => 0.4317, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.95% (0.6283 => 0.6594, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.94% (0.6135 => 0.6438, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.94% (16.6129 => 17.4331, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (13.2842 => 13.9205, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 4.75% (2.1791 => 2.2826, std. dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 4.34% (14.8535 => 15.4982, std. dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.27% (0.8698 => 0.9069, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.21% (1.1333 => 1.1810, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.21% (0.8818 => 0.9189, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.16% (0.3245 => 0.3380, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.01% (3.1889 => 3.3168, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.86% (0.3131 => 0.3252, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.82% (4.6629 => 4.8412, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.81% (8.4961 => 8.8194, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1747, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.67% (6.5754 => 6.8167, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 3.64% (0.2859 => 0.2963, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.28% (16.2614 => 16.7946, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.26% (3.2742 => 3.3811, std. dev.: 0.0181) MultiSource/Applications/ClamAV/clamscan: 3.14% (14.5298 => 14.9856, std. dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.81% (0.9108 => 0.9364, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.78% (0.6250 => 0.6424, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.76% (1.5188 => 1.5607, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.1007 => 2.1493, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.25% (3.7467 => 3.8309, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.23% (6.2785 => 6.4185, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.4805 => 0.4910, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.03% (0.6744 => 0.6881, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.01% (1.0313 => 1.0520, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.57% (1.2749 => 1.2949, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2721, std. dev.: 0.0447) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 7.68% (1.2998 => 1.3996, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7409, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3833, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5981, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.14% (10.7476 => 10.9776, std. dev.: 0.0417) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6764, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3252, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.35% (26.5159 => 26.8729, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (1.5089 => 1.5275, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.55% (22.5627 => 21.3096, std. dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3511 => 0.3395, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2308 => 1.0955, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.20% (1.9290 => 1.8094, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std. dev.: 0.0068) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.54% (1.1560 => 1.1035, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0211, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6037, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2284, std. dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3305 => 7.2014, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.41% (20.3410 => 20.0550, std. dev.: 0.0453) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std. dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3597, std. dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4771, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2376, std. dev.: 0.0195) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 21:55:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 21 Aug 2012 23:55:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822045505.C3E982A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3107?compare_to=3104&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3107, Order: 162339, Start Time: 2012-08-22 03:36:56, End Time: 2012-08-22 04:55:54 To: 3104, Order: 162337, Start Time: 2012-08-22 01:50:23, End Time: 2012-08-22 03:09:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (128 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.38% (10.3673 => 13.9312, std. dev.: 0.0073) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.06% (0.3543 => 0.4041, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3497 => 0.3975, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 13.63% (0.3543 => 0.4026, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.57% (0.3516 => 0.3993, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.56% (0.3561 => 0.4044, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.18% (0.3694 => 0.4181, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3828 => 0.4325, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3927 => 0.4427, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.46% (1.1194 => 1.2589, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.05% (1.7609 => 1.9555, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.94% (2.2022 => 2.4210, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.51% (0.1892 => 0.2034, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.45% (0.1584 => 0.1702, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.43% (0.6030 => 0.6478, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5925 => 0.6365, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.31% (0.2065 => 0.2216, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.05% (0.3177 => 0.3401, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.40% (0.3282 => 0.3492, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.27% (0.7326 => 0.7785, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.20% (7.0540 => 7.4914, std. dev.: 0.0123) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.19% (0.4879 => 0.5181, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.00% (10.4361 => 11.0627, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.89% (0.4615 => 0.4887, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3307 => 0.3493, std. dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2271 => 0.2390, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.18% (0.7433 => 0.7818, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2554 => 0.2685, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.11% (9.4845 => 9.9692, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (4.9449 => 5.1972, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.01% (0.5569 => 0.5848, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.97% (5.0018 => 5.2505, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.83% (0.8172 => 0.8567, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.68% (4.2646 => 4.4640, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.55% (0.4636 => 0.4847, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3121 => 0.3263, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 4.54% (0.3109 => 0.3250, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.51% (0.5860 => 0.6124, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.44% (0.2905 => 0.3034, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.44% (5.7591 => 6.0146, std. dev.: 0.0130) MultiSource/Benchmarks/McCat/18-imp/imp: 4.41% (0.3423 => 0.3574, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.34% (1.3050 => 1.3617, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.29% (0.2891 => 0.3015, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.22% (0.2700 => 0.2814, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.20% (0.7835 => 0.8164, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.20% (8.1363 => 8.4777, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 4.18% (0.3180 => 0.3313, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.14% (0.4103 => 0.4273, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.13% (0.4289 => 0.4466, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 4.09% (0.3422 => 0.3562, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 4.08% (0.3232 => 0.3364, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.06% (0.2756 => 0.2868, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 4.06% (0.2831 => 0.2946, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.5105 => 0.5312, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3441 => 0.3580, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.90% (0.3283 => 0.3411, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.86% (0.3650 => 0.3791, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2871 => 0.2980, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2872 => 0.2981, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (1.1861 => 1.2310, std. dev.: 0.0045) MultiSource/Applications/hbd/hbd: 3.77% (1.5603 => 1.6192, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9765 => 1.0133, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6450 => 0.6693, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hello: 3.76% (0.2714 => 0.2816, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.73% (0.6675 => 0.6924, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.69% (0.3826 => 0.3967, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.67% (1.5415 => 1.5980, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.8067 => 0.8362, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.65% (2.0665 => 2.1419, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.62% (1.1642 => 1.2064, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2802 => 0.2903, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.58% (0.3379 => 0.3500, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.58% (0.3603 => 0.3732, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.51% (0.3387 => 0.3506, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3935 => 0.4073, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.50% (0.3684 => 0.3813, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (0.4064 => 0.4204, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.44% (0.6456 => 0.6678, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.42% (3.3354 => 3.4494, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.35% (0.4203 => 0.4344, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4620 => 0.4774, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.30% (2.0273 => 2.0943, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.4048 => 0.4179, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.23% (3.8723 => 3.9973, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.15% (1.2842 => 1.3247, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.11% (0.5981 => 0.6167, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (14.3668 => 14.8043, std. dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.4186 => 1.4607, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.94% (2.2969 => 2.3644, std. dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8921 => 0.9164, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5859 => 1.6282, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.45% (17.1811 => 17.6016, std. dev.: 0.0072) MultiSource/Applications/minisat/minisat: 2.26% (0.7115 => 0.7276, std. dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 2.21% (1.1840 => 1.2102, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (2.2024 => 2.2489, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.75% (1.0722 => 1.0910, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.70% (7.9617 => 8.0973, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 1.16% (21.9371 => 22.1915, std. dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (4.2280 => 4.4562, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.04% (26.0924 => 26.8855, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7483, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3342, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.43% (1.3045 => 1.3232, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 1.22% (3.1578 => 3.1963, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.16% (1.5086 => 1.5261, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.08% (2.6546 => 2.6833, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5742, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.41% (5.2763 => 3.1969, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.49% (5.3855 => 3.7434, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.09% (5.3526 => 3.7422, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0570, std. dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: -13.98% (22.1758 => 19.0765, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.66% (2.9384 => 2.5663, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4201, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -11.18% (1.2373 => 1.0990, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -8.86% (1.5373 => 1.4011, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5645, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4734, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9840, std. dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.90% (8.6802 => 8.4282, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9575, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3358, std. dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.18% (1.8329 => 1.8113, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 22:58:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 00:58:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822055854.579E02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3108?compare_to=3106&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3108, Order: 162340, Start Time: 2012-08-22 04:45:35, End Time: 2012-08-22 05:59:44 To: 3106, Order: 162338, Start Time: 2012-08-22 03:03:52, End Time: 2012-08-22 04:18:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (155 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (702 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.42% (2.0176 => 2.3085, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.23% (0.0826 => 0.0927, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3650 => 0.4065, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 11.15% (0.3578 => 0.3977, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 11.03% (0.7061 => 0.7840, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 11.01% (0.5748 => 0.6381, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3646 => 0.4040, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3601 => 0.3987, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3663 => 0.4055, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 10.68% (0.3623 => 0.4010, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3789 => 0.4192, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3914 => 0.4322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.32% (0.4003 => 0.4416, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.08% (0.3940 => 0.4337, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.66% (0.1986 => 0.2158, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.1819 => 0.1973, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.09% (1.3693 => 1.4801, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 8.04% (0.4328 => 0.4676, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.96% (0.7710 => 0.8324, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.80% (3.9660 => 4.2754, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4062 => 0.4367, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2596 => 0.2789, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 7.36% (0.2760 => 0.2963, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2765 => 0.2968, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2690 => 0.2887, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.31% (0.5265 => 0.5650, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.31% (0.2655 => 0.2849, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 7.22% (0.7038 => 0.7546, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3022 => 0.3240, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.15% (0.2628 => 0.2816, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.15% (0.2937 => 0.3147, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.14% (1.9828 => 2.1244, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.06% (0.3485 => 0.3731, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3580 => 0.3831, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.98% (0.3899 => 0.4171, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.85% (1.2193 => 1.3028, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 6.80% (0.3149 => 0.3363, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.79% (0.9199 => 0.9824, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.4379 => 0.4670, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.64% (0.3192 => 0.3404, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.1789 => 0.1907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.47% (0.6959 => 0.7409, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 6.31% (0.3534 => 0.3757, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2127 => 0.2261, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.29% (0.4390 => 0.4666, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.26% (0.3293 => 0.3499, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.15% (0.4016 => 0.4263, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.13% (0.5577 => 0.5919, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.10% (1.1364 => 1.2057, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.01% (0.5637 => 0.5976, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (0.3756 => 0.3981, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.94% (13.8202 => 14.6410, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/moments: 5.92% (0.3868 => 0.4097, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.90% (1.4563 => 1.5422, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.87% (0.2914 => 0.3085, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.85% (0.3246 => 0.3436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.79% (0.1865 => 0.1973, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.78% (0.2023 => 0.2140, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 5.61% (0.2925 => 0.3089, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (7.2180 => 7.6150, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: 5.48% (0.2243 => 0.2366, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.33% (1.2292 => 1.2947, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.32% (0.7506 => 0.7905, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.7460 => 0.7855, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 5.17% (3.8646 => 4.0644, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 5.14% (0.2995 => 0.3149, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.14% (0.8310 => 0.8737, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.13% (1.1061 => 1.1628, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.10% (1.3245 => 1.3920, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (1.3819 => 1.4520, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (4.3801 => 4.6016, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.0594 => 1.1129, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.02% (1.3813 => 1.4507, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.98% (3.6692 => 3.8521, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.95% (0.3755 => 0.3941, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.85% (4.4433 => 4.6588, std. dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.84% (0.4791 => 0.5023, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.84% (1.9270 => 2.0202, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.74% (0.6283 => 0.6581, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.74% (0.4113 => 0.4308, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.71% (16.6129 => 17.3958, std. dev.: 0.0093) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3220 => 0.3367, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.50% (13.2842 => 13.8820, std. dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.45% (0.6135 => 0.6408, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.38% (2.1791 => 2.2746, std. dev.: 0.0195) MultiSource/Applications/JM/lencod/lencod: 4.22% (14.8535 => 15.4808, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.95% (0.8698 => 0.9042, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.92% (0.8818 => 0.9164, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.90% (3.1889 => 3.3132, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.88% (1.1333 => 1.1773, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.85% (0.3245 => 0.3370, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.80% (0.3131 => 0.3250, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.65% (4.6629 => 4.8332, std. dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 3.62% (8.4961 => 8.8037, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.52% (4.9865 => 5.1619, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (6.5754 => 6.8026, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 3.16% (16.2614 => 16.7748, std. dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 3.03% (14.5298 => 14.9694, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.02% (3.2742 => 3.3730, std. dev.: 0.0148) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.59% (0.9108 => 0.9344, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.6250 => 0.6411, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.52% (1.5188 => 1.5570, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (2.1007 => 2.1450, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.99% (0.6744 => 0.6878, std. dev.: 0.0049) MultiSource/Applications/lua/lua: 1.98% (3.7467 => 3.8208, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.96% (6.2785 => 6.4013, std. dev.: 0.0109) MultiSource/Applications/lemon/lemon: 1.81% (1.0313 => 1.0500, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.80% (1.8175 => 2.2682, std. dev.: 0.0439) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.47% (1.2998 => 1.4229, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7425, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5972, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.97% (10.7476 => 10.9595, std. dev.: 0.0453) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6784, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (1.5089 => 1.5276, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.80% (22.5627 => 21.2537, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.39% (0.3511 => 0.3392, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1037, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.90% (1.3780 => 1.3242, std. dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6002, std. dev.: 0.0142) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.12% (3.0263 => 2.9622, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2280, std. dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2069, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8604, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3590, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.25% (20.3410 => 20.0875, std. dev.: 0.0588) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 23:41:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 01:41:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822064147.874EA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3109?compare_to=3107&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3109, Order: 162341, Start Time: 2012-08-22 05:23:32, End Time: 2012-08-22 06:42:36 To: 3107, Order: 162339, Start Time: 2012-08-22 03:36:56, End Time: 2012-08-22 04:55:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.38% (0.5346 => 0.5473, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.28% (10.3673 => 13.9212, std. dev.: 0.0129) SingleSource/UnitTests/ObjC/trivial-interface: 13.91% (0.3473 => 0.3956, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.72% (0.3543 => 0.4029, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3497 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.58% (0.3543 => 0.4024, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.57% (0.3516 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.51% (0.3561 => 0.4042, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3694 => 0.4179, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions: 12.85% (0.3828 => 0.4320, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 12.63% (0.3927 => 0.4423, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.51% (0.3886 => 0.4372, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.44% (1.1194 => 1.2587, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.05% (1.7609 => 1.9555, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.96% (2.2022 => 2.4216, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.78% (0.1432 => 0.1572, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.61% (0.1892 => 0.2036, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.51% (0.1584 => 0.1703, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.38% (0.6030 => 0.6475, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.11% (0.3177 => 0.3403, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.43% (0.3282 => 0.3493, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.25% (7.0540 => 7.4946, std. dev.: 0.0071) SingleSource/UnitTests/ObjC++/property-reference: 6.20% (0.7326 => 0.7780, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.15% (0.4879 => 0.5179, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.94% (10.4361 => 11.0559, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.83% (0.4615 => 0.4884, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.50% (0.3307 => 0.3489, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.7433 => 0.7822, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.20% (9.4845 => 9.9781, std. dev.: 0.0125) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.20% (0.2271 => 0.2389, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (4.9449 => 5.2003, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.00% (5.0018 => 5.2518, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.99% (0.8172 => 0.8580, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.76% (0.5569 => 0.5834, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (4.2646 => 4.4629, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.5860 => 0.6128, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 4.50% (0.3109 => 0.3249, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.49% (0.3121 => 0.3261, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 4.41% (5.7591 => 6.0129, std. dev.: 0.0157) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4636 => 0.4840, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.28% (1.3050 => 1.3608, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.27% (0.3423 => 0.3569, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.25% (0.2891 => 0.3014, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.20% (8.1363 => 8.4780, std. dev.: 0.0103) MultiSource/Applications/spiff/spiff: 4.16% (0.7835 => 0.8161, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/09-vor/vor: 4.15% (0.3180 => 0.3312, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.12% (0.4299 => 0.4476, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.3441 => 0.3582, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.07% (0.2700 => 0.2810, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.00% (0.5105 => 0.5309, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.99% (0.2831 => 0.2944, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3232 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.92% (0.2758 => 0.2866, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 3.87% (0.4289 => 0.4455, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 3.86% (0.3422 => 0.3554, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.84% (0.3098 => 0.3217, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.80% (0.3865 => 0.4012, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2871 => 0.2980, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.79% (1.5603 => 1.6195, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2756 => 0.2860, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6450 => 0.6693, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (1.1861 => 1.2305, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.9765 => 1.0130, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.74% (2.0665 => 2.1437, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 3.72% (0.3283 => 0.3405, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.70% (0.3052 => 0.3165, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.66% (0.2872 => 0.2977, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.64% (1.1642 => 1.2066, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.62% (0.3650 => 0.3782, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.61% (0.2877 => 0.2981, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.60% (0.3136 => 0.3249, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.60% (0.6675 => 0.6915, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.59% (1.5415 => 1.5969, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3826 => 0.3963, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.54% (0.3162 => 0.3274, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.48% (0.3387 => 0.3505, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.46% (0.3379 => 0.3496, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.8067 => 0.8345, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.44% (0.3603 => 0.3727, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.40% (0.4064 => 0.4202, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3684 => 0.3809, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.37% (3.3354 => 3.4479, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3935 => 0.4066, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.31% (2.0273 => 2.0945, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.31% (0.6456 => 0.6670, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (0.4620 => 0.4772, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.24% (3.8723 => 3.9979, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/moments: 3.24% (0.4048 => 0.4179, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.4203 => 0.4337, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5981 => 0.6170, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.2842 => 1.3245, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (14.3668 => 14.7977, std. dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.4186 => 1.4607, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (0.5020 => 0.5160, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 2.79% (2.2969 => 2.3609, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 2.69% (0.8921 => 0.9161, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5859 => 1.6264, std. dev.: 0.0071) MultiSource/Applications/minisat/minisat: 2.21% (0.7115 => 0.7272, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.15% (1.1840 => 1.2095, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2471, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.77% (7.9617 => 8.1023, std. dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.65% (1.0722 => 1.0899, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 1.15% (21.9371 => 22.1892, std. dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (4.2280 => 4.4486, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7514, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 2.93% (26.0924 => 26.8570, std. dev.: 0.0169) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3341, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2372, std. dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5844, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.15% (1.5086 => 1.5260, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.12% (3.1578 => 3.1931, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.40% (5.2763 => 3.1973, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.47% (5.3855 => 3.7448, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.03% (5.3526 => 3.7454, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0472, std. dev.: 0.0416) MultiSource/Applications/ClamAV/clamscan: -14.02% (22.1758 => 19.0662, std. dev.: 0.2105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.62% (2.9384 => 2.5677, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2373 => 1.1027, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/mandel-2: -9.11% (1.5373 => 1.3973, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4672, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.13% (8.6802 => 8.4081, std. dev.: 0.0255) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9844, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3292, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9584, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3368, std. dev.: 0.0106) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8123, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 21 23:59:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 01:59:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120822065922.D04A52A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3110?compare_to=3105&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3110, Order: 162340, Start Time: 2012-08-22 04:16:22, End Time: 2012-08-22 07:00:13 To: 3105, Order: 162331, Start Time: 2012-08-22 01:05:00, End Time: 2012-08-22 03:48:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (752 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.10% (122.5011 => 131.1938, std. dev.: 0.3027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.13% (2.4663 => 2.3890, std. dev.: 0.0164) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 15.83% (0.3442 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.83% (0.3488 => 0.4040, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.76% (0.3446 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.73% (0.3465 => 0.4010, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 15.69% (0.3460 => 0.4003, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.65% (0.3496 => 0.4043, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 15.60% (0.3469 => 0.4010, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 15.15% (0.3650 => 0.4203, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 15.10% (0.3643 => 0.4193, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.90% (0.3724 => 0.4279, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.07% (0.1063 => 0.1170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.97% (0.3792 => 0.4170, std. dev.: 0.0095) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5826 => 0.6354, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.5889 => 0.6390, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.02% (0.1620 => 0.1750, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.78% (1.5932 => 1.7172, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.15% (0.7171 => 0.7684, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (3.5627 => 3.8116, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.89% (0.4994 => 0.5338, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (1.6211 => 1.7327, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.56% (1.3152 => 1.4015, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.41% (0.2014 => 0.2143, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.28% (0.4361 => 0.4635, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.14% (0.5000 => 0.5307, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2738 => 0.2906, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (0.5026 => 0.5334, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.5900 => 0.6259, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.08% (0.3930 => 0.4169, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.01% (0.4029 => 0.4271, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.73% (1.0781 => 1.1399, std. dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: 5.72% (4.2109 => 4.4517, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.67% (0.2875 => 0.3038, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.54% (0.1968 => 0.2077, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (2.7292 => 2.8784, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.43% (0.2725 => 0.2873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2729 => 0.2877, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.27% (0.2866 => 0.3017, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.26% (0.3004 => 0.3162, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.20% (0.3195 => 0.3361, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.19% (0.2792 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2803 => 0.2948, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.16% (5.5417 => 5.8277, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/strcat: 5.09% (0.2750 => 0.2890, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.07% (0.3096 => 0.3253, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.05% (0.9909 => 1.0409, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2823 => 0.2965, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.01% (0.2813 => 0.2954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.98% (0.2811 => 0.2951, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.98% (2.1013 => 2.2059, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.93% (0.2780 => 0.2917, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.92% (2.0673 => 2.1690, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (0.3890 => 0.4080, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.86% (1.9694 => 2.0651, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2911 => 0.3052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.84% (0.3267 => 0.3425, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.77% (0.3124 => 0.3273, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (1.9966 => 2.0916, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.3258 => 0.3413, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.75% (0.2566 => 0.2688, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.71% (0.3060 => 0.3204, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (0.4658 => 0.4877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.64% (0.3317 => 0.3471, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.59% (0.3726 => 0.3897, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.52% (0.3625 => 0.3789, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.45% (0.3282 => 0.3428, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.43% (0.3678 => 0.3841, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 4.43% (0.3477 => 0.3631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.42% (0.3348 => 0.3496, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.3903 => 0.4075, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3690 => 0.3850, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 4.32% (4.6177 => 4.8173, std. dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 4.28% (2.1653 => 2.2579, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 4.17% (0.4146 => 0.4319, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.12% (0.3981 => 0.4145, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.08% (0.4139 => 0.4308, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (4.4195 => 4.5997, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4251 => 0.4424, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.01% (1.8794 => 1.9548, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 4.01% (1.4269 => 1.4841, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.95% (0.3845 => 0.3997, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 3.83% (0.6634 => 0.6888, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 3.81% (0.7875 => 0.8175, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.70% (0.5546 => 0.5751, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.69% (0.2737 => 0.2838, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.2969 => 0.3077, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.62% (0.9697 => 1.0048, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.56% (0.6435 => 0.6664, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.47% (0.3084 => 0.3191, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 3.30% (0.3336 => 0.3446, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.5012 => 0.5172, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.96% (23.5202 => 24.2162, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 2.46% (2.0346 => 2.0847, std. dev.: 0.0149) MultiSource/Benchmarks/PAQ8p/paq8p: 2.21% (0.4847 => 0.4954, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (0.7426 => 0.7555, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (4.6926 => 4.7488, std. dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (11.6398 => 11.7629, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.73% (0.2122 => 0.2286, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6586, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6332, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1955, std. dev.: 0.0095) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5061, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2238, std. dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4380, std. dev.: 0.0293) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.50% (2.0820 => 2.1132, std. dev.: 0.0100) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.27% (7.1849 => 7.2765, std. dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6006, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4669, std. dev.: 0.1302) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.53% (2.4764 => 2.3890, std. dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5894, std. dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7891, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8075, std. dev.: 0.0061) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.84% (0.6293 => 0.6114, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7656, std. dev.: 0.0715) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5802, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9653, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 00:43:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 02:43:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822074340.1F9D52A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3111?compare_to=3108&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3111, Order: 162343, Start Time: 2012-08-22 06:27:19, End Time: 2012-08-22 07:44:29 To: 3108, Order: 162340, Start Time: 2012-08-22 04:45:35, End Time: 2012-08-22 05:59:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (147 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.33% (78.0696 => 80.6659, std. dev.: 0.3747) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.5315 => 56.3280, std. dev.: 0.1668) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.48% (2.0176 => 2.3098, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 11.26% (0.5818 => 0.6473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.07% (0.3578 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.06% (0.5748 => 0.6384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.77% (0.3601 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.71% (0.3650 => 0.4041, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 10.70% (0.3646 => 0.4036, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.68% (0.3623 => 0.4010, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3663 => 0.4054, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3789 => 0.4192, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3914 => 0.4325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.20% (0.3940 => 0.4342, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.19% (0.4003 => 0.4411, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.41% (0.1819 => 0.1972, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.18% (0.7710 => 0.8341, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 8.15% (1.3693 => 1.4809, std. dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 7.95% (0.4328 => 0.4672, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.90% (3.9660 => 4.2794, std. dev.: 0.0088) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.63% (0.4062 => 0.4372, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.62% (0.5265 => 0.5666, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.55% (0.2596 => 0.2792, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 7.35% (0.7038 => 0.7555, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.25% (0.3022 => 0.3241, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.21% (0.2761 => 0.2960, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.15% (0.2937 => 0.3147, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.12% (0.3485 => 0.3733, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.12% (1.9828 => 2.1239, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.02% (0.3489 => 0.3734, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.01% (0.2726 => 0.2917, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.00% (0.3899 => 0.4172, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.90% (0.9199 => 0.9834, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.88% (1.2193 => 1.3032, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4379 => 0.4675, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.70% (0.3192 => 0.3406, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.67% (0.6959 => 0.7423, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.1789 => 0.1907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3453 => 0.3680, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 6.36% (0.1589 => 0.1690, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.36% (0.4390 => 0.4669, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 6.34% (0.3534 => 0.3758, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.23% (0.3293 => 0.3498, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.22% (0.5577 => 0.5924, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.15% (1.1364 => 1.2063, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.15% (0.4016 => 0.4263, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.07% (0.2914 => 0.3091, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 6.04% (13.8202 => 14.6549, std. dev.: 0.3164) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.3868 => 0.4098, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.87% (0.2945 => 0.3118, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.87% (0.5637 => 0.5968, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.76% (0.3246 => 0.3433, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.73% (1.4563 => 1.5398, std. dev.: 0.0100) MultiSource/Benchmarks/McCat/09-vor/vor: 5.71% (0.2925 => 0.3092, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 5.57% (0.2243 => 0.2368, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (7.2180 => 7.6181, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 5.43% (3.8646 => 4.0745, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 5.36% (1.2292 => 1.2951, std. dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.3245 => 1.3949, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.27% (1.3819 => 1.4547, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.27% (0.7460 => 0.7853, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.22% (0.8310 => 0.8744, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (1.3813 => 1.4518, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.10% (0.6135 => 0.6448, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (4.3801 => 4.6033, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (3.6692 => 3.8558, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 5.08% (0.4113 => 0.4322, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.0594 => 1.1129, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.03% (0.3755 => 0.3944, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.98% (4.4433 => 4.6647, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.82% (0.4791 => 0.5022, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.81% (0.3220 => 0.3375, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.77% (0.6283 => 0.6583, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3939, std. dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (13.2842 => 13.8792, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.3245 => 0.3376, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.01% (1.1333 => 1.1787, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (0.8698 => 0.9046, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.99% (0.8818 => 0.9170, std. dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 3.77% (0.3131 => 0.3249, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.67% (8.4961 => 8.8079, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.62% (4.9865 => 5.1669, std. dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 3.17% (16.2614 => 16.7775, std. dev.: 0.0184) MultiSource/Applications/ClamAV/clamscan: 3.12% (14.5298 => 14.9834, std. dev.: 0.0549) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.03% (3.2742 => 3.3734, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5188 => 1.5593, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.61% (0.9108 => 0.9346, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6250 => 0.6407, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.18% (3.7467 => 3.8282, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.1007 => 2.1456, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 2.02% (0.6744 => 0.6880, std. dev.: 0.0018) MultiSource/Applications/lemon/lemon: 2.01% (1.0313 => 1.0520, std. dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.00% (6.2785 => 6.4043, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 1.07% (33.2944 => 33.6496, std. dev.: 0.0216) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.91% (1.8175 => 2.2703, std. dev.: 0.0404) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.09% (1.2998 => 1.4180, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.32% (11.2619 => 11.7479, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9870, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8183, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5862, std. dev.: 0.0187) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6782, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3261, std. dev.: 0.0191) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6878, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 1.10% (26.5159 => 26.8079, std. dev.: 0.0367) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.64% (22.5627 => 21.2912, std. dev.: 0.0582) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.39% (0.3511 => 0.3392, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.2308 => 1.1039, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5098, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3143, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.47% (0.4867 => 0.4698, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5827, std. dev.: 0.0234) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.12% (3.0263 => 2.9622, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2441, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2063, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3600, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 01:33:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 03:33:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822083325.A89C12A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3112?compare_to=3109&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3112, Order: 162350, Start Time: 2012-08-22 07:14:50, End Time: 2012-08-22 08:34:15 To: 3109, Order: 162341, Start Time: 2012-08-22 05:23:32, End Time: 2012-08-22 06:42:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (131 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.06% (13.9212 => 14.3467, std. dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.79% (55.0027 => 56.5397, std. dev.: 0.0594) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.38% (10.3673 => 14.3467, std. dev.: 0.0142) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.75% (0.3497 => 0.3978, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.66% (0.3543 => 0.4027, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.60% (0.3543 => 0.4025, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 13.56% (0.3561 => 0.4044, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.48% (0.3516 => 0.3990, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.08% (0.3694 => 0.4177, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.80% (0.3828 => 0.4318, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/property: 12.48% (0.3886 => 0.4371, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2540, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.68% (1.7609 => 1.9490, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.50% (2.2022 => 2.4114, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.88% (0.1892 => 0.2041, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.45% (0.1584 => 0.1702, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 7.04% (0.5925 => 0.6342, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.4879 => 0.5191, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.15% (0.4615 => 0.4899, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 5.97% (0.3282 => 0.3478, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 5.96% (0.1695 => 0.1796, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 5.95% (0.7326 => 0.7762, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.86% (7.0540 => 7.4672, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.59% (0.3307 => 0.3492, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.54% (10.4361 => 11.0141, std. dev.: 0.0246) MultiSource/Applications/lambda-0_1_3/lambda: 5.26% (0.7433 => 0.7824, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 5.25% (9.4845 => 9.9823, std. dev.: 0.0227) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.8172 => 0.8597, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.15% (0.2271 => 0.2388, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.15% (4.9449 => 5.1994, std. dev.: 0.0088) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (5.0018 => 5.2523, std. dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: 4.97% (0.2554 => 0.2681, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.81% (4.2646 => 4.4698, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.3121 => 0.3270, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.76% (0.5569 => 0.5834, std. dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 4.73% (0.3109 => 0.3256, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 4.61% (0.4299 => 0.4497, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2891 => 0.3024, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.5860 => 0.6128, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 4.47% (0.3423 => 0.3576, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.47% (1.3050 => 1.3633, std. dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 4.41% (0.2905 => 0.3033, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.32% (8.1363 => 8.4877, std. dev.: 0.0077) MultiSource/Applications/spiff/spiff: 4.30% (0.7835 => 0.8172, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/fibo: 4.29% (0.2725 => 0.2842, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.28% (0.2756 => 0.2874, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.24% (0.3865 => 0.4029, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.23% (5.7591 => 6.0028, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 4.20% (0.2831 => 0.2950, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.17% (0.4103 => 0.4274, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 4.13% (0.4289 => 0.4466, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3232 => 0.3365, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3052 => 0.3177, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 4.05% (0.2714 => 0.2824, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.05% (0.2793 => 0.2906, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.04% (1.5603 => 1.6234, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3441 => 0.3580, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.02% (0.5105 => 0.5310, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.98% (1.1642 => 1.2105, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 3.96% (0.3283 => 0.3413, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.95% (0.3162 => 0.3287, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.95% (0.4636 => 0.4819, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.93% (0.3180 => 0.3305, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.93% (0.2700 => 0.2806, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.92% (0.3650 => 0.3793, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 3.92% (0.3422 => 0.3556, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.90% (0.9765 => 1.0146, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 3.89% (0.2802 => 0.2911, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.87% (0.2871 => 0.2982, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6450 => 0.6699, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.86% (0.3136 => 0.3257, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (1.1861 => 1.2316, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2872 => 0.2982, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.82% (2.0665 => 2.1454, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.81% (0.6675 => 0.6929, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.76% (0.3826 => 0.3970, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 3.75% (0.2877 => 0.2985, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.74% (0.8921 => 0.9255, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.69% (1.5415 => 1.5984, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: 3.64% (0.3379 => 0.3502, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 3.57% (0.3387 => 0.3508, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.50% (0.3603 => 0.3729, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.49% (3.3354 => 3.4519, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (0.4064 => 0.4205, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.43% (0.3935 => 0.4070, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.42% (0.6456 => 0.6677, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.35% (2.0273 => 2.0953, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4620 => 0.4774, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.31% (0.4048 => 0.4182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.4203 => 0.4342, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.27% (1.2842 => 1.3262, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 3.27% (3.8723 => 3.9989, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.24% (0.5981 => 0.6175, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.06% (0.3427 => 0.3532, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (14.3668 => 14.8057, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.4186 => 1.4615, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.71% (0.5020 => 0.5156, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 2.66% (2.2969 => 2.3579, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5859 => 1.6279, std. dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 2.55% (17.1811 => 17.6184, std. dev.: 0.0116) MultiSource/Applications/minisat/minisat: 2.29% (0.7115 => 0.7278, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 2.22% (1.1840 => 1.2103, std. dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.00% (7.9617 => 8.1213, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.92% (2.2024 => 2.2447, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.69% (1.0722 => 1.0903, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 1.25% (21.9371 => 22.2123, std. dev.: 0.0324) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (4.2280 => 4.4332, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 2.91% (26.0924 => 26.8522, std. dev.: 0.0369) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3343, std. dev.: 0.0087) MultiSource/Applications/minisat/minisat: 1.55% (9.1159 => 9.2573, std. dev.: 0.0281) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1578 => 3.1971, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std. dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.30% (5.2763 => 3.2026, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7172, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.57% (5.3526 => 3.7165, std. dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -15.14% (54.1659 => 45.9677, std. dev.: 0.0103) MultiSource/Applications/ClamAV/clamscan: -14.03% (22.1758 => 19.0643, std. dev.: 0.0648) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.90% (2.9384 => 2.5594, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -10.44% (1.2373 => 1.1081, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -7.01% (1.5373 => 1.4296, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -5.32% (1.5835 => 1.4992, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4714, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4270, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.65% (10.2830 => 10.0105, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9569, std. dev.: 0.0077) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5080, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3484, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 02:26:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 04:26:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822092624.219C42A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3113?compare_to=3111&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3113, Order: 162350, Start Time: 2012-08-22 08:12:44, End Time: 2012-08-22 09:27:14 To: 3111, Order: 162343, Start Time: 2012-08-22 06:27:19, End Time: 2012-08-22 07:44:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (163 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (692 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.87% (2.0176 => 2.3176, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.45% (0.5818 => 0.6484, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3578 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.00% (0.3646 => 0.4047, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.00% (0.3601 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.90% (0.3650 => 0.4048, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.90% (0.3623 => 0.4018, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.89% (0.3663 => 0.4062, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.82% (0.3789 => 0.4199, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.65% (0.3914 => 0.4331, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.4003 => 0.4424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.37% (0.7061 => 0.7793, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 10.25% (0.3940 => 0.4344, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std. dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.2781 => 0.3029, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 8.87% (0.4328 => 0.4712, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.85% (0.1413 => 0.1538, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 8.84% (1.3693 => 1.4904, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.74% (0.1819 => 0.1978, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.70% (0.2782 => 0.3024, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.52% (0.4062 => 0.4408, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.32% (0.2607 => 0.2824, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.29% (0.2690 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.29% (0.7710 => 0.8349, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.29% (0.2655 => 0.2875, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.27% (3.9660 => 4.2939, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/except: 8.22% (0.2760 => 0.2987, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 8.22% (0.2628 => 0.2844, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.10% (0.2765 => 0.2989, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.08% (0.3489 => 0.3771, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 8.07% (0.2937 => 0.3174, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.06% (1.9828 => 2.1426, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.04% (0.3022 => 0.3265, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.04% (0.2761 => 0.2983, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.03% (0.2726 => 0.2945, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.02% (0.2966 => 0.3204, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.99% (0.3580 => 0.3866, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.90% (0.2696 => 0.2909, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.82% (0.3107 => 0.3350, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.81% (0.7038 => 0.7588, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary3: 7.75% (0.3149 => 0.3393, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.73% (0.2988 => 0.3219, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.72% (0.3899 => 0.4200, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.64% (0.5265 => 0.5667, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.63% (0.2596 => 0.2794, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.55% (0.3485 => 0.3748, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.52% (0.3192 => 0.3432, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3453 => 0.3710, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.32% (1.2193 => 1.3086, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.15% (0.9199 => 0.9857, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3293 => 0.3524, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 6.96% (0.3534 => 0.3780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.95% (0.4016 => 0.4295, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (0.4390 => 0.4694, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.91% (0.6959 => 0.7440, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3868 => 0.4133, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.74% (0.1588 => 0.1695, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.72% (0.2945 => 0.3143, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.66% (0.3756 => 0.4006, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.63% (0.2127 => 0.2268, std. dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.54% (1.1364 => 1.2107, std. dev.: 0.0094) MultiSource/Applications/SPASS/SPASS: 6.53% (13.8202 => 14.7229, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.49% (0.5577 => 0.5939, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.44% (1.4563 => 1.5501, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 6.42% (0.1589 => 0.1691, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.38% (0.3246 => 0.3453, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.35% (0.2914 => 0.3099, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.33% (0.2023 => 0.2151, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.16% (0.5637 => 0.5984, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.15% (0.2925 => 0.3105, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.13% (1.2292 => 1.3046, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.02% (0.7506 => 0.7958, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 6.02% (0.2243 => 0.2378, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.00% (7.2180 => 7.6509, std. dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 5.88% (0.2995 => 0.3171, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.78% (1.3813 => 1.4612, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3755 => 0.3971, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.72% (1.3819 => 1.4609, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 5.66% (0.8310 => 0.8780, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.65% (1.3245 => 1.3994, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.64% (3.8646 => 4.0826, std. dev.: 0.0211) MultiSource/Applications/Burg/burg: 5.62% (1.1061 => 1.1683, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.56% (0.2140 => 0.2259, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.51% (0.7460 => 0.7871, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.48% (4.3801 => 4.6202, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (3.6692 => 3.8688, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 5.40% (0.4113 => 0.4335, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.39% (1.9270 => 2.0309, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.37% (0.3220 => 0.3393, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.31% (4.4433 => 4.6792, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 5.30% (1.0594 => 1.1155, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.27% (0.6283 => 0.6614, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.4791 => 0.5043, std. dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 5.12% (16.6129 => 17.4628, std. dev.: 0.0068) MultiSource/Applications/siod/siod: 5.05% (2.1791 => 2.2891, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (13.2842 => 13.9521, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.97% (0.8818 => 0.9256, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.92% (0.6135 => 0.6437, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 4.69% (14.8535 => 15.5503, std. dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.56% (0.8698 => 0.9095, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.2243 => 0.2345, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (1.1333 => 1.1841, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.41% (0.3245 => 0.3388, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.31% (0.3131 => 0.3266, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.26% (3.1889 => 3.3246, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 4.18% (8.4961 => 8.8513, std. dev.: 0.0174) MultiSource/Benchmarks/Olden/bh/bh: 4.16% (0.2859 => 0.2978, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.99% (4.9865 => 5.1854, std. dev.: 0.0183) MultiSource/Applications/JM/ldecod/ldecod: 3.96% (6.5754 => 6.8360, std. dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 3.84% (4.6629 => 4.8421, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.45% (3.2742 => 3.3873, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.39% (0.6250 => 0.6462, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.32% (0.9108 => 0.9410, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.30% (14.5298 => 15.0090, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 3.27% (16.2614 => 16.7928, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (1.5188 => 1.5646, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1555, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.53% (6.2785 => 6.4376, std. dev.: 0.0060) MultiSource/Applications/lua/lua: 2.48% (3.7467 => 3.8396, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.4805 => 0.4918, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 2.33% (1.0313 => 1.0553, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.25% (0.6744 => 0.6896, std. dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 1.74% (1.2749 => 1.2971, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.68% (33.2944 => 33.8532, std. dev.: 0.0315) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5116, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0507) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.77% (1.2998 => 1.4138, std. dev.: 0.0179) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.78% (0.2093 => 0.2214, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.94% (1.5824 => 1.6606, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7419, std. dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.53% (1.9199 => 1.9877, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5983, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.01% (10.7476 => 10.9641, std. dev.: 0.0281) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5928 => 4.6760, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3260, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2066, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (1.5089 => 1.5301, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.22% (26.5159 => 26.8396, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.36% (22.5627 => 21.3525, std. dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2308 => 1.0965, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.70% (1.3780 => 1.3132, std. dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5921, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9627, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2258, std. dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2062, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3597, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.13% (5.5401 => 5.4775, std. dev.: 0.0190) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (20.3410 => 20.1219, std. dev.: 0.0415) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2400, std. dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 03:17:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 05:17:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120822101724.241DC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3114?compare_to=3110&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3114, Order: 162350, Start Time: 2012-08-22 07:34:13, End Time: 2012-08-22 10:18:14 To: 3110, Order: 162340, Start Time: 2012-08-22 04:16:22, End Time: 2012-08-22 07:00:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 31.17% (0.3792 => 0.4974, std. dev.: 0.0319) SingleSource/UnitTests/ObjC/for-in: 13.84% (0.3496 => 0.3980, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.76% (0.3446 => 0.3920, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3442 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.59% (0.3488 => 0.3962, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.55% (0.3460 => 0.3929, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.15% (0.3650 => 0.4130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.12% (0.3643 => 0.4121, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.16% (0.1063 => 0.1171, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.05% (1.5932 => 1.7215, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 7.91% (0.5826 => 0.6287, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.90% (0.5889 => 0.6354, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.1619 => 0.1735, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (1.6211 => 1.7238, std. dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference: 6.26% (0.7171 => 0.7620, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.16% (3.5627 => 3.7822, std. dev.: 0.0085) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (0.5000 => 0.5306, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.07% (1.3152 => 1.3950, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.07% (0.4994 => 0.5297, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (0.4361 => 0.4613, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.73% (0.4029 => 0.4260, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.70% (0.2875 => 0.3039, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.67% (0.5026 => 0.5311, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.53% (0.5900 => 0.6226, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.51% (0.2738 => 0.2889, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.51% (4.2109 => 4.4431, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.46% (0.2729 => 0.2878, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 5.35% (1.0781 => 1.1358, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 5.30% (0.2566 => 0.2702, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.30% (0.9909 => 1.0434, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2803 => 0.2951, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.26% (0.3096 => 0.3259, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.19% (0.2792 => 0.2937, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.09% (0.3004 => 0.3157, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.09% (0.2750 => 0.2890, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.07% (0.3195 => 0.3357, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.2780 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (0.2823 => 0.2965, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.01% (2.0673 => 2.1709, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 4.98% (0.2813 => 0.2953, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3060 => 0.3211, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.3362 => 0.3525, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.82% (1.9694 => 2.0643, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.81% (0.2911 => 0.3051, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.78% (5.5417 => 5.8068, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary3: 4.78% (0.3267 => 0.3423, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.74% (0.3124 => 0.3272, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3258 => 0.3412, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (2.7292 => 2.8562, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.2866 => 0.2998, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 4.58% (0.3317 => 0.3469, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.54% (0.3726 => 0.3895, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.53% (0.2736 => 0.2860, std. dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.51% (0.9697 => 1.0134, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.45% (0.3348 => 0.3497, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.44% (1.9966 => 2.0852, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.42% (0.3690 => 0.3853, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3625 => 0.3784, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.38% (0.3678 => 0.3839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.37% (0.3477 => 0.3629, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3282 => 0.3424, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (0.3890 => 0.4056, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.24% (1.8794 => 1.9590, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (0.4658 => 0.4854, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (2.1013 => 2.1888, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.12% (0.3981 => 0.4145, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4251 => 0.4425, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.09% (4.6177 => 4.8066, std. dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 4.04% (2.1653 => 2.2527, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.98% (4.4195 => 4.5956, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.4139 => 0.4301, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.91% (0.7875 => 0.8183, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 3.90% (1.4269 => 1.4826, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.3845 => 0.3991, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 3.79% (0.5546 => 0.5756, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 3.68% (0.6634 => 0.6878, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.3903 => 0.4046, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.55% (23.5202 => 24.3542, std. dev.: 0.0317) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.3084 => 0.3193, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.51% (0.6435 => 0.6661, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.51% (0.3336 => 0.3453, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.45% (0.5012 => 0.5185, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.46% (2.0346 => 2.0846, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (0.4847 => 0.4959, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.66% (0.7426 => 0.7549, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.26% (11.6398 => 11.7867, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.23% (4.6926 => 4.7503, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.06% (0.2162 => 0.3547, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.28% (0.2122 => 0.2319, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6631, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8966, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1622, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6317, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1953, std. dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5095, std. dev.: 0.0228) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5918, std. dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.51% (41.7953 => 42.4270, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.30% (7.1849 => 7.2782, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5967, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4666, std. dev.: 0.1583) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.21% (2.4764 => 2.3968, std. dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5924, std. dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7979, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.2402 => 0.2262, std. dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7873, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0054) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.79% (17.2379 => 16.7568, std. dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (16.2163 => 15.9662, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 03:29:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 05:29:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822102929.7BE692A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3115?compare_to=3112&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3115, Order: 162352, Start Time: 2012-08-22 09:11:03, End Time: 2012-08-22 10:30:19 To: 3112, Order: 162350, Start Time: 2012-08-22 07:14:50, End Time: 2012-08-22 08:34:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (131 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (706 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 38.47% (10.3673 => 14.3554, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 13.96% (0.3473 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.89% (0.3543 => 0.4035, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3497 => 0.3977, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-4: 13.63% (0.3543 => 0.4026, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.54% (0.3516 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.54% (0.3561 => 0.4043, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3694 => 0.4178, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.85% (0.3828 => 0.4320, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.71% (0.3927 => 0.4426, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.48% (0.3886 => 0.4371, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.98% (1.1194 => 1.2535, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.69% (1.7609 => 1.9491, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.51% (2.2022 => 2.4116, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.14% (0.1892 => 0.2046, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2065 => 0.2221, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1584 => 0.1701, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.14% (0.5925 => 0.6348, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.6030 => 0.6456, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.99% (0.3177 => 0.3399, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.78% (0.1622 => 0.1732, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.54% (0.4615 => 0.4917, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.31% (0.4879 => 0.5187, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 6.16% (0.1655 => 0.1757, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.95% (7.0540 => 7.4736, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 5.94% (0.3282 => 0.3477, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.92% (0.7326 => 0.7760, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.65% (0.3307 => 0.3494, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.63% (0.8172 => 0.8632, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.62% (10.4361 => 11.0230, std. dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.42% (0.2271 => 0.2394, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.32% (0.2107 => 0.2219, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.30% (0.7433 => 0.7827, std. dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 5.26% (9.4845 => 9.9835, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.19% (4.9449 => 5.2016, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.19% (0.3121 => 0.3283, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2554 => 0.2686, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.00% (5.0018 => 5.2519, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.94% (4.2646 => 4.4753, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.81% (0.2891 => 0.3030, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.77% (0.4299 => 0.4504, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 4.76% (0.3109 => 0.3257, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.66% (0.5860 => 0.6133, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 4.65% (0.3423 => 0.3582, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.5569 => 0.5822, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.47% (0.4636 => 0.4843, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.43% (1.3050 => 1.3628, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.40% (8.1363 => 8.4941, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: 4.37% (0.2725 => 0.2844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.32% (0.2756 => 0.2875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.27% (0.2905 => 0.3029, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.3052 => 0.3182, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.25% (5.7591 => 6.0040, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3232 => 0.3369, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.24% (0.7835 => 0.8167, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 4.22% (0.4289 => 0.4470, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 4.21% (0.2871 => 0.2992, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.19% (1.5603 => 1.6256, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 4.09% (0.3180 => 0.3310, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3650 => 0.3799, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.07% (0.5105 => 0.5313, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.07% (0.4103 => 0.4270, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.06% (0.2758 => 0.2870, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.04% (2.0665 => 2.1500, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.04% (0.2700 => 0.2809, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 4.02% (0.3283 => 0.3415, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.01% (0.3441 => 0.3579, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.01% (0.2793 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 4.00% (0.3098 => 0.3222, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.97% (0.6450 => 0.6706, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2802 => 0.2913, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.94% (0.9765 => 1.0150, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.94% (1.5415 => 1.6022, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.93% (0.8067 => 0.8384, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.89% (0.3826 => 0.3975, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.86% (0.3136 => 0.3257, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.86% (0.3162 => 0.3284, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 3.86% (0.2877 => 0.2988, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2872 => 0.2982, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.81% (1.1861 => 1.2313, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.81% (0.6675 => 0.6929, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3379 => 0.3504, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3603 => 0.3735, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.66% (0.3387 => 0.3511, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.55% (1.1642 => 1.2055, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.4064 => 0.4208, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.52% (0.6456 => 0.6683, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.48% (0.4620 => 0.4781, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.46% (3.3354 => 3.4507, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.45% (2.0273 => 2.0973, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.43% (0.3935 => 0.4070, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.40% (1.2842 => 1.3278, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 3.39% (3.8723 => 4.0035, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3427 => 0.3542, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.33% (0.4048 => 0.4183, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5981 => 0.6169, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (14.3668 => 14.7933, std. dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (1.4186 => 1.4606, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 2.83% (2.2969 => 2.3620, std. dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8921 => 0.9171, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.77% (0.5020 => 0.5159, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.51% (17.1811 => 17.6128, std. dev.: 0.0098) MultiSource/Applications/minisat/minisat: 2.26% (0.7115 => 0.7276, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 2.20% (1.1840 => 1.2101, std. dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.06% (7.9617 => 8.1255, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2460, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.69% (1.0722 => 1.0903, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.34% (21.9371 => 22.2310, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.26% (0.8101 => 0.8203, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8966, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.05% (4.2280 => 4.4416, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.60% (0.2944 => 0.3050, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7502, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 3.02% (26.0924 => 26.8811, std. dev.: 0.0195) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3343, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2484, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1982, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.20% (1.5086 => 1.5267, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std. dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.32% (5.2763 => 3.2019, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7169, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7173, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -15.19% (54.1659 => 45.9406, std. dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: -13.98% (22.1758 => 19.0753, std. dev.: 0.0262) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.88% (2.9384 => 2.5600, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2373 => 1.1089, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -7.23% (1.5373 => 1.4261, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -6.13% (1.5835 => 1.4865, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4617, std. dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4101, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0033, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9645, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3376, std. dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 04:08:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 06:08:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822110816.C4EA52A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3116?compare_to=3113&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3116, Order: 162352, Start Time: 2012-08-22 09:54:59, End Time: 2012-08-22 11:09:09 To: 3113, Order: 162350, Start Time: 2012-08-22 08:12:44, End Time: 2012-08-22 09:27:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (161 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (695 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.89% (2.0176 => 2.3181, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.71% (0.0826 => 0.0931, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.46% (0.5818 => 0.6485, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3578 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.26% (0.5748 => 0.6395, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.05% (0.3601 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.99% (0.7061 => 0.7837, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.97% (0.3663 => 0.4065, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 10.94% (0.3646 => 0.4045, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.93% (0.3650 => 0.4049, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.90% (0.3789 => 0.4202, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-3: 10.79% (0.3623 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3914 => 0.4328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.4003 => 0.4421, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.43% (0.3940 => 0.4351, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.85% (0.1819 => 0.1980, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2781 => 0.3027, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 8.81% (1.3693 => 1.4899, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 8.80% (0.4328 => 0.4709, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.78% (0.1413 => 0.1537, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.63% (0.2782 => 0.3022, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.44% (0.7710 => 0.8361, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 8.39% (0.4062 => 0.4403, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2607 => 0.2825, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.26% (0.2760 => 0.2988, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.24% (3.9660 => 4.2929, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.22% (0.2690 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.17% (0.2655 => 0.2872, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.17% (0.5265 => 0.5695, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 8.14% (0.2628 => 0.2842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.14% (0.2765 => 0.2990, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.07% (0.2937 => 0.3174, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.03% (1.9828 => 2.1421, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 8.00% (0.2761 => 0.2982, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 8.00% (0.2988 => 0.3227, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.96% (0.3580 => 0.3865, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.96% (0.2726 => 0.2943, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.96% (0.2966 => 0.3202, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.90% (0.2696 => 0.2909, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.88% (0.3489 => 0.3764, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.86% (0.2596 => 0.2800, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 7.85% (0.3107 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.75% (0.3899 => 0.4201, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.74% (0.7038 => 0.7583, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 7.72% (0.3149 => 0.3392, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3192 => 0.3431, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3453 => 0.3710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.27% (0.9199 => 0.9868, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.25% (1.2193 => 1.3077, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 7.08% (0.3293 => 0.3526, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 7.05% (0.3534 => 0.3783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.01% (0.6959 => 0.7447, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.90% (0.4016 => 0.4293, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.88% (0.1789 => 0.1912, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.77% (0.2127 => 0.2271, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 6.69% (0.2945 => 0.3142, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.65% (0.5577 => 0.5948, std. dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 6.62% (13.8202 => 14.7347, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.60% (0.3756 => 0.4004, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (1.1364 => 1.2110, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 6.22% (1.2292 => 1.3056, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.20% (0.2243 => 0.2382, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.2914 => 0.3094, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3246 => 0.3446, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.16% (0.5637 => 0.5984, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.08% (1.4563 => 1.5448, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 6.02% (0.2925 => 0.3101, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.97% (0.7506 => 0.7954, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.93% (0.8310 => 0.8803, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (7.2180 => 7.6461, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.81% (0.3755 => 0.3973, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.76% (1.3245 => 1.4008, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.69% (3.8646 => 4.0845, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 5.61% (0.2995 => 0.3163, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.57% (1.1061 => 1.1677, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.57% (1.3813 => 1.4582, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.56% (1.3819 => 1.4587, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.2140 => 0.2258, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.49% (3.6692 => 3.8706, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.45% (0.4113 => 0.4337, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.44% (4.3801 => 4.6184, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.42% (0.7460 => 0.7864, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 5.41% (1.0594 => 1.1167, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.6283 => 0.6622, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 5.28% (1.9270 => 2.0288, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (4.4433 => 4.6769, std. dev.: 0.0120) MultiSource/Applications/siod/siod: 5.16% (2.1791 => 2.2915, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.16% (0.4791 => 0.5038, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 5.12% (0.3220 => 0.3385, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.09% (0.6135 => 0.6447, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 5.03% (16.6129 => 17.4477, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.99% (13.2842 => 13.9472, std. dev.: 0.0200) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.81% (0.2243 => 0.2351, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.73% (0.8818 => 0.9235, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 4.63% (14.8535 => 15.5417, std. dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (1.1333 => 1.1855, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.52% (0.8698 => 0.9091, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.38% (0.3245 => 0.3387, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.25% (3.1889 => 3.3244, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.22% (0.3131 => 0.3263, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (8.4961 => 8.8472, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 4.02% (0.2859 => 0.2974, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.01% (4.9865 => 5.1864, std. dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 3.93% (6.5754 => 6.8339, std. dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 3.85% (4.6629 => 4.8424, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.49% (3.2742 => 3.3884, std. dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.5298 => 15.0257, std. dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: 3.34% (0.6250 => 0.6459, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.28% (0.9108 => 0.9407, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.26% (16.2614 => 16.7909, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.14% (1.5188 => 1.5665, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1564, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.45% (0.6744 => 0.6909, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.42% (6.2785 => 6.4306, std. dev.: 0.0055) MultiSource/Applications/lua/lua: 2.42% (3.7467 => 3.8373, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.37% (0.4805 => 0.4919, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.31% (1.0313 => 1.0551, std. dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 1.81% (1.2749 => 1.2980, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 1.64% (33.2944 => 33.8390, std. dev.: 0.0204) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2671, std. dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.71% (1.2998 => 1.4260, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7419, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.77% (1.7688 => 1.8178, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3841, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6036, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.97% (10.7476 => 10.9596, std. dev.: 0.0564) MultiSource/Applications/sqlite3/sqlite3: 1.89% (4.5928 => 4.6798, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3252, std. dev.: 0.0056) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5187, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5281, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.18% (26.5159 => 26.8290, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6469 => 3.6844, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.28% (22.5627 => 21.3716, std. dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.01% (1.2308 => 1.0953, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5100, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5885, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9285, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9607, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2275, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3305 => 7.2121, std. dev.: 0.0250) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7922, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3591, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4763, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.03% (20.3410 => 20.1321, std. dev.: 0.0273) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 05:16:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 07:16:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822121624.E37022A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3117?compare_to=3115&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3117, Order: 162354, Start Time: 2012-08-22 10:58:07, End Time: 2012-08-22 12:17:18 To: 3115, Order: 162352, Start Time: 2012-08-22 09:11:03, End Time: 2012-08-22 10:30:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (131 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.49% (41.9441 => 42.5702, std. dev.: 0.1581) SingleSource/Benchmarks/Misc/flops-5: 1.37% (1.4865 => 1.5068, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.23% (14.3554 => 14.0354, std. dev.: 0.0155) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.38% (10.3673 => 14.0354, std. dev.: 0.0155) SingleSource/UnitTests/ObjC/trivial-interface: 13.96% (0.3473 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.76% (0.3561 => 0.4051, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3497 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.60% (0.3543 => 0.4025, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-3: 13.59% (0.3516 => 0.3994, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.55% (0.3543 => 0.4023, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.43% (0.0834 => 0.0946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.32% (0.3694 => 0.4186, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.83% (0.3828 => 0.4319, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.45% (0.3886 => 0.4370, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.45% (0.3927 => 0.4416, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.12% (1.1194 => 1.2551, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.78% (1.7609 => 1.9507, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 10.20% (0.1432 => 0.1578, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.31% (2.2022 => 2.4073, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.04% (0.1892 => 0.2063, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (0.1584 => 0.1697, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.10% (0.6030 => 0.6458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.07% (0.5925 => 0.6344, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.2065 => 0.2211, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.64% (0.8172 => 0.8715, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.54% (0.3121 => 0.3325, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.4879 => 0.5173, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 6.02% (0.7326 => 0.7767, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (0.4615 => 0.4886, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 5.85% (0.3282 => 0.3474, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.75% (7.0540 => 7.4598, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.50% (0.3307 => 0.3489, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.50% (10.4361 => 11.0102, std. dev.: 0.0231) MultiSource/Benchmarks/mafft/pairlocalalign: 5.28% (9.4845 => 9.9857, std. dev.: 0.0128) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.20% (0.2271 => 0.2389, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.14% (4.9449 => 5.1990, std. dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 5.11% (0.7433 => 0.7813, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (5.0018 => 5.2567, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.98% (0.2107 => 0.2212, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.5569 => 0.5843, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4636 => 0.4860, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 4.82% (0.2554 => 0.2677, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.79% (0.3109 => 0.3258, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.71% (0.2758 => 0.2888, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.8067 => 0.8447, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (4.2646 => 4.4631, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.54% (0.5860 => 0.6126, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 4.44% (0.3423 => 0.3575, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.34% (1.3050 => 1.3616, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.30% (8.1363 => 8.4858, std. dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 4.29% (5.7591 => 6.0063, std. dev.: 0.0079) SingleSource/Regression/C++/ofstream_ctor: 4.27% (0.2905 => 0.3029, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.21% (0.4299 => 0.4480, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.12% (0.7835 => 0.8158, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.02% (1.5415 => 1.6034, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.00% (0.5105 => 0.5309, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.98% (0.3441 => 0.3578, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3232 => 0.3360, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.94% (1.5603 => 1.6217, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.89% (0.2700 => 0.2805, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.89% (0.3422 => 0.3555, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2831 => 0.2941, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.87% (0.3180 => 0.3303, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2872 => 0.2982, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.9765 => 1.0135, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6450 => 0.6694, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 3.77% (0.3052 => 0.3167, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (1.1861 => 1.2305, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 3.73% (0.4289 => 0.4449, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2871 => 0.2978, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.70% (0.4103 => 0.4255, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3865 => 0.4007, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3650 => 0.3784, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.67% (0.3136 => 0.3251, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.66% (0.2756 => 0.2857, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.66% (0.3387 => 0.3511, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.65% (0.3098 => 0.3211, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3283 => 0.3402, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0665 => 2.1409, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.57% (0.6675 => 0.6913, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2877 => 0.2979, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.53% (0.3826 => 0.3961, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3603 => 0.3730, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.52% (3.3354 => 3.4527, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 3.46% (0.3379 => 0.3496, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.41% (1.1642 => 1.2039, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3684 => 0.3805, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.28% (0.3935 => 0.4064, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.26% (2.0273 => 2.0933, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.25% (0.6456 => 0.6666, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.4203 => 0.4339, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.23% (0.4620 => 0.4769, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.19% (0.5981 => 0.6172, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 3.19% (0.4048 => 0.4177, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.14% (1.2842 => 1.3245, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 3.11% (3.8723 => 3.9927, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.08% (14.3668 => 14.8091, std. dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.4186 => 1.4620, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 2.81% (0.8921 => 0.9172, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.75% (0.5020 => 0.5158, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 2.70% (17.1811 => 17.6452, std. dev.: 0.0090) MultiSource/Applications/siod/siod: 2.59% (2.2969 => 2.3565, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6240, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.33% (1.1840 => 1.2116, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: 2.26% (0.7115 => 0.7276, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.2024 => 2.2457, std. dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.76% (7.9617 => 8.1022, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.74% (1.0722 => 1.0909, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.27% (21.9371 => 22.2150, std. dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.53% (4.2280 => 4.4620, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.13% (3.6395 => 3.7534, std. dev.: 0.0037) MultiSource/Applications/lua/lua: 2.95% (26.0924 => 26.8633, std. dev.: 0.0429) MultiSource/Benchmarks/llubenchmark/llu: 1.81% (3.7781 => 3.8466, std. dev.: 0.0086) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3345, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (1.3045 => 1.3248, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2488, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1578 => 3.1952, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.18% (1.5086 => 1.5264, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5809, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6816, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.33% (5.2763 => 3.2012, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7191, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7179, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -15.19% (54.1659 => 45.9384, std. dev.: 0.0726) MultiSource/Applications/ClamAV/clamscan: -14.01% (22.1758 => 19.0692, std. dev.: 0.0360) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.96% (2.9384 => 2.5577, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2373 => 1.1036, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -7.24% (1.5373 => 1.4260, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4664, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4124, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9959, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9629, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3394, std. dev.: 0.0063) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0118) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.13% (1.8329 => 1.8122, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 11:45:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 13:45:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120824184546.431632A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3191?compare_to=3187&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3191, Order: 162559, Start Time: 2012-08-24 16:02:57, End Time: 2012-08-24 18:46:42 To: 3187, Order: 162552, Start Time: 2012-08-24 12:51:57, End Time: 2012-08-24 15:35:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.17% (2.1303 => 2.0840, std. dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 14.56% (0.3488 => 0.3996, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 14.43% (0.3465 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.41% (0.3442 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.36% (0.3446 => 0.3941, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.34% (0.3460 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.33% (0.3469 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.97% (0.3643 => 0.4152, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.84% (0.3650 => 0.4155, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.53% (0.3724 => 0.4228, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.42% (0.3792 => 0.4187, std. dev.: 0.0063) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5826 => 0.6341, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.5889 => 0.6386, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.1619 => 0.1745, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.19% (3.5627 => 3.8189, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.02% (1.5932 => 1.7051, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.00% (1.3152 => 1.4073, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (1.6211 => 1.7340, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 6.82% (0.7171 => 0.7660, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.43% (0.5026 => 0.5349, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.41% (0.2014 => 0.2143, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.4361 => 0.4639, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.31% (0.4994 => 0.5309, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.16% (4.2109 => 4.4702, std. dev.: 0.0378) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (0.5000 => 0.5301, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.5900 => 0.6254, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (0.3930 => 0.4164, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.83% (0.4029 => 0.4264, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.79% (1.0781 => 1.1405, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.66% (2.7292 => 2.8837, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.65% (0.2866 => 0.3028, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.48% (2.1013 => 2.2164, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.43% (0.2875 => 0.3031, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.28% (0.4658 => 0.4904, std. dev.: 0.0078) SingleSource/Regression/C++/ofstream_ctor: 5.23% (0.3004 => 0.3161, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.16% (0.2792 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.13% (0.2750 => 0.2891, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.10% (5.5417 => 5.8241, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: 5.08% (0.2714 => 0.2852, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.08% (0.2736 => 0.2875, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2738 => 0.2877, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.07% (0.3195 => 0.3357, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2725 => 0.2863, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.06% (0.9909 => 1.0410, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.02% (0.2729 => 0.2866, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.00% (1.9694 => 2.0678, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (0.3890 => 0.4083, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.95% (0.2566 => 0.2693, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2823 => 0.2962, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (4.4195 => 4.6354, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 4.87% (0.2813 => 0.2950, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.85% (0.2803 => 0.2939, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (1.9966 => 2.0933, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.81% (2.0673 => 2.1667, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/except: 4.80% (0.2811 => 0.2946, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.75% (0.3096 => 0.3243, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.74% (0.3267 => 0.3422, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.74% (4.6177 => 4.8366, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.67% (0.2911 => 0.3047, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (2.1653 => 2.2653, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3258 => 0.3408, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.58% (0.3317 => 0.3469, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3124 => 0.3266, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 4.54% (0.3678 => 0.3845, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (1.8794 => 1.9644, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 4.51% (0.3348 => 0.3499, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.49% (0.3362 => 0.3513, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.48% (0.3060 => 0.3197, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.33% (0.3625 => 0.3782, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.33% (0.6634 => 0.6921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.29% (0.3477 => 0.3626, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.28% (1.4269 => 1.4880, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.28% (0.3690 => 0.3848, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3282 => 0.3422, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.25% (0.3271 => 0.3410, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.3903 => 0.4067, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.18% (0.9697 => 1.0102, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.14% (0.4251 => 0.4427, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.10% (0.4146 => 0.4316, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 4.06% (23.5202 => 24.4757, std. dev.: 0.0112) MultiSource/Applications/treecc/treecc: 4.05% (0.7875 => 0.8194, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.89% (0.3981 => 0.4136, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.3845 => 0.3994, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.4139 => 0.4299, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.83% (0.3084 => 0.3202, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.82% (0.5546 => 0.5758, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (0.2691 => 0.2791, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.57% (0.3336 => 0.3455, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.50% (0.2969 => 0.3073, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.6435 => 0.6660, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.33% (0.5012 => 0.5179, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 2.41% (0.4847 => 0.4964, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (0.5361 => 0.5471, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (0.7426 => 0.7570, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.42% (4.6926 => 4.7592, std. dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.24% (11.6398 => 11.7838, std. dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.2122 => 0.2277, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6662, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-2: 5.08% (1.8057 => 1.8974, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1665, std. dev.: 0.0223) SingleSource/Benchmarks/Dhrystone/dry: 4.07% (14.0481 => 14.6203, std. dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2054, std. dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5023, std. dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4538, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2823, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5853, std. dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5382, std. dev.: 0.0236) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7932, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.20% (0.2402 => 0.2253, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std. dev.: 0.0053) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.21% (17.2379 => 16.8574, std. dev.: 0.0544) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5794, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9573, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4978, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 11:34:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 13:34:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824183408.8DC1D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3190?compare_to=3188&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3190, Order: 162566, Start Time: 2012-08-24 17:20:21, End Time: 2012-08-24 18:35:03 To: 3188, Order: 162558, Start Time: 2012-08-24 15:37:02, End Time: 2012-08-24 16:51:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (159 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (698 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.70% (2.0176 => 2.3141, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.76% (0.5818 => 0.6502, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.33% (0.5748 => 0.6399, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.27% (0.7061 => 0.7857, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.23% (0.3578 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.05% (0.3601 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.04% (0.3646 => 0.4012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.96% (0.3663 => 0.4028, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.96% (0.3623 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.86% (0.3650 => 0.4010, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.81% (0.3914 => 0.4298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.79% (0.3789 => 0.4160, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.64% (0.3940 => 0.4320, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 9.64% (0.4003 => 0.4389, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.62% (0.4328 => 0.4701, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.59% (0.2781 => 0.3020, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.59% (0.2782 => 0.3021, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.57% (1.3693 => 1.4867, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.36% (0.2726 => 0.2954, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.36% (0.2966 => 0.3214, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.36% (0.1819 => 0.1971, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 8.26% (0.2760 => 0.2988, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.25% (0.2690 => 0.2912, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 8.25% (0.4062 => 0.4397, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 8.25% (0.2607 => 0.2822, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.18% (3.9660 => 4.2903, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.14% (0.2655 => 0.2871, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2628 => 0.2841, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.05% (0.3107 => 0.3357, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.99% (1.9828 => 2.1413, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.98% (0.7710 => 0.8325, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3022 => 0.3263, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.97% (0.3149 => 0.3400, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.97% (0.2937 => 0.3171, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.93% (0.2761 => 0.2980, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.75% (0.2696 => 0.2905, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.69% (0.3899 => 0.4199, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.68% (0.4390 => 0.4727, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.66% (0.3485 => 0.3752, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.66% (0.7038 => 0.7577, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.64% (0.5265 => 0.5667, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2988 => 0.3216, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.57% (0.3580 => 0.3851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3489 => 0.3751, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2596 => 0.2790, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 7.46% (0.3192 => 0.3430, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.30% (0.3453 => 0.3705, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.27% (0.9199 => 0.9868, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2721 => 0.2917, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3534 => 0.3788, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.16% (1.2193 => 1.3066, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.4379 => 0.4692, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.11% (0.6959 => 0.7454, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.92% (0.3293 => 0.3521, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3868 => 0.4131, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.76% (0.3756 => 0.4010, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.68% (0.2127 => 0.2269, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (1.1364 => 1.2112, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 6.55% (0.2945 => 0.3138, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.47% (0.3246 => 0.3456, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.42% (0.5577 => 0.5935, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.29% (13.8202 => 14.6900, std. dev.: 0.0174) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.25% (1.4563 => 1.5473, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 6.22% (1.2292 => 1.3056, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.21% (0.5637 => 0.5987, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.17% (0.1865 => 0.1980, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (0.2914 => 0.3093, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.99% (7.2180 => 7.6504, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 5.98% (0.2925 => 0.3100, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 5.88% (0.2243 => 0.2375, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 5.88% (0.2995 => 0.3171, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.76% (0.7460 => 0.7890, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 5.76% (3.8646 => 4.0872, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.74% (0.7506 => 0.7937, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 5.71% (1.1061 => 1.1693, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.67% (0.3755 => 0.3968, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.66% (1.3245 => 1.3995, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 5.51% (0.8310 => 0.8768, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.45% (3.6692 => 3.8693, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.36% (1.0594 => 1.1162, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.35% (1.3813 => 1.4552, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.3801 => 4.6142, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 5.32% (0.4113 => 0.4332, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.4791 => 0.5043, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.24% (1.3819 => 1.4543, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.20% (4.4433 => 4.6743, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.17% (0.6283 => 0.6608, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.12% (0.6135 => 0.6449, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (13.2842 => 13.9609, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 5.05% (2.1791 => 2.2891, std. dev.: 0.0053) MultiSource/Applications/treecc/treecc: 5.00% (1.9270 => 2.0233, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.94% (16.6129 => 17.4338, std. dev.: 0.0150) MultiSource/Benchmarks/McCat/18-imp/imp: 4.91% (0.3220 => 0.3378, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.82% (0.8818 => 0.9243, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 4.77% (14.8535 => 15.5613, std. dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 4.47% (0.3131 => 0.3271, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.35% (0.8698 => 0.9076, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.31% (0.3245 => 0.3385, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.1333 => 1.1814, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 4.13% (0.2859 => 0.2977, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (8.4961 => 8.8418, std. dev.: 0.0120) MultiSource/Applications/d/make_dparser: 4.05% (3.1889 => 3.3179, std. dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 3.94% (6.5754 => 6.8344, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.90% (4.9865 => 5.1811, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 3.65% (4.6629 => 4.8330, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.54% (3.2742 => 3.3902, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 3.39% (14.5298 => 15.0223, std. dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 3.35% (16.2614 => 16.8062, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 3.26% (0.6250 => 0.6454, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.5188 => 1.5655, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.01% (0.9108 => 0.9382, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 2.65% (0.6744 => 0.6923, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.44% (2.1007 => 2.1520, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.38% (6.2785 => 6.4279, std. dev.: 0.0150) MultiSource/Applications/lemon/lemon: 2.21% (1.0313 => 1.0541, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.4805 => 0.4911, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.00% (33.2944 => 33.9588, std. dev.: 0.0168) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2641, std. dev.: 0.0367) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 9.43% (1.2998 => 1.4224, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7413, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8174, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6025, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.08% (10.7476 => 10.9712, std. dev.: 0.0703) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5928 => 4.6758, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3251, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5089 => 1.5296, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.08% (26.5159 => 26.8013, std. dev.: 0.0378) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.12% (22.5627 => 21.4073, std. dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1036, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5113, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std. dev.: 0.0211) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9989, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6030, std. dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9283, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.10% (3.0263 => 2.9628, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2347, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -1.89% (7.3305 => 7.1923, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0176) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.30% (9.9194 => 9.7909, std. dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3622, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.20% (20.3410 => 20.0966, std. dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4770, std. dev.: 0.0172) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 10:08:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 12:08:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824170845.854BD2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3189?compare_to=3186&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3189, Order: 162559, Start Time: 2012-08-24 15:50:31, End Time: 2012-08-24 17:09:40 To: 3186, Order: 162552, Start Time: 2012-08-24 14:04:02, End Time: 2012-08-24 15:22:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (128 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.78% (8.6989 => 9.1143, std. dev.: 0.0318) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5482 => 56.5186, std. dev.: 0.0966) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.79% (1.4325 => 1.4069, std. dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.22% (10.3673 => 13.7076, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.63% (0.3543 => 0.4026, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 13.48% (0.3561 => 0.4041, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.41% (0.3497 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.32% (0.3543 => 0.4015, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.31% (0.3516 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.91% (0.3694 => 0.4171, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.62% (0.3828 => 0.4311, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.55% (0.3927 => 0.4420, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.23% (1.1194 => 1.2563, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 12.22% (0.3886 => 0.4361, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.86% (1.7609 => 1.9521, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.72% (2.2022 => 2.4163, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.6030 => 0.6488, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.45% (0.1892 => 0.2033, std. dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.07% (0.1584 => 0.1696, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.97% (0.2065 => 0.2209, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 6.61% (0.3282 => 0.3499, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 6.58% (0.7326 => 0.7808, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.00% (0.4615 => 0.4892, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.73% (7.0540 => 7.4579, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.68% (0.3307 => 0.3495, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.4879 => 0.5150, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.19% (0.7433 => 0.7819, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.11% (9.4845 => 9.9693, std. dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (4.9449 => 5.1966, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (5.0018 => 5.2547, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.05% (0.5569 => 0.5850, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.98% (0.2107 => 0.2212, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2271 => 0.2384, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.86% (0.2758 => 0.2892, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4636 => 0.4860, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.83% (0.5860 => 0.6143, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.77% (0.8172 => 0.8562, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.76% (4.2646 => 4.4674, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.65% (0.3121 => 0.3266, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.58% (0.2905 => 0.3038, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.57% (0.3109 => 0.3251, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.49% (5.7591 => 6.0176, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 4.47% (0.3423 => 0.3576, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.42% (0.2872 => 0.2999, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.41% (1.3050 => 1.3626, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.39% (8.1363 => 8.4936, std. dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 4.34% (10.4361 => 10.8890, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.32% (0.2756 => 0.2875, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.30% (0.4299 => 0.4484, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.26% (0.3052 => 0.3182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.24% (0.4289 => 0.4471, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3232 => 0.3369, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.20% (0.2831 => 0.2950, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.19% (0.2700 => 0.2813, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.18% (0.3441 => 0.3585, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 4.16% (0.3098 => 0.3227, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2793 => 0.2909, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.15% (0.9765 => 1.0170, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.11% (0.3865 => 0.4024, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.11% (0.3650 => 0.3800, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.08% (0.3283 => 0.3417, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.06% (0.3422 => 0.3561, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.06% (0.3180 => 0.3309, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.02% (2.0665 => 2.1496, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.01% (1.5603 => 1.6228, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2802 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.99% (0.3136 => 0.3261, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.93% (0.7835 => 0.8143, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.92% (0.3162 => 0.3286, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3826 => 0.3973, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.83% (0.3603 => 0.3741, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3935 => 0.4084, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.8067 => 0.8372, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (0.5105 => 0.5297, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 3.75% (0.3092 => 0.3208, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.75% (0.3684 => 0.3822, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.74% (0.4064 => 0.4216, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.73% (1.1861 => 1.2303, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6450 => 0.6684, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 3.61% (0.3379 => 0.3501, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.61% (1.5415 => 1.5971, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.58% (1.2842 => 1.3302, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.57% (0.3387 => 0.3508, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.55% (0.6675 => 0.6912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.55% (0.4203 => 0.4352, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.53% (1.1642 => 1.2053, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.49% (3.3354 => 3.4517, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 3.48% (0.4620 => 0.4781, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.6456 => 0.6680, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.4048 => 0.4186, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.32% (2.0273 => 2.0947, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.29% (0.5981 => 0.6178, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 3.25% (3.8723 => 3.9981, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 3.22% (0.8921 => 0.9208, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (14.3668 => 14.8284, std. dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.02% (1.4186 => 1.4615, std. dev.: 0.0118) MultiSource/Applications/siod/siod: 2.93% (2.2969 => 2.3643, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.67% (0.5020 => 0.5154, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.59% (1.5859 => 1.6269, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.50% (17.1811 => 17.6098, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.2024 => 2.2521, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 2.19% (0.7115 => 0.7271, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.91% (1.0722 => 1.0927, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.76% (7.9617 => 8.1021, std. dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 1.38% (21.9371 => 22.2391, std. dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (4.2280 => 4.4426, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.09% (26.0924 => 26.8982, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.91% (3.6395 => 3.7455, std. dev.: 0.0076) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3347, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2561, std. dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.39% (1.3045 => 1.3226, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 1.21% (3.1578 => 3.1960, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.17% (1.5086 => 1.5263, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.40% (5.2763 => 3.1975, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.77% (5.3855 => 3.7282, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.39% (5.3526 => 3.7261, std. dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0863, std. dev.: 0.0290) MultiSource/Applications/ClamAV/clamscan: -13.95% (22.1758 => 19.0830, std. dev.: 0.0237) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.96% (2.9384 => 2.5575, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2373 => 1.1062, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel-2: -8.48% (1.5373 => 1.4069, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0035) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0510, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4710, std. dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4145, std. dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0117, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9624, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6783, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3460, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4199, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 09:50:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 11:50:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824165036.25B632A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3188?compare_to=3185&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3188, Order: 162558, Start Time: 2012-08-24 15:37:02, End Time: 2012-08-24 16:51:28 To: 3185, Order: 162552, Start Time: 2012-08-24 13:54:41, End Time: 2012-08-24 15:09:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (162 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.22% (1.3355 => 1.3192, std. dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.11% (2.0176 => 2.3225, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.07% (0.5818 => 0.6462, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.99% (0.7061 => 0.7837, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 10.84% (0.5748 => 0.6371, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.06% (0.3578 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.97% (0.3601 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3650 => 0.4013, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3663 => 0.4022, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.77% (0.3623 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3789 => 0.4156, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.58% (0.3914 => 0.4289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.52% (0.4003 => 0.4384, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1413 => 0.1536, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.25% (0.7710 => 0.8346, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 8.23% (0.2781 => 0.3010, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.20% (0.4328 => 0.4683, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 8.14% (1.3693 => 1.4807, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.11% (3.9660 => 4.2878, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4062 => 0.4382, std. dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.86% (0.1819 => 0.1962, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.84% (0.2782 => 0.3000, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.72% (0.7038 => 0.7581, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.71% (0.5265 => 0.5671, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.63% (0.2596 => 0.2794, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.42% (0.2655 => 0.2852, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.41% (0.2765 => 0.2970, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.40% (0.2607 => 0.2800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.2760 => 0.2964, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.25% (1.2193 => 1.3077, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 7.24% (0.2761 => 0.2961, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.24% (1.9828 => 2.1263, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.23% (0.3899 => 0.4181, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.23% (0.6959 => 0.7462, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.21% (0.9199 => 0.9862, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 7.18% (0.3149 => 0.3375, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3107 => 0.3329, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 7.12% (0.2937 => 0.3146, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.08% (0.4379 => 0.4689, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.04% (0.3580 => 0.3832, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.03% (0.3485 => 0.3730, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.02% (0.3489 => 0.3734, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.01% (0.2696 => 0.2885, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.86% (0.1588 => 0.1697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.1789 => 0.1908, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.63% (0.2127 => 0.2268, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4390 => 0.4678, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.49% (1.1364 => 1.2102, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 6.48% (0.1589 => 0.1692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 6.44% (0.3293 => 0.3505, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 6.40% (0.3534 => 0.3760, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.37% (0.5637 => 0.5996, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.35% (0.2914 => 0.3099, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.34% (0.3756 => 0.3994, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.32% (0.4016 => 0.4270, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.31% (0.5577 => 0.5929, std. dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 6.27% (13.8202 => 14.6863, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.19% (0.3246 => 0.3447, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 6.15% (0.3868 => 0.4106, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.13% (0.2023 => 0.2147, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 6.06% (0.2243 => 0.2379, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 6.06% (0.7506 => 0.7961, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.02% (0.2925 => 0.3101, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.96% (7.2180 => 7.6480, std. dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 5.91% (0.2995 => 0.3172, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.87% (0.2945 => 0.3118, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.87% (1.4563 => 1.5418, std. dev.: 0.0051) MultiSource/Applications/Burg/burg: 5.82% (1.1061 => 1.1705, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 5.80% (3.8646 => 4.0887, std. dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 5.73% (1.2292 => 1.2996, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.69% (0.8310 => 0.8783, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (1.3819 => 1.4578, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.49% (1.3245 => 1.3972, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 5.45% (0.4113 => 0.4337, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.42% (3.6692 => 3.8679, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.41% (1.3813 => 1.4560, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.38% (0.3755 => 0.3957, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.36% (0.7460 => 0.7860, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.32% (4.3801 => 4.6131, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 5.26% (1.0594 => 1.1151, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 5.23% (2.1791 => 2.2931, std. dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.20% (0.4791 => 0.5040, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.6283 => 0.6609, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.15% (0.6135 => 0.6451, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 5.15% (1.9270 => 2.0262, std. dev.: 0.0177) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.14% (4.4433 => 4.6717, std. dev.: 0.0096) MultiSource/Benchmarks/McCat/18-imp/imp: 5.12% (0.3220 => 0.3385, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.06% (0.8818 => 0.9264, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (13.2842 => 13.9522, std. dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 4.95% (16.6129 => 17.4345, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 4.70% (14.8535 => 15.5513, std. dev.: 0.0146) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.59% (0.2243 => 0.2346, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 4.57% (0.3131 => 0.3274, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.36% (0.8698 => 0.9077, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.27% (1.1333 => 1.1817, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.22% (0.3245 => 0.3382, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (8.4961 => 8.8469, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.04% (4.9865 => 5.1878, std. dev.: 0.0129) MultiSource/Applications/d/make_dparser: 4.03% (3.1889 => 3.3174, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (6.5754 => 6.8327, std. dev.: 0.0177) MultiSource/Benchmarks/Olden/bh/bh: 3.74% (0.2859 => 0.2966, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.58% (3.2742 => 3.3915, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 3.39% (14.5298 => 15.0222, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.27% (0.9108 => 0.9406, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.25% (4.6629 => 4.8146, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.20% (1.5188 => 1.5674, std. dev.: 0.0180) MultiSource/Applications/sqlite3/sqlite3: 3.19% (16.2614 => 16.7802, std. dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/bigfib: 2.82% (0.6250 => 0.6426, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.59% (3.7467 => 3.8437, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.58% (6.2785 => 6.4405, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (2.1007 => 2.1547, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.31% (0.4805 => 0.4916, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.30% (0.6744 => 0.6899, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.23% (1.0313 => 1.0543, std. dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 1.95% (33.2944 => 33.9422, std. dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 1.91% (1.2749 => 1.2992, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.43% (5.7573 => 7.5095, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std. dev.: 0.0589) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.76% (1.2998 => 1.4266, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7408, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8184, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5968, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.02% (10.7476 => 10.9650, std. dev.: 0.0176) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6765, std. dev.: 0.0106) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3249, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5280, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.01% (26.5159 => 26.7842, std. dev.: 0.0181) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.19% (22.5627 => 21.3925, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5111, std. dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.27% (1.3780 => 1.3192, std. dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.86% (8.8259 => 8.5738, std. dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2282, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3305 => 7.2082, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7918, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3689, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8708, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.17% (5.5401 => 5.4751, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.16% (20.3410 => 20.1056, std. dev.: 0.0282) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 08:34:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 10:34:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120824153429.DA0F82A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3187?compare_to=3182&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3187, Order: 162552, Start Time: 2012-08-24 12:51:57, End Time: 2012-08-24 15:35:25 To: 3182, Order: 162545, Start Time: 2012-08-24 09:41:03, End Time: 2012-08-24 12:24:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.53% (2.0981 => 2.1303, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 14.76% (0.3469 => 0.3981, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 14.66% (0.3465 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.65% (0.3446 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.62% (0.3460 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.58% (0.3442 => 0.3944, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.56% (0.3488 => 0.3996, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 14.53% (0.3496 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.11% (0.3650 => 0.4165, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.03% (0.3643 => 0.4154, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.67% (0.3724 => 0.4233, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.92% (0.3792 => 0.4244, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/Hello: 9.30% (0.5826 => 0.6368, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.90% (0.5889 => 0.6413, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7171 => 0.7699, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.06% (3.5627 => 3.8144, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.02% (1.6211 => 1.7349, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.83% (1.5932 => 1.7020, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.73% (1.3152 => 1.4037, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.47% (0.5026 => 0.5351, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.4361 => 0.4639, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.5900 => 0.6258, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (0.3930 => 0.4166, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.99% (0.4994 => 0.5293, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 5.92% (4.2109 => 4.4601, std. dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.83% (2.7292 => 2.8883, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.73% (0.4029 => 0.4260, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.72% (0.5000 => 0.5286, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.69% (1.0781 => 1.1394, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.2736 => 0.2885, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.42% (0.2750 => 0.2899, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.37% (0.2792 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.34% (0.2566 => 0.2703, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.31% (0.2729 => 0.2874, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.29% (0.3004 => 0.3163, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3195 => 0.3364, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.28% (0.2725 => 0.2869, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2803 => 0.2951, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.26% (0.2738 => 0.2882, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 5.25% (0.9909 => 1.0429, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.24% (2.1013 => 2.2115, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.2823 => 0.2970, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.19% (0.2813 => 0.2959, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.2780 => 0.2921, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.03% (5.5417 => 5.8205, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 5.02% (0.3267 => 0.3431, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.02% (0.2811 => 0.2952, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.99% (1.9694 => 2.0677, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.98% (2.0673 => 2.1703, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.97% (0.3258 => 0.3420, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.91% (0.3096 => 0.3248, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (4.4195 => 4.6362, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.88% (0.3362 => 0.3526, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.85% (0.4658 => 0.4884, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (0.3890 => 0.4078, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3317 => 0.3477, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.78% (1.9966 => 2.0920, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.76% (0.3845 => 0.4028, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.74% (0.2911 => 0.3049, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.74% (0.3060 => 0.3205, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.74% (0.3124 => 0.3272, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.72% (0.3348 => 0.3506, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.67% (4.6177 => 4.8334, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.66% (1.8794 => 1.9670, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 4.62% (0.3726 => 0.3898, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 4.56% (2.1653 => 2.2640, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.3625 => 0.3790, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.3282 => 0.3430, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.43% (0.9697 => 1.0127, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 4.43% (0.3477 => 0.3631, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.42% (0.3690 => 0.3853, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.40% (0.3271 => 0.3415, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 4.36% (1.4269 => 1.4891, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.3903 => 0.4073, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.33% (0.4251 => 0.4435, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4146 => 0.4324, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.25% (0.3981 => 0.4150, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 4.18% (0.5546 => 0.5778, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.17% (0.7875 => 0.8203, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.99% (0.3084 => 0.3207, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.95% (0.2737 => 0.2845, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.90% (0.6634 => 0.6893, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.89% (0.4139 => 0.4300, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.77% (0.2969 => 0.3081, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 3.70% (23.5202 => 24.3903, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.48% (0.6435 => 0.6659, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 3.45% (0.3336 => 0.3451, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.43% (0.5012 => 0.5184, std. dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 2.92% (2.0346 => 2.0941, std. dev.: 0.0181) MultiSource/Benchmarks/PAQ8p/paq8p: 2.33% (0.4847 => 0.4960, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (0.5361 => 0.5464, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.82% (0.7426 => 0.7561, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.22% (4.6926 => 4.7498, std. dev.: 0.0117) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (11.6398 => 11.7632, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.78% (0.2122 => 0.2287, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6803, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.78% (1.8057 => 1.8920, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6358, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.32% (2.0820 => 2.1303, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std. dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5012, std. dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2244, std. dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4454, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2839, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5917, std. dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4791, std. dev.: 0.0479) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.45% (2.4764 => 2.3909, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5690, std. dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.56% (35.5013 => 32.8167, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7958, std. dev.: 0.0060) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.69% (0.6293 => 0.6124, std. dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -2.51% (17.2379 => 16.8058, std. dev.: 0.0477) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9623, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 08:22:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 10:22:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824152203.D50672A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3186?compare_to=3184&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3186, Order: 162552, Start Time: 2012-08-24 14:04:02, End Time: 2012-08-24 15:22:59 To: 3184, Order: 162550, Start Time: 2012-08-24 12:17:25, End Time: 2012-08-24 13:36:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.96% (13.3878 => 13.6507, std. dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.67% (10.3673 => 13.6507, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 14.48% (0.3473 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.15% (0.3497 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.15% (0.3561 => 0.4065, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.14% (0.3543 => 0.4044, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3516 => 0.4011, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.00% (0.3543 => 0.4039, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3694 => 0.4199, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.19% (0.3828 => 0.4333, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.06% (0.3927 => 0.4440, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.89% (0.3886 => 0.4387, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (1.7609 => 1.9596, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.88% (2.2022 => 2.4198, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 9.22% (0.1432 => 0.1564, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5925 => 0.6393, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.84% (0.6030 => 0.6503, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1584 => 0.1701, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.7326 => 0.7859, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 6.86% (0.3282 => 0.3507, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.74% (0.3177 => 0.3391, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.55% (0.1892 => 0.2016, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.12% (7.0540 => 7.4856, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.4615 => 0.4890, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.4879 => 0.5157, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3307 => 0.3493, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.25% (9.4845 => 9.9829, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.20% (0.2271 => 0.2389, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.17% (5.0018 => 5.2603, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (4.9449 => 5.2000, std. dev.: 0.0092) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2107 => 0.2215, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.06% (0.7433 => 0.7809, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.88% (0.8172 => 0.8571, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.84% (4.2646 => 4.4709, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.75% (0.2758 => 0.2889, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.73% (0.3109 => 0.3256, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.65% (0.3121 => 0.3266, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.5569 => 0.5826, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.56% (0.5860 => 0.6127, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 4.53% (0.3423 => 0.3578, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.48% (8.1363 => 8.5009, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.43% (1.3050 => 1.3628, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.43% (0.2891 => 0.3019, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4636 => 0.4841, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.42% (0.4299 => 0.4489, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 4.40% (10.4361 => 10.8950, std. dev.: 0.0083) MultiSource/Applications/spiff/spiff: 4.22% (0.7835 => 0.8166, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.17% (0.9765 => 1.0172, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.2905 => 0.3025, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3441 => 0.3583, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.98% (0.5105 => 0.5308, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.96% (0.3180 => 0.3306, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.90% (0.3052 => 0.3171, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.86% (0.2872 => 0.2983, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6450 => 0.6699, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.84% (5.7591 => 5.9805, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.79% (1.5415 => 1.5999, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (1.1861 => 1.2310, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.73% (0.4289 => 0.4449, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.2871 => 0.2978, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.72% (0.3092 => 0.3207, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.71% (0.2802 => 0.2906, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.70% (1.5603 => 1.6180, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.69% (1.1642 => 1.2072, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary: 3.68% (0.3232 => 0.3351, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.6675 => 0.6917, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.62% (0.8067 => 0.8359, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3826 => 0.3964, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.59% (0.3422 => 0.3545, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.57% (0.3162 => 0.3275, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.3136 => 0.3248, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.56% (2.0665 => 2.1401, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.55% (0.3603 => 0.3731, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2877 => 0.2979, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.48% (0.3935 => 0.4072, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.42% (0.3387 => 0.3503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.40% (0.4064 => 0.4202, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.36% (3.3354 => 3.4475, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 3.34% (0.3684 => 0.3807, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.4203 => 0.4342, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.30% (2.0273 => 2.0942, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5981 => 0.6177, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.22% (3.8723 => 3.9970, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 3.20% (0.4620 => 0.4768, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (14.3668 => 14.8234, std. dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/bigfib: 3.18% (0.6456 => 0.6661, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.4186 => 1.4626, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.07% (1.2842 => 1.3236, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8921 => 0.9187, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.83% (0.5020 => 0.5162, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.66% (1.5859 => 1.6281, std. dev.: 0.0089) MultiSource/Applications/siod/siod: 2.65% (2.2969 => 2.3577, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (2.2024 => 2.2568, std. dev.: 0.0101) MultiSource/Benchmarks/nbench/nbench: 2.28% (1.1840 => 1.2110, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.26% (17.1811 => 17.5694, std. dev.: 0.0177) MultiSource/Applications/minisat/minisat: 2.23% (0.7115 => 0.7274, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.96% (7.9617 => 8.1180, std. dev.: 0.0102) MultiSource/Applications/lemon/lemon: 1.84% (1.0722 => 1.0919, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.77% (21.9371 => 22.3258, std. dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.36% (4.2280 => 4.4545, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7570, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 3.07% (26.0924 => 26.8924, std. dev.: 0.0134) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3346, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2371, std. dev.: 0.0338) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.22% (3.1578 => 3.1962, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.15% (1.5086 => 1.5259, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.43% (5.2763 => 3.1960, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.67% (5.3855 => 3.7336, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.25% (5.3526 => 3.7332, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.92% (54.1659 => 46.0848, std. dev.: 0.0210) MultiSource/Applications/ClamAV/clamscan: -14.01% (22.1758 => 19.0687, std. dev.: 0.0301) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5516, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2373 => 1.1019, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.1396 => 1.0596, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -6.82% (1.5373 => 1.4325, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std. dev.: 0.0013) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4705, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4158, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.56% (10.2830 => 10.0196, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9624, std. dev.: 0.0079) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.79% (2.5528 => 2.5070, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3501, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std. dev.: 0.0062) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 08:08:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 10:08:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824150821.368632A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3185?compare_to=3183&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3185, Order: 162552, Start Time: 2012-08-24 13:54:41, End Time: 2012-08-24 15:09:16 To: 3183, Order: 162550, Start Time: 2012-08-24 12:12:43, End Time: 2012-08-24 13:27:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (158 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (699 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.92% (0.5360 => 0.5463, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: 1.40% (1.4032 => 1.4229, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/lowercase: 1.25% (7.9478 => 8.0472, std. dev.: 0.0167) SingleSource/Benchmarks/McGill/chomp: 1.02% (1.0932 => 1.1043, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.08% (2.0176 => 2.3218, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.86% (0.5818 => 0.6450, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.83% (0.7061 => 0.7826, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 10.79% (0.5748 => 0.6368, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.01% (0.3578 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.86% (0.3601 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.83% (0.3663 => 0.4023, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.78% (0.3650 => 0.4007, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.74% (0.3789 => 0.4158, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.72% (0.3623 => 0.3975, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.63% (0.3914 => 0.4291, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 9.52% (0.4003 => 0.4384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.37% (0.3940 => 0.4309, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.63% (0.1413 => 0.1535, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.44% (0.7710 => 0.8361, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 8.35% (0.4062 => 0.4401, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 8.33% (1.3693 => 1.4834, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 8.16% (0.4328 => 0.4681, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.10% (3.9660 => 4.2873, std. dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1819 => 0.1963, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.59% (0.7038 => 0.7572, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.51% (0.2596 => 0.2791, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 7.50% (0.2760 => 0.2967, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.41% (0.3022 => 0.3246, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.40% (0.2607 => 0.2800, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.3107 => 0.3337, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2765 => 0.2969, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.37% (0.2726 => 0.2927, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.37% (0.5265 => 0.5653, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.35% (0.2761 => 0.2964, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 7.29% (0.2937 => 0.3151, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.28% (1.9828 => 2.1272, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2628 => 0.2819, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.26% (0.9199 => 0.9867, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.23% (0.3899 => 0.4181, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.18% (0.6959 => 0.7459, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3485 => 0.3735, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.11% (1.2193 => 1.3060, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4379 => 0.4688, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.02% (0.3149 => 0.3370, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.99% (0.2988 => 0.3197, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.97% (0.2696 => 0.2884, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3489 => 0.3732, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.96% (0.3580 => 0.3829, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4390 => 0.4693, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.1588 => 0.1696, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.80% (0.3192 => 0.3409, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 6.72% (0.3453 => 0.3685, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.63% (0.2925 => 0.3119, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.1789 => 0.1907, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.48% (1.1364 => 1.2100, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 6.40% (0.3534 => 0.3760, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.38% (0.3293 => 0.3503, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.2914 => 0.3098, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.30% (0.4016 => 0.4269, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.28% (0.2023 => 0.2150, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 6.26% (13.8202 => 14.6851, std. dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.24% (0.5577 => 0.5925, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 6.20% (0.3868 => 0.4108, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.10% (0.3246 => 0.3444, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3756 => 0.3985, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.00% (0.5637 => 0.5975, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.91% (0.2945 => 0.3119, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.90% (0.1865 => 0.1975, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 5.87% (1.2292 => 1.3013, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.86% (1.4563 => 1.5417, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.85% (7.2180 => 7.6402, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 5.78% (0.2995 => 0.3168, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.71% (3.8646 => 4.0853, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.69% (1.3245 => 1.3999, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.67% (0.8310 => 0.8781, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (1.3819 => 1.4591, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.54% (1.0594 => 1.1181, std. dev.: 0.0143) MultiSource/Applications/spiff/spiff: 5.53% (0.7506 => 0.7921, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 5.47% (0.4113 => 0.4338, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.47% (1.1061 => 1.1666, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.43% (3.6692 => 3.8684, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.37% (1.3813 => 1.4555, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.34% (0.4791 => 0.5047, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.6135 => 0.6461, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.27% (0.6283 => 0.6614, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.27% (4.3801 => 4.6108, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.23% (0.7460 => 0.7850, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.19% (4.4433 => 4.6738, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.11% (0.8818 => 0.9269, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.10% (1.9270 => 2.0253, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 5.06% (2.1791 => 2.2893, std. dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 5.02% (16.6129 => 17.4470, std. dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3220 => 0.3381, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (13.2842 => 13.9433, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.66% (14.8535 => 15.5453, std. dev.: 0.0177) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.59% (0.2243 => 0.2346, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.3245 => 0.3383, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.21% (0.8698 => 0.9064, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.17% (4.9865 => 5.1942, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.15% (1.1333 => 1.1803, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.12% (8.4961 => 8.8459, std. dev.: 0.0097) MultiSource/Applications/d/make_dparser: 3.91% (3.1889 => 3.3137, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.85% (6.5754 => 6.8287, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 3.85% (0.2859 => 0.2969, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.68% (3.2742 => 3.3948, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 3.35% (14.5298 => 15.0159, std. dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 3.26% (4.6629 => 4.8148, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.22% (0.9108 => 0.9401, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.19% (16.2614 => 16.7806, std. dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.15% (1.5188 => 1.5667, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.93% (0.6250 => 0.6433, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (6.2785 => 6.4463, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.1007 => 2.1543, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.51% (3.7467 => 3.8408, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: 2.46% (0.6744 => 0.6910, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.4805 => 0.4918, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 2.16% (1.0313 => 1.0536, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.86% (33.2944 => 33.9139, std. dev.: 0.0247) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2599, std. dev.: 0.0271) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.47% (1.2998 => 1.4229, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (2.8606 => 2.9625, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8172, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6040, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.22% (10.7476 => 10.9859, std. dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6783, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3262, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (1.5089 => 1.5276, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.19% (26.5159 => 26.8320, std. dev.: 0.0280) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.17% (22.5627 => 21.3957, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0011) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0220, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4681, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.53% (1.9762 => 1.9263, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6105, std. dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2362, std. dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2053, std. dev.: 0.0230) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7927, std. dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3601, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4962, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4767, std. dev.: 0.0190) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.13% (20.3410 => 20.1110, std. dev.: 0.0224) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 06:35:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 08:35:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824133532.D00632A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3184?compare_to=3181&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3184, Order: 162550, Start Time: 2012-08-24 12:17:25, End Time: 2012-08-24 13:36:27 To: 3181, Order: 162549, Start Time: 2012-08-24 10:30:32, End Time: 2012-08-24 11:49:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.84% (78.6655 => 80.8983, std. dev.: 0.3173) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.13% (10.3673 => 13.3878, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 14.22% (0.3473 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.04% (0.3561 => 0.4061, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.98% (0.3497 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.94% (0.3543 => 0.4037, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.91% (0.3543 => 0.4036, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.88% (0.3516 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.48% (0.3694 => 0.4192, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.09% (0.3828 => 0.4329, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.96% (0.3927 => 0.4436, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.74% (0.3886 => 0.4381, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.88% (1.1194 => 1.2524, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.39% (1.7609 => 1.9438, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.19% (2.2022 => 2.4046, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.08% (0.1432 => 0.1562, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std. dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.2065 => 0.2222, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.44% (0.7326 => 0.7871, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.01% (0.1584 => 0.1695, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1892 => 0.2022, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.52% (0.3177 => 0.3384, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4615 => 0.4894, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 6.03% (0.3282 => 0.3480, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (7.0540 => 7.4618, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.59% (0.3307 => 0.3492, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.41% (0.4879 => 0.5143, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2271 => 0.2390, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.07% (0.7433 => 0.7810, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.06% (0.5569 => 0.5851, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.03% (0.2107 => 0.2213, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.95% (4.9449 => 5.1898, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (5.0018 => 5.2467, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.89% (0.8172 => 0.8572, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 4.83% (9.4845 => 9.9430, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.70% (4.2646 => 4.4650, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 4.56% (0.4299 => 0.4495, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3121 => 0.3263, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.44% (0.3109 => 0.3247, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.40% (0.5860 => 0.6118, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.39% (0.2891 => 0.3018, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.34% (0.7835 => 0.8175, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (1.3050 => 1.3613, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.28% (8.1363 => 8.4848, std. dev.: 0.0058) SingleSource/Regression/C++/ofstream_ctor: 4.27% (0.2905 => 0.3029, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.27% (0.3423 => 0.3569, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.18% (0.4636 => 0.4830, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 4.13% (0.4289 => 0.4466, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3441 => 0.3581, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.06% (0.2758 => 0.2870, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 4.06% (0.3180 => 0.3309, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.04% (0.2700 => 0.2809, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.01% (0.2871 => 0.2986, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.98% (10.4361 => 10.8518, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.93% (0.2872 => 0.2985, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2756 => 0.2864, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 3.90% (0.3052 => 0.3171, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2831 => 0.2941, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3232 => 0.3357, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.85% (5.7591 => 5.9811, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.9765 => 1.0140, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.83% (0.3162 => 0.3283, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.75% (0.3865 => 0.4010, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.72% (1.5415 => 1.5989, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.72% (0.2793 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.72% (0.3283 => 0.3405, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6450 => 0.6689, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.68% (0.3422 => 0.3548, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1861 => 1.2297, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3650 => 0.3784, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (0.5105 => 0.5290, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.62% (2.0665 => 2.1413, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 3.61% (0.3603 => 0.3733, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.56% (0.3092 => 0.3202, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.48% (1.1642 => 1.2047, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.48% (0.3136 => 0.3245, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (0.4064 => 0.4204, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.42% (0.3826 => 0.3957, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.42% (0.3684 => 0.3810, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.8067 => 0.8340, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.6675 => 0.6899, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.35% (1.5603 => 1.6125, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 3.31% (0.3379 => 0.3491, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.26% (0.4203 => 0.4340, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.21% (3.3354 => 3.4424, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.19% (0.5981 => 0.6172, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.19% (0.4048 => 0.4177, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.16% (0.4620 => 0.4766, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.14% (2.0273 => 2.0910, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.11% (3.8723 => 3.9927, std. dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: 2.98% (1.2842 => 1.3225, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (14.3668 => 14.7881, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.4186 => 1.4590, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.71% (2.2969 => 2.3591, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8921 => 0.9160, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.53% (0.5020 => 0.5147, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5859 => 1.6233, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.17% (17.1811 => 17.5531, std. dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (2.2024 => 2.2494, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.09% (0.7115 => 0.7264, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 2.02% (1.1840 => 1.2079, std. dev.: 0.0054) MultiSource/Applications/lemon/lemon: 1.63% (1.0722 => 1.0897, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (7.9617 => 8.0887, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.51% (21.9371 => 22.2673, std. dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.15% (4.2280 => 4.4458, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.08% (26.0924 => 26.8964, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7483, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3341, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2328, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash2: 1.20% (3.1578 => 3.1957, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.17% (1.5086 => 1.5263, std. dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5776, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1248, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.27% (5.2763 => 3.2043, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7174, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7181, std. dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0895, std. dev.: 0.0320) MultiSource/Applications/ClamAV/clamscan: -14.15% (22.1758 => 19.0378, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.03% (2.9384 => 2.5555, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -11.62% (1.2373 => 1.0935, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel-2: -7.71% (1.5373 => 1.4188, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5119, std. dev.: 0.0022) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4689, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4161, std. dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0120, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9581, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (12.5348 => 12.3447, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 06:26:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 08:26:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824132609.3D0B92A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3183?compare_to=3180&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3183, Order: 162550, Start Time: 2012-08-24 12:12:43, End Time: 2012-08-24 13:27:04 To: 3180, Order: 162549, Start Time: 2012-08-24 10:30:37, End Time: 2012-08-24 11:44:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (162 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (693 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.6197 => 56.5629, std. dev.: 0.0238) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.25% (1.3088 => 1.3252, std. dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.05% (2.0176 => 2.3213, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.33% (0.5748 => 0.6399, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.27% (0.7061 => 0.7857, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.56% (0.3578 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.43% (0.3663 => 0.4045, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3623 => 0.4000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.36% (0.3601 => 0.3974, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.31% (0.3646 => 0.4022, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.27% (0.3650 => 0.4025, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.13% (0.3789 => 0.4173, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.02% (0.3914 => 0.4306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.92% (0.4003 => 0.4400, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 9.75% (0.3940 => 0.4324, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.81% (0.7710 => 0.8389, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1413 => 0.1536, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.20% (0.4328 => 0.4683, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (3.9660 => 4.2835, std. dev.: 0.0085) MultiSource/Applications/hbd/hbd: 7.92% (1.3693 => 1.4778, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4062 => 0.4382, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.81% (0.1819 => 0.1961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.68% (0.2655 => 0.2859, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.2781 => 0.2993, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2596 => 0.2789, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.41% (0.5265 => 0.5655, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.25% (0.7038 => 0.7548, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.07% (1.2193 => 1.3055, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.95% (0.4390 => 0.4695, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.94% (0.9199 => 0.9837, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.93% (1.9828 => 2.1202, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.4379 => 0.4679, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.3899 => 0.4166, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.83% (0.3485 => 0.3723, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3580 => 0.3824, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.78% (0.6959 => 0.7431, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.65% (0.3489 => 0.3721, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.55% (0.1588 => 0.1692, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.39% (0.3756 => 0.3996, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.35% (0.2127 => 0.2262, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.1364 => 1.2084, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.2914 => 0.3098, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.29% (0.5577 => 0.5928, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.20% (0.3534 => 0.3753, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.16% (0.3293 => 0.3496, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (1.4563 => 1.5456, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 6.04% (13.8202 => 14.6546, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.4016 => 0.4256, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.3868 => 0.4098, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2023 => 0.2143, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.90% (0.1865 => 0.1975, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.5637 => 0.5967, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 5.81% (0.2925 => 0.3095, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.73% (0.3246 => 0.3432, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.73% (7.2180 => 7.6314, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 5.69% (0.8310 => 0.8783, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 5.68% (0.7506 => 0.7932, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (1.3819 => 1.4603, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.48% (0.2243 => 0.2366, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.46% (1.3245 => 1.3968, std. dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 5.43% (1.2292 => 1.2960, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 5.41% (0.2995 => 0.3157, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 5.34% (3.8646 => 4.0710, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.29% (4.3801 => 4.6118, std. dev.: 0.0082) MultiSource/Applications/Burg/burg: 5.29% (1.1061 => 1.1646, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.27% (3.6692 => 3.8624, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.25% (0.7460 => 0.7852, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.25% (0.4113 => 0.4329, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.3813 => 1.4535, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 5.13% (1.0594 => 1.1138, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.12% (0.6135 => 0.6449, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.11% (0.6283 => 0.6604, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 5.09% (0.3220 => 0.3384, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (4.4433 => 4.6680, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.03% (0.4791 => 0.5032, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.3755 => 0.3937, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.80% (1.9270 => 2.0194, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (13.2842 => 13.9197, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.73% (16.6129 => 17.3986, std. dev.: 0.0236) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.55% (0.8818 => 0.9219, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.54% (2.1791 => 2.2781, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 4.48% (14.8535 => 15.5190, std. dev.: 0.0155) MultiSource/Benchmarks/sim/sim: 4.41% (0.3131 => 0.3269, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 4.16% (0.2859 => 0.2978, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.10% (0.3245 => 0.3378, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.08% (0.8698 => 0.9053, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.03% (1.1333 => 1.1790, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (8.4961 => 8.8250, std. dev.: 0.0091) MultiSource/Applications/d/make_dparser: 3.85% (3.1889 => 3.3116, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1771, std. dev.: 0.0193) MultiSource/Applications/JM/ldecod/ldecod: 3.67% (6.5754 => 6.8164, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.50% (3.2742 => 3.3888, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 3.25% (14.5298 => 15.0018, std. dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 3.23% (4.6629 => 4.8133, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.11% (1.5188 => 1.5661, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.09% (16.2614 => 16.7645, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.95% (0.9108 => 0.9377, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 2.64% (0.6250 => 0.6415, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1509, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.31% (0.6744 => 0.6900, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (6.2785 => 6.4225, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.4805 => 0.4915, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.27% (3.7467 => 3.8318, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.90% (1.0313 => 1.0509, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.76% (0.6576 => 0.6692, std. dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 1.68% (1.2749 => 1.2963, std. dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.37% (33.2944 => 33.7511, std. dev.: 0.0280) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2596, std. dev.: 0.0446) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.96% (1.2998 => 1.4032, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.26% (0.2093 => 0.2224, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.34% (11.2619 => 11.7506, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3858, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.39% (10.7476 => 11.0047, std. dev.: 0.0319) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6001, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6784, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.17% (1.5089 => 1.5266, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 1.16% (26.5159 => 26.8237, std. dev.: 0.0502) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5726, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.47% (22.5627 => 21.3280, std. dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.18% (1.2308 => 1.0932, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.83% (1.3780 => 1.3252, std. dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.56% (8.8259 => 8.6000, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.05% (3.0263 => 2.9643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2320, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.86% (7.3305 => 7.1945, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0174) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3589, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.19% (5.5401 => 5.4744, std. dev.: 0.0107) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2260, std. dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.03% (20.3410 => 20.1324, std. dev.: 0.0459) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.02% (1.0310 => 1.0205, std. dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 05:23:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 07:23:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120824122335.B3BD62A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3182?compare_to=3177&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3182, Order: 162545, Start Time: 2012-08-24 09:41:03, End Time: 2012-08-24 12:24:32 To: 3177, Order: 162541, Start Time: 2012-08-24 06:26:43, End Time: 2012-08-24 09:13:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.38% (1.7329 => 1.7089, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 15.11% (0.3442 => 0.3962, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.09% (0.3465 => 0.3988, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 15.09% (0.3446 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.02% (0.3488 => 0.4012, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 14.97% (0.3460 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.93% (0.3496 => 0.4018, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.90% (0.3469 => 0.3986, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.60% (0.3643 => 0.4175, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 14.52% (0.3650 => 0.4180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.04% (0.3724 => 0.4247, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5826 => 0.6362, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.5889 => 0.6408, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.1620 => 0.1755, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.7171 => 0.7693, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.26% (1.5932 => 1.7089, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.26% (3.5627 => 3.8212, std. dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.24% (1.6211 => 1.7385, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.79% (1.3152 => 1.4045, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.40% (0.4361 => 0.4640, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.24% (0.5900 => 0.6268, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.19% (0.4994 => 0.5303, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 6.10% (4.2109 => 4.4677, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (0.5026 => 0.5332, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.08% (0.5000 => 0.5304, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.06% (0.3930 => 0.4168, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 5.95% (1.0781 => 1.1422, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 5.86% (0.4029 => 0.4265, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.74% (2.7292 => 2.8859, std. dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.69% (0.1968 => 0.2080, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2875 => 0.3035, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.33% (0.2738 => 0.2884, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.2866 => 0.3018, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.27% (0.2792 => 0.2939, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.23% (0.3195 => 0.3362, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.16% (0.3004 => 0.3159, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.09% (0.2729 => 0.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.09% (0.2750 => 0.2890, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.09% (0.9909 => 1.0413, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.08% (0.2813 => 0.2956, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.08% (0.2736 => 0.2875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.2780 => 0.2921, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.07% (0.2803 => 0.2945, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (0.2823 => 0.2966, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (1.9694 => 2.0688, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (1.9966 => 2.0971, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.97% (2.0673 => 2.1701, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (0.3890 => 0.4083, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.95% (2.1013 => 2.2054, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 4.94% (0.2811 => 0.2950, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.94% (0.3096 => 0.3249, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2911 => 0.3052, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.84% (0.3348 => 0.3510, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.82% (0.3362 => 0.3524, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.81% (0.3267 => 0.3424, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.79% (0.2566 => 0.2689, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.74% (0.4658 => 0.4879, std. dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 4.74% (4.6177 => 4.8365, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary: 4.73% (0.3258 => 0.3412, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.70% (0.3317 => 0.3473, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.64% (0.3726 => 0.3899, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.64% (0.3060 => 0.3202, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.62% (0.3678 => 0.3848, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.61% (5.5417 => 5.7973, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3124 => 0.3266, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.49% (2.1653 => 2.2626, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (4.4195 => 4.6175, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (1.8794 => 1.9632, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.37% (0.3477 => 0.3629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.36% (0.3625 => 0.3783, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.29% (1.4269 => 1.4881, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 4.26% (0.4251 => 0.4432, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.3903 => 0.4067, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.4139 => 0.4312, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4146 => 0.4318, std. dev.: 0.0015) MultiSource/Applications/hbd/hbd: 4.14% (0.9697 => 1.0098, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.09% (0.3690 => 0.3841, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.04% (0.7875 => 0.8193, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.02% (0.3981 => 0.4141, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.95% (0.6634 => 0.6896, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.88% (0.5546 => 0.5761, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.84% (0.2737 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.75% (0.3845 => 0.3989, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.60% (0.2969 => 0.3076, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.58% (23.5202 => 24.3617, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.3084 => 0.3193, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.42% (0.3336 => 0.3450, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.5012 => 0.5180, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.29% (0.6435 => 0.6647, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.72% (2.0346 => 2.0899, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.52% (0.4253 => 0.4360, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (0.4847 => 0.4953, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.41% (0.7426 => 0.7531, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.82% (0.2122 => 0.2288, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6677, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1732, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8909, std. dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6444, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1942, std. dev.: 0.0102) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5011, std. dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4614, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2832, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5918, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4451, std. dev.: 0.0278) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.96% (2.4764 => 2.4031, std. dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5725, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: -9.12% (0.2402 => 0.2183, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7936, std. dev.: 0.0114) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7963, std. dev.: 0.0026) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7750, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.60% (17.2379 => 16.7898, std. dev.: 0.0471) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.51% (0.6293 => 0.6135, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5721, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9566, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4966, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 04:48:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 06:48:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824114852.271CC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3181?compare_to=3178&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3181, Order: 162549, Start Time: 2012-08-24 10:30:32, End Time: 2012-08-24 11:49:48 To: 3178, Order: 162545, Start Time: 2012-08-24 08:17:28, End Time: 2012-08-24 09:36:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (129 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.05% (56.4500 => 54.7298, std. dev.: 0.2206) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.12% (10.3673 => 13.3859, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 14.20% (0.3473 => 0.3966, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.04% (0.3561 => 0.4061, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.02% (0.3516 => 0.4009, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.95% (0.3497 => 0.3985, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.91% (0.3543 => 0.4036, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.83% (0.3543 => 0.4033, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.54% (0.3694 => 0.4194, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3828 => 0.4325, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.94% (0.3927 => 0.4435, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.74% (0.3886 => 0.4381, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.83% (1.1194 => 1.2518, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.40% (1.7609 => 1.9440, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.19% (2.2022 => 2.4045, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 8.80% (0.1432 => 0.1558, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2065 => 0.2221, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7326 => 0.7848, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.01% (0.1584 => 0.1695, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1892 => 0.2022, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 6.06% (0.3282 => 0.3481, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.83% (7.0540 => 7.4653, std. dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (0.4615 => 0.4882, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.68% (0.3307 => 0.3495, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.33% (0.2271 => 0.2392, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.23% (0.4879 => 0.5134, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 5.07% (0.7433 => 0.7810, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (4.9449 => 5.1913, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.8172 => 0.8578, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.91% (5.0018 => 5.2472, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.3121 => 0.3272, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 4.83% (9.4845 => 9.9424, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.61% (4.2646 => 4.4610, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.56% (0.5569 => 0.5823, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 4.44% (0.4299 => 0.4490, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 4.44% (0.3109 => 0.3247, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.41% (0.2905 => 0.3033, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.40% (0.5860 => 0.6118, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.27% (8.1363 => 8.4835, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: 4.27% (0.3423 => 0.3569, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.26% (1.3050 => 1.3606, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.25% (0.4636 => 0.4833, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.12% (0.3180 => 0.3311, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.10% (0.7835 => 0.8156, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.02% (0.2758 => 0.2869, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (10.4361 => 10.8526, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.98% (0.3162 => 0.3288, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.98% (0.3441 => 0.3578, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.96% (0.2700 => 0.2807, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 3.94% (0.2871 => 0.2984, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3232 => 0.3359, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.90% (0.2872 => 0.2984, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2831 => 0.2941, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.88% (0.9765 => 1.0144, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.87% (0.3052 => 0.3170, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.85% (0.2756 => 0.2862, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.84% (5.7591 => 5.9802, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.72% (1.5415 => 1.5989, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (0.3422 => 0.3549, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (2.0665 => 2.1430, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.69% (0.3092 => 0.3206, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 3.68% (0.4289 => 0.4447, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (0.5105 => 0.5293, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (1.1861 => 1.2295, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3283 => 0.3403, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.65% (0.2793 => 0.2895, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.62% (0.3650 => 0.3782, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.61% (0.6450 => 0.6683, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.3136 => 0.3248, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 3.55% (0.2877 => 0.2979, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.52% (0.3603 => 0.3730, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.49% (1.5603 => 1.6147, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.48% (0.3826 => 0.3959, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.46% (1.1642 => 1.2045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.41% (0.8067 => 0.8342, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.40% (0.4064 => 0.4202, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6675 => 0.6898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.31% (0.3379 => 0.3491, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.31% (0.4620 => 0.4773, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.27% (0.6456 => 0.6667, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.4203 => 0.4339, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.19% (0.4048 => 0.4177, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.16% (3.3354 => 3.4409, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.16% (0.3387 => 0.3494, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.15% (3.8723 => 3.9941, std. dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.11% (0.5981 => 0.6167, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.07% (1.2842 => 1.3236, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.03% (2.0273 => 2.0887, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7910, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.73% (1.4186 => 1.4573, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8921 => 0.9164, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.5020 => 0.5152, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 2.57% (2.2969 => 2.3560, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6212, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.11% (17.1811 => 17.5435, std. dev.: 0.0260) MultiSource/Benchmarks/nbench/nbench: 2.04% (1.1840 => 1.2082, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.2024 => 2.2474, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 2.04% (0.7115 => 0.7260, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.60% (1.0722 => 1.0894, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.56% (7.9617 => 8.0859, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.43% (21.9371 => 22.2501, std. dev.: 0.0272) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (4.2280 => 4.4408, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.02% (26.0924 => 26.8816, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7494, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3342, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2495, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (1.5086 => 1.5265, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.07% (3.1578 => 3.1915, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5748, std. dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.29% (5.2763 => 3.2032, std. dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7176, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.53% (5.3526 => 3.7182, std. dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.87% (54.1659 => 46.1113, std. dev.: 0.0161) MultiSource/Applications/ClamAV/clamscan: -14.11% (22.1758 => 19.0479, std. dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.99% (2.9384 => 2.5566, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2373 => 1.1059, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -8.68% (1.5373 => 1.4038, std. dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.01% (1.1396 => 1.0597, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std. dev.: 0.0010) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4675, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4263, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9896, std. dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.28% (8.1563 => 7.9702, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3396, std. dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0108) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8125, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 04:44:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 06:44:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824114403.E84F42A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3180?compare_to=3179&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3180, Order: 162549, Start Time: 2012-08-24 10:30:37, End Time: 2012-08-24 11:44:59 To: 3179, Order: 162545, Start Time: 2012-08-24 08:26:58, End Time: 2012-08-24 09:41:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (158 on baseline) Performance Improvements: 1 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (700 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.13% (29.3977 => 29.7291, std. dev.: 0.0444) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -1.90% (0.5472 => 0.5368, std. dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.08% (2.0176 => 2.3218, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.48% (0.5818 => 0.6486, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.36% (0.5748 => 0.6401, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.15% (0.7061 => 0.7848, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.56% (0.3578 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.42% (0.3646 => 0.4026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.36% (0.3601 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.26% (0.3663 => 0.4039, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3650 => 0.4023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3623 => 0.3993, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.08% (0.3789 => 0.4171, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.02% (0.3914 => 0.4306, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.84% (0.4003 => 0.4397, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.70% (0.3940 => 0.4322, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.56% (0.3130 => 0.3398, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.12% (0.7710 => 0.8336, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 8.06% (0.4328 => 0.4677, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (3.9660 => 4.2836, std. dev.: 0.0074) MultiSource/Applications/hbd/hbd: 7.81% (1.3693 => 1.4762, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.75% (0.1819 => 0.1960, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.2781 => 0.2994, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5265 => 0.5661, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4062 => 0.4367, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2596 => 0.2789, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.39% (0.3899 => 0.4187, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.38% (0.2655 => 0.2851, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.35% (0.7038 => 0.7555, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/except: 7.32% (0.2760 => 0.2962, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.00% (1.2193 => 1.3046, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 6.97% (0.2726 => 0.2916, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.97% (0.6959 => 0.7444, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.89% (0.9199 => 0.9833, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2761 => 0.2951, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.86% (0.2988 => 0.3193, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.84% (0.2765 => 0.2954, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.83% (0.4379 => 0.4678, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.2937 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (1.9828 => 2.1170, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.3107 => 0.3315, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.69% (0.3485 => 0.3718, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.68% (0.3580 => 0.3819, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3149 => 0.3359, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.1789 => 0.1908, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.39% (0.2127 => 0.2263, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.26% (1.1364 => 1.2075, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.20% (0.3534 => 0.3753, std. dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.2914 => 0.3094, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4390 => 0.4660, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.15% (0.5577 => 0.5920, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.10% (13.8202 => 14.6630, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: 6.07% (0.3293 => 0.3493, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.4016 => 0.4257, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.98% (1.4563 => 1.5434, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.98% (0.5637 => 0.5974, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.3868 => 0.4098, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.3756 => 0.3977, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 5.81% (0.2925 => 0.3095, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.73% (7.2180 => 7.6313, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.54% (1.3245 => 1.3979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 5.48% (0.2995 => 0.3159, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.45% (1.2292 => 1.2962, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.43% (3.8646 => 4.0744, std. dev.: 0.0027) MultiSource/Applications/spiff/spiff: 5.40% (0.7506 => 0.7911, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (1.3819 => 1.4561, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 5.35% (0.8310 => 0.8755, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.30% (0.4113 => 0.4331, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (1.3813 => 1.4542, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.21% (3.6692 => 3.8602, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 5.16% (1.0594 => 1.1141, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.16% (0.7460 => 0.7845, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.14% (1.1061 => 1.1629, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.12% (4.3801 => 4.6043, std. dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.08% (4.4433 => 4.6692, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3220 => 0.3381, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.97% (0.6135 => 0.6440, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.97% (0.6283 => 0.6595, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.93% (0.4791 => 0.5027, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.3755 => 0.3937, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (13.2842 => 13.9116, std. dev.: 0.0111) MultiSource/Applications/kimwitu++/kc: 4.72% (16.6129 => 17.3969, std. dev.: 0.0189) MultiSource/Applications/treecc/treecc: 4.69% (1.9270 => 2.0173, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 4.49% (14.8535 => 15.5201, std. dev.: 0.0078) MultiSource/Applications/siod/siod: 4.48% (2.1791 => 2.2767, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.37% (0.8818 => 0.9203, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 4.12% (0.3131 => 0.3260, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.07% (0.8698 => 0.9052, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.07% (0.3245 => 0.3377, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.02% (1.1333 => 1.1789, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.89% (3.1889 => 3.3131, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (8.4961 => 8.8261, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1772, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 3.69% (6.5754 => 6.8180, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 3.64% (0.2859 => 0.2963, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.39% (3.2742 => 3.3853, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 3.18% (14.5298 => 14.9917, std. dev.: 0.0165) MultiSource/Applications/oggenc/oggenc: 3.15% (4.6629 => 4.8097, std. dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 3.09% (16.2614 => 16.7631, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.96% (1.5188 => 1.5637, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.82% (0.9108 => 0.9365, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.64% (0.6250 => 0.6415, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.43% (0.4805 => 0.4922, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (2.1007 => 2.1514, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (6.2785 => 6.4273, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 2.23% (3.7467 => 3.8304, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 2.19% (0.6744 => 0.6892, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.93% (1.0313 => 1.0512, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.52% (1.2749 => 1.2943, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7332, std. dev.: 0.0279) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5184, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2569, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 7.93% (1.2998 => 1.4029, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.03% (1.5824 => 1.6620, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0058, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7410, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.29% (1.9199 => 1.9831, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8156, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3858, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5969, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.02% (10.7476 => 10.9652, std. dev.: 0.0298) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6776, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 1.57% (3.2729 => 3.3243, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0060) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.19% (26.5159 => 26.8315, std. dev.: 0.0219) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.40% (22.5627 => 21.3448, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std. dev.: 0.0128) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.57% (1.1560 => 1.1032, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5968, std. dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9605, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2367, std. dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2073, std. dev.: 0.0231) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3652, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 02:35:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 04:35:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824093553.1E8AC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3178?compare_to=3175&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3178, Order: 162545, Start Time: 2012-08-24 08:17:28, End Time: 2012-08-24 09:36:43 To: 3175, Order: 162541, Start Time: 2012-08-24 06:26:45, End Time: 2012-08-24 07:48:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.92% (3.7793 => 3.8517, std. dev.: 0.0124) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.18% (10.3673 => 13.3925, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 14.31% (0.3473 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3497 => 0.3990, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3543 => 0.4042, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.03% (0.3543 => 0.4040, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3561 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.91% (0.3516 => 0.4005, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.54% (0.3694 => 0.4194, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.09% (0.3927 => 0.4441, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.06% (0.3828 => 0.4328, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.00% (1.1194 => 1.2537, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.43% (1.7609 => 1.9445, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.17% (2.2022 => 2.4041, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.6030 => 0.6516, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 7.10% (0.7326 => 0.7846, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.07% (0.1584 => 0.1696, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.92% (0.1892 => 0.2023, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.55% (0.3177 => 0.3385, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.15% (0.3282 => 0.3484, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4615 => 0.4894, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.90% (7.0540 => 7.4704, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.65% (0.3307 => 0.3494, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.4879 => 0.5136, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.18% (0.8172 => 0.8595, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.15% (0.2271 => 0.2388, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.14% (0.7433 => 0.7815, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2554 => 0.2685, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (4.9449 => 5.1971, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.93% (5.0018 => 5.2482, std. dev.: 0.0147) MultiSource/Benchmarks/mafft/pairlocalalign: 4.83% (9.4845 => 9.9423, std. dev.: 0.0159) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.71% (0.3121 => 0.3268, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.66% (4.2646 => 4.4634, std. dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 4.60% (0.3109 => 0.3252, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.60% (0.5569 => 0.5825, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 4.49% (0.4299 => 0.4492, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.49% (0.5860 => 0.6123, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.44% (0.2905 => 0.3034, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 4.44% (0.3423 => 0.3575, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.33% (1.3050 => 1.3615, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.32% (8.1363 => 8.4881, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.25% (0.2891 => 0.3014, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.11% (0.7835 => 0.8157, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.11% (0.2872 => 0.2990, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.3441 => 0.3582, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.06% (0.3180 => 0.3309, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 4.05% (10.4361 => 10.8592, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.03% (0.2756 => 0.2867, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.95% (0.2758 => 0.2867, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.94% (0.2871 => 0.2984, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.88% (0.9765 => 1.0144, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3232 => 0.3357, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.87% (0.2793 => 0.2901, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3865 => 0.4014, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 3.84% (5.7591 => 5.9804, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 3.83% (0.3052 => 0.3169, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.83% (0.3162 => 0.3283, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.82% (1.5415 => 1.6004, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 3.81% (0.3283 => 0.3408, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.80% (0.4636 => 0.4812, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.3092 => 0.3209, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 3.76% (0.2714 => 0.2816, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 3.75% (0.4289 => 0.4450, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.75% (0.6450 => 0.6692, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.74% (2.0665 => 2.1438, std. dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.73% (0.3650 => 0.3786, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.66% (0.3603 => 0.3735, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.65% (0.3422 => 0.3547, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.62% (0.5105 => 0.5290, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.62% (1.1861 => 1.2290, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.58% (0.2877 => 0.2980, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.55% (1.1642 => 1.2055, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.3136 => 0.3247, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.48% (0.3826 => 0.3959, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.46% (0.6675 => 0.6906, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3684 => 0.3811, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.43% (1.5603 => 1.6138, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.4064 => 0.4201, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.36% (0.8067 => 0.8338, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3379 => 0.3489, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.4048 => 0.4178, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.21% (2.0273 => 2.0923, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 3.16% (0.4620 => 0.4766, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.15% (3.3354 => 3.4406, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.14% (0.5981 => 0.6169, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.6456 => 0.6658, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.07% (1.2842 => 1.3236, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.06% (3.8723 => 3.9909, std. dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (14.3668 => 14.7888, std. dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.4186 => 1.4597, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8921 => 0.9164, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 2.59% (2.2969 => 2.3565, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.55% (0.5020 => 0.5148, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (1.5859 => 1.6234, std. dev.: 0.0065) MultiSource/Applications/minisat/minisat: 2.25% (0.7115 => 0.7275, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.12% (17.1811 => 17.5452, std. dev.: 0.0256) MultiSource/Benchmarks/nbench/nbench: 2.09% (1.1840 => 1.2088, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.08% (2.2024 => 2.2481, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.71% (1.0722 => 1.0905, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.59% (7.9617 => 8.0880, std. dev.: 0.0215) MultiSource/Applications/JM/lencod/lencod: 1.44% (21.9371 => 22.2530, std. dev.: 0.0292) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (4.2280 => 4.4407, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7611, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 3.00% (26.0924 => 26.8743, std. dev.: 0.0480) MultiSource/Benchmarks/llubenchmark/llu: 1.95% (3.7781 => 3.8517, std. dev.: 0.0124) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3345, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2495, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.10% (3.1578 => 3.1925, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5800, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.27% (5.2763 => 3.2045, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7177, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.52% (5.3526 => 3.7191, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0968, std. dev.: 0.0227) MultiSource/Applications/ClamAV/clamscan: -14.15% (22.1758 => 19.0384, std. dev.: 0.0304) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.95% (2.9384 => 2.5578, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: -10.39% (1.2373 => 1.1088, std. dev.: 0.0309) SingleSource/Benchmarks/Misc/mandel-2: -8.85% (1.5373 => 1.4012, std. dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0511, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4644, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4340, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.50% (10.2830 => 10.0257, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.30% (8.1563 => 7.9689, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3491, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.00% (1.8329 => 1.8145, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 02:40:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 04:40:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824094030.9C68C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3179?compare_to=3176&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3179, Order: 162545, Start Time: 2012-08-24 08:26:58, End Time: 2012-08-24 09:41:22 To: 3176, Order: 162541, Start Time: 2012-08-24 06:41:33, End Time: 2012-08-24 07:58:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (160 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.06% (2.0176 => 2.3214, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.71% (0.0826 => 0.0931, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 11.38% (0.5748 => 0.6402, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.23% (0.7061 => 0.7854, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 10.56% (0.3578 => 0.3956, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.42% (0.3646 => 0.4026, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.36% (0.3601 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.24% (0.3663 => 0.4038, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3623 => 0.3993, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3650 => 0.4022, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: 10.08% (0.3789 => 0.4171, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.04% (0.3914 => 0.4307, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.87% (0.4003 => 0.4398, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.72% (0.3940 => 0.4323, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.31% (0.7710 => 0.8351, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.19% (0.1819 => 0.1968, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.06% (0.4328 => 0.4677, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4062 => 0.4388, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.02% (3.9660 => 4.2841, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 7.83% (0.7038 => 0.7589, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 7.79% (1.3693 => 1.4760, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.2781 => 0.2994, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.39% (0.2760 => 0.2964, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2966 => 0.3182, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.10% (0.2607 => 0.2792, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.05% (1.2193 => 1.3053, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.03% (0.9199 => 0.9846, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.95% (0.3899 => 0.4170, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.92% (0.4379 => 0.4682, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.2721 => 0.2909, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.91% (0.2765 => 0.2956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.81% (1.9828 => 2.1179, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.80% (0.6959 => 0.7432, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.73% (0.3580 => 0.3821, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.71% (0.3485 => 0.3719, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.71% (0.3489 => 0.3723, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.55% (0.1588 => 0.1692, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3192 => 0.3399, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.1364 => 1.2085, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2127 => 0.2261, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.16% (0.3293 => 0.3496, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (0.2914 => 0.3093, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.13% (0.4016 => 0.4262, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.11% (0.5577 => 0.5918, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.10% (13.8202 => 14.6630, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.06% (0.4390 => 0.4656, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 6.02% (0.3868 => 0.4101, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (1.4563 => 1.5435, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.89% (0.5637 => 0.5969, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.3756 => 0.3977, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 5.81% (0.2925 => 0.3095, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.77% (7.2180 => 7.6343, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2945 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.57% (0.2243 => 0.2368, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (1.3819 => 1.4581, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.49% (0.7506 => 0.7918, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 5.48% (0.2995 => 0.3159, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.47% (3.8646 => 4.0760, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 5.46% (1.2292 => 1.2963, std. dev.: 0.0058) MultiSource/Applications/Burg/burg: 5.43% (1.1061 => 1.1662, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.39% (0.8310 => 0.8758, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (1.3813 => 1.4550, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.28% (0.4113 => 0.4330, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.27% (1.3245 => 1.3943, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (3.6692 => 3.8612, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.23% (0.7460 => 0.7850, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.13% (4.3801 => 4.6048, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.07% (0.4791 => 0.5034, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.06% (1.0594 => 1.1130, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.03% (0.6283 => 0.6599, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.02% (4.4433 => 4.6665, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3755 => 0.3938, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 4.84% (0.3220 => 0.3376, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.82% (0.6135 => 0.6431, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 4.80% (2.1791 => 2.2838, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (13.2842 => 13.9223, std. dev.: 0.0081) MultiSource/Applications/treecc/treecc: 4.78% (1.9270 => 2.0191, std. dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4020, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.55% (0.8818 => 0.9219, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.43% (14.8535 => 15.5115, std. dev.: 0.0180) MultiSource/Benchmarks/sim/sim: 4.12% (0.3131 => 0.3260, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.10% (0.3245 => 0.3378, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.08% (1.1333 => 1.1795, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.05% (0.8698 => 0.9050, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (8.4961 => 8.8290, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 3.88% (3.1889 => 3.3127, std. dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.79% (4.9865 => 5.1757, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 3.77% (6.5754 => 6.8236, std. dev.: 0.0208) MultiSource/Benchmarks/Olden/bh/bh: 3.60% (0.2859 => 0.2962, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.49% (3.2742 => 3.3886, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.21% (4.6629 => 4.8128, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 3.21% (14.5298 => 14.9959, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 3.15% (16.2614 => 16.7729, std. dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.12% (1.5188 => 1.5662, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.84% (0.9108 => 0.9367, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.64% (0.6250 => 0.6415, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 2.57% (0.6744 => 0.6917, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.44% (3.7467 => 3.8381, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.42% (2.1007 => 2.1515, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (6.2785 => 6.4228, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.4805 => 0.4914, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 2.00% (1.0313 => 1.0519, std. dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.64% (1.2749 => 1.2958, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.42% (33.2944 => 33.7665, std. dev.: 0.0242) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0277) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.81% (1.2998 => 1.4143, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (0.2093 => 0.2217, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7403, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8184, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6007, std. dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.13% (10.7476 => 10.9766, std. dev.: 0.0250) MultiSource/Applications/sqlite3/sqlite3: 1.83% (4.5928 => 4.6768, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3264, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5151, std. dev.: 0.0058) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5281, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1852, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.54% (0.2670 => 0.2522, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.45% (22.5627 => 21.3336, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2308 => 1.0991, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5091, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1031, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.98% (1.3780 => 1.3232, std. dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6105, std. dev.: 0.0204) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9287, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.14% (3.0263 => 2.9615, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2239, std. dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2048, std. dev.: 0.0240) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3641, std. dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.24% (20.3410 => 20.0891, std. dev.: 0.0281) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2419, std. dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 02:12:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 04:12:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120824091221.C5A582A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3177?compare_to=3173&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3177, Order: 162541, Start Time: 2012-08-24 06:26:43, End Time: 2012-08-24 09:13:13 To: 3173, Order: 162529, Start Time: 2012-08-24 02:36:48, End Time: 2012-08-24 05:20:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (100 on baseline) Performance Improvements: 0 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.40% (0.3465 => 0.3964, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.38% (0.3442 => 0.3937, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.25% (0.3460 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.22% (0.3488 => 0.3984, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3469 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.72% (0.3643 => 0.4143, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.67% (0.3650 => 0.4149, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.40% (0.3724 => 0.4223, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1063 => 0.1172, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 8.77% (1.5932 => 1.7329, std. dev.: 0.0277) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5826 => 0.6303, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.02% (0.1620 => 0.1750, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.86% (0.5889 => 0.6352, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.1619 => 0.1745, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.11% (1.6211 => 1.7363, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.04% (3.5627 => 3.8134, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.99% (1.3152 => 1.4071, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7171 => 0.7662, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.61% (0.1968 => 0.2098, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.5900 => 0.6286, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (0.4994 => 0.5315, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.4361 => 0.4639, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.16% (0.5000 => 0.5308, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.71% (0.5026 => 0.5313, std. dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.59% (2.7292 => 2.8818, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.2866 => 0.3021, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.2736 => 0.2880, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 5.22% (0.2566 => 0.2700, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.20% (0.4658 => 0.4900, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (1.9694 => 2.0697, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.08% (0.2875 => 0.3021, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.04% (2.1013 => 2.2072, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.97% (1.9966 => 2.0958, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2738 => 0.2873, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.91% (0.3195 => 0.3352, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.91% (0.2792 => 0.2929, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 4.86% (0.2714 => 0.2846, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.84% (0.2725 => 0.2857, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.84% (0.2729 => 0.2861, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.76% (2.0673 => 2.1658, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2780 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.74% (0.2803 => 0.2936, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (0.3890 => 0.4072, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 4.66% (0.3004 => 0.3144, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.61% (0.2823 => 0.2953, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.57% (0.3348 => 0.3501, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3362 => 0.3515, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 4.52% (0.3096 => 0.3236, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.52% (4.4195 => 4.6192, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.47% (0.2911 => 0.3041, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.46% (0.3903 => 0.4077, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3267 => 0.3411, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (1.8794 => 1.9616, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.35% (0.3060 => 0.3193, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 4.33% (0.3258 => 0.3399, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.31% (0.3317 => 0.3460, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.27% (0.3726 => 0.3885, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3124 => 0.3257, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3282 => 0.3421, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3678 => 0.3832, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.14% (0.3845 => 0.4004, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.3271 => 0.3405, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 4.06% (0.3477 => 0.3618, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.05% (0.4146 => 0.4314, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.95% (0.4251 => 0.4419, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.94% (0.4139 => 0.4302, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.3690 => 0.3832, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.69% (0.3981 => 0.4128, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.41% (23.5202 => 24.3234, std. dev.: 0.0254) SingleSource/Benchmarks/Misc-C++/bigfib: 3.07% (0.5012 => 0.5166, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.98% (0.6435 => 0.6627, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.52% (0.4253 => 0.4360, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (0.7426 => 0.7532, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6136, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.27% (0.2122 => 0.2255, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6717, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8910, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1645, std. dev.: 0.0178) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6336, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1981, std. dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5029, std. dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2243, std. dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4394, std. dev.: 0.0285) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2824, std. dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.35% (1.0142 => 1.0279, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.62% (2.4764 => 2.4115, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5426, std. dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/ary2: -8.66% (0.2402 => 0.2194, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std. dev.: 0.0386) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7899, std. dev.: 0.0122) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std. dev.: 0.0153) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0049) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7936, std. dev.: 0.0050) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8239, std. dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.65% (10.7630 => 10.5857, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9614, std. dev.: 0.0069) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 00:58:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 02:58:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824075803.EEE492A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3176?compare_to=3174&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3176, Order: 162541, Start Time: 2012-08-24 06:41:33, End Time: 2012-08-24 07:58:53 To: 3174, Order: 162534, Start Time: 2012-08-24 04:59:58, End Time: 2012-08-24 06:14:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (133 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (725 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 25.70% (0.4155 => 0.5223, std. dev.: 0.0337) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.6009 => 56.5644, std. dev.: 0.0504) SingleSource/Regression/C/uint64_to_float: 2.20% (0.5374 => 0.5492, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.18% (79.2595 => 80.9888, std. dev.: 0.2357) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.93% (2.0176 => 2.3189, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/flops: 12.71% (0.0826 => 0.0931, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 10.35% (0.5818 => 0.6420, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 10.24% (0.7061 => 0.7784, std. dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 10.14% (0.5748 => 0.6331, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.92% (0.3578 => 0.3933, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.84% (0.3650 => 0.4009, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.83% (0.3623 => 0.3979, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.78% (0.3601 => 0.3953, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.76% (0.3646 => 0.4002, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.75% (0.3663 => 0.4020, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.63% (0.3914 => 0.4291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.45% (0.3789 => 0.4147, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.31% (0.3940 => 0.4307, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 9.27% (0.4003 => 0.4374, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.34% (0.3130 => 0.3391, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.07% (0.1413 => 0.1527, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.03% (1.3693 => 1.4793, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2781 => 0.3004, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4328 => 0.4664, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.59% (3.9660 => 4.2671, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4062 => 0.4366, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.11% (0.3022 => 0.3237, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7038 => 0.7534, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.99% (0.5265 => 0.5633, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4390 => 0.4691, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.74% (0.3485 => 0.3720, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.70% (1.2193 => 1.3010, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.57% (0.9199 => 0.9803, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.43% (0.3453 => 0.3675, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.42% (1.1364 => 1.2094, std. dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.28% (0.6959 => 0.7396, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2127 => 0.2259, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.10% (0.3293 => 0.3494, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.08% (0.4016 => 0.4260, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 6.02% (0.3868 => 0.4101, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.92% (0.5577 => 0.5907, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.3756 => 0.3976, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.5637 => 0.5967, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.81% (13.8202 => 14.6236, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.63% (0.2914 => 0.3078, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.59% (0.2023 => 0.2136, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.58% (0.3246 => 0.3427, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.47% (7.2180 => 7.6126, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.2243 => 0.2364, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1865 => 0.1965, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.36% (1.2292 => 1.2951, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 5.34% (0.2995 => 0.3155, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 5.33% (0.2925 => 0.3081, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.16% (0.7506 => 0.7893, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.13% (1.3813 => 1.4521, std. dev.: 0.0271) MultiSource/Benchmarks/MallocBench/gs/gs: 5.07% (3.8646 => 4.0607, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 5.06% (1.1061 => 1.1621, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.04% (0.8310 => 0.8729, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.04% (0.7460 => 0.7836, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.02% (1.3245 => 1.3910, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 4.96% (0.4113 => 0.4317, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3755 => 0.3938, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.68% (0.6283 => 0.6577, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.67% (0.8818 => 0.9230, std. dev.: 0.0066) MultiSource/Applications/treecc/treecc: 4.66% (1.9270 => 2.0168, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.65% (0.4791 => 0.5014, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3220 => 0.3367, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.43% (0.6135 => 0.6407, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.38% (2.1791 => 2.2745, std. dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 4.27% (16.6129 => 17.3230, std. dev.: 0.0140) MultiSource/Applications/JM/lencod/lencod: 4.19% (14.8535 => 15.4765, std. dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.09% (0.8698 => 0.9054, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.02% (0.3131 => 0.3257, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.77% (1.1333 => 1.1760, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.70% (0.3245 => 0.3365, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (4.9865 => 5.1623, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.50% (3.1889 => 3.3005, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 3.43% (6.5754 => 6.8012, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.31% (4.6629 => 4.8174, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.12% (3.2742 => 3.3762, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 3.01% (14.5298 => 14.9672, std. dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 2.95% (16.2614 => 16.7407, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.71% (1.5188 => 1.5600, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.62% (0.9108 => 0.9347, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 1.92% (3.7467 => 3.8187, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.82% (0.6744 => 0.6867, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.72% (1.0313 => 1.0490, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5139, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fbench: 27.20% (1.8175 => 2.3118, std. dev.: 0.0286) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.36% (1.2998 => 1.4345, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7413, std. dev.: 0.0377) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8182, std. dev.: 0.0166) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3856, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4271 => 7.6044, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.11% (10.7476 => 10.9743, std. dev.: 0.0424) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6763, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0338) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1837, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.03% (26.5159 => 26.7886, std. dev.: 0.0226) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.76% (22.5627 => 21.2637, std. dev.: 0.4900) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1036, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.03% (1.3780 => 1.3224, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.12% (6.3560 => 6.2212, std. dev.: 0.0135) MultiSource/Applications/spiff/spiff: -2.11% (3.0263 => 2.9623, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8617, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4759, std. dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4347, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.02% (20.3410 => 20.1339, std. dev.: 0.0221) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 00:47:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 02:47:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824074742.84E5C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3175?compare_to=3172&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3175, Order: 162541, Start Time: 2012-08-24 06:26:45, End Time: 2012-08-24 07:48:32 To: 3172, Order: 162533, Start Time: 2012-08-24 04:00:24, End Time: 2012-08-24 05:19:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.9288 => 56.7374, std. dev.: 0.5672) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 32.04% (0.3817 => 0.5040, std. dev.: 0.0366) MultiSource/Benchmarks/PAQ8p/paq8p: 29.55% (10.3673 => 13.4305, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.52% (0.3543 => 0.4022, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.16% (0.3473 => 0.3930, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/synchronized: 13.11% (0.3561 => 0.4028, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.97% (0.3516 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.93% (0.3497 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3543 => 0.3999, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.51% (0.3694 => 0.4156, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.23% (0.3828 => 0.4296, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.94% (0.3886 => 0.4350, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3927 => 0.4395, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.22% (1.7609 => 1.9408, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.42% (2.2022 => 2.4096, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: 8.80% (0.1432 => 0.1558, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 7.56% (0.5925 => 0.6373, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.35% (0.6030 => 0.6473, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1892 => 0.2024, std. dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.94% (0.1584 => 0.1694, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 6.54% (0.7326 => 0.7805, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.3177 => 0.3382, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.31% (7.0540 => 7.4992, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 6.15% (0.3282 => 0.3484, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.8172 => 0.8668, std. dev.: 0.0192) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.74% (0.4615 => 0.4880, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.41% (0.3307 => 0.3486, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (4.9449 => 5.2001, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.10% (0.5569 => 0.5853, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 5.09% (0.7433 => 0.7811, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.06% (0.2271 => 0.2386, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.85% (5.0018 => 5.2446, std. dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 4.74% (9.4845 => 9.9339, std. dev.: 0.0217) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.57% (4.2646 => 4.4596, std. dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.52% (0.3121 => 0.3262, std. dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 4.37% (0.3109 => 0.3245, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.35% (8.1363 => 8.4904, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5860 => 0.6113, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 4.27% (0.3092 => 0.3224, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.26% (0.2700 => 0.2815, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.24% (0.7835 => 0.8167, std. dev.: 0.0067) SingleSource/Regression/C++/ofstream_ctor: 4.23% (0.2905 => 0.3028, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 4.21% (0.4299 => 0.4480, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4636 => 0.4831, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 4.18% (0.3423 => 0.3566, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.15% (0.2891 => 0.3011, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.12% (1.3050 => 1.3588, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 4.08% (0.2871 => 0.2988, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 4.02% (5.7591 => 5.9905, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.01% (1.5415 => 1.6033, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 3.99% (0.3180 => 0.3307, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (10.4361 => 10.8521, std. dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.95% (0.3441 => 0.3577, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.82% (0.2877 => 0.2987, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3098 => 0.3216, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.3650 => 0.3789, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.80% (0.2872 => 0.2981, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.79% (0.8067 => 0.8373, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.76% (0.2793 => 0.2898, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.73% (0.3162 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3232 => 0.3352, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6450 => 0.6689, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: 3.70% (0.3052 => 0.3165, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.68% (1.1642 => 1.2071, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash: 3.66% (0.4289 => 0.4446, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 3.64% (0.2802 => 0.2904, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.61% (1.1861 => 1.2289, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0665 => 2.1408, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 3.59% (0.3422 => 0.3545, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.59% (0.3283 => 0.3401, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9765 => 1.0115, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 3.55% (0.3603 => 0.3731, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.50% (0.3826 => 0.3960, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.48% (0.3136 => 0.3245, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3935 => 0.4068, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.37% (1.5603 => 1.6129, std. dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.4064 => 0.4200, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3684 => 0.3805, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.23% (0.3379 => 0.3488, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.21% (3.8723 => 3.9967, std. dev.: 0.0079) MultiSource/Applications/d/make_dparser: 3.18% (3.3354 => 3.4413, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5981 => 0.6170, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.14% (2.0273 => 2.0910, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4203 => 0.4335, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.13% (0.3387 => 0.3493, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.10% (0.6456 => 0.6656, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.04% (1.2842 => 1.3232, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4620 => 0.4760, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.4048 => 0.4169, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (14.3668 => 14.7744, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.4186 => 1.4582, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 2.68% (0.8921 => 0.9160, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 2.58% (2.2969 => 2.3562, std. dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.49% (0.5020 => 0.5145, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 2.26% (17.1811 => 17.5697, std. dev.: 0.0050) MultiSource/Applications/minisat/minisat: 2.11% (0.7115 => 0.7265, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.52% (1.0722 => 1.0885, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.50% (7.9617 => 8.0813, std. dev.: 0.0235) MultiSource/Applications/JM/lencod/lencod: 1.46% (21.9371 => 22.2564, std. dev.: 0.0254) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.67% (4.2280 => 4.4255, std. dev.: 0.0191) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8659, std. dev.: 0.0482) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (3.6395 => 3.7449, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3348, std. dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2423, std. dev.: 0.0157) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5086 => 1.5292, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1578 => 3.1965, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5818, std. dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.32% (5.2763 => 3.2018, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.78% (5.3855 => 3.7278, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.41% (5.3526 => 3.7249, std. dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0759, std. dev.: 0.0227) MultiSource/Applications/ClamAV/clamscan: -14.16% (22.1758 => 19.0358, std. dev.: 0.0546) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.96% (2.9384 => 2.5577, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.30% (1.2373 => 1.1098, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.91% (1.5373 => 1.4311, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.99% (1.5835 => 1.5045, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.81% (5.0483 => 4.8053, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0010) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4650, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.18% (8.6802 => 8.4040, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9922, std. dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (8.1563 => 7.9668, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3471, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 5.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 22:19:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 00:19:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120824051932.558272A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3173?compare_to=3168&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3173, Order: 162529, Start Time: 2012-08-24 02:36:48, End Time: 2012-08-24 05:20:25 To: 3168, Order: 162488, Start Time: 2012-08-23 23:25:32, End Time: 2012-08-24 02:09:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 8 (122 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 946 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.50% (0.4283 => 0.4390, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (2.8492 => 2.8838, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (1.3960 => 1.4115, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.11% (2.0590 => 2.0818, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.06% (3.7836 => 3.8238, std. dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 1.04% (2.1842 => 2.2070, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.43% (0.2210 => 0.2352, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.55% (2.0490 => 2.1012, std. dev.: 0.0149) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.12% (0.3446 => 0.3967, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.08% (0.3442 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.04% (0.3465 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.00% (0.3460 => 0.3979, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 14.99% (0.3469 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.96% (0.3496 => 0.4019, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.88% (0.3488 => 0.4007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.47% (0.3650 => 0.4178, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 14.36% (0.3643 => 0.4166, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.02% (0.3724 => 0.4246, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.16% (0.1063 => 0.1171, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5826 => 0.6347, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.5889 => 0.6392, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.1620 => 0.1755, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 7.70% (1.5932 => 1.7158, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.33% (3.5627 => 3.8238, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.32% (1.3152 => 1.4115, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (1.6211 => 1.7386, std. dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7171 => 0.7681, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.74% (0.5026 => 0.5365, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.2014 => 0.2148, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.61% (0.4994 => 0.5324, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.40% (0.4361 => 0.4640, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 6.38% (0.4029 => 0.4286, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.34% (0.3930 => 0.4179, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.5900 => 0.6273, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 6.08% (1.0781 => 1.1437, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.08% (0.5000 => 0.5304, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 6.04% (4.2109 => 4.4653, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.2866 => 0.3039, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.71% (1.9694 => 2.0818, std. dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.66% (2.7292 => 2.8838, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.36% (0.2875 => 0.3029, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (0.4658 => 0.4905, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.30% (0.2738 => 0.2883, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.27% (1.9966 => 2.1019, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.26% (0.2736 => 0.2880, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.19% (0.3890 => 0.4092, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.18% (0.2566 => 0.2699, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.08% (5.5417 => 5.8230, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 5.03% (2.1013 => 2.2070, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 5.01% (0.2714 => 0.2850, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.01% (0.3195 => 0.3355, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2823 => 0.2964, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.95% (0.2729 => 0.2864, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.94% (0.2792 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.94% (0.2813 => 0.2952, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.3004 => 0.3151, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.85% (0.2803 => 0.2939, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2750 => 0.2883, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.82% (0.9909 => 1.0387, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2780 => 0.2914, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.76% (2.0673 => 2.1657, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 4.75% (0.3096 => 0.3243, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.72% (4.6177 => 4.8358, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.71% (0.3271 => 0.3425, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.70% (1.8794 => 1.9678, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 4.70% (0.2811 => 0.2943, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.64% (0.4139 => 0.4331, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (4.4195 => 4.6240, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.3258 => 0.3407, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.57% (0.2911 => 0.3044, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 4.52% (2.1653 => 2.2632, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.51% (0.3124 => 0.3265, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.51% (1.4269 => 1.4913, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 4.51% (0.3348 => 0.3499, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.51% (0.7875 => 0.8230, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 4.50% (0.3267 => 0.3414, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.49% (0.3317 => 0.3466, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.48% (0.3060 => 0.3197, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.3845 => 0.4015, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.40% (0.3678 => 0.3840, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.40% (0.3362 => 0.3510, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3625 => 0.3784, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.38% (0.3903 => 0.4074, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.37% (0.3477 => 0.3629, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.37% (0.6634 => 0.6924, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.33% (0.3282 => 0.3424, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3726 => 0.3887, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.12% (0.4146 => 0.4317, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4251 => 0.4425, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3690 => 0.3836, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.82% (0.9697 => 1.0067, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.79% (0.3981 => 0.4132, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 3.79% (0.5546 => 0.5756, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 3.77% (23.5202 => 24.4074, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.2737 => 0.2840, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.70% (0.2969 => 0.3079, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.3084 => 0.3196, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.63% (0.3336 => 0.3457, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.31% (0.5012 => 0.5178, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.22% (0.4253 => 0.4390, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (0.6435 => 0.6641, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 2.90% (2.0346 => 2.0936, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 2.37% (0.4847 => 0.4962, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (0.7426 => 0.7555, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.22% (4.6926 => 4.7497, std. dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (11.6398 => 11.7618, std. dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.84% (0.2122 => 0.2352, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.26% (12.0509 => 12.6843, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.42% (1.8057 => 1.8855, std. dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6359, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1971, std. dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5037, std. dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2225, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4397, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2809, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5877, std. dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.25% (2.4764 => 2.3959, std. dev.: 0.0199) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5648, std. dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7933, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7932, std. dev.: 0.0124) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7656, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.48% (0.6293 => 0.6137, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9602, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 23:13:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 01:13:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824061312.372872A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3174?compare_to=3171&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3174, Order: 162534, Start Time: 2012-08-24 04:59:58, End Time: 2012-08-24 06:14:03 To: 3171, Order: 162533, Start Time: 2012-08-24 03:18:15, End Time: 2012-08-24 04:32:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (155 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (702 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.03% (3.8365 => 3.7971, std. dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.85% (2.0176 => 2.3173, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.44% (0.7061 => 0.7798, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 10.42% (0.5818 => 0.6424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.11% (0.5748 => 0.6329, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.03% (0.3578 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.91% (0.3601 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.88% (0.3663 => 0.4025, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.81% (0.3650 => 0.4008, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.80% (0.3623 => 0.3978, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3789 => 0.4159, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.50% (0.3914 => 0.4286, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.42% (0.4003 => 0.4380, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.27% (0.3130 => 0.3389, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.03% (1.3693 => 1.4793, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.99% (0.4328 => 0.4674, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.90% (0.7710 => 0.8319, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.68% (3.9660 => 4.2706, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.59% (0.1819 => 0.1957, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.58% (0.2690 => 0.2894, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2596 => 0.2790, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4062 => 0.4361, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.28% (0.3022 => 0.3242, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.27% (0.2765 => 0.2966, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.12% (0.2726 => 0.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.05% (0.5265 => 0.5636, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2966 => 0.3174, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.00% (1.9828 => 2.1215, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary: 6.98% (0.3107 => 0.3324, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.93% (0.7038 => 0.7526, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.83% (0.3485 => 0.3723, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4390 => 0.4687, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.72% (1.2193 => 1.3012, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.69% (0.2721 => 0.2903, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.68% (0.3580 => 0.3819, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.66% (0.2988 => 0.3187, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.65% (0.9199 => 0.9811, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.64% (0.3192 => 0.3404, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.59% (0.3489 => 0.3719, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3453 => 0.3679, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.51% (0.4379 => 0.4664, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.32% (0.3293 => 0.3501, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.23% (0.4016 => 0.4266, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.22% (0.6959 => 0.7392, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.20% (0.3868 => 0.4108, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.20% (0.1789 => 0.1900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.04% (1.1364 => 1.2050, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.02% (0.3756 => 0.3982, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.97% (0.5577 => 0.5910, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.97% (0.2127 => 0.2254, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.78% (13.8202 => 14.6196, std. dev.: 0.0171) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.78% (0.2023 => 0.2140, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.71% (0.5637 => 0.5959, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.66% (0.2914 => 0.3079, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3246 => 0.3428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.58% (7.2180 => 7.6208, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.4563 => 1.5375, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.2925 => 0.3084, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.35% (0.2243 => 0.2363, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.2292 => 1.2946, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.8310 => 0.8739, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.12% (1.3819 => 1.4527, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 5.11% (0.2995 => 0.3148, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.10% (0.7506 => 0.7889, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (1.3813 => 1.4512, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 4.99% (3.8646 => 4.0573, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.96% (1.3245 => 1.3902, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.95% (0.7460 => 0.7829, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 4.91% (1.1061 => 1.1604, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3755 => 0.3938, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.86% (3.6692 => 3.8474, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 4.81% (0.4113 => 0.4311, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.81% (4.3801 => 4.5907, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.80% (4.4433 => 4.6566, std. dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 4.77% (1.0594 => 1.1099, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (0.4791 => 0.5019, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (13.2842 => 13.8993, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.60% (0.6283 => 0.6572, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.53% (0.3220 => 0.3366, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.47% (1.9270 => 2.0131, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.47% (0.6135 => 0.6409, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.34% (16.6129 => 17.3347, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 4.22% (14.8535 => 15.4807, std. dev.: 0.0040) MultiSource/Applications/siod/siod: 4.19% (2.1791 => 2.2705, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.09% (0.8818 => 0.9179, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 4.06% (0.3131 => 0.3258, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.95% (0.8698 => 0.9042, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.86% (1.1333 => 1.1771, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.3245 => 0.3366, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (8.4961 => 8.7991, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 3.55% (3.1889 => 3.3022, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.43% (6.5754 => 6.8009, std. dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.38% (4.9865 => 5.1550, std. dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 3.22% (4.6629 => 4.8131, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.10% (3.2742 => 3.3757, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.07% (16.2614 => 16.7604, std. dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 2.92% (14.5298 => 14.9541, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.6250 => 0.6416, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.60% (0.9108 => 0.9345, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5188 => 1.5568, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.1007 => 2.1435, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.01% (6.2785 => 6.4045, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 1.91% (3.7467 => 3.8184, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: 1.75% (0.6744 => 0.6862, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.28% (1.2749 => 1.2912, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 1.07% (33.2944 => 33.6491, std. dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 24.64% (1.8175 => 2.2653, std. dev.: 0.0486) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.69% (1.2998 => 1.4258, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7412, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6014, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.23% (10.7476 => 10.9877, std. dev.: 0.0558) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6776, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3267, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.15% (1.5089 => 1.5263, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 1.15% (26.5159 => 26.8212, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5718, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.81% (22.5627 => 21.2526, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.25% (1.2308 => 1.1046, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.44% (1.3780 => 1.3168, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0211, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (8.8259 => 8.6144, std. dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.12% (3.0263 => 2.9621, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2359, std. dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: -1.75% (7.3305 => 7.2025, std. dev.: 0.0273) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3593, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (20.3410 => 20.1209, std. dev.: 0.0321) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 22:18:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 00:18:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824051842.269142A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3172?compare_to=3170&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3172, Order: 162533, Start Time: 2012-08-24 04:00:24, End Time: 2012-08-24 05:19:33 To: 3170, Order: 162526, Start Time: 2012-08-24 02:13:51, End Time: 2012-08-24 03:32:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (128 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.00% (27.7174 => 29.6576, std. dev.: 0.0278) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.18% (78.2761 => 80.7654, std. dev.: 0.3086) SingleSource/Benchmarks/McGill/chomp: 1.61% (1.0898 => 1.1073, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.37% (10.3673 => 13.5156, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 13.50% (0.3473 => 0.3942, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.31% (0.3561 => 0.4035, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.27% (0.3497 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.24% (0.3543 => 0.4012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.24% (0.3543 => 0.4012, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.20% (0.3516 => 0.3980, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.78% (0.3694 => 0.4166, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.36% (0.3828 => 0.4301, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.32% (0.3927 => 0.4411, std. dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.20% (1.1194 => 1.2560, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.94% (1.7609 => 1.9535, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.99% (2.2022 => 2.4222, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.50% (0.1432 => 0.1568, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.83% (0.1584 => 0.1708, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.70% (0.5925 => 0.6381, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 7.58% (0.6030 => 0.6487, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.35% (0.1892 => 0.2031, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.14% (0.7326 => 0.7849, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.02% (0.3177 => 0.3400, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.86% (0.3282 => 0.3507, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.38% (0.8172 => 0.8693, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.09% (0.4615 => 0.4896, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.07% (7.0540 => 7.4822, std. dev.: 0.0203) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.94% (0.4879 => 0.5169, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.59% (0.3307 => 0.3492, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.38% (4.9449 => 5.2109, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 5.36% (0.2554 => 0.2691, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.33% (0.2271 => 0.2392, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.27% (9.4845 => 9.9842, std. dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: 5.19% (0.7433 => 0.7819, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.17% (5.0018 => 5.2603, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 4.84% (0.4299 => 0.4507, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (4.2646 => 4.4689, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.3121 => 0.3270, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.76% (0.3109 => 0.3257, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.76% (0.5569 => 0.5834, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.71% (10.4361 => 10.9277, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 4.59% (0.3423 => 0.3580, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.56% (0.5860 => 0.6127, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (8.1363 => 8.5069, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.53% (1.3050 => 1.3641, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.52% (0.2700 => 0.2822, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.42% (5.7591 => 6.0137, std. dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.36% (0.3441 => 0.3591, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.28% (0.7835 => 0.8170, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 4.25% (0.3180 => 0.3315, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.18% (0.4636 => 0.4830, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.06% (0.2758 => 0.2870, std. dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2905 => 0.3021, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2756 => 0.2864, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.91% (0.3092 => 0.3213, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.91% (0.2891 => 0.3004, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.90% (0.5105 => 0.5304, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.88% (0.9765 => 1.0144, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6450 => 0.6699, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.80% (0.4289 => 0.4452, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.3098 => 0.3215, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.77% (1.5415 => 1.5996, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.76% (0.2793 => 0.2898, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.73% (1.1861 => 1.2304, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.68% (0.8067 => 0.8364, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 3.67% (1.5603 => 1.6176, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 3.64% (0.3052 => 0.3163, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.62% (0.3422 => 0.3546, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.61% (0.6675 => 0.6916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.60% (0.2802 => 0.2903, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.60% (0.2831 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3232 => 0.3347, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.55% (0.2872 => 0.2974, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.50% (1.1642 => 1.2049, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5981 => 0.6187, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.42% (0.3650 => 0.3775, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.42% (0.3162 => 0.3270, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.39% (2.0665 => 2.1365, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.38% (3.3354 => 3.4480, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3935 => 0.4067, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.35% (2.0273 => 2.0952, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.32% (0.3136 => 0.3240, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.30% (0.3603 => 0.3722, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3684 => 0.3804, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.25% (3.8723 => 3.9982, std. dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.25% (0.4064 => 0.4196, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (14.3668 => 14.8297, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 3.14% (0.6456 => 0.6659, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.14% (0.3379 => 0.3485, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.04% (1.4186 => 1.4617, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.02% (0.4203 => 0.4330, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8921 => 0.9187, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.92% (1.2842 => 1.3217, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 2.82% (0.4048 => 0.4162, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.74% (2.2969 => 2.3598, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.69% (0.5020 => 0.5155, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6240, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.31% (17.1811 => 17.5779, std. dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (2.2024 => 2.2530, std. dev.: 0.0059) MultiSource/Applications/minisat/minisat: 2.25% (0.7115 => 0.7275, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.1840 => 1.2105, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.95% (7.9617 => 8.1170, std. dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.82% (1.0722 => 1.0917, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.73% (21.9371 => 22.3161, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (4.2280 => 4.4420, std. dev.: 0.0121) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7559, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.98% (26.0924 => 26.8710, std. dev.: 0.0113) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0149) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2476, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.33% (1.3045 => 1.3219, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5086 => 1.5280, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 1.13% (3.1578 => 3.1936, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.10% (5.2763 => 3.2131, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.78% (5.3855 => 3.7276, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.37% (5.3526 => 3.7268, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.0998, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -14.04% (22.1758 => 19.0618, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.70% (2.9384 => 2.5652, std. dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -6.97% (1.5373 => 1.4301, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std. dev.: 0.0029) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4641, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4213, std. dev.: 0.0246) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.55% (10.2830 => 10.0211, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9623, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3365, std. dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4230, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.00% (1.8329 => 1.8145, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 21:31:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 23:31:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824043133.8DE502A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3171?compare_to=3169&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3171, Order: 162533, Start Time: 2012-08-24 03:18:15, End Time: 2012-08-24 04:32:26 To: 3169, Order: 162523, Start Time: 2012-08-24 01:36:30, End Time: 2012-08-24 02:50:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (159 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (697 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.85% (54.6610 => 56.2209, std. dev.: 0.1596) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.83% (79.0077 => 81.2421, std. dev.: 0.1069) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.65% (0.7919 => 0.7788, std. dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.30% (2.0176 => 2.3262, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 13.08% (0.0826 => 0.0934, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.85% (0.5818 => 0.6449, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3578 => 0.3952, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 10.30% (0.7061 => 0.7788, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 10.14% (0.3601 => 0.3966, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.13% (0.3663 => 0.4034, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.12% (0.3646 => 0.4015, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.03% (0.3650 => 0.4016, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 10.02% (0.3623 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.84% (0.3789 => 0.4162, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.81% (0.3914 => 0.4298, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.74% (0.4003 => 0.4393, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.59% (0.3940 => 0.4318, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.16% (0.7710 => 0.8339, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.09% (3.9660 => 4.2868, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1819 => 0.1963, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.81% (0.4328 => 0.4666, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.76% (1.3693 => 1.4755, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.67% (0.7038 => 0.7578, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5265 => 0.5661, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.2781 => 0.2990, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2596 => 0.2789, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2782 => 0.2984, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.11% (0.9199 => 0.9853, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.08% (0.3899 => 0.4175, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.01% (0.4379 => 0.4686, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.00% (1.2193 => 1.3047, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2761 => 0.2953, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2655 => 0.2836, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.80% (0.2765 => 0.2953, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.77% (0.6959 => 0.7430, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.68% (1.9828 => 2.1152, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.64% (0.2696 => 0.2875, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3149 => 0.3358, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.59% (0.3489 => 0.3719, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.57% (0.3485 => 0.3714, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.55% (0.1588 => 0.1692, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.54% (0.3580 => 0.3814, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.2988 => 0.3182, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.41% (1.1364 => 1.2093, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.24% (0.2243 => 0.2383, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2127 => 0.2259, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.20% (13.8202 => 14.6775, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.19% (0.3246 => 0.3447, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.18% (0.2023 => 0.2148, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.17% (0.5577 => 0.5921, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (0.2914 => 0.3093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.14% (0.5637 => 0.5983, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.06% (0.1865 => 0.1978, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.05% (0.2925 => 0.3102, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.98% (0.3293 => 0.3490, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.4016 => 0.4255, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (7.2180 => 7.6415, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/moments: 5.82% (0.3868 => 0.4093, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.80% (1.4563 => 1.5407, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.75% (0.3756 => 0.3972, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 5.70% (1.1061 => 1.1691, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 5.63% (3.8646 => 4.0821, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.54% (0.7506 => 0.7922, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.42% (0.8310 => 0.8760, std. dev.: 0.0112) MultiSource/Applications/sgefa/sgefa: 5.41% (0.2995 => 0.3157, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.39% (1.3245 => 1.3959, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.34% (1.3819 => 1.4557, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.34% (0.7460 => 0.7858, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.19% (1.3813 => 1.4530, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 5.19% (1.2292 => 1.2930, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.18% (4.3801 => 4.6072, std. dev.: 0.0083) MultiSource/Benchmarks/McCat/05-eks/eks: 5.15% (0.4113 => 0.4325, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.15% (3.6692 => 3.8583, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.11% (0.4791 => 0.5036, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (4.4433 => 4.6697, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 5.07% (1.0594 => 1.1131, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.01% (1.9270 => 2.0236, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 4.97% (0.3220 => 0.3380, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.96% (2.1791 => 2.2871, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (13.2842 => 13.9394, std. dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.91% (0.6135 => 0.6436, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.90% (0.6283 => 0.6591, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.89% (16.6129 => 17.4260, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.46% (14.8535 => 15.5164, std. dev.: 0.0112) MultiSource/Benchmarks/sim/sim: 4.34% (0.3131 => 0.3267, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.23% (0.8818 => 0.9191, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (1.1333 => 1.1811, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.3245 => 0.3376, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.04% (0.8698 => 0.9049, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 4.01% (3.1889 => 3.3167, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.98% (4.9865 => 5.1850, std. dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (8.4961 => 8.8342, std. dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 3.97% (6.5754 => 6.8363, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.2859 => 0.2970, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.39% (4.6629 => 4.8208, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.34% (3.2742 => 3.3836, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 3.18% (14.5298 => 14.9917, std. dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 3.18% (16.2614 => 16.7778, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.92% (1.5188 => 1.5632, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.91% (0.9108 => 0.9373, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.6250 => 0.6416, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.42% (2.1007 => 2.1515, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.39% (6.2785 => 6.4287, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.33% (3.7467 => 3.8341, std. dev.: 0.0109) MultiSource/Applications/lemon/lemon: 2.13% (1.0313 => 1.0533, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.12% (0.6744 => 0.6887, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.69% (33.2944 => 33.8564, std. dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 1.53% (1.2749 => 1.2944, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5199, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std. dev.: 0.0194) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.27% (1.2998 => 1.4203, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7421, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (2.8606 => 2.9675, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8154, std. dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6019, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9782, std. dev.: 0.0480) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6781, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.59% (3.2729 => 3.3250, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5089 => 1.5277, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1839, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6864, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.04% (26.5159 => 26.7919, std. dev.: 0.0301) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.16% (22.5627 => 21.3975, std. dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3511 => 0.3407, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2308 => 1.0968, std. dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8051, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.09% (1.3780 => 1.3216, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.8259 => 8.5810, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.03% (3.0263 => 2.9650, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: -1.96% (6.3560 => 6.2313, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2030, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3629, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.25% (5.5401 => 5.4708, std. dev.: 0.0161) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.13% (6.6320 => 6.5569, std. dev.: 0.0141) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 20:32:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 22:32:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824033202.B4D422A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3170?compare_to=3167&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3170, Order: 162526, Start Time: 2012-08-24 02:13:51, End Time: 2012-08-24 03:32:53 To: 3167, Order: 162501, Start Time: 2012-08-24 00:27:23, End Time: 2012-08-24 01:46:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (130 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.40% (0.7731 => 0.7839, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.89% (54.8995 => 56.4855, std. dev.: 0.1244) SingleSource/Benchmarks/Misc/mandel-2: 1.76% (1.4007 => 1.4253, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/lowercase: 1.16% (7.9665 => 8.0586, std. dev.: 0.0227) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.55% (10.3673 => 13.5342, std. dev.: 0.0087) SingleSource/UnitTests/ObjC/trivial-interface: 14.08% (0.3473 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.86% (0.3543 => 0.4034, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3561 => 0.4054, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.81% (0.3497 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.80% (0.3543 => 0.4032, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.74% (0.3516 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.32% (0.3694 => 0.4186, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3828 => 0.4322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3927 => 0.4428, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.56% (0.3886 => 0.4374, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.03% (1.1194 => 1.2541, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.22% (1.7609 => 1.9409, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.74% (2.2022 => 2.4166, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 9.22% (0.1432 => 0.1564, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.29% (0.6030 => 0.6530, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.29% (0.5925 => 0.6416, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (0.1584 => 0.1697, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.00% (0.7326 => 0.7839, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.77% (0.1892 => 0.2020, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.61% (0.3282 => 0.3499, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.52% (0.3177 => 0.3384, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.31% (7.0540 => 7.4992, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.92% (0.4615 => 0.4888, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.59% (0.3307 => 0.3492, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.33% (0.7433 => 0.7829, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.31% (0.4879 => 0.5138, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (0.8172 => 0.8598, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 5.21% (0.2554 => 0.2687, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.15% (0.2271 => 0.2388, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (4.9449 => 5.1946, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (5.0018 => 5.2536, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.96% (9.4845 => 9.9552, std. dev.: 0.0113) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.81% (4.2646 => 4.4696, std. dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 4.68% (0.2905 => 0.3041, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.63% (0.5569 => 0.5827, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.52% (0.3121 => 0.3262, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.51% (0.4636 => 0.4845, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.50% (0.2891 => 0.3021, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.47% (0.5860 => 0.6122, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.47% (0.3423 => 0.3576, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.44% (1.3050 => 1.3629, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 4.41% (0.3109 => 0.3246, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.39% (8.1363 => 8.4933, std. dev.: 0.0138) MultiSource/Benchmarks/McCat/05-eks/eks: 4.35% (0.4299 => 0.4486, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.30% (0.2700 => 0.2816, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.25% (0.2872 => 0.2994, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.24% (0.2831 => 0.2951, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.21% (0.2756 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.16% (0.3098 => 0.3227, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.15% (0.3180 => 0.3312, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.14% (0.2871 => 0.2990, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.13% (0.4289 => 0.4466, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.12% (0.7835 => 0.8158, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.12% (1.5603 => 1.6246, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.12% (0.3232 => 0.3365, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.3441 => 0.3582, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.08% (10.4361 => 10.8624, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 4.06% (0.3052 => 0.3176, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.4103 => 0.4268, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 4.02% (0.3283 => 0.3415, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.01% (0.2793 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 3.96% (0.2802 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.95% (0.3650 => 0.3794, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.93% (5.7591 => 5.9854, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.92% (2.0665 => 2.1475, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.92% (0.2758 => 0.2866, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.89% (0.3162 => 0.3285, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3603 => 0.3743, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 3.86% (0.2877 => 0.2988, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.79% (0.3136 => 0.3255, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.76% (0.3826 => 0.3970, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.74% (0.4064 => 0.4216, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.73% (0.9765 => 1.0129, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.73% (1.1861 => 1.2303, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.70% (1.5415 => 1.5986, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (0.5105 => 0.5293, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.3092 => 0.3205, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.64% (0.6450 => 0.6685, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.64% (0.3379 => 0.3502, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.3684 => 0.3817, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.61% (0.3935 => 0.4077, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.6456 => 0.6680, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.46% (0.4048 => 0.4188, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 3.45% (1.1642 => 1.2044, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.44% (3.3354 => 3.4500, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.8067 => 0.8343, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.40% (0.4203 => 0.4346, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.35% (0.4620 => 0.4775, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.6675 => 0.6896, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.29% (1.2842 => 1.3264, std. dev.: 0.0099) MultiSource/Applications/lua/lua: 3.25% (3.8723 => 3.9982, std. dev.: 0.0136) MultiSource/Applications/treecc/treecc: 3.25% (2.0273 => 2.0932, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.25% (0.3387 => 0.3497, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5981 => 0.6173, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (14.3668 => 14.8242, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.03% (1.4186 => 1.4616, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.72% (2.2969 => 2.3593, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.61% (0.5020 => 0.5151, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6239, std. dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 2.37% (17.1811 => 17.5889, std. dev.: 0.0193) MultiSource/Applications/minisat/minisat: 2.32% (0.7115 => 0.7280, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.20% (1.1840 => 1.2101, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.2024 => 2.2498, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.73% (1.0722 => 1.0907, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (7.9617 => 8.0943, std. dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 1.43% (21.9371 => 22.2511, std. dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.71% (4.2280 => 4.4271, std. dev.: 0.0158) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7491, std. dev.: 0.0073) MultiSource/Applications/lua/lua: 3.00% (26.0924 => 26.8753, std. dev.: 0.0328) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3346, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2374, std. dev.: 0.0244) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7986, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (1.5086 => 1.5282, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.29% (1.3045 => 1.3213, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 1.27% (3.1578 => 3.1980, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.34% (5.2763 => 3.2006, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.76% (5.3855 => 3.7291, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.37% (5.3526 => 3.7272, std. dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0713, std. dev.: 0.0417) MultiSource/Applications/ClamAV/clamscan: -14.05% (22.1758 => 19.0612, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.00% (2.9384 => 2.5565, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -11.92% (1.2373 => 1.0898, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/mandel-2: -7.29% (1.5373 => 1.4253, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5039, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4680, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4193, std. dev.: 0.0237) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9968, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9608, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3419, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std. dev.: 0.0087) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 19:49:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 21:49:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824024956.085772A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3169?compare_to=3166&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3169, Order: 162523, Start Time: 2012-08-24 01:36:30, End Time: 2012-08-24 02:50:46 To: 3166, Order: 162497, Start Time: 2012-08-23 23:54:34, End Time: 2012-08-24 01:08:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (164 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.60% (0.6570 => 0.6675, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 1.27% (2.3103 => 2.3397, std. dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.17% (6.3934 => 6.4684, std. dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 1.04% (4.8045 => 4.8543, std. dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.96% (2.0176 => 2.3397, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 13.80% (0.0826 => 0.0940, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3578 => 0.4022, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.29% (0.5818 => 0.6533, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.26% (0.3646 => 0.4093, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.25% (0.5748 => 0.6452, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.15% (0.7061 => 0.7919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.08% (0.3601 => 0.4036, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.07% (0.3663 => 0.4105, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3650 => 0.4088, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.98% (0.3623 => 0.4057, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.80% (0.3789 => 0.4236, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.73% (0.3914 => 0.4373, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.47% (0.4003 => 0.4462, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.40% (0.3940 => 0.4389, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.36% (0.3130 => 0.3423, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.06% (0.1413 => 0.1541, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.87% (0.7710 => 0.8394, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.74% (0.1819 => 0.1978, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.68% (3.9660 => 4.3102, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash2: 8.66% (0.4328 => 0.4703, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 8.59% (0.4062 => 0.4411, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 8.56% (0.2781 => 0.3019, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.38% (0.2782 => 0.3015, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.35% (1.3693 => 1.4836, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.13% (0.2596 => 0.2807, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 8.09% (0.2607 => 0.2818, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3022 => 0.3263, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2690 => 0.2904, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.93% (0.2760 => 0.2979, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.90% (0.5265 => 0.5681, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.90% (0.2761 => 0.2979, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.89% (0.2966 => 0.3200, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.89% (0.2726 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.88% (0.2628 => 0.2835, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.81% (0.2765 => 0.2981, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.71% (1.9828 => 2.1357, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.69% (0.7038 => 0.7579, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.62% (0.3899 => 0.4196, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.57% (0.2721 => 0.2927, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.57% (0.3580 => 0.3851, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.57% (0.2696 => 0.2900, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.56% (0.3107 => 0.3342, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.56% (0.4379 => 0.4710, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.54% (1.2193 => 1.3112, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.51% (0.9199 => 0.9890, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 7.49% (0.3149 => 0.3385, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.49% (0.3485 => 0.3746, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.43% (0.2988 => 0.3210, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3192 => 0.3425, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.27% (0.6959 => 0.7465, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.18% (0.1588 => 0.1702, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.15% (0.3453 => 0.3700, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2127 => 0.2275, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.95% (0.4390 => 0.4695, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.93% (1.1364 => 1.2152, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 6.86% (0.1589 => 0.1698, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3534 => 0.3775, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.75% (13.8202 => 14.7533, std. dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/moments: 6.72% (0.3868 => 0.4128, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.5577 => 0.5950, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.67% (0.5637 => 0.6013, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.63% (0.3756 => 0.4005, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.62% (0.2023 => 0.2157, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.56% (0.3246 => 0.3459, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.55% (0.2914 => 0.3105, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.54% (0.1865 => 0.1987, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/objinst: 6.49% (0.2945 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.48% (7.2180 => 7.6858, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2243 => 0.2386, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.35% (1.4563 => 1.5488, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.22% (0.4113 => 0.4369, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.07% (1.2292 => 1.3038, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.06% (0.7506 => 0.7961, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 6.00% (3.8646 => 4.0963, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 5.92% (0.8310 => 0.8802, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.89% (1.3819 => 1.4633, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.89% (1.1061 => 1.1712, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 5.88% (0.2995 => 0.3171, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.86% (3.6692 => 3.8843, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.85% (1.3245 => 1.4020, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (1.3813 => 1.4620, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.80% (0.7460 => 0.7893, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.4791 => 0.5069, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (4.3801 => 4.6324, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3755 => 0.3971, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.65% (1.0594 => 1.1193, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (4.4433 => 4.6937, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.59% (0.6283 => 0.6634, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.47% (1.9270 => 2.0325, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (13.2842 => 14.0081, std. dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.6135 => 0.6469, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 5.43% (0.3220 => 0.3395, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 5.29% (16.6129 => 17.4921, std. dev.: 0.0134) MultiSource/Applications/siod/siod: 5.26% (2.1791 => 2.2937, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.13% (0.8818 => 0.9270, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.06% (14.8535 => 15.6047, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.81% (0.2243 => 0.2351, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.71% (0.3245 => 0.3398, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.65% (0.2321 => 0.2429, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.1333 => 1.1859, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 4.63% (0.3131 => 0.3276, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.61% (0.8698 => 0.9099, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.52% (8.4961 => 8.8801, std. dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 4.46% (6.5754 => 6.8689, std. dev.: 0.0144) MultiSource/Applications/d/make_dparser: 4.41% (3.1889 => 3.3296, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 4.41% (0.2859 => 0.2985, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.37% (4.9865 => 5.2044, std. dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 4.10% (4.6629 => 4.8543, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (3.2742 => 3.4028, std. dev.: 0.0159) MultiSource/Applications/ClamAV/clamscan: 3.73% (14.5298 => 15.0724, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.56% (1.5188 => 1.5729, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.51% (0.9108 => 0.9428, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.39% (0.6250 => 0.6462, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.39% (16.2614 => 16.8124, std. dev.: 0.0131) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.02% (6.2785 => 6.4684, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.95% (2.1007 => 2.1626, std. dev.: 0.0060) MultiSource/Applications/lua/lua: 2.78% (3.7467 => 3.8507, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.77% (0.4805 => 0.4938, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 2.51% (0.6744 => 0.6913, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.44% (1.0313 => 1.0565, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.08% (1.2749 => 1.3014, std. dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 1.84% (33.2944 => 33.9081, std. dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std. dev.: 0.0447) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 7.67% (1.2998 => 1.3995, std. dev.: 0.0253) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.94% (1.5824 => 1.6606, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.34% (11.2619 => 11.7511, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5949, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.09% (10.7476 => 10.9717, std. dev.: 0.0570) MultiSource/Applications/sqlite3/sqlite3: 1.90% (4.5928 => 4.6800, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3263, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std. dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 1.50% (8.3908 => 8.5170, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5283, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0093) MultiSource/Applications/lua/lua: 1.22% (26.5159 => 26.8388, std. dev.: 0.0257) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.96% (22.5627 => 21.4430, std. dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.59% (1.1560 => 1.1029, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.19% (1.3780 => 1.3202, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0220, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.89% (8.8259 => 8.5709, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.18% (3.0263 => 2.9603, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2357, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.75% (7.3305 => 7.2020, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9920, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3572, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.25% (20.3410 => 20.0864, std. dev.: 0.0340) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 19:08:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 21:08:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120824020815.3E27F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3168?compare_to=3163&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3168, Order: 162488, Start Time: 2012-08-23 23:25:32, End Time: 2012-08-24 02:09:08 To: 3163, Order: 162461, Start Time: 2012-08-23 20:14:21, End Time: 2012-08-23 22:57:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (117 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.59% (124.5912 => 129.0701, std. dev.: 1.2335) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.43% (1.7412 => 1.7163, std. dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 12.87% (0.3496 => 0.3946, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3460 => 0.3904, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 12.81% (0.3442 => 0.3883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3488 => 0.3934, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.71% (0.3469 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3643 => 0.4091, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.22% (0.3650 => 0.4096, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 12.00% (0.3724 => 0.4171, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.91% (0.3792 => 0.4130, std. dev.: 0.0101) SingleSource/UnitTests/ObjC++/Hello: 7.76% (0.5826 => 0.6278, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.73% (1.5932 => 1.7163, std. dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.5889 => 0.6331, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.40% (1.6211 => 1.7248, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.20% (3.5627 => 3.7836, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.14% (1.3152 => 1.3960, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 5.93% (0.7171 => 0.7596, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.71% (0.4361 => 0.4610, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.65% (0.5026 => 0.5310, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (0.4994 => 0.5269, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.2014 => 0.2124, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.44% (0.2738 => 0.2887, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (0.5000 => 0.5269, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.36% (4.2109 => 4.4365, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.34% (0.3930 => 0.4140, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3195 => 0.3364, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.19% (1.0781 => 1.1341, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.11% (0.2875 => 0.3022, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.00% (0.5900 => 0.6195, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.99% (0.4029 => 0.4230, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.2823 => 0.2962, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.91% (0.2750 => 0.2885, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.90% (0.2714 => 0.2847, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.3004 => 0.3151, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.88% (0.2725 => 0.2858, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.87% (0.2792 => 0.2928, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2729 => 0.2860, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2780 => 0.2912, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 4.73% (0.2813 => 0.2946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.67% (0.2803 => 0.2934, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.66% (0.2811 => 0.2942, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.65% (0.9909 => 1.0370, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.62% (2.0673 => 2.1629, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.3096 => 0.3239, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 4.56% (0.3267 => 0.3416, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.55% (1.9694 => 2.0590, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.53% (0.2736 => 0.2860, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.3282 => 0.3430, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.49% (0.3317 => 0.3466, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.48% (0.3258 => 0.3404, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 4.45% (5.5417 => 5.7881, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.43% (0.3362 => 0.3511, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.43% (0.2911 => 0.3040, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.2866 => 0.2993, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.42% (0.3348 => 0.3496, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.41% (0.3060 => 0.3195, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.40% (2.7292 => 2.8492, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 4.38% (0.3678 => 0.3839, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.37% (0.3726 => 0.3889, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.33% (1.9966 => 2.0830, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (4.4195 => 4.6100, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.3124 => 0.3257, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (0.4658 => 0.4853, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.16% (0.3845 => 0.4005, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.15% (0.9697 => 1.0099, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 4.15% (0.6634 => 0.6909, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 4.14% (0.3477 => 0.3621, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (0.3890 => 0.4051, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.14% (0.3625 => 0.3775, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4146 => 0.4315, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.00% (1.8794 => 1.9545, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.98% (0.4251 => 0.4420, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (2.1013 => 2.1842, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 3.93% (4.6177 => 4.7992, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3690 => 0.3833, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.87% (2.1653 => 2.2492, std. dev.: 0.0079) MultiSource/Applications/treecc/treecc: 3.83% (0.7875 => 0.8177, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.3981 => 0.4127, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.66% (1.4269 => 1.4791, std. dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.60% (0.4139 => 0.4288, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.3903 => 0.4041, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 3.41% (0.5012 => 0.5183, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.39% (0.5546 => 0.5734, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.3084 => 0.3188, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.3271 => 0.3377, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (0.6435 => 0.6641, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 3.19% (23.5202 => 24.2707, std. dev.: 0.0091) MultiSource/Applications/minisat/minisat: 3.03% (0.3336 => 0.3437, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.71% (2.0346 => 2.0898, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (0.4847 => 0.4949, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (0.7426 => 0.7542, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6680, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1698, std. dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6421, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1933, std. dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5022, std. dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4509, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2815, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6026, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4739, std. dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.98% (2.4764 => 2.4026, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5619, std. dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std. dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std. dev.: 0.0119) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8003, std. dev.: 0.0042) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.68% (17.2379 => 16.7760, std. dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.65% (0.6293 => 0.6189, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.51% (16.2163 => 15.9710, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 18:45:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 20:45:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824014524.B4D212A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3167?compare_to=3165&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3167, Order: 162501, Start Time: 2012-08-24 00:27:23, End Time: 2012-08-24 01:46:19 To: 3165, Order: 162478, Start Time: 2012-08-23 22:41:03, End Time: 2012-08-23 23:59:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (113 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (723 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.60% (0.6422 => 0.6319, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.15% (0.8660 => 0.8560, std. dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.09% (10.3673 => 13.4873, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 12.87% (0.3473 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.70% (0.3543 => 0.3993, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.52% (0.3561 => 0.4007, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3516 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.81% (0.3828 => 0.4280, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.74% (0.3927 => 0.4388, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.36% (1.7609 => 1.9433, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.89% (2.2022 => 2.3980, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.94% (0.1584 => 0.1694, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1892 => 0.2021, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 6.72% (0.6030 => 0.6435, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.65% (0.5925 => 0.6319, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.52% (0.3177 => 0.3384, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 5.53% (0.7326 => 0.7731, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 5.48% (0.3282 => 0.3462, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.46% (0.4615 => 0.4867, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.40% (7.0540 => 7.4350, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.35% (0.4879 => 0.5140, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.99% (0.3307 => 0.3472, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.7433 => 0.7795, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.75% (0.8172 => 0.8560, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.67% (9.4845 => 9.9279, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.67% (0.2271 => 0.2377, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.59% (4.9449 => 5.1720, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.48% (5.0018 => 5.2259, std. dev.: 0.0064) MultiSource/Benchmarks/McCat/08-main/main: 4.46% (0.2554 => 0.2668, std. dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 4.34% (0.3109 => 0.3244, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.28% (4.2646 => 4.4471, std. dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.17% (0.3121 => 0.3251, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.11% (0.5860 => 0.6101, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.11% (1.3050 => 1.3586, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 4.09% (0.4299 => 0.4475, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5569 => 0.5796, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 4.07% (0.7835 => 0.8154, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 3.89% (0.3423 => 0.3556, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (10.4361 => 10.8316, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.77% (0.4636 => 0.4811, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.77% (0.2891 => 0.3000, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.72% (1.5603 => 1.6184, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.70% (8.1363 => 8.4377, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.69% (0.3441 => 0.3568, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 3.68% (5.7591 => 5.9713, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/09-vor/vor: 3.65% (0.3180 => 0.3296, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6450 => 0.6679, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.55% (0.2905 => 0.3008, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.54% (0.9765 => 1.0111, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.37% (0.5105 => 0.5277, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.4103 => 0.4241, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.34% (0.3865 => 0.3994, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.29% (0.4289 => 0.4430, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.24% (1.1861 => 1.2245, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (1.5415 => 1.5914, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.16% (0.6675 => 0.6886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.10% (0.3422 => 0.3528, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.08% (1.1642 => 1.2000, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.04% (0.3650 => 0.3761, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.04% (0.8067 => 0.8312, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (2.0665 => 2.1271, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3826 => 0.3938, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.90% (2.0273 => 2.0860, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3935 => 0.4048, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5981 => 0.6152, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.4203 => 0.4321, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (0.4064 => 0.4177, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.75% (3.3354 => 3.4272, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6456 => 0.6632, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.72% (14.3668 => 14.7578, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists1: 2.71% (0.3684 => 0.3784, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.71% (3.8723 => 3.9774, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.62% (1.4186 => 1.4557, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 2.59% (0.4048 => 0.4153, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.57% (0.8921 => 0.9150, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.55% (1.2842 => 1.3170, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 2.53% (0.4620 => 0.4737, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5859 => 1.6243, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 2.40% (2.2969 => 2.3520, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.13% (0.5020 => 0.5127, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (2.2024 => 2.2485, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.97% (17.1811 => 17.5190, std. dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 1.92% (1.1840 => 1.2067, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.69% (0.7115 => 0.7235, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.45% (1.0722 => 1.0878, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.03% (21.9371 => 22.1629, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.06% (4.2280 => 4.4419, std. dev.: 0.0095) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.91% (0.2944 => 0.3059, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7504, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 2.98% (26.0924 => 26.8705, std. dev.: 0.0110) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3337, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2466, std. dev.: 0.0261) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1578 => 3.1970, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (1.5086 => 1.5272, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std. dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.14% (6.6874 => 0.1246, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.38% (5.2763 => 3.1985, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7074, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7057, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0600, std. dev.: 0.0331) MultiSource/Applications/ClamAV/clamscan: -14.32% (22.1758 => 19.0012, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.94% (2.9384 => 2.5583, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0989, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -8.89% (1.5373 => 1.4007, std. dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4674, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.82% (1.5660 => 1.4905, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4625, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.20% (8.6802 => 8.4020, std. dev.: 0.0192) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9922, std. dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9635, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6786, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3345, std. dev.: 0.0081) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5144, std. dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8133, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 18:07:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 20:07:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824010758.EC0DC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3166?compare_to=3164&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3166, Order: 162497, Start Time: 2012-08-23 23:54:34, End Time: 2012-08-24 01:08:51 To: 3164, Order: 162475, Start Time: 2012-08-23 22:12:45, End Time: 2012-08-23 23:27:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (156 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (701 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.07% (1.1083 => 1.0964, std. dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.51% (2.0176 => 2.3103, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.71% (0.5818 => 0.6499, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.55% (0.5748 => 0.6412, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.43% (0.7061 => 0.7868, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.17% (0.3578 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.05% (0.3623 => 0.3987, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3663 => 0.4031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.97% (0.3601 => 0.3960, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.90% (0.3646 => 0.4007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.89% (0.3650 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.79% (0.3914 => 0.4297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3789 => 0.4159, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.44% (0.4003 => 0.4381, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.42% (0.3940 => 0.4311, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.30% (1.3693 => 1.4830, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.20% (0.7710 => 0.8342, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.04% (0.4328 => 0.4676, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.84% (0.2781 => 0.2999, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.80% (3.9660 => 4.2755, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.59% (0.1819 => 0.1957, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4062 => 0.4367, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/random: 7.36% (0.2690 => 0.2888, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.34% (0.2726 => 0.2926, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2628 => 0.2818, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.22% (0.2966 => 0.3180, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3022 => 0.3240, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.18% (0.5265 => 0.5643, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 7.17% (0.2760 => 0.2958, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.15% (0.3149 => 0.3374, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.11% (0.3107 => 0.3328, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.09% (0.2596 => 0.2780, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.09% (1.9828 => 2.1233, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3899 => 0.4174, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.2937 => 0.3143, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.94% (0.2696 => 0.2883, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3580 => 0.3828, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3485 => 0.3726, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3489 => 0.3728, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.82% (1.2193 => 1.3025, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.76% (0.9199 => 0.9821, std. dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4379 => 0.4674, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.67% (0.3192 => 0.3405, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4390 => 0.4673, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.41% (0.6959 => 0.7405, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 6.31% (0.3453 => 0.3671, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2127 => 0.2261, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 6.26% (0.3293 => 0.3499, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.17% (0.3534 => 0.3752, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.10% (1.1364 => 1.2057, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.10% (0.5577 => 0.5917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.3868 => 0.4102, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.03% (0.4016 => 0.4258, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.02% (0.3756 => 0.3982, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.90% (0.2914 => 0.3086, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 5.90% (13.8202 => 14.6358, std. dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.89% (0.5637 => 0.5969, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.76% (0.3246 => 0.3433, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.68% (0.2023 => 0.2138, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.53% (1.4563 => 1.5369, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.52% (7.2180 => 7.6164, std. dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 5.51% (0.2995 => 0.3160, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.2925 => 0.3086, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 5.46% (1.2292 => 1.2963, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.2243 => 0.2364, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.29% (1.1061 => 1.1646, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.20% (0.7506 => 0.7896, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 5.18% (0.4113 => 0.4326, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.17% (1.3813 => 1.4527, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 5.12% (3.8646 => 4.0625, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/football/football: 5.09% (0.8310 => 0.8733, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.04% (1.3245 => 1.3913, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.03% (1.3819 => 1.4514, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.0594 => 1.1120, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3755 => 0.3940, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.91% (3.6692 => 3.8495, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.84% (0.7460 => 0.7821, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.82% (0.6283 => 0.6586, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.79% (4.3801 => 4.5899, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 4.78% (1.9270 => 2.0191, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (0.4791 => 0.5019, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.74% (4.4433 => 4.6541, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.66% (0.6135 => 0.6421, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (13.2842 => 13.9027, std. dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.3220 => 0.3365, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.46% (2.1791 => 2.2763, std. dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 4.35% (16.6129 => 17.3354, std. dev.: 0.0235) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.13% (0.8818 => 0.9182, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.09% (14.8535 => 15.4608, std. dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 4.09% (0.3131 => 0.3259, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.93% (1.1333 => 1.1778, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.89% (0.8698 => 0.9036, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.79% (0.3245 => 0.3368, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.70% (8.4961 => 8.8108, std. dev.: 0.0042) MultiSource/Applications/d/make_dparser: 3.57% (3.1889 => 3.3026, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.52% (4.9865 => 5.1618, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 3.51% (6.5754 => 6.8061, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.24% (3.2742 => 3.3802, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.04% (4.6629 => 4.8045, std. dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: 2.93% (14.5298 => 14.9559, std. dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 2.72% (16.2614 => 16.7035, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.68% (1.5188 => 1.5595, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.68% (0.9108 => 0.9352, std. dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 2.59% (0.6250 => 0.6412, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.10% (2.1007 => 2.1448, std. dev.: 0.0082) MultiSource/Applications/lua/lua: 1.91% (3.7467 => 3.8183, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 1.87% (0.6744 => 0.6870, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.83% (6.2785 => 6.3934, std. dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.76% (1.0313 => 1.0495, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.61% (33.2944 => 33.8315, std. dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2673, std. dev.: 0.0280) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.75% (1.2998 => 1.4265, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: 4.62% (1.9144 => 2.0028, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7447, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3854, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6033, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9787, std. dev.: 0.0436) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6764, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3253, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5280, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.18% (26.5159 => 26.8290, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.2670 => 0.2516, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.70% (22.5627 => 21.2757, std. dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2308 => 1.0964, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.55% (1.1560 => 1.1034, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.18% (1.3780 => 1.3204, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5915, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9597, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2203, std. dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.65% (7.3305 => 7.2096, std. dev.: 0.0224) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9931, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.54% (3.9173 => 3.8569, std. dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3612, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4764, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.06% (20.3410 => 20.1256, std. dev.: 0.0257) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 16:59:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 18:59:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823235904.DB76F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3165?compare_to=3162&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3165, Order: 162478, Start Time: 2012-08-23 22:41:03, End Time: 2012-08-23 23:59:57 To: 3162, Order: 162463, Start Time: 2012-08-23 20:54:25, End Time: 2012-08-23 22:13:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.71% (10.3673 => 13.4474, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 13.50% (0.3473 => 0.3942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.18% (0.3497 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3561 => 0.4030, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.12% (0.3543 => 0.4008, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.10% (0.3543 => 0.4007, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.05% (0.3516 => 0.3975, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.72% (0.3694 => 0.4164, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.25% (0.3828 => 0.4297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.20% (0.3927 => 0.4406, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.02% (1.1194 => 1.2540, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.83% (1.7609 => 1.9516, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.07% (2.2022 => 2.4020, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 8.73% (0.1432 => 0.1557, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.39% (0.5925 => 0.6422, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.03% (0.7326 => 0.7841, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.01% (0.1584 => 0.1695, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1892 => 0.2014, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.97% (0.8172 => 0.8660, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 5.91% (0.3282 => 0.3476, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.70% (0.4615 => 0.4878, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.61% (7.0540 => 7.4499, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.38% (0.3307 => 0.3485, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.05% (9.4845 => 9.9639, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (4.9449 => 5.1911, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (0.7433 => 0.7799, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.84% (0.2107 => 0.2209, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.82% (5.0018 => 5.2429, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2271 => 0.2380, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.68% (0.3121 => 0.3267, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 4.66% (0.2554 => 0.2673, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.57% (0.3109 => 0.3251, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.47% (0.4299 => 0.4491, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.46% (0.2758 => 0.2881, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.44% (4.2646 => 4.4539, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.31% (0.4636 => 0.4836, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (1.3050 => 1.3612, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.26% (0.5569 => 0.5806, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.25% (0.2891 => 0.3014, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.21% (0.3423 => 0.3567, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.5860 => 0.6106, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 4.19% (10.4361 => 10.8737, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.17% (8.1363 => 8.4752, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.2905 => 0.3025, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.04% (0.2700 => 0.2809, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.03% (0.8067 => 0.8392, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.95% (0.3441 => 0.3577, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.4289 => 0.4457, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2831 => 0.2941, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.86% (0.3162 => 0.3284, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.84% (0.3098 => 0.3217, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.84% (0.3232 => 0.3356, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2872 => 0.2982, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.80% (0.2871 => 0.2980, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.78% (5.7591 => 5.9768, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: 3.78% (0.7835 => 0.8131, std. dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 3.77% (0.3180 => 0.3300, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2756 => 0.2860, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9765 => 1.0133, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.74% (1.5415 => 1.5992, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.74% (0.3052 => 0.3166, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (0.3422 => 0.3549, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6450 => 0.6689, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3865 => 0.4007, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (0.5105 => 0.5292, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.59% (0.3283 => 0.3401, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3650 => 0.3780, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1861 => 1.2283, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.53% (2.0665 => 2.1395, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.51% (0.3136 => 0.3246, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.49% (1.5603 => 1.6148, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.45% (0.3826 => 0.3958, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.45% (0.6675 => 0.6905, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.43% (0.3935 => 0.4070, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.41% (0.3603 => 0.3726, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.3684 => 0.3808, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.37% (0.3387 => 0.3501, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.32% (1.1642 => 1.2028, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary2: 3.31% (0.3379 => 0.3491, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 3.30% (2.0273 => 2.0942, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.4064 => 0.4198, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.21% (0.4048 => 0.4178, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.6456 => 0.6662, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.4203 => 0.4334, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.11% (0.8921 => 0.9198, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.09% (3.3354 => 3.4386, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (1.4186 => 1.4621, std. dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 3.05% (1.2842 => 1.3234, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4620 => 0.4760, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.93% (3.8723 => 3.9856, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5981 => 0.6155, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (14.3668 => 14.7846, std. dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.68% (1.5859 => 1.6284, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.57% (0.5020 => 0.5149, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.41% (2.2969 => 2.3522, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 2.37% (17.1811 => 17.5885, std. dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.27% (2.2024 => 2.2524, std. dev.: 0.0064) MultiSource/Applications/minisat/minisat: 2.05% (0.7115 => 0.7261, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.64% (1.0722 => 1.0898, std. dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 1.58% (21.9371 => 22.2830, std. dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (7.9617 => 8.0680, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.28% (4.2280 => 4.4513, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.11% (0.2944 => 0.3065, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7503, std. dev.: 0.0055) MultiSource/Applications/lua/lua: 2.92% (26.0924 => 26.8537, std. dev.: 0.0101) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2481, std. dev.: 0.0320) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.29% (3.1578 => 3.1984, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (1.5086 => 1.5271, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.3045 => 1.3186, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.43% (0.8651 => 0.1693, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.14% (5.2763 => 3.2110, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7091, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7091, std. dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1863, std. dev.: 0.0296) MultiSource/Applications/ClamAV/clamscan: -14.16% (22.1758 => 19.0348, std. dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.84% (2.9384 => 2.5612, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.19% (1.6925 => 1.4185, std. dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2373 => 1.0966, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel-2: -9.31% (1.5373 => 1.3942, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.81% (5.0483 => 4.8053, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4720, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4145, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: -2.83% (10.2830 => 9.9923, std. dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9645, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std. dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3409, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8125, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 16:26:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 18:26:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823232610.1C9A92A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3164?compare_to=3161&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3164, Order: 162475, Start Time: 2012-08-23 22:12:45, End Time: 2012-08-23 23:27:02 To: 3161, Order: 162461, Start Time: 2012-08-23 20:30:38, End Time: 2012-08-23 21:45:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (156 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (701 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.67% (54.9946 => 56.4611, std. dev.: 0.0945) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.27% (1.3040 => 1.3206, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 1.25% (3.6936 => 3.7398, std. dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.05% (2.0176 => 2.3213, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 12.23% (0.0826 => 0.0927, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.12% (0.5818 => 0.6465, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.96% (0.5748 => 0.6378, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.16% (0.3601 => 0.3931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.95% (0.3663 => 0.3991, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.87% (0.3789 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.79% (0.4003 => 0.4355, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.63% (0.3940 => 0.4280, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.93% (0.4328 => 0.4671, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1819 => 0.1963, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.73% (0.7710 => 0.8306, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.71% (3.9660 => 4.2716, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.64% (1.3693 => 1.4739, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.62% (0.2782 => 0.2994, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2781 => 0.2988, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.27% (0.7038 => 0.7550, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.16% (0.2596 => 0.2782, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4062 => 0.4352, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5265 => 0.5632, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.87% (1.2193 => 1.3031, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.83% (0.2607 => 0.2785, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3580 => 0.3824, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (1.9828 => 2.1177, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.79% (0.2726 => 0.2911, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.78% (0.3022 => 0.3227, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2628 => 0.2806, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.77% (0.2690 => 0.2872, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.67% (0.9199 => 0.9813, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2765 => 0.2949, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.57% (0.3149 => 0.3356, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.57% (0.3485 => 0.3714, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.57% (0.3899 => 0.4155, std. dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.53% (0.4379 => 0.4665, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.49% (0.1588 => 0.1691, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.48% (0.6959 => 0.7410, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.45% (0.3489 => 0.3714, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.2988 => 0.3178, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.21% (1.1364 => 1.2070, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.11% (0.3453 => 0.3664, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.99% (0.4390 => 0.4653, std. dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.90% (13.8202 => 14.6353, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3534 => 0.3742, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.88% (0.4016 => 0.4252, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (1.4563 => 1.5412, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.83% (0.2127 => 0.2251, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.81% (0.5577 => 0.5901, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 5.79% (0.3868 => 0.4092, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.61% (0.5637 => 0.5953, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.3756 => 0.3966, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.55% (0.3246 => 0.3426, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.49% (0.2914 => 0.3074, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.44% (0.2023 => 0.2133, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 5.41% (0.2995 => 0.3157, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.38% (7.2180 => 7.6065, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 5.38% (0.8310 => 0.8757, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.30% (0.2925 => 0.3080, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.20% (0.4113 => 0.4327, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.20% (1.2292 => 1.2931, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (1.3813 => 1.4523, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.13% (1.3819 => 1.4528, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.08% (1.0594 => 1.1132, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (1.3245 => 1.3916, std. dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.03% (0.4791 => 0.5032, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.99% (0.7460 => 0.7832, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.98% (3.8646 => 4.0570, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.90% (0.6283 => 0.6591, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (3.6692 => 3.8486, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.88% (0.7506 => 0.7872, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.85% (1.1061 => 1.1597, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (13.2842 => 13.9138, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.72% (4.3801 => 4.5870, std. dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.70% (4.4433 => 4.6523, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.66% (0.3755 => 0.3930, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.64% (1.9270 => 2.0165, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.54% (0.8818 => 0.9218, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.53% (2.1791 => 2.2779, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.3220 => 0.3365, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.48% (0.6135 => 0.6410, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.44% (16.6129 => 17.3505, std. dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: 4.27% (14.8535 => 15.4875, std. dev.: 0.0176) MultiSource/Benchmarks/sim/sim: 4.18% (0.3131 => 0.3262, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.92% (0.8698 => 0.9039, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.90% (3.1889 => 3.3133, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.90% (4.9865 => 5.1809, std. dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.86% (1.1333 => 1.1771, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.79% (8.4961 => 8.8181, std. dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 3.61% (4.6629 => 4.8312, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 3.61% (6.5754 => 6.8127, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.56% (3.2742 => 3.3909, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7852, std. dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 3.08% (14.5298 => 14.9773, std. dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.89% (0.9108 => 0.9371, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5188 => 1.5603, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6250 => 0.6414, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.24% (2.1007 => 2.1478, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 2.09% (1.0313 => 1.0529, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.03% (0.6744 => 0.6881, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.01% (3.7467 => 3.8221, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.75% (6.2785 => 6.3882, std. dev.: 0.0147) MultiSource/Applications/SIBsim4/SIBsim4: 1.62% (1.2749 => 1.2955, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.53% (33.2944 => 33.8052, std. dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std. dev.: 0.0425) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.98% (1.2998 => 1.4165, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7447, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8166, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3860, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6018, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.09% (10.7476 => 10.9720, std. dev.: 0.0325) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6781, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.57% (3.2729 => 3.3242, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5089 => 1.5295, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.26% (26.5159 => 26.8491, std. dev.: 0.0480) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 1.14% (3.6975 => 3.7398, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.40% (22.5627 => 21.3441, std. dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.95% (1.2308 => 1.1083, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0070) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -4.56% (1.1560 => 1.1033, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5897, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9619, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2300, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2054, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std. dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3610, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.10% (5.5401 => 5.4793, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2370, std. dev.: 0.0149) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 15:56:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 17:56:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120823225658.909332A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3163?compare_to=3158&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3163, Order: 162461, Start Time: 2012-08-23 20:14:21, End Time: 2012-08-23 22:57:53 To: 3158, Order: 162444, Start Time: 2012-08-23 17:02:50, End Time: 2012-08-23 19:46:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.13% (54.1825 => 54.7945, std. dev.: 0.0381) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 14.24% (0.3442 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.16% (0.3446 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.05% (0.3465 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.05% (0.3488 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.02% (0.3460 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3469 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.96% (0.3496 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.51% (0.3650 => 0.4143, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.48% (0.3643 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.13% (0.3724 => 0.4213, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1063 => 0.1174, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.15% (0.3792 => 0.4177, std. dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 9.29% (1.5932 => 1.7412, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 9.01% (0.5826 => 0.6351, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.5889 => 0.6391, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.01% (3.5627 => 3.8123, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.00% (0.7171 => 0.7673, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.87% (1.6211 => 1.7324, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.75% (1.3152 => 1.4040, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (0.4994 => 0.5315, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.32% (0.2738 => 0.2911, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.20% (0.5000 => 0.5310, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.17% (0.4361 => 0.4630, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (0.5026 => 0.5334, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (0.2014 => 0.2137, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.07% (0.3362 => 0.3566, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.01% (0.3930 => 0.4166, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.95% (0.2875 => 0.3046, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.80% (0.2725 => 0.2883, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 5.80% (1.0781 => 1.1406, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: 5.76% (0.4029 => 0.4261, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.73% (0.2792 => 0.2952, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2823 => 0.2983, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.66% (0.5900 => 0.6234, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 5.65% (4.2109 => 4.4490, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 5.64% (0.2750 => 0.2905, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3195 => 0.3374, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.57% (0.2729 => 0.2881, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 5.56% (0.3004 => 0.3171, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.55% (0.2813 => 0.2969, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2803 => 0.2958, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.48% (0.9909 => 1.0452, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: 5.47% (0.2780 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.41% (0.2811 => 0.2963, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.33% (2.0673 => 2.1775, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.33% (0.3096 => 0.3261, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.32% (0.2911 => 0.3066, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3060 => 0.3222, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.26% (0.3267 => 0.3439, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3258 => 0.3429, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 5.13% (0.3317 => 0.3487, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3124 => 0.3281, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.98% (0.3678 => 0.3861, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.3282 => 0.3444, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.93% (0.3348 => 0.3513, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.92% (0.9697 => 1.0174, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3726 => 0.3909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.84% (5.5417 => 5.8099, std. dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.83% (2.7292 => 2.8611, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.83% (0.3625 => 0.3800, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.78% (0.3890 => 0.4076, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.75% (0.2566 => 0.2688, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 4.72% (0.3477 => 0.3641, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.66% (0.4146 => 0.4339, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.62% (1.9694 => 2.0603, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (1.9966 => 2.0874, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3690 => 0.3856, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 4.49% (0.4251 => 0.4442, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.47% (0.4658 => 0.4866, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.45% (0.3981 => 0.4158, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.40% (4.4195 => 4.6141, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.3845 => 0.4014, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (2.1013 => 2.1928, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.3903 => 0.4069, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.16% (4.6177 => 4.8097, std. dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 4.15% (2.1653 => 2.2551, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 4.08% (1.8794 => 1.9561, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 4.03% (1.4269 => 1.4844, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.99% (0.4139 => 0.4304, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.86% (0.7875 => 0.8179, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 3.78% (0.6634 => 0.6885, std. dev.: 0.0046) MultiSource/Applications/Burg/burg: 3.73% (0.5546 => 0.5753, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.67% (0.3271 => 0.3391, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.66% (0.3084 => 0.3197, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.65% (0.2737 => 0.2837, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.62% (0.6435 => 0.6668, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.56% (23.5202 => 24.3569, std. dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.5012 => 0.5189, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.33% (0.3336 => 0.3447, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.74% (2.0346 => 2.0904, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (0.4847 => 0.4961, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (4.6926 => 4.7471, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.90% (0.2122 => 0.2332, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6717, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1689, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6388, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1919, std. dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5048, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2270, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (41.7953 => 42.4322, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2791, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std. dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.12% (2.4764 => 2.3992, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.72% (25.4195 => 16.5938, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary2: -8.58% (0.2402 => 0.2196, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7814, std. dev.: 0.0131) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8030, std. dev.: 0.0108) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.62% (17.2379 => 16.7870, std. dev.: 0.0690) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.08% (0.6293 => 0.6162, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5803, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9646, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 15:12:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 17:12:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823221236.154172A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3162?compare_to=3160&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3162, Order: 162463, Start Time: 2012-08-23 20:54:25, End Time: 2012-08-23 22:13:28 To: 3160, Order: 162454, Start Time: 2012-08-23 19:07:38, End Time: 2012-08-23 20:26:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (127 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.90% (54.4388 => 56.5635, std. dev.: 0.1012) MultiSource/Benchmarks/llubenchmark/llu: 2.65% (3.7680 => 3.8679, std. dev.: 0.0248) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.09% (10.3673 => 13.4868, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 14.31% (0.3473 => 0.3970, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-3: 13.94% (0.3516 => 0.4006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.93% (0.3561 => 0.4057, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.93% (0.3497 => 0.3984, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.83% (0.3543 => 0.4033, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.83% (0.3543 => 0.4033, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 13.32% (0.3694 => 0.4186, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3828 => 0.4327, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.83% (0.3927 => 0.4431, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.86% (1.1194 => 1.2522, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.36% (1.7609 => 1.9609, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.22% (2.2022 => 2.4052, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 9.08% (0.1432 => 0.1562, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5925 => 0.6407, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.35% (0.1892 => 0.2031, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (0.1584 => 0.1697, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.91% (0.7326 => 0.7832, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: 6.91% (0.1622 => 0.1734, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 6.09% (0.3282 => 0.3482, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4615 => 0.4895, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.76% (7.0540 => 7.4603, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.68% (0.4879 => 0.5156, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.41% (0.3307 => 0.3486, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.35% (0.8172 => 0.8609, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 5.24% (9.4845 => 9.9811, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.08% (5.0018 => 5.2559, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.08% (4.9449 => 5.1961, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.06% (0.2271 => 0.2386, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (0.7433 => 0.7807, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.97% (0.2554 => 0.2681, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.88% (0.4299 => 0.4509, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.3121 => 0.3272, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.72% (4.2646 => 4.4657, std. dev.: 0.0115) MultiSource/Applications/sgefa/sgefa: 4.66% (0.3109 => 0.3254, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.57% (8.1363 => 8.5081, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.51% (0.5569 => 0.5820, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (10.4361 => 10.8974, std. dev.: 0.0098) MultiSource/Benchmarks/McCat/18-imp/imp: 4.41% (0.3423 => 0.3574, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (1.3050 => 1.3621, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5860 => 0.6113, std. dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 4.13% (5.7591 => 5.9972, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.11% (0.2700 => 0.2811, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.08% (0.2891 => 0.3009, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.05% (0.7835 => 0.8152, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.4636 => 0.4822, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.95% (0.3441 => 0.3577, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 3.93% (0.3180 => 0.3305, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.92% (0.2905 => 0.3019, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.92% (0.2758 => 0.2866, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.83% (0.9765 => 1.0139, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.78% (0.6450 => 0.6694, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.74% (0.3422 => 0.3550, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.71% (1.5415 => 1.5987, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 3.69% (0.3283 => 0.3404, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.68% (0.3098 => 0.3212, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3865 => 0.4007, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.66% (0.2872 => 0.2977, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1861 => 1.2294, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.64% (0.5105 => 0.5291, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 3.64% (0.3052 => 0.3163, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.63% (0.2756 => 0.2856, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.61% (1.5603 => 1.6166, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.61% (0.4103 => 0.4251, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4289 => 0.4442, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 3.55% (0.2871 => 0.2973, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.51% (2.0665 => 2.1391, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.50% (0.3826 => 0.3960, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.45% (0.3650 => 0.3776, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.8067 => 0.8343, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3603 => 0.3725, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6675 => 0.6900, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.37% (0.3387 => 0.3501, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3935 => 0.4067, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.34% (1.1642 => 1.2031, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.32% (3.3354 => 3.4462, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.32% (0.3136 => 0.3240, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.4064 => 0.4198, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3684 => 0.3804, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.26% (0.3379 => 0.3489, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.15% (3.8723 => 3.9941, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.13% (2.0273 => 2.0907, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.4203 => 0.4333, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.02% (0.6456 => 0.6651, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.4048 => 0.4169, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (14.3668 => 14.7942, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4620 => 0.4756, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.94% (1.2842 => 1.3220, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5981 => 0.6157, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8921 => 0.9181, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.89% (1.4186 => 1.4596, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.5020 => 0.5153, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.57% (1.5859 => 1.6266, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.56% (2.2969 => 2.3557, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.36% (17.1811 => 17.5862, std. dev.: 0.0179) MultiSource/Applications/minisat/minisat: 2.30% (0.7115 => 0.7279, std. dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 2.18% (1.1840 => 1.2098, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.2024 => 2.2495, std. dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.70% (1.0722 => 1.0904, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.69% (7.9617 => 8.0963, std. dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 1.65% (21.9371 => 22.2992, std. dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (4.2280 => 4.4570, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0047) MultiSource/Applications/lua/lua: 3.04% (26.0924 => 26.8857, std. dev.: 0.0153) MultiSource/Benchmarks/llubenchmark/llu: 2.38% (3.7781 => 3.8679, std. dev.: 0.0248) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3350, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2446, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (1.5086 => 1.5283, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1983, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.26% (5.2763 => 3.2047, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.07% (5.3855 => 3.7124, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7126, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1350, std. dev.: 0.0262) MultiSource/Applications/ClamAV/clamscan: -14.08% (22.1758 => 19.0533, std. dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.14% (2.9384 => 2.5524, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -10.70% (1.2373 => 1.1049, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -8.65% (1.5373 => 1.4044, std. dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0037) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4696, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4265, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9901, std. dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.31% (8.1563 => 7.9676, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3382, std. dev.: 0.0099) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 14:44:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 16:44:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823214409.1B5532A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3161?compare_to=3159&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3161, Order: 162461, Start Time: 2012-08-23 20:30:38, End Time: 2012-08-23 21:45:01 To: 3159, Order: 162453, Start Time: 2012-08-23 18:48:30, End Time: 2012-08-23 20:02:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (163 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (693 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.92% (2.0176 => 2.3186, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.69% (0.7061 => 0.7816, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 10.57% (0.5818 => 0.6433, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 10.39% (0.5748 => 0.6345, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.52% (0.3646 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3650 => 0.3996, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 9.41% (0.3601 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.39% (0.3663 => 0.4007, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3789 => 0.4141, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.27% (0.3623 => 0.3959, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3914 => 0.4273, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.07% (0.1819 => 0.1984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 8.88% (0.3940 => 0.4290, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.3130 => 0.3404, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.14% (3.9660 => 4.2889, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.99% (0.7710 => 0.8326, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.97% (0.2596 => 0.2803, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (0.4328 => 0.4670, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.76% (1.3693 => 1.4756, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 7.35% (0.7038 => 0.7555, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 7.34% (0.2781 => 0.2985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2782 => 0.2984, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2721 => 0.2917, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4062 => 0.4352, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.10% (0.5265 => 0.5639, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.05% (1.2193 => 1.3053, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3022 => 0.3235, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.93% (0.6959 => 0.7441, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.87% (0.2607 => 0.2786, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.4379 => 0.4679, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.3899 => 0.4166, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.84% (0.2966 => 0.3169, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.84% (0.2690 => 0.2874, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.81% (0.4390 => 0.4689, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.81% (0.9199 => 0.9825, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 6.77% (0.2761 => 0.2948, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.76% (1.9828 => 2.1168, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.74% (0.1588 => 0.1695, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2765 => 0.2949, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.54% (0.3580 => 0.3814, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3107 => 0.3310, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.46% (0.3485 => 0.3710, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.42% (0.2696 => 0.2869, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.2988 => 0.3178, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3489 => 0.3710, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.25% (1.1364 => 1.2074, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.23% (0.3192 => 0.3391, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.17% (0.5577 => 0.5921, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 6.13% (13.8202 => 14.6675, std. dev.: 0.0137) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.11% (0.2127 => 0.2257, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.08% (1.4563 => 1.5449, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 6.07% (0.3293 => 0.3493, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.00% (0.5637 => 0.5975, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3534 => 0.3742, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.87% (0.2914 => 0.3085, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.78% (0.4016 => 0.4248, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.74% (0.2995 => 0.3167, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (0.3756 => 0.3971, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.68% (0.2925 => 0.3091, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.64% (0.3868 => 0.4086, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.63% (7.2180 => 7.6244, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.63% (0.1865 => 0.1970, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.58% (1.3813 => 1.4584, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.56% (1.3819 => 1.4588, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 5.56% (0.7506 => 0.7923, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.44% (0.2243 => 0.2365, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.40% (0.4113 => 0.4335, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.31% (0.8310 => 0.8751, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.30% (1.3245 => 1.3947, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.27% (0.7460 => 0.7853, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.24% (3.6692 => 3.8615, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.22% (0.4791 => 0.5041, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.21% (1.1061 => 1.1637, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 5.20% (1.0594 => 1.1145, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 5.19% (1.2292 => 1.2930, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.14% (3.8646 => 4.0631, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.13% (4.3801 => 4.6047, std. dev.: 0.0075) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (4.4433 => 4.6658, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.98% (0.8818 => 0.9257, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.93% (0.6283 => 0.6593, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.93% (1.9270 => 2.0220, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3755 => 0.3940, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.86% (0.2140 => 0.2244, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.74% (0.6135 => 0.6426, std. dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3940, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 4.66% (0.3220 => 0.3370, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.63% (2.1791 => 2.2799, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.53% (13.2842 => 13.8857, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 4.52% (14.8535 => 15.5242, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.50% (0.2243 => 0.2344, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.27% (1.1333 => 1.1817, std. dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 4.25% (4.6629 => 4.8612, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 4.09% (0.3131 => 0.3259, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.97% (0.8698 => 0.9043, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.94% (0.3245 => 0.3373, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.94% (3.1889 => 3.3146, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 3.91% (8.4961 => 8.8279, std. dev.: 0.0136) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.76% (4.9865 => 5.1742, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 3.65% (6.5754 => 6.8157, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.57% (3.2742 => 3.3912, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/bh/bh: 3.57% (0.2859 => 0.2961, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 3.14% (14.5298 => 14.9861, std. dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.04% (0.9108 => 0.9385, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.97% (16.2614 => 16.7444, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.84% (1.5188 => 1.5619, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.6250 => 0.6402, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.1007 => 2.1501, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.22% (3.7467 => 3.8298, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.12% (0.4805 => 0.4907, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.08% (0.6744 => 0.6884, std. dev.: 0.0050) MultiSource/Applications/lemon/lemon: 2.04% (1.0313 => 1.0523, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.91% (6.2785 => 6.3987, std. dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2964, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.57% (33.2944 => 33.8182, std. dev.: 0.0205) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 25.44% (1.8175 => 2.2799, std. dev.: 0.0399) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.49% (1.2998 => 1.4101, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (0.2093 => 0.2213, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0056, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.34% (11.2619 => 11.7502, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8172, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3833, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6034, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9792, std. dev.: 0.0565) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6776, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3262, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.36% (1.5089 => 1.5294, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.16% (26.5159 => 26.8247, std. dev.: 0.0197) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5750, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6870, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.50% (22.5627 => 21.3227, std. dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.77% (1.2308 => 1.0983, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5103, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1030, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.17% (1.3780 => 1.3206, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0219, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6025, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9618, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.97% (7.3305 => 7.1864, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2403, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3609, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.09% (5.5401 => 5.4796, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.07% (20.3410 => 20.1235, std. dev.: 0.0101) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2423, std. dev.: 0.0137) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 13:25:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 15:25:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823202547.518AD2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3160?compare_to=3157&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3160, Order: 162454, Start Time: 2012-08-23 19:07:38, End Time: 2012-08-23 20:26:38 To: 3157, Order: 162444, Start Time: 2012-08-23 17:20:56, End Time: 2012-08-23 18:40:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.11% (13.3242 => 13.4721, std. dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.95% (10.3673 => 13.4721, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/trivial-interface: 14.14% (0.3473 => 0.3964, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.04% (0.3561 => 0.4061, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3497 => 0.3983, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.80% (0.3543 => 0.4032, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.80% (0.3543 => 0.4032, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3516 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.37% (0.3694 => 0.4188, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.06% (0.3828 => 0.4328, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3927 => 0.4427, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.34% (1.7609 => 1.9605, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.22% (2.2022 => 2.4053, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 9.15% (0.1432 => 0.1563, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5925 => 0.6402, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.99% (0.6030 => 0.6512, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.56% (0.1892 => 0.2035, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.91% (0.7326 => 0.7832, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 6.72% (0.1622 => 0.1731, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4615 => 0.4889, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.85% (0.3282 => 0.3474, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.4879 => 0.5157, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.69% (7.0540 => 7.4555, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.41% (0.3307 => 0.3486, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.28% (9.4845 => 9.9850, std. dev.: 0.0099) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.19% (0.3121 => 0.3283, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (4.9449 => 5.2001, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 5.09% (0.7433 => 0.7811, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.99% (5.0018 => 5.2514, std. dev.: 0.0140) MultiSource/Benchmarks/McCat/05-eks/eks: 4.98% (0.4299 => 0.4513, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.98% (0.2271 => 0.2384, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.89% (0.2554 => 0.2679, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.89% (0.2107 => 0.2210, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.87% (0.8172 => 0.8570, std. dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 4.86% (0.3109 => 0.3260, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.68% (4.2646 => 4.4640, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.51% (0.5860 => 0.6124, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.4361 => 10.9055, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.48% (8.1363 => 8.5012, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.5569 => 0.5814, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (1.3050 => 1.3621, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 4.35% (0.3423 => 0.3572, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.18% (0.4636 => 0.4830, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 4.08% (5.7591 => 5.9943, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.01% (0.2891 => 0.3007, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.01% (0.7835 => 0.8149, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.2905 => 0.3021, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.98% (0.3441 => 0.3578, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.9765 => 1.0145, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.85% (0.2700 => 0.2804, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.84% (0.2758 => 0.2864, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 3.84% (0.3180 => 0.3302, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.83% (0.6450 => 0.6697, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (1.1861 => 1.2305, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.72% (0.3092 => 0.3207, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.71% (0.3422 => 0.3549, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2872 => 0.2978, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.68% (1.5415 => 1.5982, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (0.5105 => 0.5292, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3232 => 0.3350, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.65% (1.5603 => 1.6172, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3865 => 0.4005, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.62% (0.3098 => 0.3210, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.57% (0.3052 => 0.3161, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.54% (0.4289 => 0.4441, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.53% (0.4103 => 0.4248, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 3.52% (0.2871 => 0.2972, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.48% (0.3162 => 0.3272, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.48% (1.1642 => 1.2047, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.45% (2.0665 => 2.1378, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.40% (0.3387 => 0.3502, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.32% (0.8067 => 0.8335, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.30% (0.3603 => 0.3722, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.4064 => 0.4198, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.30% (0.6675 => 0.6895, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.25% (0.3136 => 0.3238, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.23% (3.3354 => 3.4432, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3684 => 0.3803, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.22% (2.0273 => 2.0925, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3379 => 0.3487, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 3.16% (3.8723 => 3.9945, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7987, std. dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.00% (0.4203 => 0.4329, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5981 => 0.6159, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.97% (0.6456 => 0.6648, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.97% (1.2842 => 1.3223, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4620 => 0.4755, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8921 => 0.9181, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.89% (1.4186 => 1.4596, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.4048 => 0.4161, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.71% (1.5859 => 1.6289, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.5020 => 0.5153, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.51% (2.2969 => 2.3545, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.34% (17.1811 => 17.5835, std. dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.24% (2.2024 => 2.2518, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.22% (0.7115 => 0.7273, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.13% (1.1840 => 1.2092, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.76% (1.0722 => 1.0911, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.65% (21.9371 => 22.2984, std. dev.: 0.0250) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.65% (7.9617 => 8.0927, std. dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.13% (4.2280 => 4.4451, std. dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7530, std. dev.: 0.0057) MultiSource/Applications/lua/lua: 3.02% (26.0924 => 26.8815, std. dev.: 0.0218) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3342, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2387, std. dev.: 0.0439) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.21% (3.1578 => 3.1959, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5796, std. dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6817, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1253, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.28% (5.2763 => 3.2039, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7129, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.60% (5.3526 => 3.7149, std. dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1183, std. dev.: 0.1062) MultiSource/Applications/ClamAV/clamscan: -14.06% (22.1758 => 19.0579, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.13% (2.9384 => 2.5526, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.32% (1.6925 => 1.4163, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: -10.69% (1.2373 => 1.1050, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -7.70% (1.5373 => 1.4189, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std. dev.: 0.0045) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4608, std. dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4126, std. dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.60% (10.2830 => 10.0152, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9578, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3449, std. dev.: 0.0032) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.05% (1.8329 => 1.8136, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 12:45:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 14:45:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120823194539.C20E32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3158?compare_to=3153&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3158, Order: 162444, Start Time: 2012-08-23 17:02:50, End Time: 2012-08-23 19:46:34 To: 3153, Order: 162441, Start Time: 2012-08-23 13:51:19, End Time: 2012-08-23 16:35:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.80% (128.7275 => 131.0417, std. dev.: 0.1651) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.25% (0.3465 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.15% (0.3460 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.13% (0.3488 => 0.3946, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.74% (0.3643 => 0.4107, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3724 => 0.4181, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.68% (0.3792 => 0.4197, std. dev.: 0.0101) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.16% (0.1063 => 0.1171, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.74% (0.5826 => 0.6335, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 8.72% (1.5932 => 1.7322, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.5889 => 0.6386, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.1619 => 0.1738, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 6.87% (0.7171 => 0.7664, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (1.6211 => 1.7286, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (3.5627 => 3.7948, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2875 => 0.3061, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.32% (1.3152 => 1.3983, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.27% (0.5900 => 0.6270, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2813 => 0.2989, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2792 => 0.2966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2750 => 0.2921, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.20% (0.3195 => 0.3393, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2729 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.13% (0.2823 => 0.2996, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2803 => 0.2974, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.06% (0.9909 => 1.0509, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 6.04% (0.3096 => 0.3283, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.01% (0.2780 => 0.2947, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.99% (0.3004 => 0.3184, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3267 => 0.3462, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.97% (0.4994 => 0.5292, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.2014 => 0.2133, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.91% (0.2811 => 0.2977, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (0.5026 => 0.5322, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.88% (2.0673 => 2.1888, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.2911 => 0.3082, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.85% (0.4361 => 0.4616, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.3258 => 0.3447, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.70% (0.3930 => 0.4154, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 5.70% (0.3317 => 0.3506, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.66% (0.5000 => 0.5283, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.63% (0.3124 => 0.3300, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3362 => 0.3550, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.3060 => 0.3230, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.56% (0.3348 => 0.3534, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.55% (0.3678 => 0.3882, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.51% (0.3282 => 0.3463, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.50% (0.9697 => 1.0230, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 5.49% (1.0781 => 1.1373, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.42% (0.3726 => 0.3928, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.41% (4.2109 => 4.4387, std. dev.: 0.0078) MultiSource/Applications/spiff/spiff: 5.39% (0.4029 => 0.4246, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (0.3625 => 0.3817, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.23% (0.3477 => 0.3659, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.99% (0.2866 => 0.3009, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (0.4251 => 0.4461, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3690 => 0.3872, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.90% (0.4146 => 0.4349, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.89% (0.3845 => 0.4033, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.82% (0.2736 => 0.2868, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.82% (2.7292 => 2.8608, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.72% (0.4658 => 0.4878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.72% (0.3981 => 0.4169, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.68% (0.2566 => 0.2686, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.63% (0.3890 => 0.4070, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 4.57% (5.5417 => 5.7952, std. dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 4.40% (2.1013 => 2.1938, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.30% (1.9966 => 2.0824, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.19% (4.4195 => 4.6046, std. dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.17% (1.9694 => 2.0516, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 3.98% (1.8794 => 1.9542, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.5012 => 0.5211, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.94% (2.1653 => 2.2507, std. dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 3.93% (23.5202 => 24.4440, std. dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.92% (0.3903 => 0.4056, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.89% (4.6177 => 4.7971, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.87% (0.2737 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.87% (0.6435 => 0.6684, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.3271 => 0.3396, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.77% (0.4139 => 0.4295, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 3.76% (1.4269 => 1.4806, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.70% (0.3084 => 0.3198, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.69% (0.6634 => 0.6879, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 3.67% (0.7875 => 0.8164, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.32% (0.5546 => 0.5730, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 3.30% (0.3336 => 0.3446, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.60% (2.0346 => 2.0876, std. dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.45% (0.7426 => 0.7534, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (4.6926 => 4.7458, std. dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.11% (11.6398 => 11.7692, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 8.34% (0.2122 => 0.2299, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6663, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8915, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1721, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6341, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1903, std. dev.: 0.0098) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5003, std. dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2272, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4498, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2804, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5892, std. dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5505, std. dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8099, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.08% (0.2402 => 0.2256, std. dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7890, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0060) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (17.2379 => 16.7739, std. dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5729, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (16.2163 => 15.9771, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 13:02:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 15:02:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823200201.ABDEC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3159?compare_to=3156&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3159, Order: 162453, Start Time: 2012-08-23 18:48:30, End Time: 2012-08-23 20:02:52 To: 3156, Order: 162444, Start Time: 2012-08-23 17:06:24, End Time: 2012-08-23 18:20:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (158 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (699 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.34% (1.3907 => 1.4232, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.59% (41.7412 => 42.4058, std. dev.: 0.1497) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.99% (2.0176 => 2.3200, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.52% (0.5818 => 0.6430, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.44% (0.7061 => 0.7798, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.40% (0.5748 => 0.6346, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3578 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.41% (0.3646 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3650 => 0.3991, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.28% (0.3663 => 0.4003, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.21% (0.3789 => 0.4138, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3914 => 0.4273, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.13% (0.1819 => 0.1985, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.4003 => 0.4365, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.35% (0.1413 => 0.1531, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.98% (1.3693 => 1.4786, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.92% (3.9660 => 4.2800, std. dev.: 0.0074) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.83% (0.7710 => 0.8314, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 7.81% (0.4328 => 0.4666, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.75% (0.4062 => 0.4377, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.53% (0.2655 => 0.2855, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.39% (0.5265 => 0.5654, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2781 => 0.2986, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.23% (0.7038 => 0.7547, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.12% (0.2782 => 0.2980, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.04% (1.2193 => 1.3051, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.85% (0.9199 => 0.9829, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.81% (0.4379 => 0.4677, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.74% (0.1588 => 0.1695, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.72% (0.3022 => 0.3225, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.69% (0.2690 => 0.2870, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2765 => 0.2950, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 6.66% (0.2761 => 0.2945, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.62% (0.3899 => 0.4157, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3580 => 0.3816, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.58% (1.9828 => 2.1132, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.57% (0.2937 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.51% (0.6959 => 0.7412, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.40% (0.3485 => 0.3708, std. dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.39% (0.2127 => 0.2263, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.35% (0.3149 => 0.3349, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.31% (0.2696 => 0.2866, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.2988 => 0.3175, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.20% (1.1364 => 1.2068, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 6.17% (0.3192 => 0.3389, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (0.2914 => 0.3093, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.09% (13.8202 => 14.6617, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.04% (1.4563 => 1.5443, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.01% (0.5577 => 0.5912, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.97% (0.4390 => 0.4652, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3453 => 0.3658, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 5.89% (0.3293 => 0.3487, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.89% (0.5637 => 0.5969, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.83% (0.2023 => 0.2141, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.83% (0.3534 => 0.3740, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.4016 => 0.4247, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3246 => 0.3431, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.68% (0.1865 => 0.1971, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (0.3756 => 0.3969, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.66% (1.3813 => 1.4595, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.64% (7.2180 => 7.6248, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 5.61% (0.2925 => 0.3089, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.3868 => 0.4083, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.51% (0.2995 => 0.3160, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.40% (1.0594 => 1.1166, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.2243 => 0.2364, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.38% (0.8310 => 0.8757, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.2945 => 0.3103, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.35% (0.7460 => 0.7859, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (1.3819 => 1.4556, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 5.32% (0.4113 => 0.4332, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.2292 => 1.2944, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.30% (3.8646 => 4.0693, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.26% (0.6135 => 0.6458, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.21% (1.3245 => 1.3935, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 5.13% (0.7506 => 0.7891, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 5.13% (1.1061 => 1.1628, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.12% (3.6692 => 3.8572, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.4791 => 0.5035, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (4.3801 => 4.6012, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.96% (0.8818 => 0.9255, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.95% (4.4433 => 4.6633, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.95% (0.6283 => 0.6594, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.70% (1.9270 => 2.0176, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 4.69% (0.3220 => 0.3371, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 4.64% (2.1791 => 2.2803, std. dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 4.62% (16.6129 => 17.3799, std. dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.61% (0.3755 => 0.3928, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.57% (13.2842 => 13.8910, std. dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: 4.39% (14.8535 => 15.5063, std. dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 4.17% (4.6629 => 4.8574, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.15% (0.3131 => 0.3261, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.14% (1.1333 => 1.1802, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.05% (3.1889 => 3.3181, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.99% (0.8698 => 0.9045, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.98% (0.3245 => 0.3374, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (8.4961 => 8.8258, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.76% (4.9865 => 5.1740, std. dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 3.72% (6.5754 => 6.8197, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.48% (3.2742 => 3.3881, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 3.18% (14.5298 => 14.9922, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 3.06% (16.2614 => 16.7587, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.95% (0.9108 => 0.9377, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (1.5188 => 1.5628, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.6250 => 0.6403, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.1007 => 2.1479, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.08% (3.7467 => 3.8246, std. dev.: 0.0029) MultiSource/Applications/minisat/minisat: 2.03% (0.6744 => 0.6881, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.99% (1.0313 => 1.0518, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.93% (6.2785 => 6.3996, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.56% (33.2944 => 33.8148, std. dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2942, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5123, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 9.49% (1.2998 => 1.4232, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.2093 => 0.2216, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6614, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7413, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3835, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.23% (10.7476 => 10.9872, std. dev.: 0.0518) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5912, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5928 => 4.6760, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3255, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5089 => 1.5328, std. dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 1.20% (26.5159 => 26.8350, std. dev.: 0.0364) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.47% (22.5627 => 21.3278, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2308 => 1.1022, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std. dev.: 0.0083) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.60% (1.1560 => 1.1028, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6012, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.19% (3.0263 => 2.9601, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2304, std. dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: -1.82% (7.3305 => 7.1974, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std. dev.: 0.0179) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3567, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.20% (20.3410 => 20.0975, std. dev.: 0.0307) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.10% (5.5401 => 5.4792, std. dev.: 0.0100) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 11:39:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 13:39:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823183916.1ABCB2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3157?compare_to=3155&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3157, Order: 162444, Start Time: 2012-08-23 17:20:56, End Time: 2012-08-23 18:40:10 To: 3155, Order: 162443, Start Time: 2012-08-23 15:34:19, End Time: 2012-08-23 16:53:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.36% (78.2775 => 80.9087, std. dev.: 0.0811) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.52% (10.3673 => 13.3242, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 13.76% (0.3473 => 0.3951, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3497 => 0.3973, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 13.55% (0.3543 => 0.4023, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.48% (0.3516 => 0.3990, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 13.42% (0.3561 => 0.4039, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.89% (0.3694 => 0.4170, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.72% (0.3828 => 0.4315, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.35% (0.3886 => 0.4366, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.09% (1.1194 => 1.2547, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.03% (1.7609 => 1.9552, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.00% (2.2022 => 2.4003, std. dev.: 0.0239) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1584 => 0.1701, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.14% (0.7326 => 0.7849, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.14% (0.1892 => 0.2027, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.92% (0.4615 => 0.4888, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 5.61% (0.3282 => 0.3466, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.56% (0.3307 => 0.3491, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.4879 => 0.5150, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.55% (7.0540 => 7.4458, std. dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: 5.18% (9.4845 => 9.9754, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.06% (0.2271 => 0.2386, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.97% (4.9449 => 5.1906, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 4.96% (0.7433 => 0.7802, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.86% (5.0018 => 5.2447, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 4.74% (0.2554 => 0.2675, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.72% (0.4299 => 0.4502, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (4.2646 => 4.4626, std. dev.: 0.0394) MultiSource/Applications/sgefa/sgefa: 4.63% (0.3109 => 0.3253, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.61% (0.8172 => 0.8549, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.45% (0.5569 => 0.5817, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.42% (0.3121 => 0.3259, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 4.41% (0.3423 => 0.3574, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.37% (0.5860 => 0.6116, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.36% (8.1363 => 8.4912, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.32% (0.2891 => 0.3016, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (1.3050 => 1.3612, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.27% (0.2905 => 0.3029, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.25% (0.4636 => 0.4833, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.11% (10.4361 => 10.8653, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/strcat: 4.10% (0.2831 => 0.2947, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.04% (0.2872 => 0.2988, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 4.02% (0.3283 => 0.3415, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.99% (0.7835 => 0.8148, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.99% (0.2758 => 0.2868, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 3.97% (5.7591 => 5.9879, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 3.96% (0.3052 => 0.3173, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.96% (0.2756 => 0.2865, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.95% (0.3441 => 0.3577, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.95% (0.3422 => 0.3557, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3232 => 0.3359, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.91% (0.3098 => 0.3219, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.87% (0.4289 => 0.4455, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.5105 => 0.5301, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 3.84% (0.3180 => 0.3302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.83% (0.2871 => 0.2981, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.83% (0.3865 => 0.4013, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.80% (0.2793 => 0.2899, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.4103 => 0.4258, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.78% (1.5415 => 1.5997, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.76% (0.3162 => 0.3281, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 3.76% (0.2714 => 0.2816, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2802 => 0.2907, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.72% (1.5603 => 1.6183, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.70% (2.0665 => 2.1429, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.67% (0.9765 => 1.0123, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1861 => 1.2294, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: 3.65% (0.2877 => 0.2982, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.61% (0.3603 => 0.3733, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3826 => 0.3964, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6450 => 0.6682, std. dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 3.57% (0.3387 => 0.3508, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.3136 => 0.3248, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.55% (0.3379 => 0.3499, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.8067 => 0.8353, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.54% (0.4064 => 0.4208, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.53% (0.3684 => 0.3814, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.39% (0.6675 => 0.6901, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.38% (0.4203 => 0.4345, std. dev.: 0.0049) MultiSource/Applications/Burg/burg: 3.31% (1.1642 => 1.2027, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (0.4620 => 0.4772, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.28% (0.6456 => 0.6668, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.17% (1.2842 => 1.3249, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.12% (3.3354 => 3.4396, std. dev.: 0.0061) MultiSource/Applications/treecc/treecc: 3.07% (2.0273 => 2.0895, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.06% (0.5981 => 0.6164, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.00% (3.8723 => 3.9883, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (14.3668 => 14.7862, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8921 => 0.9173, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.4186 => 1.4582, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.71% (0.5020 => 0.5156, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.5859 => 1.6262, std. dev.: 0.0062) MultiSource/Applications/siod/siod: 2.42% (2.2969 => 2.3524, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.30% (17.1811 => 17.5765, std. dev.: 0.0188) MultiSource/Benchmarks/nbench/nbench: 2.26% (1.1840 => 1.2108, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (2.2024 => 2.2493, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.04% (0.7115 => 0.7260, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.60% (21.9371 => 22.2889, std. dev.: 0.0179) MultiSource/Applications/lemon/lemon: 1.59% (1.0722 => 1.0892, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.55% (7.9617 => 8.0855, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.76% (4.2280 => 4.4292, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7528, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8651, std. dev.: 0.0233) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3348, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2436, std. dev.: 0.0309) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.17% (3.1578 => 3.1948, std. dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5809, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 1.03% (2.2771 => 2.3006, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6814, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.19% (5.2763 => 3.2086, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7042, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.78% (5.3526 => 3.7049, std. dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1270, std. dev.: 0.0280) MultiSource/Applications/ClamAV/clamscan: -14.17% (22.1758 => 19.0344, std. dev.: 0.0372) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.75% (2.9384 => 2.5637, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.62% (1.2373 => 1.1059, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -9.49% (1.5373 => 1.3914, std. dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.81% (5.0483 => 4.8053, std. dev.: 0.0007) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4673, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4150, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: -2.86% (10.2830 => 9.9885, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.76% (1.3677 => 1.3300, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.30% (8.1563 => 7.9691, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5082, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3469, std. dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4242, std. dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.13% (1.8329 => 1.8122, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 11:19:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 13:19:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823181956.715CD2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3156?compare_to=3154&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3156, Order: 162444, Start Time: 2012-08-23 17:06:24, End Time: 2012-08-23 18:20:50 To: 3154, Order: 162443, Start Time: 2012-08-23 15:24:17, End Time: 2012-08-23 16:38:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (158 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (699 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -3.33% (1.4386 => 1.3907, std. dev.: 0.0154) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.19% (2.0176 => 2.3240, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 13.08% (0.0826 => 0.0934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.16% (0.5818 => 0.6409, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.07% (0.5748 => 0.6327, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.07% (0.7061 => 0.7772, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 9.06% (0.3578 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.89% (0.3646 => 0.3970, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.86% (0.3601 => 0.3920, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.85% (0.1819 => 0.1980, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.79% (0.3650 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3663 => 0.3985, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.72% (0.3623 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.64% (0.3914 => 0.4252, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.44% (0.4003 => 0.4341, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.42% (0.4062 => 0.4404, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.07% (0.7710 => 0.8332, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 8.00% (1.3693 => 1.4788, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.97% (3.9660 => 4.2820, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (0.4328 => 0.4659, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.2781 => 0.2990, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2596 => 0.2789, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.36% (0.7038 => 0.7556, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.24% (0.5265 => 0.5646, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2690 => 0.2881, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.94% (0.4379 => 0.4683, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.92% (0.2760 => 0.2951, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.92% (0.3022 => 0.3231, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.90% (0.9199 => 0.9834, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.86% (1.2193 => 1.3030, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (1.9828 => 2.1171, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.6959 => 0.7424, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.64% (0.3899 => 0.4158, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3580 => 0.3815, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.54% (0.3485 => 0.3713, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.2988 => 0.3182, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.48% (0.3489 => 0.3715, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.43% (0.1789 => 0.1904, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.1364 => 1.2085, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.24% (1.4563 => 1.5472, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.16% (0.2127 => 0.2258, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4390 => 0.4660, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.10% (13.8202 => 14.6632, std. dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.10% (0.5577 => 0.5917, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.05% (0.4016 => 0.4259, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.98% (0.3293 => 0.3490, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.3868 => 0.4098, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.94% (0.5637 => 0.5972, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 5.91% (0.2925 => 0.3098, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.2914 => 0.3084, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.74% (0.1865 => 0.1972, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.68% (0.2023 => 0.2138, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.66% (1.3819 => 1.4601, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (0.3756 => 0.3967, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.60% (7.2180 => 7.6224, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.55% (1.3813 => 1.4580, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2945 => 0.3108, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.52% (0.7506 => 0.7920, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.45% (0.8310 => 0.8763, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.41% (0.6135 => 0.6467, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 5.41% (0.2995 => 0.3157, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.2243 => 0.2364, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.29% (1.2292 => 1.2942, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 5.26% (1.1061 => 1.1643, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.25% (0.4113 => 0.4329, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (0.7460 => 0.7851, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 5.24% (3.8646 => 4.0671, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.20% (1.3245 => 1.3934, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.18% (3.6692 => 3.8592, std. dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 5.06% (1.0594 => 1.1130, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.03% (0.6283 => 0.6599, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.4791 => 0.5030, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.98% (0.8818 => 0.9257, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.90% (4.3801 => 4.5946, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.87% (4.4433 => 4.6595, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 4.84% (0.3220 => 0.3376, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.83% (1.9270 => 2.0201, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.74% (0.3755 => 0.3933, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 4.63% (2.1791 => 2.2800, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (13.2842 => 13.8977, std. dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 4.55% (16.6129 => 17.3690, std. dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 4.36% (14.8535 => 15.5008, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.09% (1.1333 => 1.1796, std. dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 4.07% (4.6629 => 4.8525, std. dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 4.06% (0.3131 => 0.3258, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.93% (3.1889 => 3.3141, std. dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 3.93% (8.4961 => 8.8296, std. dev.: 0.0137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1743, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.3245 => 0.3366, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.56% (6.5754 => 6.8093, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.34% (3.2742 => 3.3834, std. dev.: 0.0235) MultiSource/Applications/ClamAV/clamscan: 3.20% (14.5298 => 14.9945, std. dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 3.09% (16.2614 => 16.7634, std. dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.84% (0.9108 => 0.9367, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.68% (1.5188 => 1.5595, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 2.54% (0.6250 => 0.6409, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.30% (0.6744 => 0.6899, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (2.1007 => 2.1480, std. dev.: 0.0017) MultiSource/Applications/lua/lua: 2.21% (3.7467 => 3.8294, std. dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.98% (1.0313 => 1.0517, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.82% (6.2785 => 6.3925, std. dev.: 0.0179) MultiSource/Applications/SIBsim4/SIBsim4: 1.67% (1.2749 => 1.2962, std. dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 1.60% (33.2944 => 33.8287, std. dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5197, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 23.97% (1.8175 => 2.2531, std. dev.: 0.0506) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 6.99% (1.2998 => 1.3907, std. dev.: 0.0154) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.16% (0.2093 => 0.2222, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7411, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5968, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.19% (10.7476 => 10.9828, std. dev.: 0.0386) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5928 => 4.6761, std. dev.: 0.0065) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.64% (3.2729 => 3.3267, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.27% (1.0895 => 1.1033, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.25% (1.5089 => 1.5278, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.21% (26.5159 => 26.8376, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5741, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.60% (22.5627 => 21.2998, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2308 => 1.0955, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.29% (1.3780 => 1.3189, std. dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5872, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.06% (3.0263 => 2.9640, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2365, std. dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2011, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3668, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4771, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5632, std. dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 09:34:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 11:34:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120823163411.36C162A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3153?compare_to=3150&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3153, Order: 162441, Start Time: 2012-08-23 13:51:19, End Time: 2012-08-23 16:35:05 To: 3150, Order: 162438, Start Time: 2012-08-23 10:40:14, End Time: 2012-08-23 13:23:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.15% (124.7926 => 128.7275, std. dev.: 1.3813) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.23% (1.7526 => 1.7311, std. dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.32% (0.3446 => 0.3905, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3442 => 0.3898, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: 13.22% (0.3465 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.15% (0.3460 => 0.3915, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.03% (0.3469 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.71% (0.3643 => 0.4106, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.51% (0.3724 => 0.4190, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.97% (0.1063 => 0.1169, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.74% (0.5826 => 0.6335, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.66% (1.5932 => 1.7311, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.30% (0.5889 => 0.6378, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.79% (0.7171 => 0.7658, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (3.5627 => 3.7958, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.51% (1.6211 => 1.7266, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2875 => 0.3060, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.40% (1.3152 => 1.3994, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.23% (0.2823 => 0.2999, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2729 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.22% (0.2813 => 0.2988, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2738 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2792 => 0.2965, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.18% (0.2750 => 0.2920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.07% (0.3195 => 0.3389, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2803 => 0.2972, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.01% (0.2811 => 0.2980, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.98% (0.2911 => 0.3085, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.98% (0.3096 => 0.3281, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.97% (0.2780 => 0.2946, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.96% (0.3004 => 0.3183, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.95% (0.9909 => 1.0499, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3267 => 0.3461, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.91% (2.0673 => 2.1895, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.91% (0.4994 => 0.5289, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.3258 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (0.4361 => 0.4613, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.76% (0.3317 => 0.3508, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (0.5000 => 0.5282, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.63% (0.3124 => 0.3300, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.59% (0.3362 => 0.3550, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (0.3930 => 0.4148, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 5.55% (0.3678 => 0.3882, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.51% (0.3282 => 0.3463, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.51% (4.2109 => 4.4431, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3060 => 0.3228, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.3348 => 0.3531, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.45% (1.0781 => 1.1369, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.43% (0.9697 => 1.0224, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (0.5026 => 0.5299, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 5.39% (0.4029 => 0.4246, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.37% (0.3726 => 0.3926, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (0.3625 => 0.3818, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.24% (0.5900 => 0.6209, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3477 => 0.3655, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.07% (0.4146 => 0.4356, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (0.4251 => 0.4461, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.88% (0.3690 => 0.3870, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.2866 => 0.3005, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.82% (2.7292 => 2.8607, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.80% (0.3981 => 0.4172, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.68% (0.3845 => 0.4025, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.2736 => 0.2864, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 4.57% (5.5417 => 5.7952, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.52% (0.3890 => 0.4066, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.40% (0.2566 => 0.2679, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.27% (1.9694 => 2.0535, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (2.1013 => 2.1900, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (4.4195 => 4.6055, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (0.4658 => 0.4852, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (1.9966 => 2.0791, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 4.04% (0.6634 => 0.6902, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.5012 => 0.5214, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.02% (0.3084 => 0.3208, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.01% (0.6435 => 0.6693, std. dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 3.92% (23.5202 => 24.4425, std. dev.: 0.0135) MultiSource/Applications/JM/lencod/lencod: 3.90% (4.6177 => 4.7978, std. dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 3.90% (2.1653 => 2.2497, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.87% (0.2737 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.87% (0.3903 => 0.4054, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (1.8794 => 1.9511, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.72% (0.4139 => 0.4293, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 3.69% (1.4269 => 1.4795, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 3.56% (0.7875 => 0.8155, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 3.41% (0.5546 => 0.5735, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.27% (0.3336 => 0.3445, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.62% (2.0346 => 2.0880, std. dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (0.4847 => 0.4949, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.47% (0.7426 => 0.7535, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.23% (4.6926 => 4.7503, std. dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.10% (11.6398 => 11.7673, std. dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6744, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1708, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6416, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.93% (2.0820 => 2.1222, std. dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5033, std. dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std. dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (41.7953 => 42.4294, std. dev.: 0.0173) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5841, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4803, std. dev.: 0.0394) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.14% (2.4764 => 2.3987, std. dev.: 0.0113) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5534, std. dev.: 0.0205) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7808, std. dev.: 0.0188) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8042, std. dev.: 0.0081) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std. dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8250, std. dev.: 0.0457) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5706, std. dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9690, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 09:52:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 11:52:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823165227.7463A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3155?compare_to=3152&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3155, Order: 162443, Start Time: 2012-08-23 15:34:19, End Time: 2012-08-23 16:53:19 To: 3152, Order: 162441, Start Time: 2012-08-23 13:47:37, End Time: 2012-08-23 15:06:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (129 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 3.00% (0.5326 => 0.5486, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: 1.98% (1.4060 => 1.4339, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.57% (10.3673 => 13.3292, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.65% (0.3516 => 0.3996, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.53% (0.3497 => 0.3970, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.52% (0.3543 => 0.4022, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 13.51% (0.3561 => 0.4042, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.46% (0.3543 => 0.4020, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.97% (0.3694 => 0.4173, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.77% (0.3828 => 0.4317, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.51% (0.3886 => 0.4372, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.15% (1.1194 => 1.2554, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.98% (1.7609 => 1.9543, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.02% (2.2022 => 2.4009, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.33% (0.6030 => 0.6532, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.19% (0.7326 => 0.7853, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.14% (0.1892 => 0.2027, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (0.1584 => 0.1697, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.3177 => 0.3398, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.15% (0.4615 => 0.4899, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 5.64% (0.3282 => 0.3467, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.60% (0.4879 => 0.5152, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.54% (7.0540 => 7.4451, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.53% (0.3307 => 0.3490, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.22% (9.4845 => 9.9794, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.11% (0.2271 => 0.2387, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.03% (0.2107 => 0.2213, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (0.7433 => 0.7805, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.94% (5.0018 => 5.2490, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.93% (4.9449 => 5.1885, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 4.88% (0.4299 => 0.4509, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.8172 => 0.8569, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2554 => 0.2678, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.63% (0.3109 => 0.3253, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.62% (4.2646 => 4.4618, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2891 => 0.3022, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.53% (0.3423 => 0.3578, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.51% (0.2905 => 0.3036, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.47% (0.5860 => 0.6122, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.42% (0.3121 => 0.3259, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.42% (0.5569 => 0.5815, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.41% (1.3050 => 1.3625, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.36% (8.1363 => 8.4913, std. dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.34% (0.4636 => 0.4837, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.18% (10.4361 => 10.8721, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/except: 4.14% (0.2871 => 0.2990, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.14% (0.2756 => 0.2870, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 4.10% (0.2831 => 0.2947, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3441 => 0.3581, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.06% (0.7835 => 0.8153, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3232 => 0.3363, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.03% (0.3422 => 0.3560, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.00% (0.3052 => 0.3174, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.99% (0.4289 => 0.4460, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3865 => 0.4018, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.92% (0.2758 => 0.2866, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.90% (5.7591 => 5.9839, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 3.90% (0.3283 => 0.3411, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.87% (0.3180 => 0.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.87% (0.2793 => 0.2901, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.84% (0.6450 => 0.6698, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.9765 => 1.0140, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.2700 => 0.2803, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.79% (1.5603 => 1.6195, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 3.79% (0.2877 => 0.2986, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.78% (2.0665 => 2.1447, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3650 => 0.3788, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.4103 => 0.4258, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.70% (1.5415 => 1.5986, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 3.67% (0.3379 => 0.3503, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.66% (0.5105 => 0.5292, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1861 => 1.2294, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.63% (0.3826 => 0.3965, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.61% (0.3603 => 0.3733, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.60% (0.3136 => 0.3249, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.57% (0.4064 => 0.4209, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.56% (0.3684 => 0.3815, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.43% (0.4203 => 0.4347, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.40% (0.3387 => 0.3502, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.38% (0.4620 => 0.4776, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6675 => 0.6900, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.37% (1.1642 => 1.2034, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.31% (0.8067 => 0.8334, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 3.26% (0.4048 => 0.4180, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.25% (1.2842 => 1.3260, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.6456 => 0.6662, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.15% (2.0273 => 2.0912, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.06% (3.3354 => 3.4374, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.04% (0.5981 => 0.6163, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.04% (3.8723 => 3.9900, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (14.3668 => 14.7884, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.4186 => 1.4597, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.76% (0.8921 => 0.9167, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.73% (0.5020 => 0.5157, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.59% (1.5859 => 1.6270, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.45% (2.2969 => 2.3532, std. dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 2.35% (17.1811 => 17.5852, std. dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.2024 => 2.2512, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.15% (0.7115 => 0.7268, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.15% (1.1840 => 1.2094, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.75% (1.0722 => 1.0910, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.63% (21.9371 => 22.2943, std. dev.: 0.0138) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.62% (7.9617 => 8.0910, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (4.2280 => 4.4467, std. dev.: 0.0024) MultiSource/Applications/lua/lua: 2.99% (26.0924 => 26.8737, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7456, std. dev.: 0.0042) MultiSource/Applications/siod/siod: 1.58% (3.2827 => 3.3345, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2415, std. dev.: 0.0388) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.29% (3.1578 => 3.1986, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.28% (1.5086 => 1.5279, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.17% (5.2763 => 3.2097, std. dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7047, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7041, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1577, std. dev.: 0.0333) MultiSource/Applications/ClamAV/clamscan: -14.14% (22.1758 => 19.0392, std. dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.69% (2.9384 => 2.5656, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -10.74% (1.2373 => 1.1044, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -6.73% (1.5373 => 1.4339, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std. dev.: 0.0025) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4699, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4099, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9963, std. dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9614, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5083, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3399, std. dev.: 0.0049) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.16% (1.8329 => 1.8116, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 09:37:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 11:37:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823163748.9BB0B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3154?compare_to=3151&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3154, Order: 162443, Start Time: 2012-08-23 15:24:17, End Time: 2012-08-23 16:38:41 To: 3151, Order: 162441, Start Time: 2012-08-23 13:42:23, End Time: 2012-08-23 14:56:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (159 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (697 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.06% (1.0905 => 1.1021, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.52% (2.3476 => 2.2650, std. dev.: 0.0186) MultiSource/Benchmarks/llubenchmark/llu: -3.29% (3.8866 => 3.7588, std. dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.22% (2.0176 => 2.3247, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.28% (0.5818 => 0.6416, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.04% (0.5748 => 0.6325, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: 9.79% (0.7061 => 0.7752, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.06% (0.3578 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.91% (0.3646 => 0.3971, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.91% (0.1819 => 0.1981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.86% (0.3601 => 0.3920, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.72% (0.3623 => 0.3939, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.71% (0.3650 => 0.3968, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 8.60% (0.3789 => 0.4115, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.35% (0.1413 => 0.1531, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.32% (0.3940 => 0.4268, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.26% (0.7710 => 0.8347, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (3.9660 => 4.2837, std. dev.: 0.0069) MultiSource/Applications/hbd/hbd: 8.00% (1.3693 => 1.4789, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (0.4328 => 0.4661, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.65% (0.2655 => 0.2858, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 7.50% (0.7038 => 0.7566, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2782 => 0.2990, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.40% (0.2596 => 0.2788, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.24% (0.5265 => 0.5646, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.09% (0.9199 => 0.9851, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.99% (0.2690 => 0.2878, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.2193 => 1.3043, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.2937 => 0.3141, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.3899 => 0.4169, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/except: 6.92% (0.2760 => 0.2951, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.91% (0.6959 => 0.7440, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2761 => 0.2949, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.76% (1.9828 => 2.1168, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4379 => 0.4674, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3149 => 0.3357, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.54% (0.1789 => 0.1906, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.51% (0.4390 => 0.4676, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.2988 => 0.3182, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.49% (0.1588 => 0.1691, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.48% (0.3580 => 0.3812, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.42% (0.3489 => 0.3713, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.38% (0.2914 => 0.3100, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.27% (1.1364 => 1.2077, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.16% (0.2127 => 0.2258, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.14% (13.8202 => 14.6684, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.08% (0.5577 => 0.5916, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.02% (1.4563 => 1.5439, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.4016 => 0.4257, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 5.98% (0.3293 => 0.3490, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.87% (0.3868 => 0.4095, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.3756 => 0.3976, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.5637 => 0.5967, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.85% (0.3246 => 0.3436, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.78% (0.2023 => 0.2140, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.72% (1.3819 => 1.4609, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.69% (7.2180 => 7.6287, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 5.68% (0.2925 => 0.3091, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.66% (1.3813 => 1.4595, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 5.54% (0.2995 => 0.3161, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.47% (0.2945 => 0.3106, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.44% (0.2243 => 0.2365, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.43% (1.3245 => 1.3964, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.37% (0.8310 => 0.8756, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 5.36% (0.7506 => 0.7908, std. dev.: 0.0017) MultiSource/Applications/Burg/burg: 5.25% (1.1061 => 1.1642, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.21% (0.7460 => 0.7849, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 5.20% (1.2292 => 1.2931, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 5.19% (3.8646 => 4.0650, std. dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 5.18% (1.0594 => 1.1143, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.18% (3.6692 => 3.8593, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.15% (0.4113 => 0.4325, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.00% (0.6135 => 0.6442, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.4791 => 0.5030, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.85% (0.6283 => 0.6588, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.84% (4.3801 => 4.5921, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.83% (4.4433 => 4.6580, std. dev.: 0.0062) MultiSource/Applications/treecc/treecc: 4.79% (1.9270 => 2.0193, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 4.77% (2.1791 => 2.2831, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.71% (0.3755 => 0.3932, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.66% (0.3220 => 0.3370, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.59% (0.8818 => 0.9223, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8934, std. dev.: 0.0110) MultiSource/Applications/kimwitu++/kc: 4.55% (16.6129 => 17.3686, std. dev.: 0.0144) MultiSource/Applications/JM/lencod/lencod: 4.43% (14.8535 => 15.5112, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.09% (1.1333 => 1.1797, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.09% (0.3131 => 0.3259, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 4.08% (3.1889 => 3.3189, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 4.05% (4.6629 => 4.8516, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.89% (0.8698 => 0.9036, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.85% (8.4961 => 8.8228, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.76% (4.9865 => 5.1741, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.70% (0.3245 => 0.3365, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.64% (6.5754 => 6.8150, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.45% (3.2742 => 3.3873, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.19% (14.5298 => 14.9931, std. dev.: 0.0166) MultiSource/Applications/sqlite3/sqlite3: 3.10% (16.2614 => 16.7650, std. dev.: 0.0196) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.94% (0.9108 => 0.9376, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6250 => 0.6407, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.31% (3.7467 => 3.8332, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.23% (2.1007 => 2.1476, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.99% (1.0313 => 1.0518, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.96% (0.6744 => 0.6876, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.83% (6.2785 => 6.3932, std. dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2965, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 1.61% (33.2944 => 33.8319, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0186) MultiSource/Benchmarks/McCat/17-bintr/bintr: 10.87% (0.0957 => 0.1061, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 10.68% (1.2998 => 1.4386, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0057, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.49% (11.2619 => 11.7672, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9836, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5968, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.11% (10.7476 => 10.9745, std. dev.: 0.0708) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6763, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.18% (1.5089 => 1.5267, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6869, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.07% (26.5159 => 26.8003, std. dev.: 0.0417) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.65% (22.5627 => 21.2877, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.80% (1.3780 => 1.3119, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0211, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5943, std. dev.: 0.0218) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9617, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2363, std. dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3305 => 7.1986, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0162) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.31% (9.9194 => 9.7897, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3630, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.21% (5.5401 => 5.4729, std. dev.: 0.0157) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.15% (6.6320 => 6.5559, std. dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.14% (20.3410 => 20.1093, std. dev.: 0.0352) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 08:05:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 10:05:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823150545.74FB12A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3152?compare_to=3149&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3152, Order: 162441, Start Time: 2012-08-23 13:47:37, End Time: 2012-08-23 15:06:39 To: 3149, Order: 162440, Start Time: 2012-08-23 12:00:39, End Time: 2012-08-23 13:20:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.69% (54.5452 => 55.4693, std. dev.: 0.2413) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.55% (10.3673 => 13.3272, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 14.02% (0.3473 => 0.3960, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.73% (0.3561 => 0.4050, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.58% (0.3543 => 0.4024, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.53% (0.3497 => 0.3970, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.48% (0.3516 => 0.3990, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.46% (0.3543 => 0.4020, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 13.21% (0.3694 => 0.4182, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.62% (0.3828 => 0.4311, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.40% (0.3927 => 0.4414, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.30% (0.3886 => 0.4364, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.16% (1.1194 => 1.2555, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.00% (1.7609 => 1.9546, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.98% (2.2022 => 2.4000, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 8.94% (0.1432 => 0.1560, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.19% (0.1892 => 0.2028, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.14% (0.7326 => 0.7849, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (0.1584 => 0.1697, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.00% (0.4615 => 0.4892, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 5.79% (0.3282 => 0.3472, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.65% (0.3307 => 0.3494, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.56% (7.0540 => 7.4459, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 5.16% (9.4845 => 9.9743, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.02% (0.2271 => 0.2385, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.92% (4.9449 => 5.1882, std. dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.7433 => 0.7797, std. dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.89% (0.2107 => 0.2210, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 4.88% (0.4299 => 0.4509, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.86% (5.0018 => 5.2448, std. dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: 4.70% (0.2554 => 0.2674, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.62% (4.2646 => 4.4618, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 4.60% (0.3109 => 0.3252, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.58% (0.8172 => 0.8546, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.57% (0.4636 => 0.4848, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.51% (0.5569 => 0.5820, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.46% (0.2891 => 0.3020, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.42% (0.3121 => 0.3259, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.39% (0.5860 => 0.6117, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.35% (0.3423 => 0.3572, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.33% (8.1363 => 8.4887, std. dev.: 0.0098) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.25% (1.3050 => 1.3604, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 4.19% (10.4361 => 10.8736, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 4.12% (0.7835 => 0.8158, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 4.10% (0.2831 => 0.2947, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.08% (0.2871 => 0.2988, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.04% (0.3441 => 0.3580, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 4.00% (0.2725 => 0.2834, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.96% (0.2700 => 0.2807, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.95% (0.2758 => 0.2867, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.94% (0.3098 => 0.3220, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 3.93% (0.3052 => 0.3172, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.93% (0.3232 => 0.3359, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.88% (5.7591 => 5.9824, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.87% (0.2793 => 0.2901, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3422 => 0.3553, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.81% (0.3180 => 0.3301, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.80% (0.4103 => 0.4259, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.79% (1.5603 => 1.6195, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3650 => 0.3788, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.78% (0.3283 => 0.3407, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.76% (1.5415 => 1.5994, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.76% (2.0665 => 2.1441, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 3.75% (0.2877 => 0.2985, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.75% (0.4289 => 0.4450, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.75% (0.9765 => 1.0131, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (0.3935 => 0.4082, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.72% (0.3603 => 0.3737, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.71% (0.2802 => 0.2906, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.69% (0.3092 => 0.3206, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.67% (0.3162 => 0.3278, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1861 => 1.2294, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (0.4064 => 0.4212, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6450 => 0.6684, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 3.61% (0.3379 => 0.3501, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.60% (0.5105 => 0.5289, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.60% (0.3136 => 0.3249, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.8067 => 0.8357, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3826 => 0.3963, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.47% (0.3684 => 0.3812, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.45% (0.4203 => 0.4348, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.40% (1.1642 => 1.2038, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: 3.38% (0.4048 => 0.4185, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.28% (0.6456 => 0.6668, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.28% (0.6675 => 0.6894, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.23% (0.4620 => 0.4769, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.18% (1.2842 => 1.3250, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.13% (3.3354 => 3.4398, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.13% (0.5981 => 0.6168, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.03% (2.0273 => 2.0887, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 2.95% (3.8723 => 3.9867, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7905, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8921 => 0.9175, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.75% (1.4186 => 1.4576, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.71% (0.5020 => 0.5156, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.45% (2.2969 => 2.3532, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 2.28% (17.1811 => 17.5720, std. dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 2.16% (1.1840 => 1.2096, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.2024 => 2.2495, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 2.14% (0.7115 => 0.7267, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.60% (1.0722 => 1.0894, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.57% (21.9371 => 22.2822, std. dev.: 0.0272) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.49% (7.9617 => 8.0806, std. dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (4.2280 => 4.4311, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.67% (0.2944 => 0.3052, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7485, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 2.98% (26.0924 => 26.8701, std. dev.: 0.0160) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3343, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.51% (9.1159 => 9.2533, std. dev.: 0.0421) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (1.5086 => 1.5284, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 1.19% (3.1578 => 3.1955, std. dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.12% (5.2763 => 3.2124, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7066, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.80% (5.3526 => 3.7041, std. dev.: 0.0104) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1229, std. dev.: 0.0643) MultiSource/Applications/ClamAV/clamscan: -14.11% (22.1758 => 19.0466, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.80% (2.9384 => 2.5622, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -11.04% (1.2373 => 1.1007, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -8.54% (1.5373 => 1.4060, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0591, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8046, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4762, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4269, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.66% (10.2830 => 10.0093, std. dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.21% (8.1563 => 7.9759, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3467, std. dev.: 0.0061) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8128, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 07:55:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 09:55:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823145546.B154F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3151?compare_to=3148&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3151, Order: 162441, Start Time: 2012-08-23 13:42:23, End Time: 2012-08-23 14:56:40 To: 3148, Order: 162440, Start Time: 2012-08-23 12:00:41, End Time: 2012-08-23 13:14:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (159 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (698 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.72% (2.2634 => 2.3476, std. dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.91% (78.3969 => 80.6784, std. dev.: 0.1534) SingleSource/Regression/C/uint64_to_float: 2.05% (0.5326 => 0.5435, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.71% (55.5582 => 56.5062, std. dev.: 0.1033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std. dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 15.29% (2.0176 => 2.3260, std. dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference-object: 10.59% (0.5818 => 0.6434, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.49% (0.5748 => 0.6351, std. dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference: 10.32% (0.7061 => 0.7790, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.73% (0.1819 => 0.1996, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.31% (0.3578 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.28% (0.3601 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.18% (0.3650 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.13% (0.3646 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.00% (0.3789 => 0.4130, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.89% (0.4003 => 0.4359, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.84% (0.3914 => 0.4260, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1413 => 0.1536, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 8.45% (0.2781 => 0.3016, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 8.34% (0.4328 => 0.4689, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 8.31% (1.3693 => 1.4831, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2782 => 0.3012, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.20% (0.7710 => 0.8342, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 8.10% (0.4062 => 0.4391, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 8.02% (0.2607 => 0.2816, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (3.9660 => 4.2835, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 7.88% (0.2690 => 0.2902, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.88% (0.2628 => 0.2835, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.86% (0.2760 => 0.2977, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.83% (0.2655 => 0.2863, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.80% (0.2937 => 0.3166, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.78% (0.2765 => 0.2980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2726 => 0.2937, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2761 => 0.2974, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.68% (0.3022 => 0.3254, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.2966 => 0.3193, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.60% (0.2696 => 0.2901, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.55% (1.9828 => 2.1325, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5265 => 0.5661, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.51% (0.2596 => 0.2791, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.50% (0.7038 => 0.7566, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3149 => 0.3383, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.39% (0.3899 => 0.4187, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.31% (0.3489 => 0.3744, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.29% (0.3485 => 0.3739, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.27% (0.3192 => 0.3424, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4390 => 0.4709, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.20% (0.2988 => 0.3203, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.18% (0.6959 => 0.7459, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 7.12% (0.3453 => 0.3699, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.11% (0.1435 => 0.1537, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.06% (0.9199 => 0.9848, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.01% (1.2193 => 1.3048, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.92% (0.4016 => 0.4294, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.4379 => 0.4681, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.74% (0.3293 => 0.3515, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3534 => 0.3768, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.1364 => 1.2084, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.31% (0.3756 => 0.3993, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2127 => 0.2261, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.17% (0.5577 => 0.5921, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.12% (0.5637 => 0.5982, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.12% (13.8202 => 14.6656, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (1.4563 => 1.5435, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.93% (1.3819 => 1.4638, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 5.88% (0.2995 => 0.3171, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.2914 => 0.3084, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.81% (1.2292 => 1.3006, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.78% (0.2023 => 0.2140, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 5.78% (0.2925 => 0.3094, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (7.2180 => 7.6261, std. dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.63% (1.3813 => 1.4590, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.52% (0.7460 => 0.7872, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 5.46% (0.8310 => 0.8764, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 5.44% (0.2243 => 0.2365, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.44% (0.7506 => 0.7914, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 5.43% (3.8646 => 4.0743, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.38% (1.3245 => 1.3958, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4113 => 0.4334, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.33% (1.1061 => 1.1650, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 5.32% (1.0594 => 1.1158, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.27% (3.6692 => 3.8625, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 5.14% (1.9270 => 2.0260, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.11% (0.4791 => 0.5036, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.06% (0.6283 => 0.6601, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.03% (4.3801 => 4.6006, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: 4.91% (0.3220 => 0.3378, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.88% (4.4433 => 4.6603, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.78% (0.6135 => 0.6428, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 4.75% (2.1791 => 2.2825, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 4.73% (16.6129 => 17.3984, std. dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.61% (13.2842 => 13.8968, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.57% (0.8818 => 0.9221, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.43% (14.8535 => 15.5120, std. dev.: 0.0183) MultiSource/Benchmarks/sim/sim: 4.28% (0.3131 => 0.3265, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.23% (0.8698 => 0.9066, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.16% (4.6629 => 4.8571, std. dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.12% (1.1333 => 1.1800, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 4.05% (3.1889 => 3.3179, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.3245 => 0.3376, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (8.4961 => 8.8246, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.79% (4.9865 => 5.1756, std. dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (6.5754 => 6.8176, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 3.60% (0.2859 => 0.2962, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.47% (3.2742 => 3.3877, std. dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 3.20% (14.5298 => 14.9951, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/bigfib: 3.18% (0.6250 => 0.6449, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 3.04% (16.2614 => 16.7564, std. dev.: 0.0189) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.00% (0.9108 => 0.9381, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.89% (1.5188 => 1.5627, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (2.1007 => 2.1491, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.4805 => 0.4912, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.20% (3.7467 => 3.8290, std. dev.: 0.0039) MultiSource/Applications/lemon/lemon: 2.06% (1.0313 => 1.0525, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 2.02% (0.6744 => 0.6880, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.99% (6.2785 => 6.4037, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.53% (33.2944 => 33.8033, std. dev.: 0.0243) MultiSource/Applications/SIBsim4/SIBsim4: 1.51% (1.2749 => 1.2942, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5113, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/fbench: 29.17% (1.8175 => 2.3476, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.42% (1.2998 => 1.4222, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.98% (1.5824 => 1.6612, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7425, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.53% (1.9199 => 1.9877, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.40% (10.7476 => 11.0051, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5935, std. dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4566, std. dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6765, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.57% (3.2729 => 3.3242, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.19% (26.5159 => 26.8309, std. dev.: 0.0208) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.59% (22.5627 => 21.3006, std. dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.40% (1.2308 => 1.0905, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5115, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.58% (1.1560 => 1.1031, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.37% (1.3780 => 1.3178, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.78% (0.4867 => 0.4683, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5842, std. dev.: 0.0160) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2258, std. dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2038, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3566, std. dev.: 0.0105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4761, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.03% (20.3410 => 20.1309, std. dev.: 0.0247) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 06:22:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 08:22:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120823132253.64D072A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3150?compare_to=3146&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3150, Order: 162438, Start Time: 2012-08-23 10:40:14, End Time: 2012-08-23 13:23:48 To: 3146, Order: 162430, Start Time: 2012-08-23 07:28:57, End Time: 2012-08-23 10:12:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (118 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (760 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.05% (1.0191 => 1.0298, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.2133 => 0.2273, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 13.54% (0.3442 => 0.3908, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.46% (0.3469 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.45% (0.3465 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.42% (0.3488 => 0.3956, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3643 => 0.4113, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.85% (0.3650 => 0.4119, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.49% (0.3724 => 0.4189, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.07% (0.1063 => 0.1170, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.01% (1.5932 => 1.7526, std. dev.: 0.0165) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5826 => 0.6355, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.5889 => 0.6401, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.21% (0.7171 => 0.7688, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.72% (0.2738 => 0.2922, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2875 => 0.3068, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.63% (1.3152 => 1.4024, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 6.62% (0.2750 => 0.2932, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.56% (0.3004 => 0.3201, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.54% (3.5627 => 3.7958, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2729 => 0.2907, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.52% (1.6211 => 1.7268, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.45% (0.2792 => 0.2972, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.38% (0.2823 => 0.3003, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2811 => 0.2988, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2780 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2803 => 0.2979, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.26% (0.3195 => 0.3395, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.25% (2.0673 => 2.1966, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.3096 => 0.3289, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.21% (0.3060 => 0.3250, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.20% (0.9697 => 1.0298, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 6.20% (0.9909 => 1.0523, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.16% (0.3362 => 0.3569, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.2911 => 0.3090, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (0.4994 => 0.5301, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 6.11% (0.3258 => 0.3457, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3267 => 0.3466, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (0.5026 => 0.5327, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.94% (0.3317 => 0.3514, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.86% (0.5000 => 0.5293, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.83% (0.3124 => 0.3306, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 5.76% (0.3678 => 0.3890, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.69% (0.4361 => 0.4609, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 5.68% (0.3348 => 0.3538, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.64% (0.3282 => 0.3467, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (0.3930 => 0.4151, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.58% (0.5900 => 0.6229, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (0.3625 => 0.3827, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.57% (0.3845 => 0.4059, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 5.46% (1.0781 => 1.1370, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 5.41% (4.2109 => 4.4387, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: 5.29% (0.3477 => 0.3661, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.29% (0.4029 => 0.4242, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.24% (0.3890 => 0.4094, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 5.20% (0.4251 => 0.4472, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.09% (0.4146 => 0.4357, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.01% (0.3690 => 0.3875, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.95% (0.3981 => 0.4178, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.75% (0.2736 => 0.2866, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.71% (0.2866 => 0.3001, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (2.7292 => 2.8552, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 4.61% (5.5417 => 5.7974, std. dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 4.55% (2.1013 => 2.1969, std. dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.48% (0.2566 => 0.2681, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (0.4658 => 0.4857, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.22% (1.9694 => 2.0525, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (1.9966 => 2.0806, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.19% (4.4195 => 4.6048, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 4.08% (1.8794 => 1.9560, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.5012 => 0.5216, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.99% (0.6435 => 0.6692, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (2.1653 => 2.2516, std. dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 3.95% (23.5202 => 24.4490, std. dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: 3.95% (4.6177 => 4.8000, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.91% (0.2737 => 0.2844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.3903 => 0.4053, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 3.75% (0.6634 => 0.6883, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.72% (0.4139 => 0.4293, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 3.67% (1.4269 => 1.4792, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.66% (0.3084 => 0.3197, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.64% (0.5546 => 0.5748, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 3.58% (0.7875 => 0.8157, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.3271 => 0.3386, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.72% (2.0346 => 2.0899, std. dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 2.21% (0.4847 => 0.4954, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.36% (0.7426 => 0.7527, std. dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.13% (11.6398 => 11.7710, std. dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (4.6926 => 4.7437, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.2122 => 0.2273, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.64% (3.3903 => 3.6155, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6674, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1682, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 4.60% (1.8057 => 1.8887, std. dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6547, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1949, std. dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5014, std. dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.75% (3.1722 => 3.2277, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4424, std. dev.: 0.0221) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6018, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4589, std. dev.: 0.0284) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.62% (2.4764 => 2.4116, std. dev.: 0.0195) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5635, std. dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8115, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: -6.08% (0.2402 => 0.2256, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7996, std. dev.: 0.0055) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.39% (17.2379 => 16.8252, std. dev.: 0.0305) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5743, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9632, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 06:19:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 08:19:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823131908.4D31E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3149?compare_to=3147&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3149, Order: 162440, Start Time: 2012-08-23 12:00:39, End Time: 2012-08-23 13:20:01 To: 3147, Order: 162438, Start Time: 2012-08-23 09:19:54, End Time: 2012-08-23 10:39:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (133 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (705 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.29% (1.0922 => 1.1063, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.49% (10.3673 => 13.3211, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 13.76% (0.3473 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.59% (0.3516 => 0.3994, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.51% (0.3561 => 0.4042, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3497 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.43% (0.3543 => 0.4019, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.41% (0.3543 => 0.4018, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.89% (0.3694 => 0.4170, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.64% (0.3828 => 0.4312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.33% (0.3886 => 0.4365, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.26% (1.1194 => 1.2566, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.10% (1.7609 => 1.9564, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 10.54% (0.1432 => 0.1583, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.99% (2.2022 => 2.4002, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.20% (0.1584 => 0.1698, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.14% (0.1892 => 0.2027, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.92% (0.4615 => 0.4888, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 5.82% (0.3282 => 0.3473, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.56% (7.0540 => 7.4460, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.50% (0.3307 => 0.3489, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.45% (0.4879 => 0.5145, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.25% (9.4845 => 9.9829, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.02% (0.2271 => 0.2385, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.7433 => 0.7797, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.89% (5.0018 => 5.2462, std. dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 4.88% (0.4299 => 0.4509, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.88% (4.9449 => 5.1862, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.84% (0.2107 => 0.2209, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.76% (0.8172 => 0.8561, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 4.73% (0.3109 => 0.3256, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (4.2646 => 4.4626, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 4.54% (0.2905 => 0.3037, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.53% (0.2891 => 0.3022, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.53% (0.5569 => 0.5821, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.51% (1.3050 => 1.3638, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.49% (0.5860 => 0.6123, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.49% (0.4636 => 0.4844, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.49% (0.3121 => 0.3261, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 4.44% (0.3423 => 0.3575, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.34% (8.1363 => 8.4898, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.23% (0.5105 => 0.5321, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.17% (0.2831 => 0.2949, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.17% (1.5603 => 1.6253, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 4.16% (10.4361 => 10.8703, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.14% (0.2872 => 0.2991, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.11% (0.7835 => 0.8157, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/wc: 4.10% (0.3052 => 0.3177, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.07% (0.2725 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.07% (0.3098 => 0.3224, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.01% (0.2871 => 0.2986, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.00% (0.2700 => 0.2808, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.99% (0.2756 => 0.2866, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.98% (0.9765 => 1.0154, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.98% (0.3441 => 0.3578, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3422 => 0.3558, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.96% (0.3232 => 0.3360, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.94% (5.7591 => 5.9860, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.93% (0.3283 => 0.3412, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.92% (0.2758 => 0.2866, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 3.90% (0.3180 => 0.3304, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.88% (0.3865 => 0.4015, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6450 => 0.6699, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.83% (0.3162 => 0.3283, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.82% (0.4289 => 0.4453, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 3.78% (0.2802 => 0.2908, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3650 => 0.3788, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.77% (1.5415 => 1.5996, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.72% (2.0665 => 2.1434, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 3.72% (0.2877 => 0.2984, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 3.67% (0.3379 => 0.3503, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (1.1861 => 1.2295, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.3092 => 0.3205, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.62% (0.4064 => 0.4211, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3826 => 0.3964, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.3136 => 0.3248, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.45% (0.3684 => 0.3811, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.40% (0.8067 => 0.8341, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 3.39% (1.1642 => 1.2037, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.33% (1.2842 => 1.3269, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.31% (0.6456 => 0.6670, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.4203 => 0.4341, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4620 => 0.4771, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.25% (0.6675 => 0.6892, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 3.19% (3.8723 => 3.9959, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 3.19% (0.4048 => 0.4177, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.13% (3.3354 => 3.4399, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.08% (0.5981 => 0.6165, std. dev.: 0.0039) MultiSource/Applications/treecc/treecc: 3.06% (2.0273 => 2.0894, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8059, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.90% (1.4186 => 1.4598, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8921 => 0.9179, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.5020 => 0.5152, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.55% (1.5859 => 1.6263, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.55% (2.2969 => 2.3554, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.37% (17.1811 => 17.5875, std. dev.: 0.0155) MultiSource/Applications/minisat/minisat: 2.22% (0.7115 => 0.7273, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.2024 => 2.2509, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 2.17% (1.1840 => 1.2097, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.65% (1.0722 => 1.0899, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.62% (21.9371 => 22.2920, std. dev.: 0.0250) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (7.9617 => 8.0889, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (4.2280 => 4.4320, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.63% (0.2944 => 0.3051, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7493, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 2.94% (26.0924 => 26.8591, std. dev.: 0.0451) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3342, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7979, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5086 => 1.5278, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2256, std. dev.: 0.0080) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.09% (3.1578 => 3.1923, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 1.05% (2.2771 => 2.3011, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5769, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6819, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.17% (5.2763 => 3.2094, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7047, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7095, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1739, std. dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: -14.16% (22.1758 => 19.0352, std. dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.80% (2.9384 => 2.5622, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2373 => 1.1063, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -8.94% (1.5373 => 1.3998, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std. dev.: 0.0008) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4621, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4276, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0023, std. dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9606, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std. dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3427, std. dev.: 0.0040) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8128, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 06:14:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 08:14:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823131403.E67652A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3148?compare_to=3145&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3148, Order: 162440, Start Time: 2012-08-23 12:00:41, End Time: 2012-08-23 13:14:58 To: 3145, Order: 162438, Start Time: 2012-08-23 08:28:58, End Time: 2012-08-23 09:43:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (161 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.61% (3.7556 => 3.8535, std. dev.: 0.0209) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.30% (2.0176 => 2.3262, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.51% (0.0770 => 0.0874, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 10.52% (0.5818 => 0.6430, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.46% (0.5748 => 0.6349, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.20% (0.7061 => 0.7781, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.51% (0.1819 => 0.1992, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3578 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.30% (0.3646 => 0.3985, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.25% (0.3601 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.99% (0.3650 => 0.3978, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.94% (0.3623 => 0.3947, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.87% (0.3914 => 0.4261, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.78% (0.1413 => 0.1537, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.55% (0.3940 => 0.4277, std. dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.2781 => 0.3017, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.47% (0.7710 => 0.8363, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.32% (1.3693 => 1.4832, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2782 => 0.3010, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.07% (3.9660 => 4.2862, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hello: 7.98% (0.2607 => 0.2815, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.84% (0.2690 => 0.2901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4062 => 0.4380, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.81% (0.3022 => 0.3258, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.80% (0.2628 => 0.2833, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.79% (0.2760 => 0.2975, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2765 => 0.2979, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2726 => 0.2935, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.2966 => 0.3193, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.65% (1.9828 => 2.1344, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2761 => 0.2972, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.59% (0.2596 => 0.2793, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.51% (0.3899 => 0.4192, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.50% (0.7038 => 0.7566, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.49% (0.2696 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.46% (0.3149 => 0.3384, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.46% (0.2721 => 0.2924, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4390 => 0.4715, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 7.36% (0.2988 => 0.3208, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.5265 => 0.5651, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 7.21% (0.3192 => 0.3422, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4379 => 0.4694, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.17% (0.6959 => 0.7458, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 7.15% (0.3453 => 0.3700, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.15% (0.3580 => 0.3836, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.08% (1.2193 => 1.3056, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.07% (0.9199 => 0.9849, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.71% (0.3293 => 0.3514, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.67% (0.4016 => 0.4284, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.55% (0.1588 => 0.1692, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.46% (1.4563 => 1.5504, std. dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.45% (0.2914 => 0.3102, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.39% (1.1364 => 1.2090, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.28% (0.3756 => 0.3992, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2127 => 0.2259, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5577 => 0.5922, std. dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 6.15% (13.8202 => 14.6704, std. dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.96% (0.5637 => 0.5973, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.93% (1.3819 => 1.4639, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.88% (0.2925 => 0.3097, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.83% (0.2023 => 0.2141, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 5.74% (0.2995 => 0.3167, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.74% (0.7506 => 0.7937, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.74% (0.1865 => 0.1972, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.72% (0.7460 => 0.7887, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (1.3813 => 1.4601, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.70% (1.2292 => 1.2993, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.65% (7.2180 => 7.6256, std. dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 5.57% (0.2243 => 0.2368, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.42% (1.1061 => 1.1660, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.38% (0.8310 => 0.8757, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.38% (3.6692 => 3.8665, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.36% (1.3245 => 1.3955, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 5.35% (0.4113 => 0.4333, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.30% (3.8646 => 4.0694, std. dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 5.22% (1.0594 => 1.1147, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.08% (0.6283 => 0.6602, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.07% (0.4791 => 0.5034, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.04% (1.9270 => 2.0241, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.03% (4.3801 => 4.6005, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.93% (4.4433 => 4.6622, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.79% (0.6135 => 0.6429, std. dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 4.78% (16.6129 => 17.4076, std. dev.: 0.0212) MultiSource/Benchmarks/McCat/18-imp/imp: 4.78% (0.3220 => 0.3374, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.73% (2.1791 => 2.2822, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (13.2842 => 13.9033, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.58% (0.8818 => 0.9222, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.43% (14.8535 => 15.5113, std. dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.23% (0.8698 => 0.9066, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.19% (4.6629 => 4.8585, std. dev.: 0.0120) MultiSource/Benchmarks/sim/sim: 4.12% (0.3131 => 0.3260, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.07% (0.3245 => 0.3377, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.04% (1.1333 => 1.1791, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 4.01% (3.1889 => 3.3169, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.89% (4.9865 => 5.1807, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (8.4961 => 8.8220, std. dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 3.69% (6.5754 => 6.8182, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.52% (3.2742 => 3.3894, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 3.21% (14.5298 => 14.9966, std. dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 3.01% (16.2614 => 16.7511, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.99% (0.9108 => 0.9380, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.94% (0.6250 => 0.6434, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (1.5188 => 1.5628, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1007 => 2.1517, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.23% (3.7467 => 3.8304, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.4805 => 0.4910, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.12% (0.6744 => 0.6887, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.07% (1.0313 => 1.0526, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.00% (6.2785 => 6.4039, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.55% (33.2944 => 33.8120, std. dev.: 0.0368) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2634, std. dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.60% (1.2998 => 1.4116, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (0.2093 => 0.2212, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.37% (11.2619 => 11.7540, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3853, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.38% (10.7476 => 11.0039, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5937, std. dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 2.13% (3.7731 => 3.8535, std. dev.: 0.0209) MultiSource/Applications/sqlite3/sqlite3: 1.89% (4.5928 => 4.6794, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std. dev.: 0.0044) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3257, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std. dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (1.5089 => 1.5275, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.17% (26.5159 => 26.8262, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.53% (22.5627 => 21.3147, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.36% (1.2308 => 1.0910, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.90% (1.3780 => 1.3243, std. dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.76% (0.4867 => 0.4684, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6048, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: -2.49% (1.9762 => 1.9270, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9617, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2345, std. dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2036, std. dev.: 0.0278) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7925, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3611, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.24% (20.3410 => 20.0885, std. dev.: 0.0239) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.13% (5.5401 => 5.4774, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.11% (6.6320 => 6.5582, std. dev.: 0.0103) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2400, std. dev.: 0.0322) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 03:38:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 05:38:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823103817.916522A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3147?compare_to=3144&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3147, Order: 162438, Start Time: 2012-08-23 09:19:54, End Time: 2012-08-23 10:39:10 To: 3144, Order: 162430, Start Time: 2012-08-23 07:32:30, End Time: 2012-08-23 08:52:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.25% (54.5339 => 55.7603, std. dev.: 0.4072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.82% (13.4815 => 13.2361, std. dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.67% (10.3673 => 13.2361, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3561 => 0.4029, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 12.98% (0.3497 => 0.3951, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3543 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.88% (0.3516 => 0.3969, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3543 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.51% (0.3694 => 0.4156, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.12% (0.3828 => 0.4292, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3927 => 0.4395, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.73% (0.3886 => 0.4342, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.30% (1.7609 => 1.9599, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.45% (2.2022 => 2.4102, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 8.94% (0.1432 => 0.1560, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.34% (0.6030 => 0.6533, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1584 => 0.1700, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std. dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.03% (0.1892 => 0.2025, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.3177 => 0.3388, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 6.47% (0.1622 => 0.1727, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.03% (0.3282 => 0.3480, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.02% (0.4615 => 0.4893, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.79% (7.0540 => 7.4627, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3307 => 0.3497, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.41% (0.4879 => 0.5143, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.20% (9.4845 => 9.9776, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.19% (0.2891 => 0.3041, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.03% (0.2107 => 0.2213, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.02% (0.2271 => 0.2385, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.99% (0.2905 => 0.3050, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (4.9449 => 5.1910, std. dev.: 0.0201) MultiSource/Benchmarks/McCat/05-eks/eks: 4.95% (0.4299 => 0.4512, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.95% (5.0018 => 5.2496, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (0.7433 => 0.7799, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4636 => 0.4862, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.86% (0.3109 => 0.3260, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 4.70% (0.2725 => 0.2853, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.69% (0.5860 => 0.6135, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.66% (0.8172 => 0.8553, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.66% (0.2554 => 0.2673, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 4.63% (0.2831 => 0.2962, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.61% (0.2756 => 0.2883, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.58% (4.2646 => 4.4598, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.56% (0.2872 => 0.3003, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 4.54% (0.3283 => 0.3432, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.52% (0.3052 => 0.3190, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.52% (0.3232 => 0.3378, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2871 => 0.3000, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3098 => 0.3237, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.47% (0.3423 => 0.3576, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 4.46% (0.2714 => 0.2835, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.45% (0.3121 => 0.3260, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.44% (0.2793 => 0.2917, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.38% (0.3422 => 0.3572, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (1.3050 => 1.3622, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.38% (0.5569 => 0.5813, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.36% (1.5603 => 1.6283, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.30% (2.0665 => 2.1554, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.29% (0.4103 => 0.4279, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.28% (8.1363 => 8.4844, std. dev.: 0.0087) MultiSource/Applications/oggenc/oggenc: 4.25% (5.7591 => 6.0037, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 4.25% (0.3603 => 0.3756, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 4.20% (10.4361 => 10.8741, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.18% (0.3136 => 0.3267, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 4.15% (0.4289 => 0.4467, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 4.14% (0.2877 => 0.2996, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 4.11% (0.3379 => 0.3518, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.07% (0.2700 => 0.2810, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.5105 => 0.5312, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3826 => 0.3980, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3935 => 0.4092, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.97% (0.7835 => 0.8146, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.95% (0.3441 => 0.3577, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.94% (0.3684 => 0.3829, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.80% (0.9765 => 1.0136, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6450 => 0.6693, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 3.74% (0.3180 => 0.3299, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4203 => 0.4360, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.73% (0.4048 => 0.4199, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.73% (1.5415 => 1.5990, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 3.69% (0.3092 => 0.3206, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1861 => 1.2294, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 3.64% (0.4620 => 0.4788, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.62% (1.2842 => 1.3307, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 3.60% (0.3387 => 0.3509, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.54% (0.6675 => 0.6911, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.6456 => 0.6680, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.46% (0.8067 => 0.8346, std. dev.: 0.0026) MultiSource/Applications/Burg/burg: 3.37% (1.1642 => 1.2034, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 3.16% (3.3354 => 3.4408, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.12% (2.0273 => 2.0905, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.04% (3.8723 => 3.9902, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7952, std. dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8921 => 0.9187, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5981 => 0.6158, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.4186 => 1.4605, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.75% (0.5020 => 0.5158, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.60% (1.5859 => 1.6271, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 2.59% (2.2969 => 2.3563, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.40% (17.1811 => 17.5938, std. dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.2024 => 2.2546, std. dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.1840 => 1.2105, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.21% (0.7115 => 0.7272, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.73% (1.0722 => 1.0908, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.68% (21.9371 => 22.3062, std. dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.62% (7.9617 => 8.0904, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.02% (4.2280 => 4.4401, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 3.03% (26.0924 => 26.8839, std. dev.: 0.0164) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7470, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 1.55% (2.2771 => 2.3124, std. dev.: 0.0106) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2560, std. dev.: 0.0298) MultiSource/Applications/siod/siod: 1.53% (3.2827 => 3.3328, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.12% (3.1578 => 3.1932, std. dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std. dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.27% (5.2763 => 3.2044, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.04% (5.3855 => 3.7138, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7168, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2252, std. dev.: 0.0139) MultiSource/Applications/ClamAV/clamscan: -14.10% (22.1758 => 19.0501, std. dev.: 0.0407) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.96% (2.9384 => 2.5577, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -11.73% (1.2373 => 1.0922, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel-2: -7.76% (1.5373 => 1.4180, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.1396 => 1.0594, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4780, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (8.6802 => 8.4259, std. dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0055, std. dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9579, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3500, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 03:11:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 05:11:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120823101140.6C00C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3146?compare_to=3141&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3146, Order: 162430, Start Time: 2012-08-23 07:28:57, End Time: 2012-08-23 10:12:31 To: 3141, Order: 162425, Start Time: 2012-08-23 04:11:09, End Time: 2012-08-23 06:54:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (113 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (765 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.05% (2.0747 => 2.1172, std. dev.: 0.0154) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.61% (0.3465 => 0.3902, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3442 => 0.3876, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.51% (0.3446 => 0.3877, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3460 => 0.3891, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.41% (0.3496 => 0.3930, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/synchronized: 12.40% (0.3469 => 0.3899, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.95% (0.3650 => 0.4086, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3643 => 0.4078, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.68% (0.3724 => 0.4159, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1063 => 0.1172, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.86% (1.5932 => 1.7503, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5826 => 0.6319, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.07% (0.5889 => 0.6364, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.1619 => 0.1729, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.60% (0.7171 => 0.7644, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.13% (1.6211 => 1.7205, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.05% (0.2875 => 0.3049, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.05% (3.5627 => 3.7783, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.00% (1.3152 => 1.3941, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2729 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.76% (0.2725 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2738 => 0.2895, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (0.5000 => 0.5285, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.69% (0.2792 => 0.2951, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.67% (0.3195 => 0.3376, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.65% (0.4994 => 0.5276, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 5.64% (0.2750 => 0.2905, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2823 => 0.2981, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.59% (0.3004 => 0.3172, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: 5.57% (0.2803 => 0.2959, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2813 => 0.2968, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2911 => 0.3070, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.46% (0.3096 => 0.3265, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.43% (0.2780 => 0.2931, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.42% (0.9909 => 1.0446, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (2.0673 => 2.1793, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.40% (1.0781 => 1.1363, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (0.3930 => 0.4142, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.37% (0.5900 => 0.6217, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.37% (0.2811 => 0.2962, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3258 => 0.3433, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (0.2014 => 0.2122, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.34% (0.4361 => 0.4594, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3267 => 0.3440, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.22% (0.3317 => 0.3490, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.19% (4.2109 => 4.4293, std. dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.12% (0.3282 => 0.3450, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.09% (0.9697 => 1.0191, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3362 => 0.3531, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.03% (0.3124 => 0.3281, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.98% (0.3678 => 0.3861, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.96% (0.3348 => 0.3514, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.94% (0.4029 => 0.4228, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3060 => 0.3211, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.83% (0.3726 => 0.3906, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 4.80% (0.3477 => 0.3644, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.3625 => 0.3799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.49% (0.4251 => 0.4442, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.2866 => 0.2994, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.46% (0.2736 => 0.2858, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3690 => 0.3854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.41% (0.4146 => 0.4329, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.37% (0.3981 => 0.4155, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.29% (0.2566 => 0.2676, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 4.27% (5.5417 => 5.7782, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.24% (0.3845 => 0.4008, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.16% (0.3890 => 0.4052, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (4.4195 => 4.5916, std. dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.86% (2.7292 => 2.8345, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 3.82% (2.1013 => 2.1816, std. dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.77% (1.9694 => 2.0437, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.76% (0.4658 => 0.4833, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 3.66% (4.6177 => 4.7867, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.3903 => 0.4045, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.4139 => 0.4289, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.60% (1.9966 => 2.0685, std. dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 3.59% (2.1653 => 2.2430, std. dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 3.54% (23.5202 => 24.3538, std. dev.: 0.0731) SingleSource/Benchmarks/Misc-C++/bigfib: 3.51% (0.5012 => 0.5188, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.6435 => 0.6660, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.47% (0.6634 => 0.6864, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.45% (0.3271 => 0.3384, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.44% (0.3084 => 0.3190, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.38% (1.8794 => 1.9430, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 3.36% (1.4269 => 1.4749, std. dev.: 0.0057) MultiSource/Applications/treecc/treecc: 3.17% (0.7875 => 0.8125, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.92% (0.5546 => 0.5708, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.52% (2.0346 => 2.0858, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 5.04% (1.8057 => 1.8967, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1651, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6495, std. dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2096, std. dev.: 0.0386) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5007, std. dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2225, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4332, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2870, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5822, std. dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.94% (2.4764 => 2.4036, std. dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5557, std. dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9791, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7931, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: -7.45% (0.2402 => 0.2223, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7999, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0045) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.18% (17.2379 => 16.8618, std. dev.: 0.0833) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5711, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9704, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 02:42:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 04:42:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823094215.417112A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3145?compare_to=3143&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3145, Order: 162438, Start Time: 2012-08-23 08:28:58, End Time: 2012-08-23 09:43:07 To: 3143, Order: 162429, Start Time: 2012-08-23 06:42:48, End Time: 2012-08-23 08:00:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (157 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (699 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.83% (56.6527 => 54.4835, std. dev.: 0.5515) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.86% (2.0176 => 2.3174, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 10.61% (0.5818 => 0.6435, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.49% (0.5748 => 0.6351, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.70% (0.7061 => 0.7746, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3578 => 0.3912, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 9.16% (0.3646 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.14% (0.3601 => 0.3930, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3663 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.03% (0.3623 => 0.3950, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.72% (0.4003 => 0.4352, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.58% (0.1819 => 0.1975, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.35% (0.1413 => 0.1531, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.13% (0.2596 => 0.2807, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.97% (0.4328 => 0.4673, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 7.87% (1.3693 => 1.4770, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.82% (0.7710 => 0.8313, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.81% (3.9660 => 4.2758, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 7.73% (0.4062 => 0.4376, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.73% (0.2782 => 0.2997, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.66% (0.7038 => 0.7577, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.62% (0.2690 => 0.2895, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.54% (0.3022 => 0.3250, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2765 => 0.2971, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2607 => 0.2801, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.39% (0.2937 => 0.3154, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.5265 => 0.5649, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.29% (0.6959 => 0.7466, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.27% (0.2655 => 0.2848, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.25% (0.2760 => 0.2960, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.17% (0.2761 => 0.2959, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2696 => 0.2889, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3899 => 0.4174, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.03% (1.9828 => 2.1222, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.00% (1.2193 => 1.3047, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3149 => 0.3368, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.94% (0.9199 => 0.9837, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3580 => 0.3828, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.3485 => 0.3724, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4379 => 0.4675, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.71% (0.3489 => 0.3723, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.70% (0.3192 => 0.3406, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.55% (0.1588 => 0.1692, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4390 => 0.4677, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.43% (0.1789 => 0.1904, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 6.35% (0.3293 => 0.3502, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.3534 => 0.3755, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.22% (1.1364 => 1.2071, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.20% (0.4016 => 0.4265, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.18% (0.3868 => 0.4107, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.2914 => 0.3094, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.06% (0.2127 => 0.2256, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 6.05% (13.8202 => 14.6562, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.02% (0.5577 => 0.5913, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2023 => 0.2144, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.95% (1.4563 => 1.5430, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.87% (0.2945 => 0.3118, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.87% (0.5637 => 0.5968, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.3756 => 0.3976, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 5.64% (0.2995 => 0.3164, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.63% (0.1865 => 0.1970, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (7.2180 => 7.6236, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: 5.61% (0.2925 => 0.3089, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.57% (0.7506 => 0.7924, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.52% (1.2292 => 1.2970, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (1.3819 => 1.4580, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 5.43% (0.8310 => 0.8761, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.41% (1.3813 => 1.4560, std. dev.: 0.0057) MultiSource/Applications/Burg/burg: 5.41% (1.1061 => 1.1659, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.40% (0.4113 => 0.4335, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.38% (3.6692 => 3.8667, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 5.35% (0.2243 => 0.2363, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3755 => 0.3955, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.26% (1.3245 => 1.3942, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 5.25% (3.8646 => 4.0675, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.21% (0.7460 => 0.7849, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 5.04% (1.9270 => 2.0241, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 5.01% (1.0594 => 1.1125, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.99% (0.8818 => 0.9258, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.97% (4.3801 => 4.5976, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.91% (0.4791 => 0.5026, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.90% (0.6283 => 0.6591, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.84% (0.6135 => 0.6432, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (4.4433 => 4.6548, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 4.73% (2.1791 => 2.2821, std. dev.: 0.0174) MultiSource/Benchmarks/McCat/18-imp/imp: 4.60% (0.3220 => 0.3368, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.59% (13.2842 => 13.8945, std. dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 4.54% (16.6129 => 17.3673, std. dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: 4.49% (14.8535 => 15.5208, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 4.31% (0.3131 => 0.3266, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.11% (4.6629 => 4.8545, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.06% (1.1333 => 1.1793, std. dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.04% (0.8698 => 0.9049, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 3.93% (3.1889 => 3.3141, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.88% (0.3245 => 0.3371, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.82% (8.4961 => 8.8206, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 3.75% (6.5754 => 6.8218, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.73% (4.9865 => 5.1725, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.42% (3.2742 => 3.3863, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 3.22% (14.5298 => 14.9973, std. dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 3.03% (16.2614 => 16.7542, std. dev.: 0.0192) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.00% (0.9108 => 0.9381, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.80% (1.5188 => 1.5614, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.6250 => 0.6411, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.1007 => 2.1481, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.16% (3.7467 => 3.8276, std. dev.: 0.0113) MultiSource/Applications/lemon/lemon: 2.04% (1.0313 => 1.0523, std. dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.95% (6.2785 => 6.4008, std. dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 1.77% (1.2749 => 1.2975, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.43% (33.2944 => 33.7711, std. dev.: 0.0244) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std. dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 8.24% (1.2998 => 1.4069, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0030, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7429, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3856, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.42% (10.7476 => 11.0080, std. dev.: 0.0346) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5983, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.93% (4.5928 => 4.6815, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3262, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.27% (1.5089 => 1.5281, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.18% (9.0760 => 9.1835, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.14% (26.5159 => 26.8191, std. dev.: 0.0143) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5738, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.59% (22.5627 => 21.3018, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3511 => 0.3410, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.75% (1.2308 => 1.0985, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0118) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std. dev.: 0.0105) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -4.62% (1.1560 => 1.1026, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.81% (8.8259 => 8.5781, std. dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2235, std. dev.: 0.0063) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9635, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2032, std. dev.: 0.0302) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8646, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3527, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2311, std. dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (20.3410 => 20.1357, std. dev.: 0.0271) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 01:51:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 03:51:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823085111.2E62C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3144?compare_to=3142&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3144, Order: 162430, Start Time: 2012-08-23 07:32:30, End Time: 2012-08-23 08:52:02 To: 3142, Order: 162429, Start Time: 2012-08-23 05:40:55, End Time: 2012-08-23 07:00:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.75% (0.5342 => 0.5489, std. dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.04% (10.3673 => 13.4815, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.71% (0.0834 => 0.0940, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3543 => 0.3982, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 12.31% (0.3543 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.27% (0.3561 => 0.3998, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.24% (0.3497 => 0.3925, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3516 => 0.3943, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.87% (1.1194 => 1.2523, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.75% (0.3694 => 0.4128, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 11.49% (0.3828 => 0.4268, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.74% (1.7609 => 1.9501, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.25% (2.2022 => 2.4059, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 9.15% (0.1432 => 0.1563, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std. dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 8.11% (0.6030 => 0.6519, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.77% (0.1892 => 0.2039, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1584 => 0.1701, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 6.95% (0.7326 => 0.7835, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.4615 => 0.4922, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.42% (0.3177 => 0.3381, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 6.16% (0.1655 => 0.1757, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 6.15% (0.3282 => 0.3484, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.65% (0.3307 => 0.3494, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.45% (0.4879 => 0.5145, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.38% (7.0540 => 7.4334, std. dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: 5.30% (0.7433 => 0.7827, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.21% (9.4845 => 9.9791, std. dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.06% (0.2271 => 0.2386, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 5.02% (0.3109 => 0.3265, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.95% (4.9449 => 5.1896, std. dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 4.93% (0.2554 => 0.2680, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.89% (0.2107 => 0.2210, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (5.0018 => 5.2440, std. dev.: 0.0172) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.83% (0.8172 => 0.8567, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/05-eks/eks: 4.77% (0.4299 => 0.4504, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.74% (0.2891 => 0.3028, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.71% (4.2646 => 4.4656, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.61% (0.3121 => 0.3265, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.5860 => 0.6128, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.54% (0.5569 => 0.5822, std. dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 4.51% (0.2905 => 0.3036, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.47% (0.3423 => 0.3576, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.47% (1.3050 => 1.3633, std. dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 4.44% (5.7591 => 6.0147, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 4.43% (0.4289 => 0.4479, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.42% (0.2872 => 0.2999, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.42% (0.2831 => 0.2956, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.40% (0.2725 => 0.2845, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3098 => 0.3233, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.4103 => 0.4280, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.28% (0.2756 => 0.2874, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.28% (0.7835 => 0.8170, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3422 => 0.3568, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.19% (0.3052 => 0.3180, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.19% (0.3865 => 0.4027, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.15% (0.3232 => 0.3366, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.14% (10.4361 => 10.8680, std. dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3441 => 0.3583, std. dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4636 => 0.4827, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.11% (0.5105 => 0.5315, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 4.11% (0.2871 => 0.2989, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.11% (8.1363 => 8.4704, std. dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/hello: 4.09% (0.2714 => 0.2825, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3650 => 0.3799, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2802 => 0.2916, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.06% (2.0665 => 2.1505, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.99% (0.9765 => 1.0155, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.98% (0.3162 => 0.3288, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.94% (0.3603 => 0.3745, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.90% (1.5603 => 1.6211, std. dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.3826 => 0.3974, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.86% (0.3136 => 0.3257, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.86% (0.2877 => 0.2988, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3379 => 0.3509, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 3.81% (0.3180 => 0.3301, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.76% (1.5415 => 1.5994, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 3.75% (0.3684 => 0.3822, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.74% (0.6450 => 0.6691, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.72% (0.4064 => 0.4215, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.66% (0.8067 => 0.8362, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.66% (0.6675 => 0.6919, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.63% (1.1861 => 1.2292, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.4203 => 0.4353, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 3.46% (0.4620 => 0.4780, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.45% (0.3387 => 0.3504, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.41% (1.2842 => 1.3280, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.4048 => 0.4186, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.39% (0.6456 => 0.6675, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.38% (1.1642 => 1.2035, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5981 => 0.6173, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 3.20% (2.0273 => 2.0922, std. dev.: 0.0200) MultiSource/Applications/d/make_dparser: 3.18% (3.3354 => 3.4415, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 3.13% (0.8921 => 0.9200, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.4186 => 1.4624, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 3.03% (3.8723 => 3.9897, std. dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.93% (1.5859 => 1.6323, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7806, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.83% (0.5020 => 0.5162, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 2.80% (2.2969 => 2.3611, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (2.2024 => 2.2570, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.35% (0.7115 => 0.7282, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 2.31% (1.1840 => 1.2114, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.24% (17.1811 => 17.5652, std. dev.: 0.0240) MultiSource/Applications/lemon/lemon: 1.87% (1.0722 => 1.0923, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.49% (7.9617 => 8.0804, std. dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 1.43% (21.9371 => 22.2516, std. dev.: 0.0344) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.94% (4.2280 => 4.4369, std. dev.: 0.0131) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.80% (0.2944 => 0.3056, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7540, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 2.95% (26.0924 => 26.8619, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 1.55% (3.2827 => 3.3337, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5086 => 1.5306, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (1.3045 => 1.3228, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2279, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.17% (19.9488 => 20.1823, std. dev.: 0.0732) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5801, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 1.03% (3.1578 => 3.1902, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.38% (5.2763 => 3.1984, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7030, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7060, std. dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1256, std. dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: -14.12% (22.1758 => 19.0442, std. dev.: 0.0571) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.97% (2.9384 => 2.5574, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.97% (1.2373 => 1.1016, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -9.58% (1.5373 => 1.3901, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -6.98% (1.1396 => 1.0601, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4726, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4111, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9977, std. dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9599, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3456, std. dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8130, std. dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 4.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 23 00:59:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 02:59:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823075959.AB27D2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3143?compare_to=3140&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3143, Order: 162429, Start Time: 2012-08-23 06:42:48, End Time: 2012-08-23 08:00:51 To: 3140, Order: 162425, Start Time: 2012-08-23 05:01:06, End Time: 2012-08-23 06:15:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (119 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 206.27% (2.9662 => 9.0847, std. dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.89% (54.5293 => 56.6527, std. dev.: 0.0389) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.60% (2.0176 => 2.3324, std. dev.: 0.0490) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 10.54% (0.7061 => 0.7805, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: 10.40% (0.5818 => 0.6423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.23% (0.5748 => 0.6336, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.56% (0.3578 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.37% (0.3789 => 0.4144, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.35% (0.3646 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3650 => 0.3991, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.30% (0.3601 => 0.3936, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.29% (0.1819 => 0.1988, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/synchronized: 9.20% (0.3663 => 0.4000, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3623 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.15% (0.3914 => 0.4272, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/parameter-passing: 8.82% (0.4003 => 0.4356, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.73% (0.3940 => 0.4284, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.63% (0.1413 => 0.1535, std. dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: 8.45% (0.2781 => 0.3016, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 8.43% (1.3693 => 1.4847, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 8.34% (0.4328 => 0.4689, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.28% (0.3899 => 0.4222, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2782 => 0.3011, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.10% (3.9660 => 4.2872, std. dev.: 0.1103) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 7.98% (0.2607 => 0.2815, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.88% (0.2690 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 7.86% (0.2760 => 0.2977, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.84% (0.2628 => 0.2834, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.80% (0.2937 => 0.3166, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.76% (0.7038 => 0.7584, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2726 => 0.2936, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.67% (0.2765 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2761 => 0.2972, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.57% (0.2696 => 0.2900, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.53% (0.3107 => 0.3341, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.49% (0.3580 => 0.3848, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 7.40% (0.3149 => 0.3382, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.40% (0.2988 => 0.3209, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.39% (0.3192 => 0.3428, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.31% (0.2721 => 0.2920, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.20% (0.9199 => 0.9861, std. dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3485 => 0.3734, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.09% (1.2193 => 1.3058, std. dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/sieve: 6.89% (0.3453 => 0.3691, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.1588 => 0.1696, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.68% (0.3293 => 0.3513, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4390 => 0.4683, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.50% (0.4016 => 0.4277, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 6.28% (0.2945 => 0.3130, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.26% (13.8202 => 14.6850, std. dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.26% (0.3756 => 0.3991, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.82% (1.2292 => 1.3007, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 5.66% (0.8310 => 0.8780, std. dev.: 0.0145) MultiSource/Applications/sgefa/sgefa: 5.61% (0.2995 => 0.3163, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.56% (0.7506 => 0.7923, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.55% (1.1061 => 1.1675, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3755 => 0.3961, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.45% (0.4113 => 0.4337, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.2243 => 0.2364, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.18% (0.4791 => 0.5039, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.16% (0.8818 => 0.9273, std. dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.03% (0.6283 => 0.6599, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.99% (1.9270 => 2.0232, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.78% (0.3220 => 0.3374, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.72% (2.1791 => 2.2820, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 4.69% (14.8535 => 15.5494, std. dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 4.67% (16.6129 => 17.3879, std. dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 4.36% (4.6629 => 4.8660, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.29% (0.8698 => 0.9071, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.26% (1.1333 => 1.1816, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.22% (0.3245 => 0.3382, std. dev.: 0.0035) MultiSource/Applications/d/make_dparser: 4.20% (3.1889 => 3.3227, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.10% (6.5754 => 6.8450, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 4.09% (0.2859 => 0.2976, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (8.4961 => 8.8378, std. dev.: 0.0588) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (4.9865 => 5.1769, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.70% (3.2742 => 3.3954, std. dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 3.41% (16.2614 => 16.8164, std. dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 3.40% (14.5298 => 15.0242, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 3.10% (0.6250 => 0.6444, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.70% (0.6744 => 0.6926, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.1007 => 2.1505, std. dev.: 0.0075) MultiSource/Applications/lua/lua: 2.25% (3.7467 => 3.8309, std. dev.: 0.0111) MultiSource/Applications/lemon/lemon: 2.21% (1.0313 => 1.0541, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.73% (1.2749 => 1.2969, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.65% (5.7573 => 7.5221, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0526) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.83% (1.2998 => 1.4146, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6608, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.39% (11.2619 => 11.7567, std. dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.84% (1.7688 => 1.8190, std. dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 2.46% (10.7476 => 11.0125, std. dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5961, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6782, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.58% (3.2729 => 3.3247, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5180, std. dev.: 0.0423) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.03% (26.5159 => 26.7898, std. dev.: 0.0416) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.39% (22.5627 => 21.3458, std. dev.: 0.4188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2308 => 1.0997, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -4.63% (1.1560 => 1.1025, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.24% (0.4366 => 0.4181, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.07% (1.3780 => 1.3219, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.51% (8.8259 => 8.6048, std. dev.: 0.0730) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9287, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9617, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2402, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4917, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.10% (20.3410 => 20.1170, std. dev.: 0.0333) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 23:53:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 01:53:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120823065358.3ED202A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3141?compare_to=3137&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3141, Order: 162425, Start Time: 2012-08-23 04:11:09, End Time: 2012-08-23 06:54:52 To: 3137, Order: 162417, Start Time: 2012-08-23 00:59:59, End Time: 2012-08-23 03:43:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (116 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (763 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.46% (1.7158 => 1.7409, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.32% (54.2672 => 54.9819, std. dev.: 0.0454) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -2.34% (50.5912 => 49.4081, std. dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 13.79% (0.3792 => 0.4315, std. dev.: 0.0153) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.56% (0.3465 => 0.3935, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.45% (0.3488 => 0.3957, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.38% (0.3469 => 0.3933, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 13.12% (0.3643 => 0.4121, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 12.88% (0.3650 => 0.4120, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1063 => 0.1168, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.27% (1.5932 => 1.7409, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.55% (0.5826 => 0.6324, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.27% (0.5889 => 0.6376, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7171 => 0.7697, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.04% (0.1619 => 0.1733, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (1.6211 => 1.7286, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.45% (0.4994 => 0.5316, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (3.5627 => 3.7904, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.27% (1.3152 => 1.3977, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (0.5026 => 0.5341, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.92% (0.5000 => 0.5296, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.70% (0.2875 => 0.3039, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.2014 => 0.2128, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.66% (0.2792 => 0.2950, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (0.3930 => 0.4152, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (0.4361 => 0.4607, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.59% (0.2738 => 0.2891, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3195 => 0.3371, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.50% (0.2729 => 0.2879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.49% (0.2750 => 0.2901, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.42% (0.2823 => 0.2976, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2813 => 0.2965, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.39% (0.3004 => 0.3166, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.36% (4.2109 => 4.4368, std. dev.: 0.0113) MultiSource/Applications/d/make_dparser: 5.36% (1.0781 => 1.1359, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2803 => 0.2951, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.26% (0.3096 => 0.3259, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.2911 => 0.3064, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.2780 => 0.2926, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.24% (0.9909 => 1.0428, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/except: 5.23% (0.2811 => 0.2958, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.22% (0.3317 => 0.3490, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.15% (2.0673 => 2.1737, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 5.09% (0.4029 => 0.4234, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.06% (0.3362 => 0.3532, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (0.3267 => 0.3432, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.03% (0.3258 => 0.3422, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.98% (0.5900 => 0.6194, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.93% (0.3124 => 0.3278, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3678 => 0.3858, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.84% (0.3060 => 0.3208, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.82% (0.2736 => 0.2868, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3477 => 0.3642, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.72% (0.3348 => 0.3506, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.70% (0.9697 => 1.0153, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.69% (0.3282 => 0.3436, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3625 => 0.3795, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 4.67% (0.3726 => 0.3900, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (2.7292 => 2.8533, std. dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 4.54% (5.5417 => 5.7932, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 4.52% (0.4251 => 0.4443, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 4.39% (0.4146 => 0.4328, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.36% (0.3690 => 0.3851, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (0.3890 => 0.4059, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.30% (1.9966 => 2.0824, std. dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.29% (0.3845 => 0.4010, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.19% (0.3981 => 0.4148, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.17% (0.2566 => 0.2673, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (1.9694 => 2.0506, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 4.10% (2.1013 => 2.1874, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.02% (4.4195 => 4.5970, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (0.4658 => 0.4844, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.87% (0.4139 => 0.4299, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 3.85% (1.4269 => 1.4819, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.3903 => 0.4053, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 3.82% (4.6177 => 4.7940, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: 3.78% (0.3336 => 0.3462, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 3.77% (1.8794 => 1.9502, std. dev.: 0.0056) MultiSource/Applications/treecc/treecc: 3.73% (0.7875 => 0.8169, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.66% (2.1653 => 2.2446, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.5012 => 0.5191, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 3.53% (23.5202 => 24.3514, std. dev.: 0.0202) MultiSource/Applications/siod/siod: 3.50% (0.6634 => 0.6866, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.44% (0.3084 => 0.3190, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.43% (0.5546 => 0.5736, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.6435 => 0.6653, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 2.60% (2.0346 => 2.0875, std. dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (0.4847 => 0.4953, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6792, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 5.04% (1.8057 => 1.8967, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6485, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1971, std. dev.: 0.0077) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5011, std. dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2228, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4546, std. dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6022, std. dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.05% (25.4195 => 16.5100, std. dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/ary2: -9.33% (0.2402 => 0.2178, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9783, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8050, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8010, std. dev.: 0.0062) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.18% (17.2379 => 16.8628, std. dev.: 0.0363) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9638, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 23:59:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 01:59:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823065951.A138A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3142?compare_to=3139&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3142, Order: 162429, Start Time: 2012-08-23 05:40:55, End Time: 2012-08-23 07:00:43 To: 3139, Order: 162425, Start Time: 2012-08-23 03:53:52, End Time: 2012-08-23 05:12:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.22% (10.3673 => 13.5007, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3473 => 0.3919, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.73% (0.3543 => 0.3994, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.70% (0.3497 => 0.3941, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/synchronized: 12.61% (0.3561 => 0.4010, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.51% (0.3516 => 0.3956, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.18% (0.3694 => 0.4144, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.87% (1.1194 => 1.2523, std. dev.: 0.0146) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.81% (0.3828 => 0.4280, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.53% (0.3886 => 0.4334, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (1.7609 => 1.9506, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.27% (2.2022 => 2.4064, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.73% (0.5925 => 0.6383, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.63% (0.6030 => 0.6490, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1584 => 0.1700, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.29% (0.1892 => 0.2030, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 6.46% (0.7326 => 0.7799, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.42% (0.3177 => 0.3381, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 6.12% (0.3282 => 0.3483, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.92% (0.4615 => 0.4888, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.47% (0.3307 => 0.3488, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.45% (7.0540 => 7.4386, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.21% (9.4845 => 9.9785, std. dev.: 0.0371) MultiSource/Applications/lambda-0_1_3/lambda: 5.11% (0.7433 => 0.7813, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.02% (0.2271 => 0.2385, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.94% (0.2107 => 0.2211, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.93% (4.9449 => 5.1888, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.85% (0.5860 => 0.6144, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.82% (0.3109 => 0.3259, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.81% (5.0018 => 5.2423, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 4.70% (0.2554 => 0.2674, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.58% (0.3121 => 0.3264, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.54% (0.4299 => 0.4494, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.53% (4.2646 => 4.4578, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.47% (0.5569 => 0.5818, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.47% (0.8172 => 0.8537, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.46% (1.3050 => 1.3632, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.43% (0.2891 => 0.3019, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.4636 => 0.4840, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 4.35% (0.3423 => 0.3572, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 4.33% (5.7591 => 6.0082, std. dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: 4.23% (0.2905 => 0.3028, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.11% (8.1363 => 8.4703, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.3441 => 0.3582, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.07% (0.2700 => 0.2810, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.03% (0.2831 => 0.2945, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.02% (0.3162 => 0.3289, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.01% (10.4361 => 10.8545, std. dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.00% (0.2872 => 0.2987, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.96% (0.2725 => 0.2833, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 3.96% (0.7835 => 0.8145, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/except: 3.94% (0.2871 => 0.2984, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.92% (0.2756 => 0.2864, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.88% (0.4103 => 0.4262, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.87% (0.3180 => 0.3303, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.87% (0.3232 => 0.3357, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.87% (0.3052 => 0.3170, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.81% (1.5415 => 1.6002, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 3.80% (0.3603 => 0.3740, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.77% (2.0665 => 2.1445, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.9765 => 1.0133, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.77% (0.6450 => 0.6693, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.76% (0.2793 => 0.2898, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4289 => 0.4448, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.70% (0.3650 => 0.3785, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 3.68% (0.2714 => 0.2814, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 3.68% (0.2802 => 0.2905, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3283 => 0.3403, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1861 => 1.2283, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 3.55% (0.3379 => 0.3499, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.54% (1.5603 => 1.6156, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.53% (0.3826 => 0.3961, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists1: 3.50% (0.3684 => 0.3813, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.49% (0.6675 => 0.6908, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.48% (0.8067 => 0.8348, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.48% (0.3136 => 0.3245, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.45% (0.4203 => 0.4348, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.43% (0.3935 => 0.4070, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.43% (1.1642 => 1.2041, std. dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.40% (0.4064 => 0.4202, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.25% (3.3354 => 3.4438, std. dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 3.25% (0.3387 => 0.3497, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.6456 => 0.6663, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.13% (1.2842 => 1.3244, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.11% (2.0273 => 2.0904, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4620 => 0.4763, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 3.00% (3.8723 => 3.9886, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8921 => 0.9187, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5981 => 0.6157, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.93% (1.4186 => 1.4602, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.80% (1.5859 => 1.6303, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 2.76% (2.2969 => 2.3603, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.75% (0.5020 => 0.5158, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.68% (14.3668 => 14.7512, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.2024 => 2.2564, std. dev.: 0.0071) MultiSource/Applications/minisat/minisat: 2.26% (0.7115 => 0.7276, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.26% (1.1840 => 1.2107, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.23% (17.1811 => 17.5637, std. dev.: 0.0178) MultiSource/Applications/lemon/lemon: 1.78% (1.0722 => 1.0913, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.40% (21.9371 => 22.2453, std. dev.: 0.0096) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.30% (7.9617 => 8.0654, std. dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (4.2280 => 4.4283, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7559, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.88% (26.0924 => 26.8435, std. dev.: 0.0305) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3340, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.41% (1.5086 => 1.5299, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2425, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1578 => 3.1950, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6821, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.38% (5.2763 => 3.1983, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7055, std. dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7069, std. dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1419, std. dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: -14.18% (22.1758 => 19.0316, std. dev.: 0.0362) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.10% (2.9384 => 2.5534, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2373 => 1.0996, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -7.03% (1.1396 => 1.0595, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -6.77% (1.5373 => 1.4333, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4612, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4280, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9970, std. dev.: 0.0254) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (8.1563 => 7.9665, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6776, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5114, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3376, std. dev.: 0.0061) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.14% (1.8329 => 1.8120, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 23:14:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 01:14:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823061423.9E3492A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3140?compare_to=3138&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3140, Order: 162425, Start Time: 2012-08-23 05:01:06, End Time: 2012-08-23 06:15:16 To: 3138, Order: 162424, Start Time: 2012-08-23 03:19:18, End Time: 2012-08-23 04:33:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (160 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (697 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.29% (79.6485 => 80.6769, std. dev.: 0.3463) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.63% (2.0176 => 2.3329, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.69% (0.7061 => 0.7816, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.57% (0.5818 => 0.6433, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.44% (0.5748 => 0.6348, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 9.46% (0.3646 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3601 => 0.3941, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.40% (0.1819 => 0.1990, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3650 => 0.3991, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3663 => 0.4005, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3623 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3789 => 0.4141, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3914 => 0.4276, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.4003 => 0.4365, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.49% (1.3693 => 1.4855, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 8.42% (0.4062 => 0.4404, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 8.32% (0.1478 => 0.1601, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.31% (0.1986 => 0.2151, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.29% (0.4328 => 0.4687, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.27% (0.2781 => 0.3011, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.16% (0.2782 => 0.3009, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.11% (3.9660 => 4.2876, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.86% (0.7710 => 0.8316, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.80% (0.7038 => 0.7587, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hello: 7.79% (0.2607 => 0.2810, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.73% (0.2690 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.72% (0.2655 => 0.2860, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.69% (0.2628 => 0.2830, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.63% (0.2937 => 0.3161, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.58% (0.3022 => 0.3251, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2765 => 0.2974, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.55% (0.2966 => 0.3190, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.53% (0.2761 => 0.2969, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 7.48% (0.2726 => 0.2930, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.42% (1.9828 => 2.1300, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.41% (0.5265 => 0.5655, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.38% (0.2696 => 0.2895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.34% (0.3107 => 0.3335, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2988 => 0.3206, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.27% (0.3149 => 0.3378, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3485 => 0.3738, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.22% (1.2193 => 1.3073, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.21% (0.6959 => 0.7461, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.21% (0.3899 => 0.4180, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2721 => 0.2917, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.17% (0.3192 => 0.3421, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.10% (0.9199 => 0.9852, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3580 => 0.3831, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.1588 => 0.1696, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3453 => 0.3686, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.72% (0.4390 => 0.4685, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.65% (0.3293 => 0.3512, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.59% (1.1364 => 1.2113, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.50% (0.4016 => 0.4277, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.49% (0.2127 => 0.2265, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.46% (0.3868 => 0.4118, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.43% (0.1789 => 0.1904, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.36% (13.8202 => 14.6986, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.22% (0.5577 => 0.5924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.21% (0.2945 => 0.3128, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.12% (0.5637 => 0.5982, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3756 => 0.3985, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.06% (1.4563 => 1.5446, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2023 => 0.2143, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (0.2914 => 0.3082, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.74% (7.2180 => 7.6321, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 5.71% (1.2292 => 1.2994, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.70% (0.7506 => 0.7934, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.68% (0.1865 => 0.1971, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 5.68% (0.8310 => 0.8782, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.65% (1.3813 => 1.4593, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 5.64% (0.2925 => 0.3090, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 5.61% (0.2995 => 0.3163, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.53% (1.3245 => 1.3978, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.52% (1.3819 => 1.4582, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 5.45% (0.4113 => 0.4337, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.42% (1.1061 => 1.1661, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.39% (3.8646 => 4.0728, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.30% (0.3755 => 0.3954, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.7460 => 0.7855, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.28% (3.6692 => 3.8628, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.22% (1.0594 => 1.1147, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.08% (0.6283 => 0.6602, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (4.3801 => 4.6016, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 5.02% (1.9270 => 2.0237, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.01% (0.4791 => 0.5031, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3220 => 0.3381, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.97% (4.4433 => 4.6643, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.96% (0.6135 => 0.6439, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (13.2842 => 13.9337, std. dev.: 0.0188) MultiSource/Applications/siod/siod: 4.89% (2.1791 => 2.2856, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.82% (0.8818 => 0.9243, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.65% (14.8535 => 15.5435, std. dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 4.61% (16.6129 => 17.3784, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.34% (4.6629 => 4.8654, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.25% (0.3131 => 0.3264, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.21% (1.1333 => 1.1810, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.18% (0.8698 => 0.9062, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.15% (3.1889 => 3.3213, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.08% (8.4961 => 8.8430, std. dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 4.04% (6.5754 => 6.8412, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.91% (0.3245 => 0.3372, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.71% (3.2742 => 3.3957, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.68% (4.9865 => 5.1701, std. dev.: 0.0207) MultiSource/Benchmarks/Olden/bh/bh: 3.57% (0.2859 => 0.2961, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.38% (16.2614 => 16.8109, std. dev.: 0.0222) MultiSource/Applications/ClamAV/clamscan: 3.27% (14.5298 => 15.0054, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.08% (1.5188 => 1.5656, std. dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/bigfib: 3.04% (0.6250 => 0.6440, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.03% (0.9108 => 0.9384, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (2.1007 => 2.1513, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: 2.27% (0.6744 => 0.6897, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.26% (3.7467 => 3.8315, std. dev.: 0.0076) MultiSource/Applications/lemon/lemon: 2.22% (1.0313 => 1.0542, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.99% (6.2785 => 6.4036, std. dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 1.78% (33.2944 => 33.8871, std. dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (1.2749 => 1.2972, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5182, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fbench: 24.77% (1.8175 => 2.2677, std. dev.: 0.0517) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.66% (1.2998 => 1.4254, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9870, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6057, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.95% (10.7476 => 10.9569, std. dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5928 => 4.6757, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3258, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.29% (26.5159 => 26.8576, std. dev.: 0.0276) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (1.5089 => 1.5269, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5748, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.48% (22.5627 => 21.3257, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.63% (1.2308 => 1.1000, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.82% (1.3780 => 1.3253, std. dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4675, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5840, std. dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.13% (3.0263 => 2.9617, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2289, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3305 => 7.1986, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3625, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.06% (5.5401 => 5.4811, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.06% (20.3410 => 20.1257, std. dev.: 0.0361) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 22:12:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 23 Aug 2012 00:12:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823051206.D52692A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3139?compare_to=3136&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3139, Order: 162425, Start Time: 2012-08-23 03:53:52, End Time: 2012-08-23 05:12:59 To: 3136, Order: 162422, Start Time: 2012-08-23 02:07:16, End Time: 2012-08-23 03:26:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (124 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (715 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.42% (13.3062 => 13.4950, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (54.6506 => 56.4760, std. dev.: 0.1275) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.78% (76.2010 => 78.3175, std. dev.: 0.6589) SingleSource/Benchmarks/Misc/mandel-2: 1.80% (1.4036 => 1.4289, std. dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.17% (10.3673 => 13.4950, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.06% (0.3561 => 0.4026, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.97% (0.3516 => 0.3972, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3543 => 0.4001, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 12.93% (0.3497 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.87% (0.3543 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.62% (0.3694 => 0.4160, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.42% (1.1194 => 1.2584, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 12.12% (0.3828 => 0.4292, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.35% (1.7609 => 1.9607, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.52% (2.2022 => 2.4118, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.43% (0.1432 => 0.1567, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.22% (0.5925 => 0.6412, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.21% (0.6030 => 0.6525, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.35% (0.1892 => 0.2031, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.20% (0.1584 => 0.1698, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.96% (0.7326 => 0.7836, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4615 => 0.4927, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.70% (0.3177 => 0.3390, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.34% (0.3282 => 0.3490, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.78% (0.4879 => 0.5161, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.67% (7.0540 => 7.4543, std. dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.41% (0.3307 => 0.3486, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.23% (9.4845 => 9.9802, std. dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.02% (0.2271 => 0.2385, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.01% (4.9449 => 5.1927, std. dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.8172 => 0.8576, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (0.7433 => 0.7799, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 4.92% (0.3109 => 0.3262, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.5569 => 0.5841, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.87% (5.0018 => 5.2456, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.84% (0.2107 => 0.2209, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.74% (0.2554 => 0.2675, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.59% (4.2646 => 4.4605, std. dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.49% (0.3121 => 0.3261, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.43% (1.3050 => 1.3628, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.37% (0.5860 => 0.6116, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 4.35% (5.7591 => 6.0095, std. dev.: 0.0146) MultiSource/Benchmarks/McCat/18-imp/imp: 4.27% (0.3423 => 0.3569, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.18% (0.4636 => 0.4830, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.16% (8.1363 => 8.4751, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 4.02% (10.4361 => 10.8560, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.98% (0.2891 => 0.3006, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.92% (0.3441 => 0.3576, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.90% (1.5415 => 1.6016, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.84% (0.7835 => 0.8136, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.81% (0.2700 => 0.2803, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.81% (0.9765 => 1.0137, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 3.81% (0.3180 => 0.3301, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.77% (0.2758 => 0.2862, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (0.5105 => 0.5295, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.72% (0.2905 => 0.3013, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6450 => 0.6689, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.65% (1.5603 => 1.6172, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.58% (1.1861 => 1.2286, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4289 => 0.4442, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.55% (0.3098 => 0.3208, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.55% (0.6675 => 0.6912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.54% (0.3865 => 0.4002, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.53% (0.4103 => 0.4248, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.53% (0.2831 => 0.2931, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.8067 => 0.8351, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.52% (0.2872 => 0.2973, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.50% (0.3232 => 0.3345, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.41% (0.3052 => 0.3156, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3935 => 0.4068, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.36% (0.3603 => 0.3724, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.32% (0.3162 => 0.3267, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.31% (1.1642 => 1.2027, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.31% (0.3387 => 0.3499, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (2.0665 => 2.1343, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3379 => 0.3487, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.15% (3.3354 => 3.4403, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.14% (0.3826 => 0.3946, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.4064 => 0.4191, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.4203 => 0.4334, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.09% (0.3684 => 0.3798, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.02% (0.6456 => 0.6651, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 3.02% (0.8921 => 0.9190, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 2.99% (2.0273 => 2.0879, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.4048 => 0.4169, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.4186 => 1.4605, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.94% (0.5981 => 0.6157, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4620 => 0.4755, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.90% (3.8723 => 3.9846, std. dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.83% (1.2842 => 1.3205, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (14.3668 => 14.7704, std. dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.67% (1.5859 => 1.6282, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.5020 => 0.5152, std. dev.: 0.0012) MultiSource/Applications/siod/siod: 2.51% (2.2969 => 2.3546, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.2024 => 2.2547, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.29% (1.1840 => 1.2111, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.21% (17.1811 => 17.5603, std. dev.: 0.0095) MultiSource/Applications/minisat/minisat: 2.07% (0.7115 => 0.7262, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.71% (1.0722 => 1.0905, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.57% (7.9617 => 8.0867, std. dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 1.52% (21.9371 => 22.2712, std. dev.: 0.0181) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (4.2280 => 4.4488, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 3.01% (26.0924 => 26.8774, std. dev.: 0.0257) MultiSource/Applications/siod/siod: 1.53% (3.2827 => 3.3329, std. dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2449, std. dev.: 0.0282) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (1.5086 => 1.5288, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1578 => 3.1966, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5829, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.06% (2.6546 => 2.6828, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.26% (5.2763 => 3.2048, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7222, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.38% (5.3526 => 3.7265, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1456, std. dev.: 0.0357) MultiSource/Applications/ClamAV/clamscan: -14.13% (22.1758 => 19.0423, std. dev.: 0.0313) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.60% (2.9384 => 2.5681, std. dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1010, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -7.05% (1.5373 => 1.4289, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.83% (1.5660 => 1.4904, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4710, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4315, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0007, std. dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (8.1563 => 7.9587, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3436, std. dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4196, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.17% (1.8329 => 1.8114, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 21:32:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 23:32:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823043238.0A0FF2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3138?compare_to=3135&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3138, Order: 162424, Start Time: 2012-08-23 03:19:18, End Time: 2012-08-23 04:33:29 To: 3135, Order: 162422, Start Time: 2012-08-23 01:37:30, End Time: 2012-08-23 02:51:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (161 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (697 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.26% (55.3246 => 56.5757, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/lowercase: 1.01% (7.9640 => 8.0446, std. dev.: 0.0134) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.69% (2.0176 => 2.3341, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.71% (0.0826 => 0.0931, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.74% (0.5818 => 0.6443, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.69% (0.7061 => 0.7816, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.40% (0.5748 => 0.6346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.28% (0.3578 => 0.3910, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.14% (0.3623 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.11% (0.3646 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.01% (0.3130 => 0.3412, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.94% (0.3914 => 0.4264, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.82% (0.4003 => 0.4356, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.69% (0.1819 => 0.1977, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.31% (0.1986 => 0.2151, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.16% (3.9660 => 4.2897, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.94% (1.3693 => 1.4780, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.83% (0.7710 => 0.8314, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 7.79% (0.4328 => 0.4665, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.57% (0.7038 => 0.7571, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2782 => 0.2987, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.2596 => 0.2787, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5265 => 0.5648, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.16% (0.9199 => 0.9858, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.12% (0.1588 => 0.1701, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.01% (1.2193 => 1.3048, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 6.99% (0.1589 => 0.1700, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.90% (0.6959 => 0.7439, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.4379 => 0.4681, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2607 => 0.2782, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.67% (0.2655 => 0.2832, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.65% (0.3022 => 0.3223, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.60% (0.2726 => 0.2906, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.2966 => 0.3161, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.51% (1.9828 => 2.1119, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.50% (0.2937 => 0.3128, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.50% (1.1364 => 1.2103, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.47% (0.4390 => 0.4674, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2765 => 0.2943, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.43% (0.1789 => 0.1904, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.42% (0.3580 => 0.3810, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3107 => 0.3306, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.31% (0.3485 => 0.3705, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2988 => 0.3176, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.27% (13.8202 => 14.6868, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.25% (0.2127 => 0.2260, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2696 => 0.2863, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5577 => 0.5922, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (0.2914 => 0.3090, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3246 => 0.3442, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.99% (0.3453 => 0.3660, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.4563 => 1.5423, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 5.87% (0.3868 => 0.4095, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.5637 => 0.5967, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 5.84% (0.2995 => 0.3170, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.77% (0.3293 => 0.3483, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 5.75% (0.2243 => 0.2372, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.3534 => 0.3737, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.64% (0.2925 => 0.3090, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.63% (0.8310 => 0.8778, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.54% (7.2180 => 7.6178, std. dev.: 0.0057) MultiSource/Applications/Burg/burg: 5.50% (1.1061 => 1.1669, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.45% (1.3819 => 1.4572, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.44% (1.3245 => 1.3965, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (0.3756 => 0.3960, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.4113 => 0.4336, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.2945 => 0.3104, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.37% (3.8646 => 4.0722, std. dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (1.3813 => 1.4550, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.6283 => 0.6617, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.32% (0.7506 => 0.7905, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.31% (3.6692 => 3.8641, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 5.26% (1.0594 => 1.1151, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.23% (0.7460 => 0.7850, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.18% (0.4791 => 0.5039, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.08% (1.2292 => 1.2916, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.07% (0.6135 => 0.6446, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.05% (4.3801 => 4.6015, std. dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.98% (4.4433 => 4.6645, std. dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.95% (1.9270 => 2.0224, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.92% (0.8818 => 0.9252, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 4.88% (2.1791 => 2.2855, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (13.2842 => 13.9247, std. dev.: 0.0200) MultiSource/Applications/kimwitu++/kc: 4.69% (16.6129 => 17.3924, std. dev.: 0.0225) MultiSource/Benchmarks/McCat/18-imp/imp: 4.69% (0.3220 => 0.3371, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.60% (14.8535 => 15.5373, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3755 => 0.3926, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.28% (4.6629 => 4.8627, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (1.1333 => 1.1811, std. dev.: 0.0117) MultiSource/Benchmarks/sim/sim: 4.15% (0.3131 => 0.3261, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.05% (3.1889 => 3.3179, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.01% (8.4961 => 8.8364, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.94% (0.8698 => 0.9041, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.86% (6.5754 => 6.8290, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.82% (0.3245 => 0.3369, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.75% (4.9865 => 5.1735, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.65% (3.2742 => 3.3938, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 3.60% (0.2859 => 0.2962, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.24% (0.9108 => 0.9403, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.19% (16.2614 => 16.7797, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.19% (1.5188 => 1.5672, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 3.14% (14.5298 => 14.9862, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.08% (2.1007 => 2.1654, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6250 => 0.6410, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.4805 => 0.4920, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.28% (1.0313 => 1.0548, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.28% (3.7467 => 3.8320, std. dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.08% (6.2785 => 6.4092, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 2.06% (0.6744 => 0.6883, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.71% (33.2944 => 33.8637, std. dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (1.2749 => 1.2966, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2620, std. dev.: 0.0369) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.92% (1.2998 => 1.4287, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7429, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.73% (2.8606 => 2.9673, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.52% (1.9199 => 1.9875, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8166, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.35% (10.7476 => 10.9997, std. dev.: 0.0583) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5918, std. dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 1.83% (4.5928 => 4.6770, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3261, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5089 => 1.5272, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1837, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6868, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (26.5159 => 26.8020, std. dev.: 0.0262) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5717, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.54% (22.5627 => 21.3125, std. dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.32% (1.2308 => 1.1038, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.21% (2.6470 => 2.5090, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.61% (1.1560 => 1.1027, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.33% (1.3780 => 1.3183, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.24% (5.0168 => 4.8043, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6054, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std. dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.26% (0.6589 => 0.6440, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.16% (3.0263 => 2.9610, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2242, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.84% (7.3305 => 7.1955, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9920, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std. dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7926, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3649, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.19% (20.3410 => 20.0993, std. dev.: 0.0246) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 20:42:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 22:42:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120823034244.0E5A82A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3137?compare_to=3132&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3137, Order: 162417, Start Time: 2012-08-23 00:59:59, End Time: 2012-08-23 03:43:37 To: 3132, Order: 162396, Start Time: 2012-08-22 21:48:59, End Time: 2012-08-23 00:32:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (117 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.64% (125.2896 => 129.8471, std. dev.: 0.6455) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.55% (1.7428 => 1.7158, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.41% (0.3446 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.30% (0.3488 => 0.3952, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.20% (0.3469 => 0.3927, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.85% (0.3650 => 0.4119, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.85% (0.3643 => 0.4111, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.46% (0.3724 => 0.4188, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5826 => 0.6312, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.10% (0.5889 => 0.6366, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.70% (1.5932 => 1.7158, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.55% (1.6211 => 1.7273, std. dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: 6.48% (0.7171 => 0.7636, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.45% (3.5627 => 3.7925, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.45% (1.3152 => 1.4000, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.98% (0.4361 => 0.4622, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (0.5026 => 0.5317, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.78% (0.3930 => 0.4157, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (0.4994 => 0.5282, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.68% (0.4029 => 0.4258, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.56% (0.5000 => 0.5278, std. dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 5.43% (4.2109 => 4.4397, std. dev.: 0.0111) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.5900 => 0.6211, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 5.26% (1.0781 => 1.1348, std. dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.2736 => 0.2869, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 4.75% (0.2566 => 0.2688, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.66% (0.2875 => 0.3009, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.63% (0.3195 => 0.3343, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.59% (1.9966 => 2.0883, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 4.53% (0.2823 => 0.2951, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.52% (5.5417 => 5.7922, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (0.2813 => 0.2939, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.48% (0.2792 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.46% (0.2714 => 0.2835, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.44% (1.9694 => 2.0569, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 4.44% (0.2725 => 0.2846, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (0.4658 => 0.4863, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (0.3890 => 0.4061, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 4.36% (0.3004 => 0.3135, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.36% (0.2729 => 0.2848, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (2.1013 => 2.1919, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 4.26% (0.9909 => 1.0331, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 4.25% (0.2750 => 0.2867, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.2780 => 0.2898, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3096 => 0.3227, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.21% (2.0673 => 2.1544, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2803 => 0.2921, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.18% (2.7292 => 2.8433, std. dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.17% (0.3625 => 0.3776, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 4.16% (0.2811 => 0.2928, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3124 => 0.3253, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.08% (4.4195 => 4.5999, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.07% (0.3362 => 0.3499, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.2911 => 0.3029, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.05% (0.3258 => 0.3390, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.04% (0.3267 => 0.3399, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.96% (0.3282 => 0.3412, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.95% (0.3726 => 0.3873, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.92% (2.1653 => 2.2502, std. dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 3.92% (4.6177 => 4.7987, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 3.91% (1.8794 => 1.9528, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: 3.89% (0.3317 => 0.3446, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.89% (0.3060 => 0.3179, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 3.85% (0.3348 => 0.3477, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.83% (0.9697 => 1.0068, std. dev.: 0.0023) MultiSource/Applications/lua/lua: 3.80% (1.4269 => 1.4811, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.74% (0.3903 => 0.4049, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 3.74% (0.4146 => 0.4301, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.3477 => 0.3606, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.70% (0.7875 => 0.8166, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 3.68% (0.6634 => 0.6878, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.4139 => 0.4291, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.67% (0.3678 => 0.3813, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.62% (0.4251 => 0.4405, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (0.3845 => 0.3984, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.50% (0.3690 => 0.3819, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.3981 => 0.4119, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.3271 => 0.3383, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.37% (0.5546 => 0.5733, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 3.33% (23.5202 => 24.3041, std. dev.: 0.0117) MultiSource/Applications/minisat/minisat: 3.33% (0.3336 => 0.3447, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.24% (0.3084 => 0.3184, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.91% (0.5012 => 0.5158, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.6435 => 0.6621, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.49% (2.0346 => 2.0853, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (0.7426 => 0.7526, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6691, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1651, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6421, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2071, std. dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5026, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5912, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std. dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4631, std. dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2859, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5856, std. dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4455, std. dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.35% (2.4764 => 2.3934, std. dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5339, std. dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7880, std. dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0073) SingleSource/UnitTests/Vector/build2: -3.79% (11.2080 => 10.7829, std. dev.: 0.0100) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -3.03% (17.2379 => 16.7161, std. dev.: 0.0955) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5827, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (16.2163 => 15.9552, std. dev.: 0.0129) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4974, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 20:25:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 22:25:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823032529.61A322A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3136?compare_to=3134&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3136, Order: 162422, Start Time: 2012-08-23 02:07:16, End Time: 2012-08-23 03:26:22 To: 3134, Order: 162410, Start Time: 2012-08-23 00:20:35, End Time: 2012-08-23 01:39:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (128 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.02% (1.0972 => 1.1084, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.52% (13.7914 => 13.3062, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.05% (2.4293 => 2.4037, std. dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.35% (10.3673 => 13.3062, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3473 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3543 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.78% (0.3561 => 0.4016, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.75% (0.3497 => 0.3943, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3543 => 0.3994, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.71% (0.3516 => 0.3963, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.29% (1.1194 => 1.2570, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.15% (0.3828 => 0.4293, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.19% (1.7609 => 1.9579, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.15% (2.2022 => 2.4037, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.22% (0.5925 => 0.6412, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.45% (0.1892 => 0.2033, std. dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.45% (0.1584 => 0.1702, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.34% (0.1622 => 0.1741, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.85% (0.7326 => 0.7828, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.61% (0.3177 => 0.3387, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.88% (0.3282 => 0.3475, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.79% (0.4615 => 0.4882, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.64% (7.0540 => 7.4518, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.60% (0.4879 => 0.5152, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.38% (0.3307 => 0.3485, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.02% (9.4845 => 9.9604, std. dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (0.7433 => 0.7805, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2271 => 0.2382, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.86% (5.0018 => 5.2447, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.83% (4.9449 => 5.1838, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.79% (0.2107 => 0.2208, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 4.79% (0.3109 => 0.3258, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 4.74% (0.2554 => 0.2675, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5569 => 0.5828, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.63% (0.8172 => 0.8550, std. dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.58% (0.3121 => 0.3264, std. dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 4.56% (0.4299 => 0.4495, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.55% (4.2646 => 4.4587, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 4.32% (0.3423 => 0.3571, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5860 => 0.6113, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.27% (0.2905 => 0.3029, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.26% (1.3050 => 1.3606, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.21% (8.1363 => 8.4791, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.19% (0.2891 => 0.3012, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.16% (0.3441 => 0.3584, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.14% (0.7835 => 0.8159, std. dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4636 => 0.4827, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 4.11% (5.7591 => 5.9960, std. dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 4.09% (10.4361 => 10.8633, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.00% (0.2700 => 0.2808, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.96% (0.3180 => 0.3306, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.89% (1.5603 => 1.6210, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2831 => 0.2940, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.78% (0.9765 => 1.0134, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.76% (0.2872 => 0.2980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 3.74% (0.2725 => 0.2827, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.5105 => 0.5296, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.74% (0.2756 => 0.2859, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.74% (0.3052 => 0.3166, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.2758 => 0.2861, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3232 => 0.3352, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4289 => 0.4448, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.4103 => 0.4253, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.63% (0.8067 => 0.8360, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 3.62% (0.2871 => 0.2975, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3865 => 0.4005, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.62% (1.1861 => 1.2290, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.60% (1.5415 => 1.5970, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0665 => 2.1407, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists: 3.57% (0.3422 => 0.3544, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.54% (0.3162 => 0.3274, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.53% (0.6450 => 0.6678, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.45% (1.1642 => 1.2044, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.39% (0.6675 => 0.6901, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.38% (0.3136 => 0.3242, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.35% (0.3826 => 0.3954, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3684 => 0.3806, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.28% (0.3935 => 0.4064, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.28% (0.3603 => 0.3721, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.4064 => 0.4195, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.20% (0.3379 => 0.3487, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.15% (3.3354 => 3.4405, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4203 => 0.4335, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.14% (2.0273 => 2.0909, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.13% (0.5981 => 0.6168, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.11% (0.6456 => 0.6657, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.11% (3.8723 => 3.9926, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 3.01% (0.4048 => 0.4170, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.00% (1.2842 => 1.3227, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 2.97% (0.4620 => 0.4757, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.94% (1.4186 => 1.4603, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.87% (0.8921 => 0.9177, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (14.3668 => 14.7711, std. dev.: 0.0248) MultiSource/Applications/siod/siod: 2.62% (2.2969 => 2.3571, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.61% (1.5859 => 1.6273, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.45% (0.5020 => 0.5143, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.2024 => 2.2541, std. dev.: 0.0144) MultiSource/Benchmarks/nbench/nbench: 2.10% (1.1840 => 1.2089, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.07% (17.1811 => 17.5364, std. dev.: 0.0299) MultiSource/Applications/minisat/minisat: 2.02% (0.7115 => 0.7259, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.73% (1.0722 => 1.0907, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.46% (7.9617 => 8.0776, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.40% (21.9371 => 22.2433, std. dev.: 0.0212) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.60% (4.2280 => 4.4225, std. dev.: 0.0131) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 2.96% (26.0924 => 26.8656, std. dev.: 0.0213) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0079) MultiSource/Applications/siod/siod: 1.60% (3.2827 => 3.3351, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.36% (9.1159 => 9.2399, std. dev.: 0.0264) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.30% (3.1578 => 3.1987, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.26% (19.9488 => 20.1993, std. dev.: 0.0605) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.5086 => 1.5270, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.29% (5.2763 => 3.2033, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7225, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.45% (5.3526 => 3.7225, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1480, std. dev.: 0.0381) MultiSource/Applications/ClamAV/clamscan: -14.18% (22.1758 => 19.0310, std. dev.: 0.0354) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.86% (2.9384 => 2.5604, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4267, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2373 => 1.1084, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -8.70% (1.5373 => 1.4036, std. dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.81% (5.0483 => 4.8053, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.54% (1.5835 => 1.5116, std. dev.: 0.0024) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.21% (8.6802 => 8.4018, std. dev.: 0.0189) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4746, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.53% (10.2830 => 10.0231, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9595, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3300, std. dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 19:50:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 21:50:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823025059.BFB092A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3135?compare_to=3133&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3135, Order: 162422, Start Time: 2012-08-23 01:37:30, End Time: 2012-08-23 02:51:52 To: 3133, Order: 162408, Start Time: 2012-08-22 23:55:53, End Time: 2012-08-23 01:09:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (162 on baseline) Performance Improvements: 2 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (695 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.07% (0.5354 => 0.5465, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.17% (2.1373 => 2.1122, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: -1.10% (1.4937 => 1.4772, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.67% (2.0176 => 2.3337, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 12.71% (0.0826 => 0.0931, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.76% (0.5818 => 0.6444, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.51% (0.7061 => 0.7803, std. dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 10.39% (0.5748 => 0.6345, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3578 => 0.3913, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.16% (0.3646 => 0.3980, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.14% (0.3130 => 0.3416, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.08% (0.3601 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.04% (0.3650 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.98% (0.3663 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.97% (0.3623 => 0.3948, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.95% (0.3789 => 0.4128, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.84% (0.4003 => 0.4357, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.63% (0.1819 => 0.1976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.10% (3.9660 => 4.2874, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 7.88% (1.3693 => 1.4772, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.81% (0.4328 => 0.4666, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.57% (0.7038 => 0.7571, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.56% (0.7710 => 0.8293, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.2596 => 0.2787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.5265 => 0.5649, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.11% (0.9199 => 0.9853, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.05% (0.1588 => 0.1700, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.01% (1.2193 => 1.3048, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.92% (0.4379 => 0.4682, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.84% (0.6959 => 0.7435, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.77% (0.3899 => 0.4163, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.70% (0.2761 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2765 => 0.2950, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.68% (0.3022 => 0.3224, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.64% (0.2966 => 0.3163, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.63% (0.2655 => 0.2831, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.63% (0.4390 => 0.4681, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.62% (0.2690 => 0.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.60% (0.2726 => 0.2906, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.54% (0.1789 => 0.1906, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (1.9828 => 2.1122, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.51% (0.3580 => 0.3813, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.51% (0.2628 => 0.2799, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3107 => 0.3308, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.47% (0.2937 => 0.3127, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.45% (1.1364 => 1.2097, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.45% (0.3489 => 0.3714, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.45% (0.3149 => 0.3352, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.43% (0.3485 => 0.3709, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 6.36% (0.1589 => 0.1690, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.31% (0.2696 => 0.2866, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2127 => 0.2261, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2988 => 0.3176, std. dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 6.14% (13.8202 => 14.6684, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.13% (0.5577 => 0.5919, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (0.2914 => 0.3090, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.98% (0.5637 => 0.5974, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3453 => 0.3658, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.92% (0.3293 => 0.3488, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.4563 => 1.5423, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.83% (0.2023 => 0.2141, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 5.81% (0.2925 => 0.3095, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.80% (0.3534 => 0.3739, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.74% (0.1865 => 0.1972, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.73% (0.4016 => 0.4246, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.71% (0.2995 => 0.3166, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.66% (0.3868 => 0.4087, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.62% (0.2243 => 0.2369, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.61% (0.8310 => 0.8776, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (0.3756 => 0.3963, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.49% (7.2180 => 7.6144, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.46% (1.3819 => 1.4573, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.41% (1.1061 => 1.1659, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 5.40% (3.8646 => 4.0732, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.36% (1.3813 => 1.4554, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.35% (1.3245 => 1.3954, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.35% (0.4113 => 0.4333, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.33% (0.7506 => 0.7906, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (3.6692 => 3.8638, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.7460 => 0.7855, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.26% (1.0594 => 1.1151, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.16% (0.4791 => 0.5038, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.13% (1.2292 => 1.2923, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.6283 => 0.6603, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.04% (4.3801 => 4.6010, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 4.97% (1.9270 => 2.0228, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.94% (0.3220 => 0.3379, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.91% (4.4433 => 4.6616, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.91% (0.8818 => 0.9251, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.91% (0.6135 => 0.6436, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.87% (2.1791 => 2.2852, std. dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 4.84% (16.6129 => 17.4162, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (13.2842 => 13.9158, std. dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 4.61% (14.8535 => 15.5376, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.53% (0.3755 => 0.3925, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.25% (4.6629 => 4.8609, std. dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.1333 => 1.1814, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.18% (0.3131 => 0.3262, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.00% (3.1889 => 3.3165, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.97% (0.8698 => 0.9043, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (8.4961 => 8.8322, std. dev.: 0.0179) MultiSource/Applications/JM/ldecod/ldecod: 3.85% (6.5754 => 6.8286, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.82% (0.3245 => 0.3369, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.76% (4.9865 => 5.1742, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.74% (3.2742 => 3.3968, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.57% (0.2859 => 0.2961, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.23% (0.9108 => 0.9402, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.15% (14.5298 => 14.9870, std. dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 3.13% (16.2614 => 16.7706, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5188 => 1.5641, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6250 => 0.6410, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1510, std. dev.: 0.0176) MultiSource/Applications/lua/lua: 2.22% (3.7467 => 3.8298, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 2.16% (1.0313 => 1.0536, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 2.14% (0.6744 => 0.6888, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.08% (0.4805 => 0.4905, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.95% (6.2785 => 6.4009, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (1.2749 => 1.2966, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.67% (33.2944 => 33.8499, std. dev.: 0.0188) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fbench: 24.66% (1.8175 => 2.2657, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.06% (1.2998 => 1.4176, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.01% (1.5824 => 1.6616, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7424, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.24% (10.7476 => 10.9882, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5927, std. dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.86% (4.5928 => 4.6783, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.61% (3.2729 => 3.3256, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.50% (8.3908 => 8.5164, std. dev.: 0.0065) MultiSource/Applications/lemon/lemon: 1.49% (1.4298 => 1.4511, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0026) MultiSource/Applications/lua/lua: 1.22% (26.5159 => 26.8396, std. dev.: 0.0171) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.5089 => 1.5273, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6469 => 3.6851, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.66% (0.2670 => 0.2519, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.51% (22.5627 => 21.3186, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2308 => 1.0938, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5115, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3125, std. dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.53% (1.1560 => 1.1036, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.80% (0.4867 => 0.4682, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5970, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.29% (0.6589 => 0.6438, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.12% (3.0263 => 2.9620, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2389, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2058, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3658, std. dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.22% (20.3410 => 20.0931, std. dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.10% (5.5401 => 5.4794, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 18:38:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 20:38:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120823013842.A8F892A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3134?compare_to=3131&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3134, Order: 162410, Start Time: 2012-08-23 00:20:35, End Time: 2012-08-23 01:39:36 To: 3131, Order: 162399, Start Time: 2012-08-22 22:34:13, End Time: 2012-08-22 23:53:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (127 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.84% (13.5418 => 13.7914, std. dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.23% (55.1470 => 56.3749, std. dev.: 0.1183) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.03% (10.3673 => 13.7914, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/trivial-interface: 13.33% (0.3473 => 0.3936, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.10% (0.3543 => 0.4007, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3543 => 0.4006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.01% (0.3497 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.94% (0.3516 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.64% (0.3694 => 0.4161, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.42% (1.1194 => 1.2584, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.15% (0.3828 => 0.4293, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.40% (1.7609 => 1.9616, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.31% (2.2022 => 2.4293, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.85% (0.3817 => 0.4193, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: 9.78% (0.1432 => 0.1572, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.45% (0.1892 => 0.2033, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.39% (0.5925 => 0.6363, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.33% (0.6030 => 0.6472, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.13% (0.1584 => 0.1697, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.35% (0.1622 => 0.1725, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.33% (7.0540 => 7.5004, std. dev.: 0.0118) SingleSource/UnitTests/ObjC++/property-reference: 6.25% (0.7326 => 0.7784, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.90% (0.4879 => 0.5167, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 5.88% (0.3282 => 0.3475, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (0.4615 => 0.4872, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.20% (0.3307 => 0.3479, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.05% (9.4845 => 9.9636, std. dev.: 0.0175) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (0.7433 => 0.7799, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.2905 => 0.3047, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.87% (4.9449 => 5.1856, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.81% (5.0018 => 5.2422, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2271 => 0.2380, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2891 => 0.3029, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.66% (0.4636 => 0.4852, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.53% (0.2871 => 0.3001, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.52% (1.5603 => 1.6309, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.3098 => 0.3238, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.49% (0.3052 => 0.3189, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.49% (0.3232 => 0.3377, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.49% (0.2831 => 0.2958, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.46% (0.2756 => 0.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.46% (0.2872 => 0.3000, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.41% (5.7591 => 6.0129, std. dev.: 0.0147) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.37% (0.8172 => 0.8529, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.35% (4.2646 => 4.4499, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 4.34% (0.3109 => 0.3244, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.24% (0.3422 => 0.3567, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.22% (0.2793 => 0.2911, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.21% (0.3162 => 0.3295, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.20% (0.4289 => 0.4469, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.20% (10.4361 => 10.8739, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.19% (2.0665 => 2.1531, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5569 => 0.5802, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (0.2877 => 0.2997, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.16% (0.3650 => 0.3802, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.14% (0.4103 => 0.4273, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.14% (0.2802 => 0.2918, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.14% (1.3050 => 1.3590, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3603 => 0.3752, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.06% (0.3423 => 0.3562, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.3136 => 0.3263, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.04% (8.1363 => 8.4649, std. dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3121 => 0.3247, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.03% (0.5860 => 0.6096, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.02% (0.3379 => 0.3515, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 4.02% (0.4299 => 0.4472, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.90% (0.4048 => 0.4206, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.85% (0.3684 => 0.3826, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.84% (0.4064 => 0.4220, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3935 => 0.4083, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.74% (0.3826 => 0.3969, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4203 => 0.4360, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.72% (0.3441 => 0.3569, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.62% (0.7835 => 0.8119, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.60% (0.5105 => 0.5289, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.55% (1.2842 => 1.3298, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.53% (0.4620 => 0.4783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.49% (0.9765 => 1.0106, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.5415 => 1.5950, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.42% (0.3387 => 0.3503, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.41% (0.6450 => 0.6670, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6675 => 0.6898, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 3.31% (0.6456 => 0.6670, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.29% (1.1861 => 1.2251, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.8067 => 0.8328, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 3.18% (3.3354 => 3.4414, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 3.13% (1.1642 => 1.2006, std. dev.: 0.0064) MultiSource/Applications/treecc/treecc: 2.88% (2.0273 => 2.0856, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.86% (3.8723 => 3.9830, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (14.3668 => 14.7700, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.5981 => 0.6143, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8921 => 0.9155, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.59% (1.4186 => 1.4553, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.5020 => 0.5135, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.20% (2.2969 => 2.3474, std. dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 2.19% (17.1811 => 17.5574, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.17% (1.5859 => 1.6203, std. dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 1.98% (1.1840 => 1.2075, std. dev.: 0.0069) MultiSource/Applications/minisat/minisat: 1.93% (0.7115 => 0.7252, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.73% (2.2024 => 2.2405, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.39% (1.0722 => 1.0871, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.37% (21.9371 => 22.2385, std. dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.30% (7.9617 => 8.0651, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.73% (4.2280 => 4.4278, std. dev.: 0.0134) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7537, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 3.03% (26.0924 => 26.8843, std. dev.: 0.0150) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3339, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.46% (9.1159 => 9.2490, std. dev.: 0.0227) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.29% (3.1578 => 3.1984, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5832, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.11% (1.5086 => 1.5254, std. dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6818, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.22% (5.2763 => 3.2070, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.72% (5.3855 => 3.7313, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.27% (5.3526 => 3.7322, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -15.09% (54.1659 => 45.9948, std. dev.: 0.0316) MultiSource/Applications/ClamAV/clamscan: -14.10% (22.1758 => 19.0497, std. dev.: 0.0216) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.87% (2.9384 => 2.5602, std. dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.65% (1.6925 => 1.4277, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -7.75% (1.5373 => 1.4182, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5038, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4747, std. dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.79% (8.6802 => 8.4380, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.61% (10.2830 => 10.0144, std. dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9644, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3483, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.05% (1.8329 => 1.8137, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 15:29:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 17:29:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120824222919.B25ED2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3197?compare_to=3194&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3197, Order: 162586, Start Time: 2012-08-24 21:10:54, End Time: 2012-08-24 22:30:14 To: 3194, Order: 162579, Start Time: 2012-08-24 19:24:01, End Time: 2012-08-24 20:43:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (132 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 1.93% (0.5379 => 0.5483, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 1.05% (7.9722 => 8.0559, std. dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.17% (10.3673 => 13.2882, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/trivial-interface: 15.17% (0.3473 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.96% (0.3497 => 0.4020, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.87% (0.3543 => 0.4070, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 14.82% (0.3543 => 0.4068, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 14.80% (0.3561 => 0.4088, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.76% (0.3516 => 0.4035, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3694 => 0.4221, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.87% (0.3828 => 0.4359, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.80% (0.3927 => 0.4469, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.56% (0.3886 => 0.4413, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.01% (1.1194 => 1.2538, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.49% (1.7609 => 1.9457, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.59% (2.2022 => 2.4133, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 9.15% (0.1432 => 0.1563, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5925 => 0.6428, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.29% (0.6030 => 0.6530, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.09% (0.1892 => 0.2045, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.58% (0.1584 => 0.1704, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.40% (0.1622 => 0.1742, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.15% (0.7326 => 0.7850, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.52% (0.4615 => 0.4916, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 6.28% (0.3282 => 0.3488, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.70% (7.0540 => 7.4561, std. dev.: 0.0322) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2271 => 0.2399, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.52% (0.4636 => 0.4892, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 5.50% (0.7433 => 0.7842, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.48% (0.2554 => 0.2694, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.46% (4.9449 => 5.2150, std. dev.: 0.0068) SingleSource/Regression/C++/ofstream_ctor: 5.44% (0.2905 => 0.3063, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 5.44% (9.4845 => 10.0000, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.8172 => 0.8603, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.24% (5.0018 => 5.2641, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 5.23% (0.2831 => 0.2979, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.22% (0.2891 => 0.3042, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.13% (0.3121 => 0.3281, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.12% (0.5860 => 0.6160, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.10% (0.5569 => 0.5853, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.07% (0.4299 => 0.4517, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (4.2646 => 4.4799, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/fibo: 5.03% (0.2725 => 0.2862, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.93% (0.2756 => 0.2892, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.92% (0.3109 => 0.3262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.87% (0.2872 => 0.3012, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.87% (0.2793 => 0.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.85% (0.3052 => 0.3200, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.84% (8.1363 => 8.5300, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.84% (0.3865 => 0.4052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.81% (0.2871 => 0.3009, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.80% (1.3050 => 1.3676, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.80% (0.3232 => 0.3387, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.79% (0.2714 => 0.2844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.78% (0.3098 => 0.3246, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.76% (0.3423 => 0.3586, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.72% (0.3283 => 0.3438, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.68% (0.3422 => 0.3582, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.66% (0.4289 => 0.4489, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.65% (2.0665 => 2.1626, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 4.64% (0.2802 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.62% (0.2877 => 0.3010, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3826 => 0.4002, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.59% (0.3162 => 0.3307, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.58% (0.4103 => 0.4291, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.58% (0.3650 => 0.3817, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.55% (10.4361 => 10.9107, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.53% (0.3136 => 0.3278, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.50% (0.3603 => 0.3765, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.49% (0.7835 => 0.8187, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.46% (0.2758 => 0.2881, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 4.45% (5.7591 => 6.0154, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.41% (0.2700 => 0.2819, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.33% (0.3441 => 0.3590, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3379 => 0.3525, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.29% (0.3935 => 0.4104, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.28% (0.9765 => 1.0183, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.22% (1.5603 => 1.6261, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.3092 => 0.3222, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.17% (1.1861 => 1.2356, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.17% (0.6450 => 0.6719, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.16% (0.4064 => 0.4233, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.09% (0.5105 => 0.5314, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.09% (0.4203 => 0.4375, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.07% (0.4620 => 0.4808, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.4048 => 0.4212, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.6456 => 0.6712, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (1.5415 => 1.6026, std. dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: 3.92% (1.2842 => 1.3346, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.92% (1.1642 => 1.2098, std. dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 3.78% (0.3387 => 0.3515, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.78% (0.6675 => 0.6927, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.73% (0.8067 => 0.8368, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 3.71% (3.3354 => 3.4590, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.67% (2.0273 => 2.1017, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 3.55% (3.8723 => 4.0098, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.41% (0.5981 => 0.6185, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.36% (1.4186 => 1.4662, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.13% (14.3668 => 14.8170, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.11% (0.5020 => 0.5176, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 3.06% (0.8921 => 0.9194, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 3.02% (2.2969 => 2.3662, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (1.5859 => 1.6321, std. dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.79% (17.1811 => 17.6608, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (2.2024 => 2.2609, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.60% (0.7115 => 0.7300, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.54% (1.1840 => 1.2141, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.05% (1.0722 => 1.0942, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.99% (7.9617 => 8.1198, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.87% (21.9371 => 22.3467, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (0.8101 => 0.8215, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.05% (4.2280 => 4.4415, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.02% (3.6395 => 3.7493, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 1.76% (26.0924 => 26.5524, std. dev.: 0.0144) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3397, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (1.5086 => 1.5324, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7986, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2290, std. dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/hash2: 1.19% (3.1578 => 3.1953, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6816, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.64% (5.2763 => 3.1850, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.92% (5.3855 => 3.7201, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7196, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0659, std. dev.: 0.0475) MultiSource/Applications/ClamAV/clamscan: -13.77% (22.1758 => 19.1229, std. dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.07% (2.9384 => 2.5544, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.24% (1.6925 => 1.4177, std. dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: -10.52% (1.2373 => 1.1071, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -8.00% (1.5373 => 1.4143, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4680, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -6.08% (1.1396 => 1.0703, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std. dev.: 0.0016) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4674, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4164, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.62% (10.2830 => 10.0132, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (8.1563 => 7.9661, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3304, std. dev.: 0.0068) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 14:20:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 16:20:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120822212034.F16122A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3127?compare_to=3122&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3127, Order: 162371, Start Time: 2012-08-22 18:37:57, End Time: 2012-08-22 21:21:28 To: 3122, Order: 162360, Start Time: 2012-08-22 15:26:45, End Time: 2012-08-22 18:10:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (120 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.17% (1.7146 => 1.7347, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.02% (2.8641 => 2.8933, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.87% (2.0805 => 2.1194, std. dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 15.90% (0.3496 => 0.4052, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 15.89% (0.3442 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.87% (0.3446 => 0.3993, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.85% (0.3488 => 0.4041, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 15.79% (0.3465 => 0.4012, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 15.75% (0.3460 => 0.4005, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 15.74% (0.3469 => 0.4015, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 15.23% (0.3643 => 0.4198, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 15.18% (0.3650 => 0.4204, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 14.93% (0.3724 => 0.4280, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.23% (0.3792 => 0.4218, std. dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.18% (0.5826 => 0.6361, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 8.88% (1.5932 => 1.7347, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 8.68% (0.5889 => 0.6400, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.58% (0.1620 => 0.1759, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.39% (0.7171 => 0.7701, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (3.5627 => 3.8234, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.30% (1.6211 => 1.7395, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.94% (1.3152 => 1.4065, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.86% (0.5000 => 0.5343, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.79% (0.4994 => 0.5333, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.68% (0.4029 => 0.4298, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2875 => 0.3061, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.39% (0.3930 => 0.4181, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.34% (1.0781 => 1.1465, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.33% (0.4361 => 0.4637, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.20% (4.2109 => 4.4721, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.15% (0.5026 => 0.5335, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.12% (0.5900 => 0.6261, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2729 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.01% (2.7292 => 2.8933, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2738 => 0.2902, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.91% (0.2792 => 0.2957, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2803 => 0.2967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.85% (0.3096 => 0.3277, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.68% (0.9909 => 1.0472, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.66% (0.3004 => 0.3174, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3195 => 0.3374, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.60% (0.2750 => 0.2904, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.56% (0.2823 => 0.2980, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.55% (0.2811 => 0.2967, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.55% (0.2813 => 0.2969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.2780 => 0.2933, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.47% (2.0673 => 2.1804, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.2866 => 0.3022, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.37% (5.5417 => 5.8393, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.32% (0.2911 => 0.3066, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.22% (1.9694 => 2.0723, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.22% (0.3258 => 0.3428, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3124 => 0.3287, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.21% (0.3625 => 0.3814, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.20% (0.3267 => 0.3437, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (1.9966 => 2.0990, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.12% (2.1013 => 2.2088, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3726 => 0.3916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.09% (0.4658 => 0.4895, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.07% (0.3060 => 0.3215, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3362 => 0.3531, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.99% (0.2566 => 0.2694, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.98% (0.3678 => 0.3861, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (2.1653 => 2.2729, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.91% (0.3690 => 0.3871, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (0.3890 => 0.4080, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.87% (0.3348 => 0.3511, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.83% (0.3477 => 0.3645, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.78% (0.3282 => 0.3439, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.75% (0.9697 => 1.0158, std. dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 4.73% (4.6177 => 4.8359, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.72% (0.3981 => 0.4169, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (4.4195 => 4.6186, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.3903 => 0.4078, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 4.44% (0.4146 => 0.4330, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 4.43% (0.7875 => 0.8224, std. dev.: 0.0059) MultiSource/Applications/lua/lua: 4.40% (1.4269 => 1.4897, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.32% (0.3845 => 0.4011, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.27% (1.8794 => 1.9597, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.3271 => 0.3409, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.12% (0.6634 => 0.6907, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 4.09% (0.5546 => 0.5773, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.06% (0.4139 => 0.4307, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.5012 => 0.5204, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.3084 => 0.3196, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.57% (23.5202 => 24.3595, std. dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.54% (0.6435 => 0.6663, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.37% (0.2969 => 0.3069, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.33% (0.3336 => 0.3447, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.71% (2.0346 => 2.0898, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (4.6926 => 4.7401, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 10.51% (0.2122 => 0.2345, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6706, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8963, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6337, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2011, std. dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5074, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.80% (2.0820 => 2.1194, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5893, std. dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2249, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.62% (41.7953 => 42.4715, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std. dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5864, std. dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.61% (2.4764 => 2.3871, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.71% (25.4195 => 16.5955, std. dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7977, std. dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8013, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.15% (0.6293 => 0.6095, std. dev.: 0.0043) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.03% (17.2379 => 16.8882, std. dev.: 0.0293) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5732, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9694, std. dev.: 0.0118) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4972, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 11:09:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 13:09:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120822180925.670FA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3122?compare_to=3119&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3122, Order: 162360, Start Time: 2012-08-22 15:26:45, End Time: 2012-08-22 18:10:18 To: 3119, Order: 162354, Start Time: 2012-08-22 10:45:50, End Time: 2012-08-22 13:29:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.20% (54.2088 => 54.8604, std. dev.: 0.0590) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.29% (0.3465 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.24% (0.3442 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.19% (0.3446 => 0.3935, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.19% (0.3496 => 0.3992, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.13% (0.3488 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3460 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3469 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 13.59% (0.3650 => 0.4146, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3724 => 0.4219, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.66% (0.3792 => 0.4234, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.31% (0.5826 => 0.6310, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.91% (0.5889 => 0.6355, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.62% (1.5932 => 1.7146, std. dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.1619 => 0.1737, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.58% (0.7171 => 0.7643, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.58% (1.6211 => 1.7277, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2875 => 0.3063, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.51% (3.5627 => 3.7947, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.36% (0.2738 => 0.2912, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.31% (0.2725 => 0.2897, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.23% (1.3152 => 1.3972, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2729 => 0.2898, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2803 => 0.2976, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (0.4361 => 0.4629, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.11% (0.5026 => 0.5333, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.03% (0.4994 => 0.5295, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.96% (0.5000 => 0.5298, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.96% (0.3004 => 0.3183, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.95% (0.2792 => 0.2958, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.94% (0.3096 => 0.3280, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.89% (0.2750 => 0.2912, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.86% (0.9909 => 1.0490, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3195 => 0.3382, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.83% (0.2780 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.79% (0.2813 => 0.2976, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.77% (0.3258 => 0.3446, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.76% (0.2811 => 0.2973, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2823 => 0.2985, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.73% (0.4029 => 0.4260, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.73% (0.3930 => 0.4155, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.72% (2.0673 => 2.1856, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2911 => 0.3074, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.57% (0.3267 => 0.3449, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.56% (4.2109 => 4.4452, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 5.52% (0.3317 => 0.3500, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.51% (0.5900 => 0.6225, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 5.41% (1.0781 => 1.1364, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3060 => 0.3225, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.38% (0.3124 => 0.3292, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.23% (0.3362 => 0.3538, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.23% (0.3726 => 0.3921, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.23% (0.3348 => 0.3523, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.23% (0.2736 => 0.2879, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.18% (0.3282 => 0.3452, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3678 => 0.3868, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.13% (0.3625 => 0.3811, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 5.12% (0.3477 => 0.3655, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.06% (0.9697 => 1.0188, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.02% (0.2866 => 0.3010, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 4.96% (5.5417 => 5.8166, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.94% (2.7292 => 2.8641, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (0.4251 => 0.4455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.4146 => 0.4343, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.75% (0.3981 => 0.4170, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.74% (1.9694 => 2.0628, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.65% (1.9966 => 2.0895, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.64% (0.2566 => 0.2685, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.63% (0.3845 => 0.4023, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.60% (0.3890 => 0.4069, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (0.4658 => 0.4869, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.25% (2.1013 => 2.1907, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.25% (2.1653 => 2.2573, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 4.22% (0.6634 => 0.6914, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (4.4195 => 4.6055, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.09% (4.6177 => 4.8064, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.07% (0.3903 => 0.4062, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.07% (0.6435 => 0.6697, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 4.06% (1.4269 => 1.4848, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 4.00% (1.8794 => 1.9545, std. dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 3.97% (23.5202 => 24.4531, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.91% (0.2737 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.87% (0.5012 => 0.5206, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 3.86% (0.7875 => 0.8179, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.84% (0.4139 => 0.4298, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.73% (0.3084 => 0.3199, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.67% (0.3271 => 0.3391, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.59% (0.5546 => 0.5745, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.47% (0.2969 => 0.3072, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 3.45% (0.3336 => 0.3451, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.51% (2.0346 => 2.0856, std. dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (0.4847 => 0.4961, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.88% (0.5361 => 0.5462, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (0.7426 => 0.7558, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.34% (11.6398 => 11.7962, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.29% (4.6926 => 4.7529, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 8.25% (0.2122 => 0.2297, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6659, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0270) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8867, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6383, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1923, std. dev.: 0.0126) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5044, std. dev.: 0.0235) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5915, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4483, std. dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2805, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5869, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4385, std. dev.: 0.0309) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.42% (2.4764 => 2.3918, std. dev.: 0.0288) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5707, std. dev.: 0.0126) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8116, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std. dev.: 0.0050) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.25% (17.2379 => 16.8501, std. dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5719, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9581, std. dev.: 0.0162) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4977, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 17:31:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 19:31:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120823003133.A5AA72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3132?compare_to=3127&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3132, Order: 162396, Start Time: 2012-08-22 21:48:59, End Time: 2012-08-23 00:32:26 To: 3127, Order: 162371, Start Time: 2012-08-22 18:37:57, End Time: 2012-08-22 21:21:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (116 on baseline) Performance Improvements: 14 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 939 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.06% (1.3453 => 1.3595, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: -2.65% (0.4041 => 0.3934, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -2.64% (0.4052 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -2.59% (0.4015 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -2.53% (0.3989 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.53% (0.3993 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.53% (0.4198 => 0.4092, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4280 => 0.4172, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -2.50% (0.4005 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.45% (0.4204 => 0.4101, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.75% (2.8933 => 2.8427, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: -1.30% (0.7701 => 0.7601, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (2.2088 => 2.1858, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.03% (2.0723 => 2.0510, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -4.56% (0.2345 => 0.2238, std. dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3465 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3442 => 0.3888, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.86% (0.3460 => 0.3905, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.84% (0.3496 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.79% (0.3488 => 0.3934, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.36% (0.3650 => 0.4101, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3643 => 0.4092, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1063 => 0.1172, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 9.39% (1.5932 => 1.7428, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.81% (0.5826 => 0.6281, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.44% (0.5889 => 0.6327, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.92% (0.1619 => 0.1731, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (1.6211 => 1.7292, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (3.5627 => 3.7854, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.17% (1.3152 => 1.3963, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (0.4994 => 0.5301, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.00% (0.7171 => 0.7601, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (0.5000 => 0.5288, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.2014 => 0.2130, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.71% (0.4361 => 0.4610, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.70% (0.3930 => 0.4154, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.66% (0.4029 => 0.4257, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.58% (1.0781 => 1.1383, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.2866 => 0.3024, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.37% (0.2738 => 0.2885, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.25% (4.2109 => 4.4318, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.19% (0.2736 => 0.2878, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.15% (0.5026 => 0.5285, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.07% (0.5900 => 0.6199, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.97% (0.2875 => 0.3018, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.84% (0.9909 => 1.0389, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 4.79% (0.3004 => 0.3148, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.73% (0.2725 => 0.2854, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.69% (0.3195 => 0.3345, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.69% (0.2729 => 0.2857, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2714 => 0.2841, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 4.60% (5.5417 => 5.7968, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.58% (0.2792 => 0.2920, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 4.58% (0.2750 => 0.2876, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.53% (0.2780 => 0.2906, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.52% (0.2566 => 0.2682, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.51% (0.2813 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.2823 => 0.2950, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.49% (0.3096 => 0.3235, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.46% (2.0673 => 2.1595, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.45% (0.2811 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.39% (0.2803 => 0.2926, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (0.3625 => 0.3784, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.3267 => 0.3408, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.30% (0.3258 => 0.3398, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.28% (0.3362 => 0.3506, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.26% (0.2911 => 0.3035, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.25% (0.3317 => 0.3458, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (0.3890 => 0.4054, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.22% (0.3060 => 0.3189, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.19% (4.6177 => 4.8111, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.17% (0.3282 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.16% (0.3726 => 0.3881, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.16% (2.7292 => 2.8427, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.16% (0.3271 => 0.3407, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (1.9694 => 2.0510, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.12% (4.4195 => 4.6015, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (1.9966 => 2.0787, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.07% (0.9697 => 1.0092, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.07% (0.3124 => 0.3251, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.06% (0.3348 => 0.3484, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (2.1013 => 2.1858, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.00% (2.1653 => 2.2520, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (0.4658 => 0.4844, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.97% (0.7875 => 0.8188, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 3.91% (23.5202 => 24.4410, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists1: 3.88% (0.3477 => 0.3612, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.81% (0.4146 => 0.4304, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.77% (1.8794 => 1.9502, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 3.76% (0.4251 => 0.4411, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.67% (0.3981 => 0.4127, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.66% (0.3903 => 0.4046, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.66% (0.3690 => 0.3825, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 3.57% (0.6634 => 0.6871, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 3.46% (1.4269 => 1.4763, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (0.3845 => 0.3978, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.34% (0.5546 => 0.5731, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.3084 => 0.3186, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.09% (0.3336 => 0.3439, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.07% (0.5012 => 0.5166, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.62% (2.0346 => 2.0880, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.39% (0.7426 => 0.7529, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6716, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8912, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6451, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1981, std. dev.: 0.0071) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5053, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5903, std. dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2218, std. dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4373, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2829, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5990, std. dev.: 0.0316) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.69% (2.4764 => 2.3849, std. dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5826, std. dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/ary2: -7.83% (0.2402 => 0.2214, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8087, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8065, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std. dev.: 0.0030) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.89% (17.2379 => 16.7400, std. dev.: 0.0906) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5777, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9642, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 15:05:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 17:05:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822220535.4336F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3129?compare_to=3126&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3129, Order: 162386, Start Time: 2012-08-22 20:47:21, End Time: 2012-08-22 22:06:19 To: 3126, Order: 162375, Start Time: 2012-08-22 19:00:45, End Time: 2012-08-22 20:19:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (113 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (726 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.79% (54.7313 => 56.2584, std. dev.: 0.2447) SingleSource/Benchmarks/Misc/mandel-2: 1.03% (1.4146 => 1.4291, std. dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.75% (10.3673 => 13.5557, std. dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.10% (1.1194 => 1.2548, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.81% (0.3473 => 0.3883, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3543 => 0.3949, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.36% (1.7609 => 1.9609, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.71% (2.2022 => 2.4161, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.80% (0.3817 => 0.4153, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference-object: 7.50% (0.6030 => 0.6482, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.46% (0.5925 => 0.6367, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.24% (0.1892 => 0.2029, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.94% (0.1584 => 0.1694, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.32% (0.7326 => 0.7789, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.30% (0.2065 => 0.2195, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.25% (7.0540 => 7.4946, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 5.94% (0.3282 => 0.3477, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4615 => 0.4868, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.17% (0.3307 => 0.3478, std. dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 4.96% (0.7433 => 0.7802, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 4.91% (9.4845 => 9.9499, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.65% (4.9449 => 5.1748, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.62% (0.2271 => 0.2376, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.60% (0.3109 => 0.3252, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.49% (5.0018 => 5.2266, std. dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 4.44% (10.4361 => 10.8997, std. dev.: 0.0104) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.38% (0.8172 => 0.8530, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 4.35% (0.2554 => 0.2665, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.16% (0.5860 => 0.6104, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.16% (4.2646 => 4.4421, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 4.13% (5.7591 => 5.9970, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.09% (0.5569 => 0.5797, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.03% (1.3050 => 1.3576, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.01% (0.3121 => 0.3246, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.95% (8.1363 => 8.4575, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 3.93% (0.4299 => 0.4468, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.90% (0.4636 => 0.4817, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 3.89% (0.3423 => 0.3556, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.87% (0.3441 => 0.3574, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.70% (1.5603 => 1.6181, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.9765 => 1.0125, std. dev.: 0.0049) MultiSource/Applications/spiff/spiff: 3.64% (0.7835 => 0.8120, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.49% (0.6450 => 0.6675, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.37% (0.5105 => 0.5277, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.35% (1.1861 => 1.2258, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.33% (1.5415 => 1.5928, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.31% (0.4103 => 0.4239, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.30% (0.8067 => 0.8333, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.26% (0.3865 => 0.3991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.19% (0.4289 => 0.4426, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.16% (0.6675 => 0.6886, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.15% (1.1642 => 1.2009, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (0.4064 => 0.4189, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.07% (0.3935 => 0.4056, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.07% (0.3387 => 0.3491, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.03% (0.3826 => 0.3942, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.99% (0.6456 => 0.6649, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.98% (2.0665 => 2.1281, std. dev.: 0.0044) MultiSource/Applications/d/make_dparser: 2.94% (3.3354 => 3.4335, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.88% (2.0273 => 2.0857, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 2.86% (0.3603 => 0.3706, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.83% (0.5981 => 0.6150, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.79% (3.8723 => 3.9805, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.71% (0.4620 => 0.4745, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.70% (1.2842 => 1.3189, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.65% (0.8921 => 0.9157, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (14.3668 => 14.7426, std. dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.59% (1.4186 => 1.4554, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.43% (2.2969 => 2.3527, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.32% (1.5859 => 1.6227, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.03% (17.1811 => 17.5305, std. dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2470, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.97% (1.1840 => 1.2073, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.95% (0.7115 => 0.7254, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.52% (1.0722 => 1.0885, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.26% (7.9617 => 8.0620, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.19% (21.9371 => 22.1972, std. dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.16% (4.2280 => 4.4462, std. dev.: 0.0104) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.03% (26.0924 => 26.8826, std. dev.: 0.0311) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7466, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3342, std. dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2485, std. dev.: 0.0375) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.09% (3.1578 => 3.1922, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5790, std. dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6813, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1249, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.31% (5.2763 => 3.2021, std. dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.65% (5.3855 => 3.7349, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.22% (5.3526 => 3.7351, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0045, std. dev.: 0.0319) MultiSource/Applications/ClamAV/clamscan: -14.29% (22.1758 => 19.0072, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.82% (2.9384 => 2.5618, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -7.04% (1.5373 => 1.4291, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std. dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4691, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4254, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.78% (1.3677 => 1.3297, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0054, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9583, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3419, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.48% (2.5528 => 2.5151, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: -1.01% (1.1333 => 1.1219, std. dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 16:52:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 18:52:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822235219.692D22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3131?compare_to=3129&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3131, Order: 162399, Start Time: 2012-08-22 22:34:13, End Time: 2012-08-22 23:53:13 To: 3129, Order: 162386, Start Time: 2012-08-22 20:47:21, End Time: 2012-08-22 22:06:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.62% (10.3673 => 13.5418, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/trivial-interface: 12.93% (0.3473 => 0.3922, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/synchronized: 12.55% (0.3561 => 0.4008, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 12.53% (0.3543 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3516 => 0.3955, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.07% (1.1194 => 1.2545, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3694 => 0.4137, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.83% (1.7609 => 1.9516, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.91% (2.2022 => 2.4204, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops: 9.08% (0.1432 => 0.1562, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.25% (0.3817 => 0.4132, std. dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.14% (0.1892 => 0.2027, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.01% (0.1584 => 0.1695, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.00% (0.5925 => 0.6340, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.93% (0.6030 => 0.6448, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.84% (0.1622 => 0.1733, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.39% (7.0540 => 7.5045, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/oourafft: 6.19% (0.3282 => 0.3485, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 5.83% (0.7326 => 0.7753, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.4615 => 0.4874, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.37% (0.4879 => 0.5141, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3307 => 0.3475, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.07% (9.4845 => 9.9654, std. dev.: 0.0142) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2271 => 0.2382, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.8172 => 0.8565, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.75% (0.2107 => 0.2207, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.70% (4.9449 => 5.1771, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.63% (5.0018 => 5.2335, std. dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 4.62% (0.2554 => 0.2672, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.61% (0.7433 => 0.7776, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 4.47% (0.3109 => 0.3248, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.31% (0.5569 => 0.5809, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 4.26% (0.4299 => 0.4482, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.20% (4.2646 => 4.4436, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.17% (0.3121 => 0.3251, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.16% (0.4636 => 0.4829, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3441 => 0.3583, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.11% (8.1363 => 8.4710, std. dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 4.10% (5.7591 => 5.9954, std. dev.: 0.0157) MultiSource/Benchmarks/McCat/18-imp/imp: 4.09% (0.3423 => 0.3563, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.08% (0.5860 => 0.6099, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.03% (1.3050 => 1.3576, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.97% (10.4361 => 10.8506, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.84% (0.5105 => 0.5301, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: 3.79% (0.7835 => 0.8132, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.78% (0.2700 => 0.2802, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 3.77% (1.5603 => 1.6192, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 3.75% (0.2905 => 0.3014, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2891 => 0.2998, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 3.68% (0.3180 => 0.3297, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.63% (1.5415 => 1.5974, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.49% (0.4103 => 0.4246, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.48% (0.2872 => 0.2972, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.43% (0.3232 => 0.3343, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.43% (0.9765 => 1.0100, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.43% (0.6450 => 0.6671, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.41% (0.3052 => 0.3156, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.40% (0.4289 => 0.4435, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3865 => 0.3996, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.36% (0.3098 => 0.3202, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.35% (0.3162 => 0.3268, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.30% (0.8067 => 0.8333, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2252, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3650 => 0.3769, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.26% (0.3283 => 0.3390, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (2.0665 => 2.1333, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.21% (0.3422 => 0.3532, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.21% (1.1642 => 1.2016, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.12% (0.3684 => 0.3799, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.11% (0.3826 => 0.3945, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.11% (0.3603 => 0.3715, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.05% (0.3935 => 0.4055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 2.99% (0.3379 => 0.3480, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5981 => 0.6159, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.94% (0.6675 => 0.6871, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.93% (0.4064 => 0.4183, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.92% (3.8723 => 3.9852, std. dev.: 0.0082) MultiSource/Applications/treecc/treecc: 2.92% (2.0273 => 2.0864, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.89% (3.3354 => 3.4319, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.4203 => 0.4321, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.77% (0.6456 => 0.6635, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.75% (1.2842 => 1.3195, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.4620 => 0.4746, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.4048 => 0.4157, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (14.3668 => 14.7419, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8921 => 0.9152, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.4186 => 1.4541, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 2.29% (2.2969 => 2.3495, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.5020 => 0.5131, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.02% (17.1811 => 17.5288, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.5859 => 1.6178, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.88% (1.1840 => 1.2062, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.70% (2.2024 => 2.2399, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.63% (0.7115 => 0.7231, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.53% (7.9617 => 8.0839, std. dev.: 0.0084) MultiSource/Applications/lemon/lemon: 1.35% (1.0722 => 1.0867, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.27% (21.9371 => 22.2151, std. dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (4.2280 => 4.4285, std. dev.: 0.0135) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.2944 => 0.3053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7593, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.91% (26.0924 => 26.8528, std. dev.: 0.0409) MultiSource/Applications/siod/siod: 1.59% (3.2827 => 3.3350, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 1.47% (9.1159 => 9.2498, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7976, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.32% (1.5086 => 1.5285, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.08% (3.1578 => 3.1918, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.44% (0.8651 => 0.1692, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.19% (5.2763 => 3.2083, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.50% (5.3855 => 3.7428, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.10% (5.3526 => 3.7412, std. dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0664, std. dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: -14.33% (22.1758 => 18.9974, std. dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.53% (2.9384 => 2.5702, std. dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2373 => 1.1076, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -7.78% (1.5373 => 1.4177, std. dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4680, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -7.09% (1.1396 => 1.0588, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.82% (1.5660 => 1.4905, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4651, std. dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4176, std. dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.59% (10.2830 => 10.0170, std. dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9612, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3485, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.8329 => 1.8143, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 13:18:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 15:18:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822201857.D35132A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3126?compare_to=3124&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3126, Order: 162375, Start Time: 2012-08-22 19:00:45, End Time: 2012-08-22 20:19:50 To: 3124, Order: 162362, Start Time: 2012-08-22 17:13:46, End Time: 2012-08-22 18:33:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (116 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (723 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.42% (1.0927 => 1.1082, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.37% (13.8226 => 13.4956, std. dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: -1.70% (11.0650 => 10.8773, std. dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.17% (10.3673 => 13.4956, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/trivial-interface: 14.51% (0.3473 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.24% (0.3497 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.20% (0.3543 => 0.4046, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3561 => 0.4066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.11% (0.3543 => 0.4043, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3516 => 0.4011, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3694 => 0.4200, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.24% (0.3828 => 0.4335, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: 12.96% (0.3927 => 0.4436, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.92% (0.3886 => 0.4388, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.06% (1.1194 => 1.2544, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.60% (1.7609 => 1.9475, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.11% (2.2022 => 2.4029, std. dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 7.56% (0.5925 => 0.6373, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.51% (0.6030 => 0.6483, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.45% (0.1892 => 0.2033, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.07% (0.1584 => 0.1696, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.70% (0.3177 => 0.3390, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.42% (0.7326 => 0.7796, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.00% (0.4615 => 0.4892, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.89% (7.0540 => 7.4693, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: 5.79% (0.3282 => 0.3472, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.47% (0.3307 => 0.3488, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.4879 => 0.5146, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.46% (0.2271 => 0.2395, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.27% (0.8172 => 0.8603, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.15% (4.9449 => 5.1995, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 5.15% (9.4845 => 9.9728, std. dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.04% (5.0018 => 5.2540, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 4.93% (0.2554 => 0.2680, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.86% (0.5860 => 0.6145, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 4.63% (0.7433 => 0.7777, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.61% (0.3121 => 0.3265, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5569 => 0.5824, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.53% (4.2646 => 4.4579, std. dev.: 0.0126) MultiSource/Applications/sgefa/sgefa: 4.50% (0.3109 => 0.3249, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.46% (8.1363 => 8.4993, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.42% (1.3050 => 1.3627, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.38% (0.3423 => 0.3573, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.35% (0.4299 => 0.4486, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.23% (10.4361 => 10.8773, std. dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 4.20% (5.7591 => 6.0011, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 4.19% (0.7835 => 0.8163, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.98% (1.5415 => 1.6028, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.95% (0.3441 => 0.3577, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.93% (0.4636 => 0.4818, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.90% (0.9765 => 1.0146, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.88% (0.6450 => 0.6700, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 3.84% (0.3180 => 0.3302, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.82% (0.8067 => 0.8375, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.78% (0.2700 => 0.2802, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.77% (0.2891 => 0.3000, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.73% (0.2872 => 0.2979, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1861 => 1.2294, std. dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 3.65% (0.2905 => 0.3011, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.59% (0.4289 => 0.4443, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 3.56% (0.3092 => 0.3202, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5105 => 0.5284, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 3.50% (0.3603 => 0.3729, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.50% (1.1642 => 1.2049, std. dev.: 0.0087) MultiSource/Benchmarks/sim/sim: 3.45% (0.3387 => 0.3504, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.45% (3.3354 => 3.4506, std. dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/matrix: 3.45% (0.3098 => 0.3205, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.41% (1.5603 => 1.6135, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 3.37% (0.3232 => 0.3341, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3865 => 0.3995, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.6675 => 0.6898, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.30% (0.3422 => 0.3535, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.21% (0.4203 => 0.4338, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5981 => 0.6173, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.16% (2.0665 => 2.1319, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.16% (2.0273 => 2.0914, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 3.14% (0.3283 => 0.3386, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (0.4064 => 0.4188, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.05% (3.8723 => 3.9904, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8026, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.01% (0.3826 => 0.3941, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3684 => 0.3793, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.92% (0.4620 => 0.4755, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.91% (1.4186 => 1.4599, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.90% (0.6456 => 0.6643, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 2.79% (0.8921 => 0.9170, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.69% (0.4048 => 0.4157, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.2842 => 1.3183, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 2.49% (2.2969 => 2.3542, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5859 => 1.6243, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.41% (0.5020 => 0.5141, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.25% (17.1811 => 17.5669, std. dev.: 0.0159) MultiSource/Benchmarks/nbench/nbench: 2.24% (1.1840 => 1.2105, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 2.11% (0.7115 => 0.7265, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (2.2024 => 2.2468, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.86% (7.9617 => 8.1098, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.54% (1.0722 => 1.0887, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.37% (21.9371 => 22.2379, std. dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.99% (4.2280 => 4.4388, std. dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.77% (0.2944 => 0.3055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0031) MultiSource/Applications/lua/lua: 2.84% (26.0924 => 26.8342, std. dev.: 0.0239) MultiSource/Applications/siod/siod: 1.56% (3.2827 => 3.3338, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2414, std. dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.17% (3.1578 => 3.1949, std. dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.40% (5.2763 => 3.1975, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.66% (5.3855 => 3.7345, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.27% (5.3526 => 3.7323, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1583, std. dev.: 0.0514) MultiSource/Applications/ClamAV/clamscan: -14.05% (22.1758 => 19.0603, std. dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.79% (2.9384 => 2.5626, std. dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.43% (1.2373 => 1.1082, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -7.98% (1.5373 => 1.4146, std. dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.05% (1.1396 => 1.0593, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0026) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4687, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4180, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0036, std. dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (8.1563 => 7.9565, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3470, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4237, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8133, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 09:45:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 11:45:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822164520.C6EDF2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3121?compare_to=3117&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3121, Order: 162360, Start Time: 2012-08-22 15:26:46, End Time: 2012-08-22 16:46:14 To: 3117, Order: 162354, Start Time: 2012-08-22 10:58:07, End Time: 2012-08-22 12:17:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (125 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.54% (78.5723 => 80.5646, std. dev.: 0.3315) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.54% (3.8466 => 3.7875, std. dev.: 0.0214) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.42% (10.3673 => 14.0393, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 13.94% (0.3473 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.72% (0.3543 => 0.4029, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.72% (0.3543 => 0.4029, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 13.68% (0.3516 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3497 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.56% (0.3561 => 0.4044, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.26% (0.3694 => 0.4184, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.83% (0.3828 => 0.4319, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.55% (0.3927 => 0.4420, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.43% (0.3886 => 0.4369, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.08% (1.1194 => 1.2546, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.76% (1.7609 => 1.9504, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.30% (2.2022 => 2.4071, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.14% (0.1892 => 0.2046, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 7.58% (0.1622 => 0.1745, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.20% (0.1584 => 0.1698, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.16% (0.5925 => 0.6349, std. dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 7.08% (0.6030 => 0.6457, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.99% (0.3177 => 0.3399, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.11% (0.4879 => 0.5177, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 6.03% (0.7326 => 0.7768, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.4615 => 0.4890, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 5.94% (0.3282 => 0.3477, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.89% (7.0540 => 7.4693, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.79% (0.8172 => 0.8645, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.51% (0.2758 => 0.2910, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 5.50% (10.4361 => 11.0103, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.47% (0.3307 => 0.3488, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.35% (9.4845 => 9.9920, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.25% (4.9449 => 5.2045, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.3121 => 0.3284, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.20% (5.0018 => 5.2618, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.20% (0.2271 => 0.2389, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 5.06% (0.7433 => 0.7809, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2554 => 0.2678, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.83% (0.5860 => 0.6143, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.80% (4.2646 => 4.4693, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.67% (0.5569 => 0.5829, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 4.63% (0.3109 => 0.3253, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.41% (1.3050 => 1.3626, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.38% (0.4636 => 0.4839, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.37% (8.1363 => 8.4917, std. dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 4.34% (5.7591 => 6.0092, std. dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 4.30% (0.2905 => 0.3030, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.28% (0.4299 => 0.4483, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.24% (0.7835 => 0.8167, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.22% (0.6450 => 0.6722, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.18% (0.3441 => 0.3585, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.18% (0.3180 => 0.3313, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.12% (0.2891 => 0.3010, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.8067 => 0.8398, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.07% (0.5105 => 0.5313, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.04% (0.2700 => 0.2809, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.97% (1.5603 => 1.6223, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.96% (0.2756 => 0.2865, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.91% (1.5415 => 1.6017, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2831 => 0.2941, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.85% (0.9765 => 1.0141, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.84% (2.0665 => 2.1458, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (1.1861 => 1.2316, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3422 => 0.3553, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3232 => 0.3355, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.78% (0.3650 => 0.3788, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.73% (0.6675 => 0.6924, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.72% (0.3387 => 0.3513, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.3098 => 0.3213, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4289 => 0.4448, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 3.69% (0.2871 => 0.2977, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.69% (0.3092 => 0.3206, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 3.67% (0.3052 => 0.3164, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.4103 => 0.4253, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.60% (0.3136 => 0.3249, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3865 => 0.4004, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (0.3283 => 0.3400, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 3.55% (0.3379 => 0.3499, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.54% (3.3354 => 3.4535, std. dev.: 0.0185) MultiSource/Applications/Burg/burg: 3.51% (1.1642 => 1.2051, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.51% (0.3162 => 0.3273, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.48% (0.3826 => 0.3959, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3603 => 0.3725, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.32% (3.8723 => 4.0008, std. dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3684 => 0.3805, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5981 => 0.6177, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4620 => 0.4771, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.25% (2.0273 => 2.0931, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.6456 => 0.6663, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.19% (1.2842 => 1.3252, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.4064 => 0.4193, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (14.3668 => 14.8130, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.4203 => 0.4333, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.06% (0.4048 => 0.4172, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.4186 => 1.4609, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 2.89% (0.8921 => 0.9179, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.70% (17.1811 => 17.6444, std. dev.: 0.0233) MultiSource/Applications/siod/siod: 2.64% (2.2969 => 2.3576, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.59% (0.5020 => 0.5150, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.53% (1.5859 => 1.6260, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.1840 => 1.2106, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: 2.15% (0.7115 => 0.7268, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.2024 => 2.2475, std. dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.93% (7.9617 => 8.1151, std. dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.68% (1.0722 => 1.0902, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.33% (21.9371 => 22.2290, std. dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.42% (2.6778 => 2.9569, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.97% (4.2280 => 4.4381, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.74% (0.2944 => 0.3054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7536, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.97% (26.0924 => 26.8664, std. dev.: 0.0347) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2423, std. dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1983, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.26% (1.5086 => 1.5276, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5768, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6815, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.32% (5.2763 => 3.2019, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.82% (5.3855 => 3.7256, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.48% (5.3526 => 3.7209, std. dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -15.18% (54.1659 => 45.9451, std. dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: -13.90% (22.1758 => 19.0940, std. dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.99% (2.9384 => 2.5567, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.2373 => 1.0987, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -9.65% (1.5373 => 1.3890, std. dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.1396 => 1.0592, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4638, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.6802 => 8.4394, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0024, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (8.1563 => 7.9611, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3379, std. dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8130, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 11:32:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 13:32:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120822183213.D54792A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3124?compare_to=3121&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3124, Order: 162362, Start Time: 2012-08-22 17:13:46, End Time: 2012-08-22 18:33:07 To: 3121, Order: 162360, Start Time: 2012-08-22 15:26:46, End Time: 2012-08-22 16:46:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (131 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (706 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.54% (14.0393 => 13.8226, std. dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.33% (10.3673 => 13.8226, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/trivial-interface: 14.43% (0.3473 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.20% (0.3543 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.18% (0.3497 => 0.3993, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.11% (0.3516 => 0.4012, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3543 => 0.4042, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.04% (0.3561 => 0.4061, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3694 => 0.4197, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.30% (0.3828 => 0.4337, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.99% (0.3927 => 0.4437, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.97% (0.3886 => 0.4390, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.04% (1.1194 => 1.2542, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.89% (1.7609 => 1.9526, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.55% (2.2022 => 2.4125, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.43% (0.1432 => 0.1567, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.98% (0.1892 => 0.2043, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.46% (0.5925 => 0.6367, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.45% (0.1584 => 0.1702, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.40% (0.6030 => 0.6476, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.11% (0.3177 => 0.3403, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.91% (0.7326 => 0.7832, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 6.25% (0.3282 => 0.3487, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.22% (7.0540 => 7.4927, std. dev.: 0.0160) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.07% (0.4615 => 0.4895, std. dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 6.03% (10.4361 => 11.0650, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.96% (0.4879 => 0.5170, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.78% (0.3307 => 0.3498, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.34% (0.7433 => 0.7830, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 5.29% (9.4845 => 9.9865, std. dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2271 => 0.2390, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.11% (4.9449 => 5.1975, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 5.09% (0.2554 => 0.2684, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.02% (0.8172 => 0.8582, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.00% (5.0018 => 5.2518, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.88% (0.2891 => 0.3032, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.77% (0.7835 => 0.8209, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.77% (0.4636 => 0.4857, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.74% (0.5569 => 0.5833, std. dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 4.70% (0.3109 => 0.3255, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (4.2646 => 4.4626, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.59% (0.5860 => 0.6129, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.52% (0.3121 => 0.3262, std. dev.: 0.0052) SingleSource/Regression/C++/ofstream_ctor: 4.51% (0.2905 => 0.3036, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.41% (0.3423 => 0.3574, std. dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 4.40% (5.7591 => 6.0125, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.40% (1.3050 => 1.3624, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.36% (8.1363 => 8.4909, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/strcat: 4.34% (0.2831 => 0.2954, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.33% (0.4299 => 0.4485, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2758 => 0.2877, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 4.29% (0.4289 => 0.4473, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.28% (0.2756 => 0.2874, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3232 => 0.3370, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.24% (0.3441 => 0.3587, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 4.23% (0.3283 => 0.3422, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3052 => 0.3181, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.18% (0.2871 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.15% (0.2793 => 0.2909, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.14% (0.2872 => 0.2991, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.13% (0.3098 => 0.3226, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.11% (1.5603 => 1.6245, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.11% (0.3162 => 0.3292, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.09% (0.3180 => 0.3310, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.07% (0.2700 => 0.2810, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.06% (0.3865 => 0.4022, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.06% (0.3422 => 0.3561, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.05% (0.3136 => 0.3263, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.04% (0.3092 => 0.3217, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2802 => 0.2914, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.99% (2.0665 => 2.1490, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.98% (0.8067 => 0.8388, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 3.93% (0.2877 => 0.2990, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.92% (0.3826 => 0.3976, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.91% (0.9765 => 1.0147, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6450 => 0.6701, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.83% (1.5415 => 1.6005, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 3.82% (0.3379 => 0.3508, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.5105 => 0.5298, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.72% (1.1642 => 1.2075, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1861 => 1.2298, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3935 => 0.4079, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (0.4064 => 0.4212, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.61% (1.2842 => 1.3305, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.4203 => 0.4353, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.56% (0.3684 => 0.3815, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 3.53% (0.4048 => 0.4191, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.6456 => 0.6684, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.51% (0.3387 => 0.3506, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.46% (0.4620 => 0.4780, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.46% (0.6675 => 0.6906, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.46% (2.0273 => 2.0974, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 3.38% (3.3354 => 3.4481, std. dev.: 0.0127) MultiSource/Applications/lua/lua: 3.33% (3.8723 => 4.0014, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.33% (0.5981 => 0.6180, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (14.3668 => 14.8102, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.07% (1.4186 => 1.4621, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 2.92% (2.2969 => 2.3639, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8921 => 0.9176, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.69% (0.5020 => 0.5155, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.60% (1.5859 => 1.6271, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.36% (17.1811 => 17.5874, std. dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 2.30% (1.1840 => 1.2112, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 2.25% (0.7115 => 0.7275, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2471, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.92% (7.9617 => 8.1142, std. dev.: 0.0097) MultiSource/Applications/lemon/lemon: 1.67% (1.0722 => 1.0901, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.40% (21.9371 => 22.2446, std. dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9581, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.92% (4.2280 => 4.4362, std. dev.: 0.0152) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.84% (0.2944 => 0.3057, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.03% (26.0924 => 26.8827, std. dev.: 0.0216) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7489, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.57% (3.2827 => 3.3341, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2426, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7977, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.10% (3.1578 => 3.1925, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5789, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.03% (2.6546 => 2.6820, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1277, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.38% (0.8651 => 0.1697, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.25% (5.2763 => 3.2053, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.90% (5.3855 => 3.7213, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.43% (5.3526 => 3.7239, std. dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -15.14% (54.1659 => 45.9670, std. dev.: 0.0186) MultiSource/Applications/ClamAV/clamscan: -14.05% (22.1758 => 19.0598, std. dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.76% (2.9384 => 2.5634, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.69% (1.2373 => 1.0927, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -8.57% (1.5373 => 1.4056, std. dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -7.07% (1.1396 => 1.0590, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.23% (8.6802 => 8.3999, std. dev.: 0.0117) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4689, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0018, std. dev.: 0.0215) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (8.1563 => 7.9636, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1096, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3344, std. dev.: 0.0049) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.13% (1.8329 => 1.8122, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std. dev.: 0.0149) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 18:09:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 20:09:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120823010904.627812A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3133?compare_to=3130&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3133, Order: 162408, Start Time: 2012-08-22 23:55:53, End Time: 2012-08-23 01:09:56 To: 3130, Order: 162399, Start Time: 2012-08-22 22:14:23, End Time: 2012-08-22 23:28:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (159 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.04% (2.0176 => 2.3211, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.46% (0.5818 => 0.6485, std. dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference: 11.34% (0.7061 => 0.7862, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.26% (0.5748 => 0.6395, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3578 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3601 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.52% (0.3650 => 0.4034, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 10.45% (0.3646 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3623 => 0.4000, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.37% (0.3663 => 0.4043, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.27% (0.3789 => 0.4178, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.22% (0.3914 => 0.4314, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.99% (0.4003 => 0.4403, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.97% (0.3940 => 0.4333, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.08% (1.3693 => 1.4937, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.96% (0.1819 => 0.1982, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.84% (0.2782 => 0.3028, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.67% (0.2781 => 0.3022, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.67% (0.4062 => 0.4414, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.63% (0.1413 => 0.1535, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2607 => 0.2823, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.21% (0.2655 => 0.2873, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2628 => 0.2843, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.14% (0.2690 => 0.2909, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2760 => 0.2983, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.08% (0.2761 => 0.2984, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.07% (3.9660 => 4.2862, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wc: 8.07% (0.2937 => 0.3174, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.94% (0.7710 => 0.8322, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 7.92% (0.2726 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.91% (0.3022 => 0.3261, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.89% (0.2966 => 0.3200, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.86% (0.2696 => 0.2908, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.79% (1.9828 => 2.1373, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.69% (0.3107 => 0.3346, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.68% (0.4390 => 0.4727, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.61% (0.3192 => 0.3435, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3149 => 0.3388, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.57% (0.3899 => 0.4194, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.52% (0.7038 => 0.7567, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 7.50% (0.2988 => 0.3212, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.48% (0.5265 => 0.5659, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (0.3485 => 0.3744, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3489 => 0.3748, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.2596 => 0.2787, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.4379 => 0.4701, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.35% (0.3580 => 0.3843, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3453 => 0.3703, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.18% (1.2193 => 1.3069, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.10% (0.9199 => 0.9852, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.93% (0.3534 => 0.3779, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3868 => 0.4133, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.72% (0.4016 => 0.4286, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.71% (0.6959 => 0.7426, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 6.69% (0.2945 => 0.3142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.68% (0.1588 => 0.1694, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.52% (0.3756 => 0.4001, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.49% (0.2127 => 0.2265, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.41% (1.1364 => 1.2093, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.26% (13.8202 => 14.6859, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.17% (0.5577 => 0.5921, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.07% (0.2914 => 0.3091, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3246 => 0.3443, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 6.04% (1.2292 => 1.3035, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2023 => 0.2145, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.94% (0.5637 => 0.5972, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.89% (7.2180 => 7.6434, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.88% (1.4563 => 1.5419, std. dev.: 0.0080) MultiSource/Applications/spiff/spiff: 5.86% (0.7506 => 0.7946, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.84% (0.2243 => 0.2374, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.64% (0.2925 => 0.3090, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.61% (0.8310 => 0.8776, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.59% (0.3755 => 0.3965, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.54% (0.4113 => 0.4341, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.54% (1.3819 => 1.4584, std. dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 5.44% (0.2995 => 0.3158, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.44% (1.3245 => 1.3965, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (1.3813 => 1.4556, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.38% (3.6692 => 3.8665, std. dev.: 0.0128) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.36% (0.7460 => 0.7860, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.34% (0.4791 => 0.5047, std. dev.: 0.0000) MultiSource/Applications/Burg/burg: 5.34% (1.1061 => 1.1652, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 5.29% (3.8646 => 4.0690, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.22% (4.3801 => 4.6088, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 5.19% (1.0594 => 1.1144, std. dev.: 0.0124) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.12% (4.4433 => 4.6709, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.11% (0.6283 => 0.6604, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.06% (1.9270 => 2.0245, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 4.88% (0.3220 => 0.3377, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.79% (0.6135 => 0.6429, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.79% (16.6129 => 17.4085, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (13.2842 => 13.9165, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.71% (0.8818 => 0.9233, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.69% (2.1791 => 2.2813, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 4.61% (14.8535 => 15.5386, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.1333 => 1.1814, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.24% (0.8698 => 0.9067, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.19% (0.3245 => 0.3381, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.14% (4.6629 => 4.8559, std. dev.: 0.0074) MultiSource/Benchmarks/sim/sim: 4.12% (0.3131 => 0.3260, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.11% (3.1889 => 3.3200, std. dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (8.4961 => 8.8373, std. dev.: 0.0148) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (6.5754 => 6.8244, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.2859 => 0.2967, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.71% (4.9865 => 5.1717, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.56% (3.2742 => 3.3906, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 3.33% (14.5298 => 15.0143, std. dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 3.21% (16.2614 => 16.7830, std. dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/bigfib: 3.10% (0.6250 => 0.6444, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.10% (0.9108 => 0.9390, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.00% (1.5188 => 1.5644, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.1007 => 2.1522, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.29% (0.4805 => 0.4915, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.25% (6.2785 => 6.4199, std. dev.: 0.0081) MultiSource/Applications/lua/lua: 2.24% (3.7467 => 3.8308, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 2.06% (1.0313 => 1.0525, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.02% (0.6744 => 0.6880, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.96% (33.2944 => 33.9468, std. dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 1.61% (1.2749 => 1.2954, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5140, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2625, std. dev.: 0.0516) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.22% (1.2998 => 1.4196, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.94% (1.5824 => 1.6606, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7412, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3852, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.38% (10.7476 => 11.0034, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5982, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6765, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3263, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.26% (26.5159 => 26.8489, std. dev.: 0.0268) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.54% (22.5627 => 21.3123, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.63% (1.2308 => 1.1000, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5126, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.67% (1.1560 => 1.1020, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.51% (1.3780 => 1.3158, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5871, std. dev.: 0.0200) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.08% (3.0263 => 2.9633, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2424, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2005, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8587, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3608, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.20% (5.5401 => 5.4736, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.14% (20.3410 => 20.1097, std. dev.: 0.0154) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.00% (6.6320 => 6.5655, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 16:27:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 18:27:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822232738.8517C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3130?compare_to=3128&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3130, Order: 162399, Start Time: 2012-08-22 22:14:23, End Time: 2012-08-22 23:28:31 To: 3128, Order: 162386, Start Time: 2012-08-22 20:32:37, End Time: 2012-08-22 21:46:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (161 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.48% (2.0176 => 2.3300, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3578 => 0.3994, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.60% (0.7061 => 0.7880, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.50% (0.5748 => 0.6409, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.39% (0.3601 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.27% (0.3646 => 0.4057, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.25% (0.3663 => 0.4075, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3650 => 0.4060, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 11.21% (0.3623 => 0.4029, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.08% (0.3789 => 0.4209, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.96% (0.3914 => 0.4343, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.4003 => 0.4432, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.61% (0.3940 => 0.4358, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std. dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0043) MultiSource/Applications/hbd/hbd: 8.96% (1.3693 => 1.4920, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.92% (0.1413 => 0.1539, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.91% (0.1819 => 0.1981, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 8.89% (0.4062 => 0.4423, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2781 => 0.3027, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.78% (0.4328 => 0.4708, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.73% (0.2782 => 0.3025, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.36% (0.2690 => 0.2915, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.33% (0.2628 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.32% (0.2607 => 0.2824, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.29% (0.7710 => 0.8349, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.29% (0.2655 => 0.2875, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.28% (3.9660 => 4.2944, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 8.27% (0.2937 => 0.3180, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.21% (0.3022 => 0.3270, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.19% (0.2760 => 0.2986, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 8.19% (0.2761 => 0.2987, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.14% (0.2765 => 0.2990, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.11% (0.2726 => 0.2947, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.02% (0.2966 => 0.3204, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.98% (0.3107 => 0.3355, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.95% (1.9828 => 2.1404, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.91% (0.3149 => 0.3398, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.90% (0.2696 => 0.2909, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.84% (0.7038 => 0.7590, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 7.74% (0.3192 => 0.3439, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.72% (0.3899 => 0.4200, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.68% (0.4390 => 0.4727, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.66% (0.2988 => 0.3217, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.62% (0.5265 => 0.5666, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3485 => 0.3750, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.57% (0.3580 => 0.3851, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.57% (0.3489 => 0.3753, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3453 => 0.3710, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.38% (1.2193 => 1.3093, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.32% (0.9199 => 0.9872, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4379 => 0.4693, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.05% (0.1588 => 0.1700, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3293 => 0.3524, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.96% (0.3534 => 0.3780, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.90% (0.6959 => 0.7439, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.87% (0.4016 => 0.4292, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3868 => 0.4133, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.74% (0.3756 => 0.4009, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.72% (0.2945 => 0.3143, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.54% (0.2127 => 0.2266, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.52% (1.1364 => 1.2105, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 6.52% (13.8202 => 14.7211, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.46% (0.5577 => 0.5937, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 6.42% (0.1589 => 0.1691, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.40% (0.5637 => 0.5998, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.25% (0.2914 => 0.3096, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.17% (1.2292 => 1.3051, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.13% (0.2023 => 0.2147, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.06% (1.4563 => 1.5446, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.00% (7.2180 => 7.6508, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.95% (0.2925 => 0.3099, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.84% (0.2243 => 0.2374, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 5.81% (0.2995 => 0.3169, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.81% (0.3755 => 0.3973, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 5.76% (0.7506 => 0.7938, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 5.74% (0.8310 => 0.8787, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.71% (0.4113 => 0.4348, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.70% (1.3819 => 1.4606, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.62% (0.7460 => 0.7879, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.61% (1.3245 => 1.3988, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.59% (3.8646 => 4.0807, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.3813 => 1.4574, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.49% (3.6692 => 3.8707, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.43% (1.1061 => 1.1662, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.39% (4.3801 => 4.6162, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 5.37% (1.0594 => 1.1163, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.34% (0.4791 => 0.5047, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.33% (0.2140 => 0.2254, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.30% (4.4433 => 4.6788, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.20% (0.6135 => 0.6454, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.6283 => 0.6609, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.17% (13.2842 => 13.9707, std. dev.: 0.0271) MultiSource/Applications/treecc/treecc: 5.14% (1.9270 => 2.0261, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 4.97% (0.3220 => 0.3380, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.91% (0.8818 => 0.9251, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.89% (16.6129 => 17.4257, std. dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 4.85% (14.8535 => 15.5742, std. dev.: 0.0093) MultiSource/Applications/siod/siod: 4.83% (2.1791 => 2.2843, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.46% (0.8698 => 0.9086, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.44% (1.1333 => 1.1836, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 4.38% (0.3131 => 0.3268, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3245 => 0.3386, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.21% (3.1889 => 3.3232, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (8.4961 => 8.8520, std. dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 4.09% (4.6629 => 4.8535, std. dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (6.5754 => 6.8422, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/bh/bh: 3.92% (0.2859 => 0.2971, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.91% (4.9865 => 5.1814, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.78% (3.2742 => 3.3981, std. dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 3.38% (14.5298 => 15.0207, std. dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.28% (0.9108 => 0.9407, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 3.26% (0.6250 => 0.6454, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.24% (16.2614 => 16.7888, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5188 => 1.5640, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.61% (6.2785 => 6.4424, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (2.1007 => 2.1532, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.38% (3.7467 => 3.8358, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.22% (33.2944 => 34.0324, std. dev.: 0.0085) MultiSource/Applications/minisat/minisat: 2.19% (0.6744 => 0.6892, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.19% (1.0313 => 1.0539, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.14% (0.4805 => 0.4908, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.76% (1.2749 => 1.2974, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std. dev.: 0.0508) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.39% (1.2998 => 1.4219, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.97% (1.5824 => 1.6610, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.39% (11.2619 => 11.7562, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3857, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5970, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.03% (10.7476 => 10.9658, std. dev.: 0.0445) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5928 => 4.6756, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.63% (3.2729 => 3.3262, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 1.52% (8.3908 => 8.5185, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (1.5089 => 1.5275, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.13% (26.5159 => 26.8149, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5739, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.35% (22.5627 => 21.3551, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.33% (1.2308 => 1.1036, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.61% (1.1560 => 1.1027, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5910, std. dev.: 0.0173) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.09% (3.0263 => 2.9632, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2053, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7918, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3565, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.22% (5.5401 => 5.4727, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.22% (20.3410 => 20.0937, std. dev.: 0.0424) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: -1.08% (4.4810 => 4.4325, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 13:04:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 15:04:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822200410.BE5982A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3125?compare_to=3123&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3125, Order: 162375, Start Time: 2012-08-22 18:50:54, End Time: 2012-08-22 20:05:03 To: 3123, Order: 162362, Start Time: 2012-08-22 17:08:52, End Time: 2012-08-22 18:23:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (158 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.13% (7.9722 => 8.0619, std. dev.: 0.0047) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.82% (2.0176 => 2.3167, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 12.35% (0.0826 => 0.0928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.66% (0.7061 => 0.7814, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 10.52% (0.5818 => 0.6430, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3578 => 0.3954, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/Hello: 10.32% (0.5748 => 0.6341, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3623 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.29% (0.3646 => 0.4021, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3601 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.18% (0.3663 => 0.4036, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.11% (0.3650 => 0.4019, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.07% (0.3914 => 0.4308, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 10.03% (0.3789 => 0.4169, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.69% (0.4003 => 0.4391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.67% (0.3940 => 0.4321, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.91% (0.1819 => 0.1981, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.40% (0.7710 => 0.8358, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2781 => 0.3008, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.16% (0.4328 => 0.4681, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.09% (0.2782 => 0.3007, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.08% (1.3693 => 1.4800, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.89% (3.9660 => 4.2791, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hello: 7.71% (0.2607 => 0.2808, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.62% (0.2690 => 0.2895, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.61% (0.2655 => 0.2857, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2760 => 0.2968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2765 => 0.2973, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2761 => 0.2968, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.50% (0.2628 => 0.2825, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2726 => 0.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.42% (0.2937 => 0.3155, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.41% (0.3022 => 0.3246, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.38% (0.2966 => 0.3185, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3149 => 0.3381, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.30% (1.9828 => 2.1275, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2696 => 0.2892, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.24% (0.2596 => 0.2784, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3107 => 0.3332, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.5265 => 0.5645, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.20% (0.3485 => 0.3736, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2988 => 0.3202, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.7038 => 0.7542, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 7.11% (0.3192 => 0.3419, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3580 => 0.3831, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.98% (0.3899 => 0.4171, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.94% (0.3489 => 0.3731, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.92% (1.2193 => 1.3037, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.91% (0.9199 => 0.9835, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.80% (0.3293 => 0.3517, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 6.78% (0.3453 => 0.3687, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4379 => 0.4675, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.1789 => 0.1908, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.45% (0.3534 => 0.3762, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.6959 => 0.7403, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.32% (0.4016 => 0.4270, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2127 => 0.2261, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.26% (0.3868 => 0.4110, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.15% (0.3756 => 0.3987, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.10% (0.7506 => 0.7964, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.08% (1.1364 => 1.2055, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 6.02% (13.8202 => 14.6525, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.94% (0.5577 => 0.5908, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.87% (0.2914 => 0.3085, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.84% (0.5637 => 0.5966, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.73% (0.2023 => 0.2139, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.73% (0.3246 => 0.3432, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.70% (7.2180 => 7.6295, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 5.68% (1.2292 => 1.2990, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.57% (0.2243 => 0.2368, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.56% (1.4563 => 1.5372, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 5.40% (0.2925 => 0.3083, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (1.3819 => 1.4555, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.22% (0.8310 => 0.8744, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 5.21% (0.2995 => 0.3151, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.20% (0.4113 => 0.4327, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.19% (1.3245 => 1.3932, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.3813 => 1.4525, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.09% (0.3755 => 0.3946, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.08% (3.8646 => 4.0609, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.05% (3.6692 => 3.8545, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.99% (1.1061 => 1.1613, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.97% (0.7460 => 0.7831, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.95% (1.0594 => 1.1118, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.89% (4.3801 => 4.5945, std. dev.: 0.0105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.86% (0.2140 => 0.2244, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (4.4433 => 4.6585, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.82% (0.4791 => 0.5022, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.79% (0.6283 => 0.6584, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.76% (1.9270 => 2.0188, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.69% (0.3220 => 0.3371, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.60% (0.6135 => 0.6417, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (13.2842 => 13.8802, std. dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 4.36% (16.6129 => 17.3377, std. dev.: 0.0123) MultiSource/Applications/siod/siod: 4.33% (2.1791 => 2.2734, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 4.32% (14.8535 => 15.4948, std. dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.04% (0.8698 => 0.9049, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.02% (1.1333 => 1.1789, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.92% (0.8818 => 0.9164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.88% (0.3245 => 0.3371, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.86% (0.3131 => 0.3252, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.84% (3.1889 => 3.3112, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 3.75% (4.6629 => 4.8379, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (8.4961 => 8.8097, std. dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 3.54% (6.5754 => 6.8080, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.2859 => 0.2960, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.23% (4.9865 => 5.1476, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.21% (3.2742 => 3.3793, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.94% (14.5298 => 14.9575, std. dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 2.80% (16.2614 => 16.7164, std. dev.: 0.0213) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.76% (0.9108 => 0.9359, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.74% (0.6250 => 0.6421, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5188 => 1.5590, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.1007 => 2.1457, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.03% (6.2785 => 6.4059, std. dev.: 0.0066) MultiSource/Applications/lua/lua: 1.95% (3.7467 => 3.8198, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.88% (0.6744 => 0.6871, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.80% (1.0313 => 1.0499, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.43% (33.2944 => 33.7699, std. dev.: 0.0187) MultiSource/Applications/SIBsim4/SIBsim4: 1.42% (1.2749 => 1.2930, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 25.77% (1.8175 => 2.2859, std. dev.: 0.0416) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.32% (1.2998 => 1.4210, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7433, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.07% (1.7081 => 1.7776, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8180, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3857, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9934, std. dev.: 0.0730) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5959, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6764, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.60% (3.2729 => 3.3254, std. dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (26.5159 => 26.7947, std. dev.: 0.0491) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.69% (22.5627 => 21.2788, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.53% (0.3511 => 0.3387, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2308 => 1.1003, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -4.55% (1.1560 => 1.1034, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6008, std. dev.: 0.0158) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.23% (3.0263 => 2.9588, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2339, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2075, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (84.4286 => 83.3595, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.20% (5.5401 => 5.4735, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4961, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.13% (20.3410 => 20.1104, std. dev.: 0.0401) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4346, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2407, std. dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 09:40:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 11:40:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822164021.A5CD02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3120?compare_to=3118&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3120, Order: 162360, Start Time: 2012-08-22 15:26:56, End Time: 2012-08-22 16:41:13 To: 3118, Order: 162354, Start Time: 2012-08-22 11:36:45, End Time: 2012-08-22 12:51:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (161 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.45% (2.2922 => 2.2590, std. dev.: 0.0107) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.07% (2.0176 => 2.3217, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.86% (0.5818 => 0.6508, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.85% (0.7061 => 0.7898, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.77% (0.3578 => 0.3999, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.66% (0.5748 => 0.6418, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.47% (0.3601 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3646 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.42% (0.3650 => 0.4067, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.37% (0.3623 => 0.4035, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.33% (0.3663 => 0.4078, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.30% (0.3789 => 0.4217, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.11% (0.3914 => 0.4349, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.89% (0.4003 => 0.4439, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.79% (0.3940 => 0.4365, std. dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.61% (0.1072 => 0.1175, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 9.17% (0.2781 => 0.3036, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.03% (0.4328 => 0.4719, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.02% (0.2782 => 0.3033, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.92% (0.7710 => 0.8398, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.73% (1.3693 => 1.4888, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1413 => 0.1536, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2765 => 0.3004, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.59% (0.2607 => 0.2831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.59% (0.4062 => 0.4411, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 8.51% (0.2760 => 0.2995, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.51% (0.2655 => 0.2881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.49% (0.2628 => 0.2851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.48% (0.2690 => 0.2918, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.1819 => 0.1973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.41% (0.2937 => 0.3184, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.41% (0.3022 => 0.3276, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.40% (0.2761 => 0.2993, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.31% (1.9828 => 2.1476, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 8.29% (0.2726 => 0.2952, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.23% (3.9660 => 4.2925, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.23% (0.2966 => 0.3210, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.20% (0.2696 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.15% (0.3485 => 0.3769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.14% (0.3107 => 0.3360, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.07% (0.3580 => 0.3869, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.05% (0.3489 => 0.3770, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.03% (0.3149 => 0.3402, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 8.00% (0.2988 => 0.3227, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.76% (0.3453 => 0.3721, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.74% (0.3192 => 0.3439, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.73% (0.5265 => 0.5672, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 7.63% (0.7038 => 0.7575, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.53% (0.2721 => 0.2926, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.4390 => 0.4711, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 7.23% (0.3293 => 0.3531, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 7.22% (0.3534 => 0.3789, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.19% (0.9199 => 0.9860, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.18% (1.2193 => 1.3069, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4379 => 0.4693, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.12% (0.4016 => 0.4302, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.90% (0.3868 => 0.4135, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.89% (0.2945 => 0.3148, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.88% (0.1789 => 0.1912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.6959 => 0.7436, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.63% (0.2127 => 0.2268, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.55% (0.1588 => 0.1692, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.49% (0.2914 => 0.3103, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.48% (13.8202 => 14.7162, std. dev.: 0.0140) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.41% (1.1364 => 1.2093, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.38% (0.5577 => 0.5933, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.32% (1.2292 => 1.3069, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.32% (1.4563 => 1.5483, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.10% (0.5637 => 0.5981, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (7.2180 => 7.6563, std. dev.: 0.0097) MultiSource/Benchmarks/McCat/09-vor/vor: 6.02% (0.2925 => 0.3101, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.97% (0.2243 => 0.2377, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.91% (0.3755 => 0.3977, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.90% (0.7506 => 0.7949, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (1.3819 => 1.4616, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.61% (0.2140 => 0.2260, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.59% (1.1061 => 1.1679, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 5.56% (0.8310 => 0.8772, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.55% (3.6692 => 3.8730, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.55% (1.3813 => 1.4580, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.55% (0.7460 => 0.7874, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 5.54% (0.2995 => 0.3161, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.52% (1.3245 => 1.3976, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 5.49% (3.8646 => 4.0766, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.4113 => 0.4336, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.34% (1.0594 => 1.1160, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.30% (4.4433 => 4.6789, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.30% (4.3801 => 4.6123, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.24% (0.4791 => 0.5042, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.6283 => 0.6609, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.18% (1.9270 => 2.0269, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.14% (16.6129 => 17.4667, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3220 => 0.3381, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (13.2842 => 13.9443, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.92% (0.6135 => 0.6437, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.89% (2.1791 => 2.2856, std. dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.68% (0.8698 => 0.9105, std. dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 4.60% (14.8535 => 15.5367, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.56% (0.3245 => 0.3393, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.48% (0.8818 => 0.9213, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.38% (1.1333 => 1.1829, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (8.4961 => 8.8558, std. dev.: 0.0119) MultiSource/Benchmarks/sim/sim: 4.15% (0.3131 => 0.3261, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 4.14% (3.1889 => 3.3209, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.13% (6.5754 => 6.8471, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 4.13% (0.2859 => 0.2977, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1868, std. dev.: 0.0091) MultiSource/Applications/oggenc/oggenc: 3.65% (4.6629 => 4.8329, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 3.31% (0.6250 => 0.6457, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.28% (3.2742 => 3.3815, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.27% (1.5188 => 1.5684, std. dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 3.23% (14.5298 => 14.9991, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.22% (0.9108 => 0.9401, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.14% (16.2614 => 16.7726, std. dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.66% (0.4805 => 0.4933, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.53% (2.1007 => 2.1539, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.50% (6.2785 => 6.4353, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 2.42% (3.7467 => 3.8372, std. dev.: 0.0129) MultiSource/Applications/minisat/minisat: 2.37% (0.6744 => 0.6904, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.23% (1.0313 => 1.0543, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.91% (33.2944 => 33.9295, std. dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2590, std. dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 8.62% (1.2998 => 1.4119, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.02% (0.2093 => 0.2219, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.99% (1.5824 => 1.6613, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7410, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3841, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5977, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 1.97% (10.7476 => 10.9597, std. dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5928 => 4.6777, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.56% (3.2729 => 3.3241, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0080) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (1.5089 => 1.5272, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1855, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.16% (26.5159 => 26.8234, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.34% (22.5627 => 21.3570, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.94% (0.2670 => 0.2538, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.35% (1.2308 => 1.1034, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.66% (0.4867 => 0.4689, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.72% (8.8259 => 8.5855, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.20% (3.0263 => 2.9596, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2407, std. dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2064, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3661, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.09% (5.5401 => 5.4799, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2364, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.06% (6.6320 => 6.5617, std. dev.: 0.0076) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 11:22:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 13:22:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822182221.444A22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3123?compare_to=3120&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3123, Order: 162362, Start Time: 2012-08-22 17:08:52, End Time: 2012-08-22 18:23:10 To: 3120, Order: 162360, Start Time: 2012-08-22 15:26:56, End Time: 2012-08-22 16:41:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (160 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.97% (78.6555 => 80.2087, std. dev.: 0.4639) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.3097 => 1.3239, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.77% (2.0176 => 2.3156, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 13.68% (0.0826 => 0.0939, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.41% (0.5818 => 0.6482, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 11.37% (0.7061 => 0.7864, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 11.17% (0.5748 => 0.6390, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 10.96% (0.3578 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.66% (0.3601 => 0.3985, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3646 => 0.4034, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3650 => 0.4036, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.54% (0.3663 => 0.4049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3623 => 0.4004, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3789 => 0.4185, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3914 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.17% (0.4003 => 0.4410, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.03% (0.3940 => 0.4335, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.18% (0.4062 => 0.4435, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 9.13% (0.2781 => 0.3035, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.90% (0.4328 => 0.4713, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.77% (0.2782 => 0.3026, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.63% (0.2655 => 0.2884, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.60% (0.7710 => 0.8373, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.58% (0.1819 => 0.1975, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.56% (1.3693 => 1.4865, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.48% (0.2607 => 0.2828, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.47% (0.2596 => 0.2816, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.37% (0.3022 => 0.3275, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2628 => 0.2848, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.37% (0.2760 => 0.2991, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.35% (0.2765 => 0.2996, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.33% (0.2690 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.31% (0.2937 => 0.3181, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.29% (1.9828 => 2.1471, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.22% (0.2726 => 0.2950, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 8.19% (0.2761 => 0.2987, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.09% (0.2966 => 0.3206, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.05% (0.3489 => 0.3770, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.05% (0.2696 => 0.2913, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.03% (3.9660 => 4.2846, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.94% (0.3149 => 0.3399, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 7.93% (0.2988 => 0.3225, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.91% (0.3580 => 0.3863, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.89% (0.3485 => 0.3760, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.85% (0.3107 => 0.3351, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.79% (0.4390 => 0.4732, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.71% (0.5265 => 0.5671, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 7.56% (0.3453 => 0.3714, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.55% (0.3192 => 0.3433, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.53% (0.7038 => 0.7568, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.39% (0.2721 => 0.2922, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.35% (0.3293 => 0.3535, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 7.13% (0.3534 => 0.3786, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.05% (0.4016 => 0.4299, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.04% (1.2193 => 1.3051, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.00% (0.9199 => 0.9843, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.4379 => 0.4681, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3756 => 0.4015, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.3868 => 0.4134, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.6959 => 0.7436, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 6.79% (0.2945 => 0.3145, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.49% (0.2127 => 0.2265, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.42% (0.1588 => 0.1690, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.37% (1.1364 => 1.2088, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.35% (0.2914 => 0.3099, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.35% (0.5577 => 0.5931, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 6.20% (1.2292 => 1.3054, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 6.19% (13.8202 => 14.6753, std. dev.: 0.0194) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.08% (0.2023 => 0.2146, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.05% (0.5637 => 0.5978, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.99% (0.3755 => 0.3980, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.2925 => 0.3096, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (1.4563 => 1.5412, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.82% (0.3246 => 0.3435, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.77% (7.2180 => 7.6344, std. dev.: 0.0117) MultiSource/Benchmarks/McCat/08-main/main: 5.71% (0.2243 => 0.2371, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.62% (0.7506 => 0.7928, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 5.48% (3.8646 => 4.0763, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2140 => 0.2256, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.42% (1.1061 => 1.1660, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.40% (1.3245 => 1.3960, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.35% (0.7460 => 0.7859, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 5.31% (0.8310 => 0.8751, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.30% (1.3813 => 1.4545, std. dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 5.28% (0.2995 => 0.3153, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.28% (1.3819 => 1.4548, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.24% (3.6692 => 3.8613, std. dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 5.13% (1.0594 => 1.1138, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.11% (0.4113 => 0.4323, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.4791 => 0.5035, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.08% (0.6283 => 0.6602, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.04% (4.3801 => 4.6008, std. dev.: 0.0036) MultiSource/Applications/treecc/treecc: 5.00% (1.9270 => 2.0234, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.96% (16.6129 => 17.4373, std. dev.: 0.0189) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.92% (4.4433 => 4.6621, std. dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 4.84% (0.3220 => 0.3376, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.79% (0.6135 => 0.6429, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (13.2842 => 13.8947, std. dev.: 0.0132) MultiSource/Applications/siod/siod: 4.58% (2.1791 => 2.2790, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.57% (0.8818 => 0.9221, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.48% (14.8535 => 15.5186, std. dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.46% (0.8698 => 0.9086, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3245 => 0.3386, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.28% (0.3131 => 0.3265, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.1333 => 1.1798, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 3.87% (3.1889 => 3.3124, std. dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 3.85% (8.4961 => 8.8232, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (0.2859 => 0.2968, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.78% (6.5754 => 6.8242, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1747, std. dev.: 0.0094) MultiSource/Applications/oggenc/oggenc: 3.69% (4.6629 => 4.8350, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.44% (3.2742 => 3.3867, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 3.28% (0.6250 => 0.6455, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.18% (0.9108 => 0.9398, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.10% (14.5298 => 14.9804, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.92% (1.5188 => 1.5631, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 2.78% (16.2614 => 16.7139, std. dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.54% (0.4805 => 0.4927, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (2.1007 => 2.1527, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.27% (0.6744 => 0.6897, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.20% (6.2785 => 6.4167, std. dev.: 0.0044) MultiSource/Applications/lua/lua: 2.11% (3.7467 => 3.8256, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.95% (1.0313 => 1.0514, std. dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.59% (33.2944 => 33.8236, std. dev.: 0.0273) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std. dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.80% (1.2998 => 1.4272, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.96% (1.5824 => 1.6609, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.42% (11.2619 => 11.7597, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8180, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4271 => 7.6052, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.18% (10.7476 => 10.9815, std. dev.: 0.0361) MultiSource/Applications/sqlite3/sqlite3: 1.88% (4.5928 => 4.6790, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.58% (3.2729 => 3.3246, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std. dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.22% (1.5089 => 1.5273, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (1.9433 => 1.9663, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 1.10% (26.5159 => 26.8067, std. dev.: 0.0608) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5728, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.42% (22.5627 => 21.3407, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.21% (0.2670 => 0.2531, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.36% (1.2308 => 1.1033, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.65% (1.1560 => 1.1023, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.93% (1.3780 => 1.3239, std. dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.25% (0.4867 => 0.4709, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.65% (8.8259 => 8.5916, std. dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.17% (3.0263 => 2.9606, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2420, std. dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: -1.66% (7.3305 => 7.2088, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9933, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3613, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.20% (5.5401 => 5.4738, std. dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5646, std. dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (20.3410 => 20.1363, std. dev.: 0.0184) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 22 14:46:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 22 Aug 2012 16:46:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120822214600.8C8232A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3128?compare_to=3125&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3128, Order: 162386, Start Time: 2012-08-22 20:32:37, End Time: 2012-08-22 21:46:52 To: 3125, Order: 162375, Start Time: 2012-08-22 18:50:54, End Time: 2012-08-22 20:05:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (159 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.5901 => 56.4426, std. dev.: 0.0724) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.88% (78.9214 => 80.4019, std. dev.: 0.1853) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.23% (1.3139 => 1.3301, std. dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.45% (2.0176 => 2.3294, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 13.44% (0.0826 => 0.0937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.93% (0.7061 => 0.7833, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.90% (0.5818 => 0.6452, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 10.73% (0.5748 => 0.6365, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.40% (0.3578 => 0.3950, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.31% (0.3646 => 0.4022, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.19% (0.3601 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3650 => 0.4017, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3663 => 0.4031, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 10.03% (0.3789 => 0.4169, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.02% (0.3623 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.79% (0.3914 => 0.4297, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.69% (0.4003 => 0.4391, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 9.59% (0.3940 => 0.4318, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.11% (0.3130 => 0.3415, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.85% (0.1413 => 0.1538, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.81% (0.4062 => 0.4420, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.73% (1.3693 => 1.4889, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.58% (0.1819 => 0.1975, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.53% (0.7710 => 0.8368, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.2781 => 0.3017, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.45% (0.2782 => 0.3017, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.33% (3.9660 => 4.2965, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 8.06% (0.2607 => 0.2817, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 8.00% (0.2937 => 0.3172, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.98% (0.2655 => 0.2867, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 7.91% (0.2628 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.89% (0.3107 => 0.3352, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/random: 7.88% (0.2690 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.85% (0.2765 => 0.2982, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.79% (0.2760 => 0.2975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.78% (0.2726 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.74% (0.3022 => 0.3256, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.74% (0.2596 => 0.2797, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2761 => 0.2974, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.2966 => 0.3193, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 7.64% (0.7038 => 0.7576, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.59% (1.9828 => 2.1332, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.57% (0.2696 => 0.2900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.54% (0.5265 => 0.5662, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.53% (0.3149 => 0.3386, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.49% (0.3899 => 0.4191, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.44% (0.4379 => 0.4705, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.43% (0.4390 => 0.4716, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.40% (0.2988 => 0.3209, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.37% (0.3485 => 0.3742, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3192 => 0.3425, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.29% (1.2193 => 1.3082, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3489 => 0.3741, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.20% (0.9199 => 0.9861, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.13% (0.2721 => 0.2915, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 7.04% (0.3453 => 0.3696, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.93% (0.1588 => 0.1698, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.91% (0.6959 => 0.7440, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 6.89% (0.3293 => 0.3520, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.83% (0.5577 => 0.5958, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3534 => 0.3774, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.77% (0.4016 => 0.4288, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.76% (0.1789 => 0.1910, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.3868 => 0.4126, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.58% (0.2127 => 0.2267, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.57% (1.1364 => 1.2111, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.43% (13.8202 => 14.7089, std. dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.39% (0.3756 => 0.3996, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.30% (0.5637 => 0.5992, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.22% (0.3246 => 0.3448, std. dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.21% (0.2914 => 0.3095, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (1.4563 => 1.5467, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.92% (1.3819 => 1.4637, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.92% (7.2180 => 7.6451, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 5.88% (0.2925 => 0.3097, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.83% (1.2292 => 1.3009, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 5.81% (0.2995 => 0.3169, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3755 => 0.3971, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.70% (0.8310 => 0.8784, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.63% (1.1061 => 1.1684, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.63% (1.3245 => 1.3991, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.62% (0.2243 => 0.2369, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.62% (3.6692 => 3.8753, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 5.62% (0.4113 => 0.4344, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (1.3813 => 1.4586, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.54% (0.7506 => 0.7922, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 5.53% (3.8646 => 4.0784, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.44% (0.7460 => 0.7866, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.43% (1.0594 => 1.1169, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.6283 => 0.6617, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.28% (0.4791 => 0.5044, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (4.3801 => 4.6098, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.6135 => 0.6453, std. dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.16% (4.4433 => 4.6724, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.14% (1.9270 => 2.0260, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.01% (13.2842 => 13.9498, std. dev.: 0.0354) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.94% (0.3220 => 0.3379, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.90% (16.6129 => 17.4274, std. dev.: 0.0101) MultiSource/Applications/siod/siod: 4.87% (2.1791 => 2.2852, std. dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 4.73% (14.8535 => 15.5556, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.71% (0.8818 => 0.9233, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 4.41% (0.3131 => 0.3269, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.39% (0.8698 => 0.9080, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.31% (1.1333 => 1.1822, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.3245 => 0.3383, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (8.4961 => 8.8501, std. dev.: 0.0007) MultiSource/Applications/d/make_dparser: 4.14% (3.1889 => 3.3209, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.99% (4.6629 => 4.8488, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 3.91% (6.5754 => 6.8326, std. dev.: 0.0142) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.79% (4.9865 => 5.1757, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.2859 => 0.2967, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.63% (3.2742 => 3.3932, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 3.31% (14.5298 => 15.0112, std. dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 3.17% (16.2614 => 16.7776, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.17% (1.5188 => 1.5670, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.6250 => 0.6441, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.63% (2.1007 => 2.1560, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.4805 => 0.4918, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.32% (3.7467 => 3.8336, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.27% (1.0313 => 1.0547, std. dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.12% (6.2785 => 6.4116, std. dev.: 0.0040) MultiSource/Applications/minisat/minisat: 2.06% (0.6744 => 0.6883, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.72% (33.2944 => 33.8662, std. dev.: 0.0228) MultiSource/Applications/SIBsim4/SIBsim4: 1.60% (1.2749 => 1.2953, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5211, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 26.33% (1.8175 => 2.2960, std. dev.: 0.0290) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.02% (1.2998 => 1.4300, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.95% (1.5824 => 1.6607, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7399, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.43% (12.0921 => 12.3857, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5962, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.20% (10.7476 => 10.9839, std. dev.: 0.0445) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5928 => 4.6766, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std. dev.: 0.0034) MultiSource/Applications/siod/siod: 1.62% (3.2729 => 3.3259, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0065) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.36% (1.0895 => 1.1043, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.20% (1.5089 => 1.5270, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.13% (26.5159 => 26.8161, std. dev.: 0.0225) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.09% (13.3668 => 13.5128, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5722, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.42% (22.5627 => 21.3388, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1041, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -4.64% (1.1560 => 1.1024, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.48% (1.3780 => 1.3301, std. dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.60% (8.8259 => 8.5960, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.12% (3.0263 => 2.9622, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2284, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2028, std. dev.: 0.0339) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7922, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (84.4286 => 83.3656, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std. dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4760, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.5254 => 2.4963, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.02% (9.3358 => 9.2406, std. dev.: 0.0334) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (20.3410 => 20.1351, std. dev.: 0.0119) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 16:39:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 18:39:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120824233949.C7D842A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3198?compare_to=3195&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3198, Order: 162603, Start Time: 2012-08-24 22:26:41, End Time: 2012-08-24 23:40:43 To: 3195, Order: 162582, Start Time: 2012-08-24 20:44:42, End Time: 2012-08-24 21:59:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (159 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 951 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.26% (28.9752 => 29.6311, std. dev.: 0.0862) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.40% (79.2343 => 80.3431, std. dev.: 0.1995) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.10% (2.6762 => 2.7056, std. dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.55% (2.0176 => 2.3112, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 13.08% (0.0826 => 0.0934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 12.34% (0.5818 => 0.6536, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.20% (0.5748 => 0.6449, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.01% (0.7061 => 0.7909, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.35% (0.3578 => 0.3984, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 11.22% (0.3601 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.19% (0.3646 => 0.4054, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3623 => 0.4027, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3650 => 0.4057, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.14% (0.3663 => 0.4071, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 10.91% (0.3914 => 0.4341, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.87% (0.3789 => 0.4201, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.4003 => 0.4427, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.48% (0.3940 => 0.4353, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.2781 => 0.3029, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.85% (0.3130 => 0.3407, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.67% (0.4062 => 0.4414, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.58% (1.3693 => 1.4868, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.57% (0.4328 => 0.4699, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.55% (0.2782 => 0.3020, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.1819 => 0.1973, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.33% (0.7710 => 0.8352, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 8.29% (0.2726 => 0.2952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.21% (0.2655 => 0.2873, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.21% (0.2607 => 0.2821, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.17% (3.9660 => 4.2900, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2690 => 0.2908, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.10% (0.2765 => 0.2989, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.04% (0.2937 => 0.3173, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.03% (0.2628 => 0.2839, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.3107 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.01% (0.3022 => 0.3264, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.01% (0.2760 => 0.2981, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.90% (0.2761 => 0.2979, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.88% (0.3149 => 0.3397, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.86% (0.2966 => 0.3199, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.85% (1.9828 => 2.1385, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.83% (0.2696 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.72% (0.3485 => 0.3754, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.64% (0.3899 => 0.4197, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2988 => 0.3216, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.61% (0.4390 => 0.4724, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.55% (0.2596 => 0.2792, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.46% (0.5265 => 0.5658, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.37% (0.7038 => 0.7557, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3489 => 0.3746, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.33% (0.3192 => 0.3426, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.12% (0.3453 => 0.3699, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.02% (0.9199 => 0.9845, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.02% (0.2721 => 0.2912, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.02% (0.3534 => 0.3782, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3293 => 0.3523, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.98% (1.2193 => 1.3044, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4379 => 0.4675, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.70% (0.6959 => 0.7425, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3756 => 0.4007, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.67% (0.4016 => 0.4284, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.62% (0.2945 => 0.3140, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.54% (0.1789 => 0.1906, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.45% (1.1364 => 1.2097, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.36% (0.1588 => 0.1689, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5577 => 0.5922, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.17% (0.5637 => 0.5985, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.07% (0.2914 => 0.3091, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.07% (13.8202 => 14.6593, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 6.06% (1.2292 => 1.3037, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3246 => 0.3442, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.80% (1.4563 => 1.5408, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.78% (7.2180 => 7.6351, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/09-vor/vor: 5.71% (0.2925 => 0.3092, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.62% (0.2243 => 0.2369, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.53% (1.3819 => 1.4583, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.43% (0.7460 => 0.7865, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 5.42% (0.7506 => 0.7913, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 5.38% (3.8646 => 4.0726, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.33% (1.1061 => 1.1651, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.29% (1.3245 => 1.3946, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.23% (1.3813 => 1.4536, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 5.21% (0.8310 => 0.8743, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 5.14% (0.2995 => 0.3149, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.09% (3.6692 => 3.8558, std. dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 5.04% (1.0594 => 1.1128, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.94% (4.3801 => 4.5964, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 4.94% (0.4113 => 0.4316, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.92% (1.9270 => 2.0218, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.85% (4.4433 => 4.6586, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.84% (0.4791 => 0.5023, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.82% (0.6283 => 0.6586, std. dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.77% (16.6129 => 17.4058, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.70% (13.2842 => 13.9080, std. dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.68% (0.6135 => 0.6422, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 4.55% (2.1791 => 2.2783, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.31% (0.8698 => 0.9073, std. dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: 4.27% (14.8535 => 15.4884, std. dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.19% (0.3245 => 0.3381, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.16% (0.8818 => 0.9185, std. dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 4.09% (0.3131 => 0.3259, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.04% (1.1333 => 1.1791, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 3.77% (3.1889 => 3.3092, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.73% (4.9865 => 5.1724, std. dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (8.4961 => 8.8115, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 3.71% (0.2859 => 0.2965, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.57% (4.6629 => 4.8293, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 3.55% (6.5754 => 6.8091, std. dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 3.32% (16.2614 => 16.8011, std. dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 3.22% (14.5298 => 14.9970, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.11% (3.2742 => 3.3760, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.01% (0.6250 => 0.6438, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.86% (1.5188 => 1.5623, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.68% (0.9108 => 0.9352, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.1007 => 2.1482, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.16% (0.4805 => 0.4909, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.08% (6.2785 => 6.4094, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.05% (3.7467 => 3.8236, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: 1.97% (0.6744 => 0.6877, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 1.97% (33.2944 => 33.9492, std. dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.91% (1.0313 => 1.0510, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (1.2749 => 1.2914, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 24.15% (1.8175 => 2.2565, std. dev.: 0.0553) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.05% (1.2998 => 1.4174, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.88% (1.5824 => 1.6596, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7423, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8163, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 2.53% (10.7476 => 11.0190, std. dev.: 0.0459) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3839, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6039, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.04% (3.2729 => 3.3397, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.01% (1.4298 => 1.4585, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0055) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (1.5089 => 1.5299, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.13% (3.6469 => 3.6881, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6439, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5723, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.92% (0.2670 => 0.2512, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.52% (22.5627 => 21.3178, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.24% (1.2308 => 1.0925, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.02% (1.3780 => 1.3226, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0211, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -3.19% (1.1560 => 1.1191, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5874, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2318, std. dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -1.83% (5.3167 => 5.2194, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9718, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3305 => 7.2257, std. dev.: 0.0245) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4251, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.19% (5.5401 => 5.4743, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2359, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.03% (20.3410 => 20.1319, std. dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 17:16:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 19:16:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120825001616.CF47C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3199?compare_to=3197&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3199, Order: 162609, Start Time: 2012-08-24 22:58:02, End Time: 2012-08-25 00:17:11 To: 3197, Order: 162586, Start Time: 2012-08-24 21:10:54, End Time: 2012-08-24 22:30:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (709 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.06% (54.4886 => 56.1539, std. dev.: 0.2433) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.53% (10.3673 => 13.2213, std. dev.: 0.0175) SingleSource/UnitTests/ObjC/trivial-interface: 14.05% (0.3473 => 0.3961, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3497 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.82% (0.3561 => 0.4053, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.75% (0.3543 => 0.4030, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.75% (0.3543 => 0.4030, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 13.68% (0.3516 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.48% (0.3694 => 0.4192, std. dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3828 => 0.4323, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3927 => 0.4428, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.66% (1.1194 => 1.2611, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 12.58% (0.3886 => 0.4375, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.35% (1.7609 => 1.9607, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.64% (2.2022 => 2.4144, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.40% (0.1892 => 0.2051, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.22% (0.5925 => 0.6412, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.14% (0.6030 => 0.6521, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2065 => 0.2221, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1584 => 0.1701, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.03% (0.7326 => 0.7841, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.12% (0.3282 => 0.3483, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.09% (0.4615 => 0.4896, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.88% (0.4879 => 0.5166, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.84% (7.0540 => 7.4662, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.78% (0.3307 => 0.3498, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.46% (0.2271 => 0.2395, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.40% (0.2554 => 0.2692, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.40% (9.4845 => 9.9963, std. dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7433 => 0.7825, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.22% (0.4636 => 0.4878, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.19% (4.9449 => 5.2013, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.09% (5.0018 => 5.2562, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.08% (0.5569 => 0.5852, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.04% (0.8172 => 0.8584, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.00% (0.4299 => 0.4514, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.87% (4.2646 => 4.4724, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.81% (0.3121 => 0.3271, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 4.79% (0.3109 => 0.3258, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.77% (0.2891 => 0.3029, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.73% (8.1363 => 8.5213, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.71% (0.5860 => 0.6136, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.66% (1.3050 => 1.3658, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 4.65% (0.2905 => 0.3040, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.63% (5.7591 => 6.0258, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.61% (0.2756 => 0.2883, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.59% (0.3423 => 0.3580, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.58% (0.7835 => 0.8194, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 4.56% (0.2831 => 0.2960, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.55% (10.4361 => 10.9112, std. dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.53% (0.2872 => 0.3002, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.52% (0.3232 => 0.3378, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.48% (0.3865 => 0.4038, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.42% (0.3052 => 0.3187, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.36% (0.4289 => 0.4476, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3098 => 0.3233, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.32% (0.2871 => 0.2995, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.30% (0.2793 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.29% (0.4103 => 0.4279, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.27% (0.3441 => 0.3588, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3422 => 0.3568, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.26% (0.2700 => 0.2815, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.25% (0.3180 => 0.3315, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.21% (0.3162 => 0.3295, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.20% (1.5603 => 1.6259, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 4.20% (0.3283 => 0.3421, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.15% (2.0665 => 2.1523, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists1: 4.13% (0.3684 => 0.3836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.10% (0.2802 => 0.2917, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.2758 => 0.2871, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.08% (0.3136 => 0.3264, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.08% (0.3603 => 0.3750, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3650 => 0.3798, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.03% (0.2877 => 0.2993, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3826 => 0.3980, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.00% (0.5105 => 0.5309, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.99% (0.9765 => 1.0155, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 3.97% (0.3379 => 0.3513, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.95% (0.6450 => 0.6705, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.90% (1.1861 => 1.2324, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.86% (0.4064 => 0.4221, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.80% (1.5415 => 1.6001, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.70% (0.4620 => 0.4791, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.69% (0.6456 => 0.6694, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.67% (0.6675 => 0.6920, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.63% (1.1642 => 1.2065, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.61% (0.4048 => 0.4194, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.60% (0.3387 => 0.3509, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.59% (3.3354 => 3.4550, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.8067 => 0.8356, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.57% (1.2842 => 1.3301, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.51% (0.5981 => 0.6191, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.43% (2.0273 => 2.0968, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.34% (1.4186 => 1.4660, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.31% (3.8723 => 4.0006, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.3668 => 14.8120, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8921 => 0.9195, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.00% (2.2969 => 2.3658, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.99% (0.5020 => 0.5170, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.93% (1.5859 => 1.6324, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.70% (17.1811 => 17.6450, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.2024 => 2.2586, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 2.46% (0.7115 => 0.7290, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.46% (1.1840 => 1.2131, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.94% (7.9617 => 8.1164, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.83% (1.0722 => 1.0918, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.80% (21.9371 => 22.3327, std. dev.: 0.0250) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.47% (2.6778 => 2.9582, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (4.2280 => 4.4520, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7508, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 1.75% (3.2827 => 3.3403, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.74% (26.0924 => 26.5465, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (1.5086 => 1.5290, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2332, std. dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1578 => 3.1969, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.35% (5.2763 => 3.2000, std. dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.51% (5.3855 => 3.7423, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.11% (5.3526 => 3.7407, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1646, std. dev.: 0.0288) MultiSource/Applications/ClamAV/clamscan: -13.82% (22.1758 => 19.1108, std. dev.: 0.0430) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.70% (2.9384 => 2.5652, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0958, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -7.46% (1.5373 => 1.4226, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.1396 => 1.0699, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5107, std. dev.: 0.0011) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4687, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4339, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0081, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9582, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6788, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5132, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3487, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.08% (1.8329 => 1.8131, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 18:13:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 20:13:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120825011334.C11F42A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3200?compare_to=3196&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3200, Order: 162603, Start Time: 2012-08-24 22:30:56, End Time: 2012-08-25 01:14:29 To: 3196, Order: 162579, Start Time: 2012-08-24 19:19:34, End Time: 2012-08-24 22:03:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (115 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.87% (0.6100 => 0.6214, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.05% (16.7239 => 16.8987, std. dev.: 0.0309) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 15.15% (0.3465 => 0.3990, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 15.11% (0.3442 => 0.3962, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.09% (0.3446 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.09% (0.3460 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.08% (0.3488 => 0.4014, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.02% (0.3469 => 0.3990, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.02% (0.3496 => 0.4021, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.63% (0.3650 => 0.4184, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 14.49% (0.3643 => 0.4171, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.29% (0.3724 => 0.4256, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.29% (0.5826 => 0.6367, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.78% (0.5889 => 0.6406, std. dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 8.71% (1.5932 => 1.7320, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.1620 => 0.1751, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.7171 => 0.7693, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (3.5627 => 3.8198, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.17% (1.3152 => 1.4095, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (1.6211 => 1.7342, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.70% (0.5000 => 0.5335, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.46% (0.5900 => 0.6281, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.40% (0.4029 => 0.4287, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.39% (0.4994 => 0.5313, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.36% (0.2014 => 0.2142, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.19% (0.4361 => 0.4631, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.16% (0.2875 => 0.3052, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.15% (0.5026 => 0.5335, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.06% (0.3930 => 0.4168, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 5.89% (0.3004 => 0.3181, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.80% (4.2109 => 4.4551, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.2866 => 0.3032, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2729 => 0.2887, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.77% (0.9909 => 1.0481, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.77% (0.2792 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.76% (0.2725 => 0.2882, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 5.73% (1.0781 => 1.1399, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.73% (0.3195 => 0.3378, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.71% (0.2750 => 0.2907, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.62% (2.7292 => 2.8827, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 5.55% (0.2813 => 0.2969, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2803 => 0.2958, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2823 => 0.2979, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.2780 => 0.2933, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.46% (0.3096 => 0.3265, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (2.0673 => 2.1794, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 5.39% (0.3267 => 0.3443, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3258 => 0.3432, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2911 => 0.3065, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: 5.28% (0.3317 => 0.3492, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.25% (5.5417 => 5.8328, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.12% (0.3124 => 0.3284, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.11% (0.3348 => 0.3519, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.09% (0.3362 => 0.3533, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.05% (0.3625 => 0.3808, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 5.03% (0.3678 => 0.3863, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.00% (1.9694 => 2.0678, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3060 => 0.3211, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3726 => 0.3909, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.88% (2.1013 => 2.2038, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.88% (0.3282 => 0.3442, std. dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 4.87% (0.2566 => 0.2691, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.83% (1.9966 => 2.0930, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists1: 4.77% (0.3477 => 0.3643, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.76% (0.3890 => 0.4075, std. dev.: 0.0021) MultiSource/Applications/hbd/hbd: 4.73% (0.9697 => 1.0156, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.72% (0.4658 => 0.4878, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 4.61% (0.4251 => 0.4447, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 4.58% (0.4146 => 0.4336, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.53% (0.3690 => 0.3857, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 4.51% (4.6177 => 4.8258, std. dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: 4.39% (2.1653 => 2.2603, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.35% (0.3981 => 0.4154, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.28% (0.3903 => 0.4070, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (4.4195 => 4.6071, std. dev.: 0.0072) MultiSource/Applications/treecc/treecc: 4.24% (0.7875 => 0.8209, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.4139 => 0.4313, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.18% (0.5546 => 0.5778, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.16% (0.3845 => 0.4005, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 4.12% (1.8794 => 1.9569, std. dev.: 0.0079) MultiSource/Applications/lua/lua: 4.11% (1.4269 => 1.4855, std. dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 3.95% (23.5202 => 24.4487, std. dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.3271 => 0.3400, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 3.89% (0.6634 => 0.6892, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.3084 => 0.3196, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.6435 => 0.6666, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.45% (0.3336 => 0.3451, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.88% (2.0346 => 2.0931, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.60% (0.7426 => 0.7545, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.10% (4.6926 => 4.7444, std. dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.03% (11.6398 => 11.7602, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.94% (0.2122 => 0.2333, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6473, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1954, std. dev.: 0.0079) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5072, std. dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std. dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4498, std. dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2891, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5877, std. dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.98% (2.4764 => 2.4027, std. dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5506, std. dev.: 0.0245) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8075, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7978, std. dev.: 0.0021) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5193, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -1.97% (17.2379 => 16.8987, std. dev.: 0.0309) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5741, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9570, std. dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 18:48:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 20:48:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120825014807.D837A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3201?compare_to=3198&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3201, Order: 162630, Start Time: 2012-08-25 00:34:46, End Time: 2012-08-25 01:49:02 To: 3198, Order: 162603, Start Time: 2012-08-24 22:26:41, End Time: 2012-08-24 23:40:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (160 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.11% (7.9514 => 8.0398, std. dev.: 0.0095) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.32% (2.0176 => 2.3267, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 13.08% (0.0826 => 0.0934, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.45% (0.5818 => 0.6484, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.41% (0.7061 => 0.7867, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.29% (0.3578 => 0.3946, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 10.23% (0.3646 => 0.4019, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.19% (0.3601 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.11% (0.3650 => 0.4019, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 10.05% (0.3623 => 0.3987, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.02% (0.3663 => 0.4030, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.95% (0.3789 => 0.4166, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 9.86% (0.3914 => 0.4300, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.64% (0.4003 => 0.4389, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 9.54% (0.3940 => 0.4316, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2781 => 0.3027, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.70% (0.2782 => 0.3024, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.63% (0.1413 => 0.1535, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.60% (1.3693 => 1.4871, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.58% (0.1819 => 0.1975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.44% (0.2607 => 0.2827, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.36% (0.2690 => 0.2915, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.34% (3.9660 => 4.2967, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 8.33% (0.2761 => 0.2991, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 8.33% (0.2726 => 0.2953, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.30% (0.2628 => 0.2846, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.2655 => 0.2874, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.21% (0.3107 => 0.3362, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.15% (0.2760 => 0.2985, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.12% (0.4062 => 0.4392, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.08% (0.7710 => 0.8333, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.04% (0.3022 => 0.3265, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.02% (0.2966 => 0.3204, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.02% (1.9828 => 2.1419, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wc: 8.00% (0.2937 => 0.3172, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.98% (0.3899 => 0.4210, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.97% (0.3149 => 0.3400, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.79% (0.2696 => 0.2906, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2988 => 0.3216, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 7.63% (0.7038 => 0.7575, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3485 => 0.3750, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.54% (0.3580 => 0.3850, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.54% (0.3489 => 0.3752, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.46% (0.5265 => 0.5658, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3453 => 0.3710, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.42% (0.3192 => 0.3429, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.36% (1.2193 => 1.3090, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.31% (0.2721 => 0.2920, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.31% (0.9199 => 0.9871, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.26% (0.4379 => 0.4697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3293 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 7.07% (0.3534 => 0.3784, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.05% (0.1588 => 0.1700, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (0.4390 => 0.4694, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.91% (0.6959 => 0.7440, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4016 => 0.4289, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3868 => 0.4130, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.76% (0.3756 => 0.4010, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.68% (0.2127 => 0.2269, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.66% (1.1364 => 1.2121, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.55% (0.2945 => 0.3138, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.47% (0.5577 => 0.5938, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.42% (13.8202 => 14.7072, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.32% (0.5637 => 0.5993, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3246 => 0.3449, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.2914 => 0.3094, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.15% (1.2292 => 1.3048, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.11% (0.1865 => 0.1979, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.09% (7.2180 => 7.6579, std. dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.04% (1.4563 => 1.5443, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 6.02% (0.2925 => 0.3101, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.91% (1.3813 => 1.4630, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 5.80% (0.2243 => 0.2373, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.77% (1.3245 => 1.4009, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3755 => 0.3971, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (1.3819 => 1.4608, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.65% (0.7506 => 0.7930, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 5.63% (0.8310 => 0.8778, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.61% (0.4791 => 0.5060, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.61% (0.2140 => 0.2260, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.60% (3.8646 => 4.0810, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 5.57% (1.1061 => 1.1677, std. dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 5.54% (0.2995 => 0.3161, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.52% (0.7460 => 0.7872, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.44% (3.6692 => 3.8689, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 5.40% (1.0594 => 1.1166, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4113 => 0.4334, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.35% (0.6283 => 0.6619, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.32% (4.3801 => 4.6130, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 5.28% (0.3220 => 0.3390, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.6135 => 0.6456, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.18% (1.9270 => 2.0268, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.17% (4.4433 => 4.6731, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (13.2842 => 13.9512, std. dev.: 0.0129) MultiSource/Applications/siod/siod: 4.95% (2.1791 => 2.2869, std. dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 4.90% (16.6129 => 17.4266, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.85% (0.8818 => 0.9246, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 4.66% (14.8535 => 15.5454, std. dev.: 0.0157) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.2243 => 0.2345, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 4.50% (0.3131 => 0.3272, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.47% (0.8698 => 0.9087, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.31% (0.3245 => 0.3385, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (8.4961 => 8.8626, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.23% (1.1333 => 1.1812, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 4.07% (3.1889 => 3.3186, std. dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: 4.03% (6.5754 => 6.8402, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.9865 => 5.1871, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.2859 => 0.2967, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.60% (3.2742 => 3.3920, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 3.57% (4.6629 => 4.8293, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 3.38% (14.5298 => 15.0207, std. dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/bigfib: 3.38% (0.6250 => 0.6461, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.33% (16.2614 => 16.8024, std. dev.: 0.0206) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.23% (0.9108 => 0.9402, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.21% (1.5188 => 1.5675, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.70% (2.1007 => 2.1574, std. dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (6.2785 => 6.4469, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.46% (0.4805 => 0.4923, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.43% (3.7467 => 3.8377, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 2.30% (0.6744 => 0.6899, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 2.27% (1.0313 => 1.0547, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.12% (33.2944 => 33.9990, std. dev.: 0.0159) MultiSource/Applications/SIBsim4/SIBsim4: 1.72% (1.2749 => 1.2968, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5150, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2667, std. dev.: 0.0415) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.56% (1.2998 => 1.4241, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.90% (1.5824 => 1.6599, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7426, std. dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4271 => 7.6063, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.32% (10.7476 => 10.9973, std. dev.: 0.0479) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.08% (3.2729 => 3.3411, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.02% (1.4298 => 1.4587, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.42% (1.5089 => 1.5303, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6469 => 3.6879, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6390, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.22% (22.5627 => 21.3841, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.68% (0.2670 => 0.2545, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.47% (1.2308 => 1.0896, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std. dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -3.23% (1.1560 => 1.1187, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.8259 => 8.5750, std. dev.: 0.0237) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.45% (1.9762 => 1.9277, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2354, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: -1.88% (3.0263 => 2.9695, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2028, std. dev.: 0.0171) MultiSource/Applications/lambda-0_1_3/lambda: -1.72% (5.3167 => 5.2254, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9932, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std. dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4938, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.23% (5.5401 => 5.4720, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2225, std. dev.: 0.0169) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4221, std. dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.05% (20.3410 => 20.1275, std. dev.: 0.0150) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 19:03:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 21:03:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120825020319.D8A3F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3202?compare_to=3199&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3202, Order: 162631, Start Time: 2012-08-25 00:45:01, End Time: 2012-08-25 02:04:15 To: 3199, Order: 162609, Start Time: 2012-08-24 22:58:02, End Time: 2012-08-25 00:17:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (136 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (700 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.39% (79.8585 => 80.9648, std. dev.: 0.3737) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.02% (10.3673 => 13.2718, std. dev.: 0.0094) SingleSource/UnitTests/ObjC/trivial-interface: 14.37% (0.3473 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.31% (0.3543 => 0.4050, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 14.13% (0.3561 => 0.4064, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3516 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.03% (0.3543 => 0.4040, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-2: 14.01% (0.3497 => 0.3987, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.56% (0.3694 => 0.4195, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.19% (0.3927 => 0.4445, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.17% (0.3828 => 0.4332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.00% (0.3886 => 0.4391, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.38% (1.1194 => 1.2580, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.44% (1.7609 => 1.9624, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.90% (0.3817 => 0.4233, std. dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.79% (2.2022 => 2.4178, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 9.43% (0.1432 => 0.1567, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.09% (0.1892 => 0.2045, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.83% (0.1584 => 0.1708, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.76% (0.5925 => 0.6385, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.58% (0.6030 => 0.6487, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 7.46% (0.1622 => 0.1743, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.30% (0.3177 => 0.3409, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.66% (0.7326 => 0.7814, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.59% (0.4615 => 0.4919, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 6.55% (0.3282 => 0.3497, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 6.40% (0.1655 => 0.1761, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.31% (0.1695 => 0.1802, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.19% (0.4879 => 0.5181, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.06% (7.0540 => 7.4818, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 5.81% (0.7433 => 0.7865, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.81% (0.3307 => 0.3499, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.79% (4.9449 => 5.2314, std. dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 5.72% (0.2554 => 0.2700, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.71% (9.4845 => 10.0259, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.65% (0.4299 => 0.4542, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.60% (0.2107 => 0.2225, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.51% (5.0018 => 5.2776, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.24% (0.8172 => 0.8600, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.21% (4.2646 => 4.4868, std. dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: 5.18% (0.3109 => 0.3270, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.16% (0.3121 => 0.3282, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.15% (0.5569 => 0.5856, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.05% (10.4361 => 10.9629, std. dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.03% (0.5860 => 0.6155, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.96% (1.3050 => 1.3697, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.91% (0.3423 => 0.3591, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.78% (0.2700 => 0.2829, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.77% (0.4636 => 0.4857, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (8.1363 => 8.5224, std. dev.: 0.0033) MultiSource/Applications/spiff/spiff: 4.63% (0.7835 => 0.8198, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.3180 => 0.3327, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.60% (0.2891 => 0.3024, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.56% (0.6450 => 0.6744, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.51% (0.2905 => 0.3036, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.48% (0.3441 => 0.3595, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 4.47% (5.7591 => 6.0164, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.44% (1.1861 => 1.2388, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.44% (0.4103 => 0.4285, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.43% (0.4289 => 0.4479, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.43% (0.2756 => 0.2878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.39% (0.3232 => 0.3374, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.39% (0.2758 => 0.2879, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3098 => 0.3233, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 4.33% (0.2725 => 0.2843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 4.33% (0.3052 => 0.3184, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.32% (0.2872 => 0.2996, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 4.30% (0.3092 => 0.3225, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.29% (0.3865 => 0.4031, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.29% (0.9765 => 1.0184, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.2831 => 0.2952, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.26% (1.5603 => 1.6268, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 4.24% (0.3422 => 0.3567, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.20% (0.3283 => 0.3421, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.15% (0.5105 => 0.5317, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 4.14% (0.2871 => 0.2990, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.14% (0.3650 => 0.3801, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.11% (0.3162 => 0.3292, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.07% (0.3387 => 0.3525, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.07% (0.2877 => 0.2994, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.06% (2.0665 => 2.1505, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.05% (0.3826 => 0.3981, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.05% (0.2793 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2802 => 0.2914, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.00% (0.3603 => 0.3747, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.99% (0.8067 => 0.8389, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.99% (0.3136 => 0.3261, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.95% (1.1642 => 1.2102, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hello: 3.94% (0.2714 => 0.2821, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.89% (1.5415 => 1.6015, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.85% (0.6675 => 0.6932, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.84% (0.4064 => 0.4220, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.3684 => 0.3825, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3935 => 0.4083, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.75% (0.6456 => 0.6698, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.70% (0.3379 => 0.3504, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.66% (2.0273 => 2.1015, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.62% (0.4203 => 0.4355, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.61% (0.4620 => 0.4787, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.61% (3.3354 => 3.4559, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.58% (0.4048 => 0.4193, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.4186 => 1.4692, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 3.55% (3.8723 => 4.0097, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.48% (0.5981 => 0.6189, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.44% (1.2842 => 1.3284, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.28% (2.2969 => 2.3723, std. dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/football/football: 3.26% (0.8921 => 0.9212, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.20% (1.5859 => 1.6367, std. dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (14.3668 => 14.8258, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.19% (0.5020 => 0.5180, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.82% (2.2024 => 2.2646, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.63% (1.1840 => 1.2151, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 2.53% (0.7115 => 0.7295, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.51% (17.1811 => 17.6132, std. dev.: 0.0152) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.13% (7.9617 => 8.1311, std. dev.: 0.0024) MultiSource/Applications/lemon/lemon: 2.13% (1.0722 => 1.0950, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.82% (21.9371 => 22.3354, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (0.8101 => 0.8215, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.23% (4.2280 => 4.4490, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.18% (3.6395 => 3.7551, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.76% (26.0924 => 26.5520, std. dev.: 0.0084) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3397, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5313, std. dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 1.19% (3.1578 => 3.1954, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.09% (2.6546 => 2.6835, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.11% (5.2763 => 3.2127, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.84% (5.3855 => 3.7245, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.41% (5.3526 => 3.7249, std. dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0941, std. dev.: 0.0445) MultiSource/Applications/ClamAV/clamscan: -13.89% (22.1758 => 19.0945, std. dev.: 0.0333) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.89% (2.9384 => 2.5597, std. dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std. dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -11.85% (1.2373 => 1.0907, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel-2: -7.96% (1.5373 => 1.4150, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.09% (1.1396 => 1.0702, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std. dev.: 0.0020) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4668, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4132, std. dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.58% (10.2830 => 10.0177, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9645, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3461, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8124, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (1.6805 => 1.6631, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std. dev.: 0.0050) MultiSource/Applications/lemon/lemon: -1.00% (1.4460 => 1.4315, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 20:29:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 22:29:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120825032958.C0FED2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3203?compare_to=3201&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3203, Order: 162638, Start Time: 2012-08-25 02:16:38, End Time: 2012-08-25 03:30:51 To: 3201, Order: 162630, Start Time: 2012-08-25 00:34:46, End Time: 2012-08-25 01:49:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (158 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.31% (1.0896 => 1.1039, std. dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.42% (2.0176 => 2.3287, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.39% (0.7061 => 0.7865, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 11.24% (0.5818 => 0.6472, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.76% (0.3578 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.66% (0.3601 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.65% (0.3663 => 0.4053, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.59% (0.3646 => 0.4032, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3650 => 0.4036, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3623 => 0.4003, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3914 => 0.4322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.35% (0.3789 => 0.4181, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.12% (0.4003 => 0.4408, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.05% (0.3940 => 0.4336, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.06% (0.1986 => 0.2166, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.63% (0.1819 => 0.1976, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.45% (0.2781 => 0.3016, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2782 => 0.3016, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.35% (1.3693 => 1.4836, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.22% (0.7710 => 0.8344, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.21% (0.2607 => 0.2821, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 8.14% (0.2690 => 0.2909, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.09% (3.9660 => 4.2868, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4062 => 0.4390, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2655 => 0.2868, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.99% (0.2628 => 0.2838, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.93% (0.2937 => 0.3170, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.86% (0.2760 => 0.2977, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.79% (0.2696 => 0.2906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2761 => 0.2975, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2765 => 0.2979, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.69% (1.9828 => 2.1352, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2726 => 0.2935, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.2966 => 0.3193, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.56% (0.3107 => 0.3342, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.53% (0.3149 => 0.3386, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.39% (0.3899 => 0.4187, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3580 => 0.3844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.37% (0.5265 => 0.5653, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7038 => 0.7554, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3485 => 0.3740, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2988 => 0.3206, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.3489 => 0.3742, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.21% (0.3192 => 0.3422, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.05% (1.2193 => 1.3052, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.01% (0.9199 => 0.9844, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 6.98% (0.3453 => 0.3694, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (0.4379 => 0.4684, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.1588 => 0.1696, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.77% (0.3293 => 0.3516, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.70% (0.6959 => 0.7425, std. dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.61% (0.4390 => 0.4680, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3534 => 0.3766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.49% (0.2127 => 0.2265, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.47% (0.3756 => 0.3999, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.46% (1.1364 => 1.2098, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.42% (0.4016 => 0.4274, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.27% (13.8202 => 14.6871, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.04% (0.5577 => 0.5914, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2023 => 0.2145, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.01% (0.5637 => 0.5976, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.98% (0.2925 => 0.3100, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.97% (7.2180 => 7.6490, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (0.2914 => 0.3088, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.90% (0.1865 => 0.1975, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.86% (1.2292 => 1.3012, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.84% (1.4563 => 1.5414, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 5.84% (0.2243 => 0.2374, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.77% (0.7506 => 0.7939, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.54% (0.3755 => 0.3963, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.46% (1.3819 => 1.4573, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.44% (0.7460 => 0.7866, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.3813 => 1.4562, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 5.39% (3.8646 => 4.0729, std. dev.: 0.0085) MultiSource/Applications/sgefa/sgefa: 5.38% (0.2995 => 0.3156, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.35% (1.3245 => 1.3954, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.32% (0.8310 => 0.8752, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.29% (1.1061 => 1.1646, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.24% (3.6692 => 3.8614, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.12% (4.3801 => 4.6044, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.11% (0.4113 => 0.4323, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.08% (0.6283 => 0.6602, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.0594 => 1.1129, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.03% (0.4791 => 0.5032, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.00% (4.4433 => 4.6656, std. dev.: 0.0034) MultiSource/Applications/treecc/treecc: 4.91% (1.9270 => 2.0216, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.89% (0.6135 => 0.6435, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (13.2842 => 13.9301, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 4.81% (0.3220 => 0.3375, std. dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 4.54% (16.6129 => 17.3672, std. dev.: 0.0067) MultiSource/Applications/siod/siod: 4.54% (2.1791 => 2.2780, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.54% (0.8818 => 0.9218, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.43% (14.8535 => 15.5109, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 4.18% (0.3131 => 0.3262, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.8698 => 0.9057, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.1333 => 1.1798, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.10% (0.3245 => 0.3378, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (8.4961 => 8.8378, std. dev.: 0.0137) MultiSource/Applications/d/make_dparser: 3.98% (3.1889 => 3.3158, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.82% (6.5754 => 6.8263, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 3.74% (0.2859 => 0.2966, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.74% (4.9865 => 5.1729, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.71% (4.6629 => 4.8361, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.32% (3.2742 => 3.3830, std. dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 3.24% (14.5298 => 15.0002, std. dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 3.17% (16.2614 => 16.7766, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 2.96% (0.6250 => 0.6435, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.94% (0.9108 => 0.9376, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.84% (1.5188 => 1.5619, std. dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.39% (6.2785 => 6.4288, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.1007 => 2.1485, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.15% (3.7467 => 3.8274, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.08% (0.4805 => 0.4905, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.08% (0.6744 => 0.6884, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.50% (33.2944 => 33.7950, std. dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5144, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 24.98% (1.8175 => 2.2716, std. dev.: 0.0463) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 8.82% (1.2998 => 1.4144, std. dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.88% (1.5824 => 1.6597, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.30% (11.2619 => 11.7460, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.75% (1.7688 => 1.8175, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3846, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.37% (7.4271 => 7.6030, std. dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 2.32% (10.7476 => 10.9974, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 2.05% (1.4298 => 1.4591, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 2.03% (3.2729 => 3.3392, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.50% (8.3908 => 8.5167, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.40% (1.5089 => 1.5300, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6858, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5928 => 4.6410, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.59% (22.5627 => 21.3018, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.09% (0.2670 => 0.2534, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.2308 => 1.1039, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.65% (1.3780 => 1.3139, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -3.23% (1.1560 => 1.1187, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5954, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2202, std. dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.85% (5.3167 => 5.2184, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9732, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2030, std. dev.: 0.0263) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4249, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4772, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2357, std. dev.: 0.0271) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 20:50:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 22:50:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120825035026.EAD1C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3204?compare_to=3202&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3204, Order: 162638, Start Time: 2012-08-25 02:32:05, End Time: 2012-08-25 03:51:21 To: 3202, Order: 162631, Start Time: 2012-08-25 00:45:01, End Time: 2012-08-25 02:04:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (134 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (704 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (13.2718 => 13.6632, std. dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.40% (1.4150 => 1.4490, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 1.36% (1.0907 => 1.1055, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.79% (10.3673 => 13.6632, std. dev.: 0.0122) SingleSource/UnitTests/ObjC/trivial-interface: 13.91% (0.3473 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 13.63% (0.3543 => 0.4026, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3497 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.56% (0.3561 => 0.4044, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.54% (0.3516 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.08% (0.3694 => 0.4177, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.83% (0.3828 => 0.4319, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.82% (1.1194 => 1.2629, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3927 => 0.4430, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.58% (0.3886 => 0.4375, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.28% (1.7609 => 1.9772, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 10.34% (0.1432 => 0.1580, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.30% (2.2022 => 2.4291, std. dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.41% (0.1892 => 0.2070, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.6030 => 0.6555, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.89% (0.1584 => 0.1709, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.43% (0.7326 => 0.7870, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 7.27% (0.1622 => 0.1740, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.22% (0.3282 => 0.3519, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.70% (0.4879 => 0.5206, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 6.59% (0.1655 => 0.1764, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.43% (0.1695 => 0.1804, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.22% (7.0540 => 7.4931, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 6.07% (0.2554 => 0.2709, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (9.4845 => 10.0395, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.82% (4.9449 => 5.2325, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 5.82% (0.4299 => 0.4549, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 5.79% (0.3109 => 0.3289, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.72% (5.0018 => 5.2881, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.7433 => 0.7855, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2271 => 0.2397, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.35% (0.8172 => 0.8609, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.30% (4.2646 => 4.4905, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.23% (0.5569 => 0.5860, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.17% (10.4361 => 10.9760, std. dev.: 0.0102) MultiSource/Benchmarks/McCat/18-imp/imp: 5.08% (0.3423 => 0.3597, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.02% (1.3050 => 1.3705, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.98% (8.1363 => 8.5416, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.98% (0.2891 => 0.3035, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.88% (0.5860 => 0.6146, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.87% (0.4636 => 0.4862, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.83% (0.4103 => 0.4301, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.81% (0.2700 => 0.2830, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.81% (0.3180 => 0.3333, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2905 => 0.3044, std. dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 4.65% (5.7591 => 6.0269, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.59% (0.7835 => 0.8195, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.57% (0.2758 => 0.2884, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.56% (0.2831 => 0.2960, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.53% (0.2872 => 0.3002, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.52% (0.3232 => 0.3378, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 4.51% (0.2725 => 0.2848, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.50% (0.6450 => 0.6740, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3098 => 0.3237, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.47% (0.5105 => 0.5333, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.46% (0.2756 => 0.2879, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 4.37% (1.5603 => 1.6285, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3052 => 0.3185, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.34% (0.4289 => 0.4475, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.33% (0.2793 => 0.2914, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 4.32% (0.2871 => 0.2995, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.9765 => 1.0185, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 4.28% (0.2877 => 0.3000, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.27% (0.3162 => 0.3297, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.25% (0.3650 => 0.3805, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.25% (0.3603 => 0.3756, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.24% (0.2714 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.24% (0.3092 => 0.3223, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (1.1861 => 1.2362, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.21% (0.3136 => 0.3268, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3422 => 0.3566, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.20% (2.0665 => 2.1533, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.18% (0.3826 => 0.3986, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.18% (0.2802 => 0.2919, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (0.4064 => 0.4232, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.13% (0.8067 => 0.8400, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.09% (0.6675 => 0.6948, std. dev.: 0.0041) MultiSource/Applications/treecc/treecc: 4.01% (2.0273 => 2.1085, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.99% (1.1642 => 1.2107, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3684 => 0.3831, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.95% (0.4203 => 0.4369, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.93% (0.4048 => 0.4207, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.92% (1.5415 => 1.6019, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 3.92% (0.4620 => 0.4801, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.90% (0.6456 => 0.6708, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.89% (0.3935 => 0.4088, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3379 => 0.3510, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.76% (3.3354 => 3.4607, std. dev.: 0.0141) MultiSource/Benchmarks/sim/sim: 3.75% (0.3387 => 0.3514, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 3.66% (3.8723 => 4.0142, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 3.66% (1.2842 => 1.3312, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (1.4186 => 1.4685, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.48% (0.5981 => 0.6189, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.42% (2.2969 => 2.3755, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 3.33% (0.8921 => 0.9218, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (14.3668 => 14.8395, std. dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.29% (0.5020 => 0.5185, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.22% (1.5859 => 1.6370, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.2024 => 2.2678, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.95% (0.3427 => 0.3528, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.1840 => 1.2159, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.68% (0.7115 => 0.7306, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.56% (17.1811 => 17.6202, std. dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.38% (7.9617 => 8.1512, std. dev.: 0.0108) MultiSource/Applications/lemon/lemon: 2.21% (1.0722 => 1.0959, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.03% (21.9371 => 22.3820, std. dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.51% (0.8101 => 0.8223, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (4.2280 => 4.4311, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7575, std. dev.: 0.0013) MultiSource/Applications/siod/siod: 1.77% (3.2827 => 3.3407, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.70% (26.0924 => 26.5371, std. dev.: 0.0179) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5313, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2336, std. dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/hash2: 1.19% (3.1578 => 3.1953, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.12% (2.6546 => 2.6844, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.91% (5.2763 => 3.2235, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.52% (5.3855 => 3.7416, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.12% (5.3526 => 3.7406, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0786, std. dev.: 0.0400) MultiSource/Applications/ClamAV/clamscan: -13.79% (22.1758 => 19.1174, std. dev.: 0.0273) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.52% (2.9384 => 2.5706, std. dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2373 => 1.1055, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: -6.08% (1.5835 => 1.4873, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.74% (1.5373 => 1.4490, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.81% (5.0483 => 4.8053, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4774, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4160, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/salsa20: -2.78% (10.2830 => 9.9973, std. dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.25% (8.1563 => 7.9728, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6777, std. dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.54% (12.5348 => 12.3417, std. dev.: 0.0067) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4227, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (1.6805 => 1.6627, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.03% (1.4460 => 1.4311, std. dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 21:25:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 24 Aug 2012 23:25:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120825042503.912E02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3205?compare_to=3200&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3205, Order: 162637, Start Time: 2012-08-25 01:42:18, End Time: 2012-08-25 04:25:58 To: 3200, Order: 162603, Start Time: 2012-08-24 22:30:56, End Time: 2012-08-25 01:14:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (116 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (762 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.62% (124.6908 => 130.4514, std. dev.: 0.4651) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.55% (1.7320 => 1.7052, std. dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3465 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.15% (0.3442 => 0.3929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.13% (0.3460 => 0.3949, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.02% (0.3488 => 0.3977, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 13.96% (0.3496 => 0.3984, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.95% (0.3469 => 0.3953, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.51% (0.3650 => 0.4143, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 13.51% (0.3643 => 0.4135, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 13.10% (0.3724 => 0.4212, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.74% (0.5826 => 0.6335, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.39% (0.5889 => 0.6383, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 7.03% (1.5932 => 1.7052, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (3.5627 => 3.8108, std. dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.86% (1.6211 => 1.7323, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 6.75% (0.7171 => 0.7655, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.65% (1.3152 => 1.4026, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.15% (0.4361 => 0.4629, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (0.5000 => 0.5305, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (0.5026 => 0.5332, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.5900 => 0.6258, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.95% (0.4994 => 0.5291, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2738 => 0.2899, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.76% (4.2109 => 4.4536, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.74% (0.2875 => 0.3040, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.73% (0.4029 => 0.4260, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.67% (0.3930 => 0.4153, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 5.63% (1.0781 => 1.1388, std. dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.48% (0.3195 => 0.3370, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.43% (0.2725 => 0.2873, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.31% (0.2714 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.30% (0.2866 => 0.3018, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (2.7292 => 2.8739, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.1968 => 0.2071, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.19% (0.3004 => 0.3160, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2803 => 0.2948, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.2823 => 0.2969, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.17% (0.2729 => 0.2870, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.12% (0.2792 => 0.2935, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.12% (0.9909 => 1.0416, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 5.05% (0.2750 => 0.2889, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (0.2813 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.2780 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.03% (0.3317 => 0.3484, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.02% (0.3625 => 0.3807, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.02% (0.2811 => 0.2952, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.96% (1.9694 => 2.0670, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.93% (2.0673 => 2.1693, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 4.91% (0.3258 => 0.3418, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 4.84% (0.3096 => 0.3246, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.84% (0.2911 => 0.3052, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 4.84% (0.9697 => 1.0166, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 4.84% (0.3267 => 0.3425, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.73% (1.9966 => 2.0910, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.68% (0.2566 => 0.2686, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3678 => 0.3850, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.64% (0.3060 => 0.3202, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3362 => 0.3518, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 4.60% (0.3348 => 0.3502, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3124 => 0.3266, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.54% (0.3282 => 0.3431, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (0.4658 => 0.4869, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 4.48% (5.5417 => 5.7901, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 4.48% (0.3726 => 0.3893, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.47% (2.1013 => 2.1952, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.46% (0.3271 => 0.3417, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 4.43% (0.3477 => 0.3631, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.42% (0.3890 => 0.4062, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.40% (0.3845 => 0.4014, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.38% (0.4251 => 0.4437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.34% (0.4146 => 0.4326, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 4.18% (4.6177 => 4.8108, std. dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 4.16% (1.8794 => 1.9576, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 4.09% (2.1653 => 2.2538, std. dev.: 0.0033) MultiSource/Applications/lua/lua: 4.06% (1.4269 => 1.4848, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3690 => 0.3839, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.03% (4.4195 => 4.5974, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.3903 => 0.4060, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.01% (0.4139 => 0.4305, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.92% (0.3981 => 0.4137, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.81% (0.7875 => 0.8175, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.63% (0.6634 => 0.6875, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 3.57% (0.5546 => 0.5744, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.50% (0.3084 => 0.3192, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.47% (0.2969 => 0.3072, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.5012 => 0.5181, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 3.26% (23.5202 => 24.2864, std. dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 2.31% (2.0346 => 2.0817, std. dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (0.7426 => 0.7532, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.80% (0.2122 => 0.2330, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6125, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6644, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.65% (15.4430 => 16.1618, std. dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6366, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std. dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5059, std. dev.: 0.0252) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std. dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4337, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2796, std. dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5152, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5783, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.11% (2.4764 => 2.3993, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5720, std. dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary2: -8.49% (0.2402 => 0.2198, std. dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7942, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8050, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std. dev.: 0.0048) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.64% (17.2379 => 16.7835, std. dev.: 0.0378) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5828, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9583, std. dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 22:11:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 00:11:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120825051153.D21922A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3206?compare_to=3203&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3206, Order: 162639, Start Time: 2012-08-25 03:58:34, End Time: 2012-08-25 05:12:46 To: 3203, Order: 162638, Start Time: 2012-08-25 02:16:38, End Time: 2012-08-25 03:30:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (159 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (695 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.58% (1.4144 => 1.4368, std. dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.53% (79.4479 => 80.6647, std. dev.: 0.1092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.16% (2.0176 => 2.3234, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.84% (0.5818 => 0.6507, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.70% (0.7061 => 0.7887, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 11.59% (0.5748 => 0.6414, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.12% (0.3578 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.96% (0.3623 => 0.4020, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.94% (0.3601 => 0.3995, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3663 => 0.4063, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3646 => 0.4044, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.79% (0.3789 => 0.4198, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.74% (0.3650 => 0.4042, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3914 => 0.4328, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.37% (0.4003 => 0.4418, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.23% (0.3940 => 0.4343, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 8.86% (0.4062 => 0.4422, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.85% (0.3130 => 0.3407, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.85% (0.4328 => 0.4711, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.81% (0.2781 => 0.3026, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.70% (0.2782 => 0.3024, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.69% (0.1819 => 0.1977, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 8.48% (0.2690 => 0.2918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.44% (0.2607 => 0.2827, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.43% (1.3693 => 1.4848, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.36% (0.2655 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.34% (0.3022 => 0.3274, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.26% (0.2628 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.24% (0.2937 => 0.3179, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.17% (0.2765 => 0.2991, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.12% (3.9660 => 4.2882, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 8.11% (0.2726 => 0.2947, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.08% (0.7710 => 0.8333, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.08% (1.9828 => 2.1430, std. dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.01% (0.2696 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.01% (0.2760 => 0.2981, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.99% (0.2966 => 0.3203, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.97% (0.2761 => 0.2981, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.3107 => 0.3353, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.75% (0.3149 => 0.3393, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.74% (0.7038 => 0.7583, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.63% (0.2596 => 0.2794, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3485 => 0.3750, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.58% (0.3192 => 0.3434, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.57% (0.3580 => 0.3851, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.56% (0.2988 => 0.3214, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.56% (0.4390 => 0.4722, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.50% (0.5265 => 0.5660, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 7.30% (0.3453 => 0.3705, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.19% (1.2193 => 1.3070, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.19% (0.9199 => 0.9860, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.13% (0.2721 => 0.2915, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.4379 => 0.4690, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 6.92% (0.3293 => 0.3521, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.6959 => 0.7436, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 6.83% (0.3868 => 0.4132, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3534 => 0.3774, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.72% (0.5577 => 0.5952, std. dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.68% (0.1588 => 0.1694, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.66% (0.3756 => 0.4006, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.65% (0.4016 => 0.4283, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.62% (0.2945 => 0.3140, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.58% (0.2127 => 0.2267, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (1.1364 => 1.2109, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.24% (13.8202 => 14.6819, std. dev.: 0.0207) MultiSource/Applications/hexxagon/hexxagon: 6.13% (1.2292 => 1.3045, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.08% (0.5637 => 0.5980, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3246 => 0.3442, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (0.2914 => 0.3089, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.01% (0.1865 => 0.1977, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 5.98% (0.2925 => 0.3100, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 5.97% (0.2243 => 0.2377, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.96% (1.4563 => 1.5431, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2023 => 0.2143, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.89% (7.2180 => 7.6434, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 5.85% (3.8646 => 4.0906, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.81% (0.3755 => 0.3973, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.56% (0.7506 => 0.7923, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.51% (1.3245 => 1.3975, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.3813 => 1.4574, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 5.45% (1.1061 => 1.1664, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.44% (1.3819 => 1.4571, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 5.40% (0.8310 => 0.8759, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 5.34% (0.2995 => 0.3155, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.34% (0.7460 => 0.7858, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (3.6692 => 3.8638, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 5.25% (0.4113 => 0.4329, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.19% (1.0594 => 1.1144, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.6283 => 0.6609, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.4791 => 0.5035, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (4.3801 => 4.6030, std. dev.: 0.0077) MultiSource/Applications/treecc/treecc: 5.07% (1.9270 => 2.0247, std. dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (4.4433 => 4.6682, std. dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3220 => 0.3381, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.95% (16.6129 => 17.4353, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (13.2842 => 13.9387, std. dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.86% (0.6135 => 0.6433, std. dev.: 0.0032) MultiSource/Applications/siod/siod: 4.85% (2.1791 => 2.2848, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.64% (0.2243 => 0.2347, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.51% (0.8818 => 0.9216, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.47% (14.8535 => 15.5176, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.46% (0.8698 => 0.9086, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 4.38% (0.3131 => 0.3268, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.35% (0.3245 => 0.3386, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.20% (1.1333 => 1.1809, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.08% (4.9865 => 5.1898, std. dev.: 0.0106) MultiSource/Applications/d/make_dparser: 4.06% (3.1889 => 3.3184, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (8.4961 => 8.8329, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.2859 => 0.2970, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.76% (6.5754 => 6.8226, std. dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: 3.58% (4.6629 => 4.8299, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.47% (3.2742 => 3.3878, std. dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 3.40% (14.5298 => 15.0245, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 3.28% (16.2614 => 16.7946, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.25% (0.6250 => 0.6453, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.02% (1.5188 => 1.5646, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.96% (0.9108 => 0.9378, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1548, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (6.2785 => 6.4326, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.25% (3.7467 => 3.8311, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.4805 => 0.4912, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.16% (33.2944 => 34.0147, std. dev.: 0.0080) MultiSource/Applications/lemon/lemon: 2.15% (1.0313 => 1.0535, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 2.06% (0.6744 => 0.6883, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.2749 => 1.2945, std. dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5133, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std. dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 10.54% (1.2998 => 1.4368, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.86% (1.5824 => 1.6593, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7429, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8179, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.6000, std. dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 2.30% (10.7476 => 10.9953, std. dev.: 0.0598) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.07% (1.4298 => 1.4594, std. dev.: 0.0038) MultiSource/Applications/siod/siod: 2.04% (3.2729 => 3.3398, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5315, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std. dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1836, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5743, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6394, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.35% (22.5627 => 21.3554, std. dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.70% (1.2308 => 1.0868, std. dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3154, std. dev.: 0.0070) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -3.17% (1.1560 => 1.1194, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5830, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2218, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.86% (5.3167 => 5.2176, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9711, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2122, std. dev.: 0.0265) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.22% (5.5401 => 5.4723, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (84.4286 => 83.4159, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.07% (20.3410 => 20.1232, std. dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 24 22:37:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 00:37:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120825053740.F0DEB2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3207?compare_to=3204&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3207, Order: 162639, Start Time: 2012-08-25 04:19:14, End Time: 2012-08-25 05:38:35 To: 3204, Order: 162638, Start Time: 2012-08-25 02:32:05, End Time: 2012-08-25 03:51:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (136 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (701 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops-5: 1.36% (1.4873 => 1.5075, std. dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.24% (1.4490 => 1.4311, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.17% (10.3673 => 13.5990, std. dev.: 0.0061) SingleSource/UnitTests/ObjC/trivial-interface: 16.10% (0.3473 => 0.4032, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.84% (0.3561 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.81% (0.3543 => 0.4103, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.76% (0.3516 => 0.4070, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.76% (0.3497 => 0.4048, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.69% (0.3543 => 0.4099, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.21% (0.3694 => 0.4256, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.73% (0.3828 => 0.4392, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.67% (0.3927 => 0.4503, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.49% (0.3886 => 0.4449, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.94% (1.1194 => 1.2642, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.33% (1.7609 => 1.9780, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.53% (2.2022 => 2.4340, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 10.13% (0.1432 => 0.1577, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5925 => 0.6473, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.10% (0.6030 => 0.6579, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.14% (0.1584 => 0.1713, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.14% (0.1892 => 0.2046, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.97% (0.7326 => 0.7910, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.3177 => 0.3422, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 7.28% (0.3282 => 0.3521, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.87% (0.4615 => 0.4932, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.78% (0.4879 => 0.5210, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 6.71% (0.1655 => 0.1766, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.35% (7.0540 => 7.5016, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.21% (4.9449 => 5.2518, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.03% (0.2554 => 0.2708, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.00% (0.4299 => 0.4557, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.00% (5.0018 => 5.3018, std. dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (9.4845 => 10.0498, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (0.3121 => 0.3307, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7433 => 0.7870, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.81% (0.2271 => 0.2403, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.78% (0.2891 => 0.3058, std. dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.70% (0.2107 => 0.2227, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 5.66% (0.3109 => 0.3285, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1940 => 0.2049, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.57% (0.8172 => 0.8627, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2905 => 0.3064, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2871 => 0.3027, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 5.42% (10.4361 => 11.0022, std. dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.39% (4.2646 => 4.4945, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.37% (0.4636 => 0.4885, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 5.28% (0.2725 => 0.2869, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5569 => 0.5862, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.26% (0.2872 => 0.3023, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.23% (0.2831 => 0.2979, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2756 => 0.2900, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.18% (0.3052 => 0.3210, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.17% (0.3232 => 0.3399, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.16% (0.3098 => 0.3258, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.14% (0.4103 => 0.4314, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.12% (0.2793 => 0.2936, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.12% (1.3050 => 1.3718, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 5.11% (0.3423 => 0.3598, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.10% (8.1363 => 8.5513, std. dev.: 0.0057) MultiSource/Applications/spiff/spiff: 5.09% (0.7835 => 0.8234, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.09% (0.5860 => 0.6158, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.05% (0.2714 => 0.2851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.01% (0.2877 => 0.3021, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.00% (0.3283 => 0.3447, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.99% (0.3865 => 0.4058, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.97% (0.3162 => 0.3319, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.96% (0.2700 => 0.2834, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.96% (2.0665 => 2.1690, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 4.94% (0.3422 => 0.3591, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 4.93% (0.2802 => 0.2940, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.89% (0.3826 => 0.4013, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.86% (0.2758 => 0.2892, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4289 => 0.4497, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.85% (0.3136 => 0.3288, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 4.81% (0.3180 => 0.3333, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 4.77% (0.3603 => 0.3775, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.74% (0.3650 => 0.3823, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.74% (0.3441 => 0.3604, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.71% (1.5603 => 1.6338, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.65% (0.4064 => 0.4253, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.62% (0.6450 => 0.6748, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 4.60% (5.7591 => 6.0243, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3684 => 0.3852, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.56% (0.3379 => 0.3533, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.46% (0.4620 => 0.4826, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.45% (0.4048 => 0.4228, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.40% (0.4203 => 0.4388, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 4.40% (0.3092 => 0.3228, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.40% (0.3935 => 0.4108, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.37% (0.5105 => 0.5328, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.35% (0.9765 => 1.0190, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.31% (1.1861 => 1.2372, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 4.23% (0.6456 => 0.6729, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.22% (1.2842 => 1.3384, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.17% (0.8067 => 0.8403, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.11% (1.1642 => 1.2121, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.04% (1.5415 => 1.6037, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.03% (0.6675 => 0.6944, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.87% (0.3387 => 0.3518, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.85% (2.0273 => 2.1053, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.5981 => 0.6210, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.81% (3.8723 => 4.0199, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 3.81% (3.3354 => 3.4624, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.51% (1.4186 => 1.4684, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 3.50% (2.2969 => 2.3774, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.45% (0.5020 => 0.5193, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 3.36% (0.8921 => 0.9221, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (14.3668 => 14.8492, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.23% (1.5859 => 1.6371, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 2.85% (1.1840 => 1.2178, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.2024 => 2.2651, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.71% (0.7115 => 0.7308, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.61% (7.9617 => 8.1696, std. dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 2.57% (17.1811 => 17.6231, std. dev.: 0.0098) MultiSource/Applications/lemon/lemon: 2.21% (1.0722 => 1.0959, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.19% (21.9371 => 22.4174, std. dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.8101 => 0.8237, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (4.2280 => 4.4275, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.19% (3.6395 => 3.7556, std. dev.: 0.0030) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3398, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 1.68% (26.0924 => 26.5305, std. dev.: 0.0258) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1578 => 3.1970, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2263, std. dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (1.3045 => 1.3199, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5836, std. dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (5.2763 => 3.2266, std. dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.44% (5.3855 => 3.7464, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.01% (5.3526 => 3.7462, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.82% (54.1659 => 46.1409, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -13.69% (22.1758 => 19.1410, std. dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.35% (2.9384 => 2.5754, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -6.91% (1.5373 => 1.4311, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std. dev.: 0.0028) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.24% (32.5116 => 31.4582, std. dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.11% (8.6802 => 8.4106, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/salsa20: -2.91% (10.2830 => 9.9837, std. dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.28% (8.1563 => 7.9706, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3259, std. dev.: 0.0121) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.07% (1.4460 => 1.4305, std. dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 25 00:17:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 02:17:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120825071702.2100F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3208?compare_to=3206&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3208, Order: 162641, Start Time: 2012-08-25 06:00:44, End Time: 2012-08-25 07:17:56 To: 3206, Order: 162639, Start Time: 2012-08-25 03:58:34, End Time: 2012-08-25 05:12:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.52% (55.1131 => 56.5011, std. dev.: 0.1104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.20% (2.0176 => 2.3242, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.33% (0.5818 => 0.6477, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.27% (0.7061 => 0.7857, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 11.15% (0.5748 => 0.6389, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.59% (0.3578 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.55% (0.3650 => 0.4035, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 10.48% (0.3646 => 0.4028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3601 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3623 => 0.4000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.40% (0.3663 => 0.4044, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3914 => 0.4316, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 10.19% (0.3789 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.94% (0.4003 => 0.4401, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.85% (0.3940 => 0.4328, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.80% (1.3693 => 1.4898, std. dev.: 0.0359) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 8.56% (0.2781 => 0.3019, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.48% (0.4328 => 0.4695, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1819 => 0.1970, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2782 => 0.3011, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.98% (0.2607 => 0.2815, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.98% (3.9660 => 4.2824, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 7.95% (0.4062 => 0.4385, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.91% (0.7710 => 0.8320, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.89% (0.2966 => 0.3200, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 7.88% (0.2628 => 0.2835, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2690 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.78% (0.2765 => 0.2980, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2761 => 0.2975, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.72% (0.2655 => 0.2860, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2726 => 0.2936, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.62% (0.5265 => 0.5666, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.59% (0.2596 => 0.2793, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.59% (1.9828 => 2.1332, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.49% (0.2696 => 0.2898, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3149 => 0.3383, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.31% (0.3899 => 0.4184, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.15% (0.4390 => 0.4704, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 7.11% (0.3192 => 0.3419, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.2988 => 0.3200, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.09% (0.9199 => 0.9851, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.3453 => 0.3697, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.02% (1.2193 => 1.3049, std. dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.94% (0.4379 => 0.4683, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.71% (0.6959 => 0.7426, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.65% (0.3293 => 0.3512, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.52% (0.4016 => 0.4278, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3534 => 0.3764, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.47% (0.3756 => 0.3999, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.46% (0.3868 => 0.4118, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.35% (0.2127 => 0.2262, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.1364 => 1.2084, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.23% (0.5637 => 0.5988, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5577 => 0.5922, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (0.2914 => 0.3088, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.95% (0.2925 => 0.3099, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.88% (7.2180 => 7.6425, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.87% (1.4563 => 1.5418, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.79% (0.1865 => 0.1973, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.63% (1.3813 => 1.4590, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.46% (1.3819 => 1.4574, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.43% (1.3245 => 1.3964, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 5.38% (0.8310 => 0.8757, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3755 => 0.3955, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (0.7460 => 0.7857, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 5.30% (3.8646 => 4.0695, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.17% (3.6692 => 3.8588, std. dev.: 0.0164) MultiSource/Benchmarks/nbench/nbench: 5.16% (1.0594 => 1.1141, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.14% (4.3801 => 4.6053, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.4791 => 0.5035, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.08% (0.4113 => 0.4322, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.06% (0.6283 => 0.6601, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.96% (4.4433 => 4.6635, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 4.91% (0.3220 => 0.3378, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.91% (0.6135 => 0.6436, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.76% (16.6129 => 17.4044, std. dev.: 0.0254) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (13.2842 => 13.9169, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.49% (0.8818 => 0.9214, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 4.28% (0.3131 => 0.3265, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.16% (0.3245 => 0.3380, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.12% (0.8698 => 0.9056, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.05% (1.1333 => 1.1792, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (8.4961 => 8.8318, std. dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: 3.85% (0.2859 => 0.2969, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1777, std. dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.39% (3.2742 => 3.3853, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.5188 => 1.5654, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.01% (0.6250 => 0.6438, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.88% (0.9108 => 0.9370, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (2.1007 => 2.1508, std. dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.19% (6.2785 => 6.4163, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.12% (0.4805 => 0.4907, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.77% (33.2944 => 33.8840, std. dev.: 0.0290) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.78% (1.8175 => 2.2678, std. dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.01% (1.2998 => 1.4169, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.88% (1.5824 => 1.6596, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7439, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3841, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6006, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5089 => 1.5322, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5734, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6863, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.45% (22.5627 => 21.3320, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2308 => 1.0913, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std. dev.: 0.0143) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0220, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.90% (0.4867 => 0.4677, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -3.17% (1.1560 => 1.1193, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.70% (8.8259 => 8.5874, std. dev.: 0.0273) MultiSource/Benchmarks/Olden/bh/bh: -2.43% (1.9762 => 1.9281, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2318, std. dev.: 0.0037) SingleSource/Regression/C/uint64_to_float: -1.85% (0.5449 => 0.5348, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9729, std. dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.3167 => 5.2256, std. dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2074, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.26% (5.5401 => 5.4705, std. dev.: 0.0179) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4229, std. dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.06% (20.3410 => 20.1253, std. dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 25 00:27:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 02:27:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120825072728.1CEC82A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3209?compare_to=3207&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3209, Order: 162641, Start Time: 2012-08-25 06:06:16, End Time: 2012-08-25 07:28:23 To: 3207, Order: 162639, Start Time: 2012-08-25 04:19:14, End Time: 2012-08-25 05:38:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (104 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (733 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.02% (54.7228 => 55.8270, std. dev.: 0.3544) SingleSource/Benchmarks/Misc/fbench: 1.27% (2.2810 => 2.3099, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.69% (10.3673 => 13.6527, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.25% (0.3543 => 0.4048, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 13.96% (0.3473 => 0.3958, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3561 => 0.4054, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3516 => 0.4001, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3497 => 0.3976, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-4: 13.55% (0.3543 => 0.4023, std. dev.: 0.0096) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3694 => 0.4180, std. dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3828 => 0.4323, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.86% (1.1194 => 1.2634, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.78% (0.3927 => 0.4429, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/property: 12.69% (0.3886 => 0.4379, std. dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.35% (1.7609 => 1.9784, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 10.41% (0.1432 => 0.1581, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.35% (2.2022 => 2.4302, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.39% (0.5925 => 0.6422, std. dev.: 0.0120) SingleSource/UnitTests/ObjC++/property-reference-object: 8.24% (0.6030 => 0.6527, std. dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.93% (0.1892 => 0.2042, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.83% (0.1584 => 0.1708, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 7.31% (0.3282 => 0.3522, std. dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.55% (0.1940 => 0.2067, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.29% (7.0540 => 7.4975, std. dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std. dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 6.00% (0.7433 => 0.7879, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 5.86% (9.4845 => 10.0406, std. dev.: 0.0132) MultiSource/Benchmarks/McCat/08-main/main: 5.83% (0.2554 => 0.2703, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.82% (4.9449 => 5.2326, std. dev.: 0.0114) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.70% (5.0018 => 5.2869, std. dev.: 0.0108) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2271 => 0.2397, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.32% (0.8172 => 0.8607, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 5.24% (0.3109 => 0.3272, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.23% (4.2646 => 4.4878, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.3121 => 0.3284, std. dev.: 0.0056) MultiSource/Applications/hbd/hbd: 5.18% (1.5603 => 1.6412, std. dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 5.10% (10.4361 => 10.9683, std. dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.07% (0.4103 => 0.4311, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.02% (0.5860 => 0.6154, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.00% (1.3050 => 1.3702, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.5569 => 0.5843, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.91% (0.3826 => 0.4014, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.91% (0.3423 => 0.3591, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.85% (8.1363 => 8.5310, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.79% (2.0665 => 2.1655, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.78% (0.3162 => 0.3313, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.74% (5.7591 => 6.0319, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.71% (0.3650 => 0.3822, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2700 => 0.2827, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.67% (0.6450 => 0.6751, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.66% (0.3136 => 0.3282, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.62% (0.3180 => 0.3327, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.57% (0.7835 => 0.8193, std. dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.53% (0.3441 => 0.3597, std. dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 4.49% (0.3387 => 0.3539, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.49% (0.5105 => 0.5334, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.3092 => 0.3222, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.19% (0.9765 => 1.0174, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.16% (1.1861 => 1.2355, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.10% (0.6675 => 0.6949, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.8067 => 0.8398, std. dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: 4.07% (1.2842 => 1.3365, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.02% (1.1642 => 1.2110, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.94% (1.5415 => 1.6022, std. dev.: 0.0054) MultiSource/Applications/treecc/treecc: 3.79% (2.0273 => 2.1042, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 3.78% (3.3354 => 3.4615, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.63% (0.5981 => 0.6198, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 3.59% (3.8723 => 4.0115, std. dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (1.4186 => 1.4680, std. dev.: 0.0077) MultiSource/Applications/siod/siod: 3.36% (2.2969 => 2.3741, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 3.34% (0.8921 => 0.9219, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (14.3668 => 14.8435, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.20% (1.5859 => 1.6367, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.13% (0.5020 => 0.5177, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.87% (2.2024 => 2.2657, std. dev.: 0.0171) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.1840 => 1.2174, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 2.69% (17.1811 => 17.6432, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 2.61% (0.7115 => 0.7301, std. dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.31% (7.9617 => 8.1457, std. dev.: 0.0132) MultiSource/Applications/lemon/lemon: 2.12% (1.0722 => 1.0949, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.11% (21.9371 => 22.4006, std. dev.: 0.0257) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (0.8101 => 0.8230, std. dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0637) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std. dev.: 0.0236) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.00% (4.2280 => 4.4395, std. dev.: 0.0167) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7516, std. dev.: 0.0144) MultiSource/Applications/siod/siod: 1.72% (3.2827 => 3.3393, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 1.49% (26.0924 => 26.4801, std. dev.: 0.0481) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5086 => 1.5307, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 1.44% (2.2771 => 2.3099, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.18% (19.9488 => 20.1837, std. dev.: 0.0586) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2144, std. dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.94% (5.2763 => 3.2218, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.48% (5.3855 => 3.7441, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.00% (5.3526 => 3.7469, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1425, std. dev.: 0.6055) MultiSource/Applications/ClamAV/clamscan: -13.78% (22.1758 => 19.1196, std. dev.: 0.0478) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.43% (2.9384 => 2.5732, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.60% (1.6925 => 1.4284, std. dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2373 => 1.1076, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/mandel-2: -9.82% (1.5373 => 1.3863, std. dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.09% (1.1396 => 1.0702, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0400) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4696, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.6802 => 8.4399, std. dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0122, std. dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9634, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3491, std. dev.: 0.0398) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.11% (1.0313 => 1.0199, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: -1.03% (1.4460 => 1.4311, std. dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 25 00:38:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 02:38:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120825073859.DA2C62A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3210?compare_to=3205&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3210, Order: 162639, Start Time: 2012-08-25 04:53:36, End Time: 2012-08-25 07:39:52 To: 3205, Order: 162637, Start Time: 2012-08-25 01:42:18, End Time: 2012-08-25 04:25:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (119 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 949 (760 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 7.34% (0.4099 => 0.4400, std. dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 1.10% (24.2864 => 24.5545, std. dev.: 0.0252) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.08% (2.0327 => 2.0953, std. dev.: 0.0185) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.69% (0.6096 => 0.6199, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.15% (54.1489 => 54.7722, std. dev.: 0.0392) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 16.03% (0.3792 => 0.4400, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/synchronized: 15.80% (0.3469 => 0.4017, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 15.73% (0.3446 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.67% (0.3465 => 0.4008, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.66% (0.3442 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.64% (0.3460 => 0.4001, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.59% (0.3496 => 0.4041, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.54% (0.3488 => 0.4030, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.04% (0.3643 => 0.4191, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 15.04% (0.3650 => 0.4199, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.58% (0.3724 => 0.4267, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5826 => 0.6369, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.95% (0.1620 => 0.1765, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.90% (0.5889 => 0.6413, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.59% (3.5627 => 3.8331, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.35% (1.6211 => 1.7403, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 7.32% (0.7171 => 0.7696, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.18% (1.3152 => 1.4096, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 6.95% (1.5932 => 1.7039, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.2014 => 0.2152, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.67% (0.4361 => 0.4652, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.61% (0.5026 => 0.5358, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (0.3930 => 0.4177, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.27% (0.4994 => 0.5307, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.26% (0.5000 => 0.5313, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.2738 => 0.2909, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.24% (2.7292 => 2.8994, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.17% (0.5900 => 0.6264, std. dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 6.16% (4.2109 => 4.4702, std. dev.: 0.0111) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.09% (0.2875 => 0.3050, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 5.96% (1.0781 => 1.1424, std. dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.3004 => 0.3182, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.80% (0.2725 => 0.2883, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.78% (0.2750 => 0.2909, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.75% (0.2729 => 0.2886, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.70% (0.3195 => 0.3377, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.69% (0.2792 => 0.2951, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.65% (0.2866 => 0.3028, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 5.65% (0.9909 => 1.0469, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/random: 5.64% (0.2803 => 0.2961, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.63% (0.3267 => 0.3451, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.63% (2.0673 => 2.1837, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3060 => 0.3231, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.56% (0.3096 => 0.3268, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.55% (0.2813 => 0.2969, std. dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 5.53% (0.2566 => 0.2708, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.2823 => 0.2979, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.2780 => 0.2933, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 5.48% (0.2811 => 0.2965, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2911 => 0.3070, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.44% (1.9694 => 2.0766, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.3362 => 0.3545, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.43% (0.3258 => 0.3435, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.37% (0.2736 => 0.2883, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 5.34% (0.9697 => 1.0215, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.33% (1.9966 => 2.1030, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 5.28% (0.3317 => 0.3492, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3678 => 0.3870, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.21% (5.5417 => 5.8305, std. dev.: 0.0160) MultiSource/Benchmarks/mafft/pairlocalalign: 5.12% (2.1013 => 2.2088, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 5.10% (0.3726 => 0.3916, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.09% (0.3124 => 0.3283, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.08% (0.3348 => 0.3518, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.06% (0.3890 => 0.4087, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.06% (0.3477 => 0.3653, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.02% (0.4658 => 0.4892, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.94% (0.3625 => 0.3804, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.3282 => 0.3444, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.79% (4.6177 => 4.8387, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 4.75% (0.4251 => 0.4453, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (4.4195 => 4.6294, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (2.1653 => 2.2674, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 4.66% (0.4146 => 0.4339, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.63% (0.3690 => 0.3861, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.53% (0.3903 => 0.4080, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (1.8794 => 1.9644, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 4.49% (1.4269 => 1.4909, std. dev.: 0.0051) MultiSource/Applications/treecc/treecc: 4.47% (0.7875 => 0.8227, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.42% (0.3981 => 0.4157, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.40% (23.5202 => 24.5545, std. dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.37% (0.3271 => 0.3414, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.35% (0.4139 => 0.4319, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.29% (0.3845 => 0.4010, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.02% (0.2737 => 0.2847, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.98% (0.6634 => 0.6898, std. dev.: 0.0073) MultiSource/Applications/minisat/minisat: 3.96% (0.3336 => 0.3468, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.5012 => 0.5210, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.95% (0.5546 => 0.5765, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.2969 => 0.3084, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.79% (0.6435 => 0.6679, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.81% (2.0346 => 2.0918, std. dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 2.48% (0.4847 => 0.4967, std. dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (11.6398 => 11.8172, std. dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.48% (0.2122 => 0.2302, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.58% (3.3903 => 3.6135, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1668, std. dev.: 0.0239) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6386, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1924, std. dev.: 0.0103) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5046, std. dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.77% (3.1722 => 3.2282, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4439, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2817, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.12% (1.0927 => 1.1049, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5925, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.06% (2.4764 => 2.4005, std. dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5648, std. dev.: 0.0224) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7868, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8089, std. dev.: 0.0053) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8242, std. dev.: 0.0544) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9579, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4997, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 25 01:59:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 03:59:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120825085934.BE5682A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3211?compare_to=3208&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3211, Order: 162642, Start Time: 2012-08-25 07:45:53, End Time: 2012-08-25 09:00:28 To: 3208, Order: 162641, Start Time: 2012-08-25 06:00:44, End Time: 2012-08-25 07:17:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (158 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.18% (42.0224 => 42.5168, std. dev.: 0.0836) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.18% (2.0176 => 2.3239, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.24% (0.5748 => 0.6394, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3578 => 0.3958, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3601 => 0.3980, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3623 => 0.4003, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 10.48% (0.3646 => 0.4028, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3650 => 0.4031, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.40% (0.3663 => 0.4044, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.35% (0.7061 => 0.7792, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 10.19% (0.3789 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.12% (0.3914 => 0.4310, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.97% (0.4003 => 0.4402, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.82% (0.3940 => 0.4327, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.47% (0.7710 => 0.8363, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.46% (1.3693 => 1.4852, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 8.39% (0.4062 => 0.4403, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 8.31% (0.2781 => 0.3012, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1819 => 0.1970, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.16% (0.2782 => 0.3009, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.06% (0.2607 => 0.2817, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2655 => 0.2868, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.02% (3.9660 => 4.2840, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 7.88% (0.2690 => 0.2902, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.3899 => 0.4206, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.80% (0.2628 => 0.2833, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2765 => 0.2979, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.2966 => 0.3192, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2761 => 0.2971, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2726 => 0.2933, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.56% (0.7038 => 0.7570, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.53% (1.9828 => 2.1322, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.49% (0.2696 => 0.2898, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2596 => 0.2790, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.47% (0.3107 => 0.3339, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.46% (0.5265 => 0.5658, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3149 => 0.3380, std. dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.20% (0.3485 => 0.3736, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.17% (0.3489 => 0.3739, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.14% (0.9199 => 0.9856, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.2988 => 0.3201, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.12% (1.2193 => 1.3061, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 7.08% (0.3192 => 0.3418, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4390 => 0.4699, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 7.04% (0.3453 => 0.3696, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.94% (0.4379 => 0.4683, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.73% (0.6959 => 0.7427, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.70% (1.1364 => 1.2125, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.65% (0.3293 => 0.3512, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.55% (0.2914 => 0.3105, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.45% (0.4016 => 0.4275, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 6.44% (0.3868 => 0.4117, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.39% (0.2127 => 0.2263, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.39% (0.3756 => 0.3996, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.24% (1.4563 => 1.5472, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.22% (0.5577 => 0.5924, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.21% (0.2945 => 0.3128, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.2925 => 0.3106, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 6.17% (13.8202 => 14.6732, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.07% (0.5637 => 0.5979, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 6.00% (1.2292 => 1.3029, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.89% (7.2180 => 7.6434, std. dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.63% (1.3813 => 1.4590, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 5.62% (1.1061 => 1.1683, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.62% (0.8310 => 0.8777, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.57% (1.3819 => 1.4589, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: 5.45% (0.7506 => 0.7915, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 5.41% (3.8646 => 4.0735, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.35% (1.3245 => 1.3953, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 5.34% (0.2995 => 0.3155, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.32% (1.0594 => 1.1158, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.29% (3.6692 => 3.8634, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.28% (0.7460 => 0.7854, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.17% (0.6135 => 0.6452, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.6283 => 0.6603, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 5.06% (0.4113 => 0.4321, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.03% (0.4791 => 0.5032, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (4.4433 => 4.6657, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.94% (4.3801 => 4.5964, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (13.2842 => 13.9294, std. dev.: 0.0246) MultiSource/Applications/treecc/treecc: 4.84% (1.9270 => 2.0203, std. dev.: 0.0104) MultiSource/Applications/siod/siod: 4.80% (2.1791 => 2.2836, std. dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 4.69% (16.6129 => 17.3913, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.49% (0.8818 => 0.9214, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.42% (14.8535 => 15.5096, std. dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: 4.37% (0.2859 => 0.2984, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.25% (0.8698 => 0.9068, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 4.18% (0.3131 => 0.3262, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.12% (1.1333 => 1.1800, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.3245 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (8.4961 => 8.8250, std. dev.: 0.0026) MultiSource/Applications/d/make_dparser: 3.86% (3.1889 => 3.3119, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1775, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 3.71% (4.6629 => 4.8357, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (6.5754 => 6.8186, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.34% (3.2742 => 3.3837, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.28% (14.5298 => 15.0060, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 3.25% (16.2614 => 16.7900, std. dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/bigfib: 3.04% (0.6250 => 0.6440, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.88% (1.5188 => 1.5626, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.80% (0.9108 => 0.9363, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1509, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.23% (3.7467 => 3.8304, std. dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.22% (6.2785 => 6.4177, std. dev.: 0.0040) MultiSource/Applications/lemon/lemon: 2.01% (1.0313 => 1.0520, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.99% (0.6744 => 0.6878, std. dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.87% (33.2944 => 33.9162, std. dev.: 0.0104) MultiSource/Applications/SIBsim4/SIBsim4: 1.56% (1.2749 => 1.2948, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5124, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2549, std. dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.77% (1.2998 => 1.4268, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.35% (0.2093 => 0.2226, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.87% (1.5824 => 1.6594, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.30% (11.2619 => 11.7456, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3849, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6022, std. dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 2.30% (10.7476 => 10.9943, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3401, std. dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.97% (1.4298 => 1.4579, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.54% (1.5089 => 1.5321, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std. dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1848, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5740, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6422, std. dev.: 0.0131) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.51% (22.5627 => 21.3205, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.38% (1.2308 => 1.0907, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.49% (1.3780 => 1.3161, std. dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.84% (0.4867 => 0.4680, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -3.17% (1.1560 => 1.1194, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6005, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2331, std. dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.74% (5.3167 => 5.2240, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9740, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2039, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8611, std. dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.17% (84.4286 => 83.4422, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2318, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.07% (20.3410 => 20.1232, std. dev.: 0.0271) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 25 02:15:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 04:15:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120825091500.6A04C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3212?compare_to=3209&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3212, Order: 162643, Start Time: 2012-08-25 07:56:24, End Time: 2012-08-25 09:15:53 To: 3209, Order: 162641, Start Time: 2012-08-25 06:06:16, End Time: 2012-08-25 07:28:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (134 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (704 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.57% (1.3863 => 1.4219, std. dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.69% (10.3673 => 13.6526, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 14.05% (0.3473 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3543 => 0.4031, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.68% (0.3561 => 0.4048, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3497 => 0.3975, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.66% (0.3543 => 0.4027, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.51% (0.3516 => 0.3991, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3694 => 0.4179, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.93% (1.1194 => 1.2641, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.80% (0.3828 => 0.4318, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3927 => 0.4428, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.58% (0.3886 => 0.4375, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.48% (1.7609 => 1.9807, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.34% (2.2022 => 2.4300, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 10.34% (0.1432 => 0.1580, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.03% (0.1892 => 0.2044, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.89% (0.1584 => 0.1709, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.65% (0.3177 => 0.3420, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 7.14% (0.7326 => 0.7849, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 7.10% (0.3282 => 0.3515, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 6.53% (0.1655 => 0.1763, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.4615 => 0.4915, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.22% (7.0540 => 7.4926, std. dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 5.95% (0.7433 => 0.7875, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.92% (4.9449 => 5.2375, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: 5.87% (0.2554 => 0.2704, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.87% (0.3307 => 0.3501, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.78% (9.4845 => 10.0328, std. dev.: 0.0094) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.70% (5.0018 => 5.2867, std. dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 5.69% (0.3109 => 0.3286, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.65% (0.4299 => 0.4542, std. dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3121 => 0.3293, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2271 => 0.2396, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.45% (0.8172 => 0.8617, std. dev.: 0.0074) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.41% (0.2107 => 0.2221, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.40% (0.2905 => 0.3062, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.40% (0.2891 => 0.3047, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.36% (1.5603 => 1.6440, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.26% (4.2646 => 4.4888, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/strcat: 5.16% (0.2831 => 0.2977, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (10.4361 => 10.9728, std. dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hello: 5.12% (0.2714 => 0.2853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.03% (0.2725 => 0.2862, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.02% (0.4103 => 0.4309, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3423 => 0.3594, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.98% (0.2871 => 0.3014, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.98% (0.2872 => 0.3015, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.97% (0.2756 => 0.2893, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 4.95% (0.3052 => 0.3203, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.94% (0.5569 => 0.5844, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.93% (0.3162 => 0.3318, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.93% (1.3050 => 1.3693, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary: 4.92% (0.3232 => 0.3391, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.91% (0.3098 => 0.3250, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.90% (0.7835 => 0.8219, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.89% (0.3865 => 0.4054, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.87% (0.2793 => 0.2929, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 4.84% (0.3283 => 0.3442, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.81% (0.5860 => 0.6142, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 4.78% (0.2802 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.76% (0.2877 => 0.3014, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (8.1363 => 8.5224, std. dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 4.74% (5.7591 => 6.0323, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.74% (2.0665 => 2.1644, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 4.73% (0.4289 => 0.4492, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 4.70% (0.3422 => 0.3583, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.66% (0.3136 => 0.3282, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.64% (0.4636 => 0.4851, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 4.56% (0.3092 => 0.3233, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.3650 => 0.3816, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.55% (0.3826 => 0.4000, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.52% (0.3603 => 0.3766, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.50% (0.3180 => 0.3323, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.45% (0.5105 => 0.5332, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.4064 => 0.4244, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.42% (0.2758 => 0.2880, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.42% (0.3441 => 0.3593, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.37% (0.3684 => 0.3845, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.32% (0.3379 => 0.3525, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.3935 => 0.4105, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.29% (0.6450 => 0.6727, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 4.29% (0.4620 => 0.4818, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2842 => 1.3392, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.28% (0.9765 => 1.0183, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.27% (1.5415 => 1.6073, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.21% (0.4203 => 0.4380, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6456 => 0.6723, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.08% (1.1861 => 1.2345, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 4.08% (0.4048 => 0.4213, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.00% (0.8067 => 0.8390, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 3.97% (1.1642 => 1.2104, std. dev.: 0.0021) MultiSource/Applications/treecc/treecc: 3.91% (2.0273 => 2.1066, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.91% (0.6675 => 0.6936, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.75% (0.3387 => 0.3514, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 3.66% (3.8723 => 4.0142, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (1.4186 => 1.4704, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 3.64% (3.3354 => 3.4567, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.58% (0.5981 => 0.6195, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (14.3668 => 14.8567, std. dev.: 0.0061) MultiSource/Applications/siod/siod: 3.40% (2.2969 => 2.3749, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.31% (0.5020 => 0.5186, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 3.24% (0.8921 => 0.9210, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.20% (1.5859 => 1.6366, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.78% (1.1840 => 1.2169, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.2024 => 2.2630, std. dev.: 0.0210) MultiSource/Applications/sqlite3/sqlite3: 2.66% (17.1811 => 17.6383, std. dev.: 0.0068) MultiSource/Applications/minisat/minisat: 2.60% (0.7115 => 0.7300, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.28% (7.9617 => 8.1429, std. dev.: 0.0134) MultiSource/Applications/lemon/lemon: 2.07% (1.0722 => 1.0944, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.01% (21.9371 => 22.3772, std. dev.: 0.0158) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.36% (0.8101 => 0.8211, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.11% (4.2280 => 4.4440, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.99% (3.6395 => 3.7483, std. dev.: 0.0049) MultiSource/Applications/siod/siod: 1.75% (3.2827 => 3.3400, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.74% (26.0924 => 26.5458, std. dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2423, std. dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 1.24% (3.1578 => 3.1970, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.16% (1.3045 => 1.3196, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.88% (5.2763 => 3.2250, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.47% (5.3855 => 3.7443, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.06% (5.3526 => 3.7437, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1586, std. dev.: 0.0166) MultiSource/Applications/ClamAV/clamscan: -13.75% (22.1758 => 19.1263, std. dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.46% (2.9384 => 2.5723, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2373 => 1.1046, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -7.51% (1.5373 => 1.4219, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std. dev.: 0.0020) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4653, std. dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4157, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0030, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9634, std. dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -1.80% (2.5528 => 2.5068, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (12.5348 => 12.3328, std. dev.: 0.0116) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.16% (1.8329 => 1.8117, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (1.6805 => 1.6629, std. dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 25 03:43:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 05:43:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120825104317.511DE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3213?compare_to=3211&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3213, Order: 162643, Start Time: 2012-08-25 09:28:05, End Time: 2012-08-25 10:44:09 To: 3211, Order: 162642, Start Time: 2012-08-25 07:45:53, End Time: 2012-08-25 09:00:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (158 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (698 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.17% (2.0176 => 2.3237, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 11.17% (0.5748 => 0.6390, std. dev.: 0.0065) SingleSource/UnitTests/ObjC++/property-reference: 11.05% (0.7061 => 0.7841, std. dev.: 0.0135) SingleSource/UnitTests/ObjC/trivial-interface: 10.59% (0.3578 => 0.3957, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3601 => 0.3982, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.52% (0.3650 => 0.4034, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 10.48% (0.3646 => 0.4028, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3623 => 0.3999, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 10.32% (0.3663 => 0.4041, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 10.17% (0.3914 => 0.4312, std. dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 10.13% (0.3789 => 0.4173, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: 10.04% (0.4003 => 0.4405, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/property: 9.87% (0.3940 => 0.4329, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.52% (1.3693 => 1.4859, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 8.41% (0.2781 => 0.3015, std. dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1819 => 0.1970, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2782 => 0.3011, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.99% (0.7710 => 0.8326, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 7.98% (0.2607 => 0.2815, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.95% (3.9660 => 4.2811, std. dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 7.91% (0.7038 => 0.7595, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.81% (0.2765 => 0.2981, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2690 => 0.2900, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2761 => 0.2976, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.2937 => 0.3164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.72% (0.2760 => 0.2973, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.69% (0.2628 => 0.2830, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.67% (0.3899 => 0.4198, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2726 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3149 => 0.3388, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.58% (1.9828 => 2.1330, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.57% (0.2696 => 0.2900, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.50% (0.3107 => 0.3340, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.29% (0.5265 => 0.5649, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3453 => 0.3703, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3580 => 0.3839, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.23% (0.3485 => 0.3737, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.14% (0.3192 => 0.3420, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.14% (0.3489 => 0.3738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.2988 => 0.3200, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.08% (1.2193 => 1.3056, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.06% (0.9199 => 0.9848, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.01% (0.6959 => 0.7447, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.4379 => 0.4679, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.70% (0.4016 => 0.4285, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.56% (0.3293 => 0.3509, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.54% (0.1789 => 0.1906, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.47% (0.5577 => 0.5938, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.46% (1.1364 => 1.2098, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 6.45% (0.3534 => 0.3762, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4390 => 0.4673, std. dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.28% (0.3756 => 0.3992, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.28% (0.2023 => 0.2150, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.23% (13.8202 => 14.6818, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3246 => 0.3446, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.10% (1.2292 => 1.3042, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.05% (0.5637 => 0.5978, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (0.2914 => 0.3090, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.89% (7.2180 => 7.6433, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.2925 => 0.3096, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (1.3819 => 1.4624, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.73% (0.7506 => 0.7936, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.73% (1.4563 => 1.5397, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 5.67% (0.8310 => 0.8781, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (1.3813 => 1.4587, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.60% (0.7460 => 0.7878, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.59% (1.3245 => 1.3986, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.52% (1.1061 => 1.1672, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 5.38% (3.8646 => 4.0726, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.31% (1.0594 => 1.1157, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 5.31% (2.1791 => 2.2948, std. dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 5.28% (0.2995 => 0.3153, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.26% (0.6135 => 0.6458, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.26% (3.6692 => 3.8623, std. dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.16% (0.4791 => 0.5038, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.12% (0.6283 => 0.6605, std. dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 5.11% (0.4113 => 0.4323, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.08% (0.2243 => 0.2357, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.99% (4.3801 => 4.5988, std. dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.94% (1.9270 => 2.0221, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.87% (0.8818 => 0.9247, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.86% (4.4433 => 4.6592, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (13.2842 => 13.9286, std. dev.: 0.0234) MultiSource/Benchmarks/McCat/18-imp/imp: 4.78% (0.3220 => 0.3374, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.77% (16.6129 => 17.4049, std. dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: 4.47% (14.8535 => 15.5168, std. dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.33% (0.8698 => 0.9075, std. dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 4.31% (0.3131 => 0.3266, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.09% (1.1333 => 1.1796, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.07% (0.3245 => 0.3377, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (8.4961 => 8.8378, std. dev.: 0.1071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.94% (4.9865 => 5.1832, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.92% (0.2859 => 0.2971, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 3.91% (3.1889 => 3.3136, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.83% (6.5754 => 6.8274, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 3.78% (4.6629 => 4.8393, std. dev.: 0.0136) MultiSource/Applications/ClamAV/clamscan: 3.36% (14.5298 => 15.0186, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.30% (3.2742 => 3.3821, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 3.24% (16.2614 => 16.7885, std. dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 3.12% (0.6250 => 0.6445, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.00% (1.5188 => 1.5643, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.92% (0.9108 => 0.9374, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1510, std. dev.: 0.0014) MultiSource/Applications/minisat/minisat: 2.39% (0.6744 => 0.6905, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.28% (3.7467 => 3.8323, std. dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.25% (6.2785 => 6.4195, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.16% (0.4805 => 0.4909, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.11% (1.0313 => 1.0531, std. dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (1.2749 => 1.2977, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std. dev.: 0.0430) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.62% (1.2998 => 1.4248, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.2093 => 0.2195, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.87% (1.5824 => 1.6595, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7415, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0164) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3833, std. dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.39% (10.7476 => 11.0041, std. dev.: 0.0215) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5983, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 2.07% (1.4298 => 1.4594, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 2.04% (3.2729 => 3.3396, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.33% (1.5089 => 1.5290, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.0895 => 1.1037, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1841, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6413, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.39% (22.5627 => 21.3461, std. dev.: 0.3349) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.55% (1.2308 => 1.1010, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0319) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0174) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.20% (1.3780 => 1.3201, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -3.17% (1.1560 => 1.1194, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5828, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.07% (0.8342 => 0.8169, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2427, std. dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.75% (5.3167 => 5.2238, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: -1.72% (3.0263 => 2.9741, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9926, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.47% (20.3410 => 20.0415, std. dev.: 0.0544) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4365, std. dev.: 0.0756) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2392, std. dev.: 0.0234) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 5.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Aug 25 03:50:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 25 Aug 2012 05:50:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120825105050.E982B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3214?compare_to=3210&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3214, Order: 162643, Start Time: 2012-08-25 08:07:51, End Time: 2012-08-25 10:51:48 To: 3210, Order: 162639, Start Time: 2012-08-25 04:53:36, End Time: 2012-08-25 07:39:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (766 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (2.8994 => 2.8682, std. dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.96% (0.3488 => 0.3975, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.92% (0.3442 => 0.3921, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3460 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.72% (0.3469 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.29% (0.3643 => 0.4127, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.15% (0.3650 => 0.4130, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.58% (0.5826 => 0.6326, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.5889 => 0.6362, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.1619 => 0.1741, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 7.49% (1.5932 => 1.7126, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.63% (3.5627 => 3.7988, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 6.60% (0.7171 => 0.7644, std. dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (1.6211 => 1.7254, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.20% (1.3152 => 1.3968, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.91% (0.2875 => 0.3045, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.2014 => 0.2133, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.89% (0.4994 => 0.5288, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (0.4361 => 0.4617, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.71% (0.9697 => 1.0251, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (0.5000 => 0.5282, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.59% (0.2738 => 0.2891, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2714 => 0.2865, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.5900 => 0.6227, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.52% (0.3930 => 0.4147, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.52% (0.2792 => 0.2946, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.49% (0.5026 => 0.5302, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.46% (0.2729 => 0.2878, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.46% (0.2823 => 0.2977, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (0.3195 => 0.3369, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.43% (0.2780 => 0.2931, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 5.43% (0.3004 => 0.3167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.42% (0.2803 => 0.2955, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.42% (4.2109 => 4.4391, std. dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/strcat: 5.42% (0.2750 => 0.2899, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.37% (0.2811 => 0.2962, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.35% (2.0673 => 2.1778, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 5.34% (1.0781 => 1.1357, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 5.34% (0.9909 => 1.0438, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2911 => 0.3065, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.26% (0.3096 => 0.3259, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.26% (0.2813 => 0.2961, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.24% (0.4029 => 0.4240, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 5.17% (0.3267 => 0.3436, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.10% (0.3258 => 0.3424, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.09% (2.7292 => 2.8682, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 5.06% (0.3317 => 0.3485, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3060 => 0.3213, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.99% (0.3124 => 0.3280, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.91% (0.3362 => 0.3527, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 4.90% (0.3348 => 0.3512, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.81% (0.3282 => 0.3440, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3726 => 0.3904, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (0.3625 => 0.3796, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.69% (0.3477 => 0.3640, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.68% (0.2736 => 0.2864, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (0.3890 => 0.4067, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.53% (1.9694 => 2.0587, std. dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 4.48% (0.2566 => 0.2681, std. dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (1.9966 => 2.0846, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 4.40% (0.4251 => 0.4438, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.37% (0.4146 => 0.4327, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3690 => 0.3850, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.33% (5.5417 => 5.7819, std. dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (4.4195 => 4.6109, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (2.1013 => 2.1902, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.17% (0.3981 => 0.4147, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.14% (4.6177 => 4.8091, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (0.4658 => 0.4849, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.08% (0.3845 => 0.4002, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 3.95% (2.1653 => 2.2508, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.87% (0.3903 => 0.4054, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 3.78% (1.4269 => 1.4809, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 3.72% (1.8794 => 1.9494, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.67% (0.4139 => 0.4291, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.64% (0.3271 => 0.3390, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.57% (0.5012 => 0.5191, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.45% (0.7875 => 0.8147, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 3.40% (23.5202 => 24.3210, std. dev.: 0.0372) MultiSource/Applications/Burg/burg: 3.39% (0.5546 => 0.5734, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.37% (0.6435 => 0.6652, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.33% (0.6634 => 0.6855, std. dev.: 0.0066) MultiSource/Applications/minisat/minisat: 3.24% (0.3336 => 0.3444, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.40% (2.0346 => 2.0835, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6706, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6498, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1964, std. dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5049, std. dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.63% (41.7953 => 42.4759, std. dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2796, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5935, std. dev.: 0.0208) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4416, std. dev.: 0.1057) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.13% (2.4764 => 2.3989, std. dev.: 0.0224) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5684, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7917, std. dev.: 0.0124) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8040, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0064) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.79% (17.2379 => 16.7571, std. dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5778, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9704, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.41% (5.5810 => 5.5021, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 16:52:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 26 Aug 2012 18:52:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120826235247.36B292A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3215?compare_to=3213&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3215, Order: 162649, Start Time: 2012-08-26 22:39:32, End Time: 2012-08-26 23:53:44 To: 3213, Order: 162643, Start Time: 2012-08-25 09:28:05, End Time: 2012-08-25 10:44:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (158 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (695 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.38% (54.6189 => 56.4659, std. dev.: 0.1715) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.02% (3.8299 => 3.7525, std. dev.: 0.0214) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.14% (2.0176 => 2.3231, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.34% (0.5818 => 0.6478, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.15% (0.5748 => 0.6389, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.59% (0.3578 => 0.3957, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3646 => 0.4030, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3623 => 0.4004, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.50% (0.3601 => 0.3979, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3650 => 0.4030, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.37% (0.3663 => 0.4043, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.27% (0.7061 => 0.7786, std. dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 10.19% (0.3789 => 0.4175, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3914 => 0.4311, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.97% (0.4003 => 0.4402, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.95% (0.3940 => 0.4332, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.1819 => 0.1973, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.46% (1.3693 => 1.4852, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 8.46% (0.4328 => 0.4694, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.45% (0.2781 => 0.3016, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.38% (0.2782 => 0.3015, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.07% (0.2690 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.06% (0.2607 => 0.2817, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (3.9660 => 4.2835, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.95% (0.4062 => 0.4385, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 7.93% (0.2761 => 0.2980, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3022 => 0.3260, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.86% (0.7710 => 0.8316, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 7.84% (0.2628 => 0.2834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3899 => 0.4204, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 7.80% (0.2937 => 0.3166, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.78% (0.2765 => 0.2980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2726 => 0.2937, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.72% (0.2966 => 0.3195, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.68% (0.2696 => 0.2903, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.63% (1.9828 => 2.1341, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 7.60% (0.3107 => 0.3343, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 7.56% (0.3149 => 0.3387, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.49% (0.7038 => 0.7565, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2596 => 0.2789, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.35% (0.5265 => 0.5652, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.35% (1.2193 => 1.3089, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3485 => 0.3740, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.2988 => 0.3205, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.21% (0.3192 => 0.3422, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.12% (0.3580 => 0.3835, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.3453 => 0.3697, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.03% (0.9199 => 0.9846, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.85% (0.4379 => 0.4679, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.77% (0.3293 => 0.3516, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.3868 => 0.4127, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3534 => 0.3769, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.60% (0.6959 => 0.7418, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.54% (0.1789 => 0.1906, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4390 => 0.4677, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.54% (0.2127 => 0.2266, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.47% (0.4016 => 0.4276, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.42% (0.3756 => 0.3997, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.40% (1.1364 => 1.2091, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.32% (0.5637 => 0.5993, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (1.4563 => 1.5464, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.15% (0.5577 => 0.5920, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.07% (0.2914 => 0.3091, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.06% (13.8202 => 14.6574, std. dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.93% (1.2292 => 1.3021, std. dev.: 0.0112) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (7.2180 => 7.6420, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.2925 => 0.3096, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.79% (0.1865 => 0.1973, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 5.75% (0.2243 => 0.2372, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.59% (0.7460 => 0.7877, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.55% (1.3813 => 1.4579, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (1.3819 => 1.4581, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 5.43% (3.8646 => 4.0744, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 5.43% (0.8310 => 0.8761, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.41% (0.7506 => 0.7912, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.41% (0.3755 => 0.3958, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.39% (1.1061 => 1.1657, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 5.37% (1.0594 => 1.1163, std. dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 5.34% (0.2995 => 0.3155, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.34% (1.3245 => 1.3952, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.18% (3.6692 => 3.8592, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.11% (0.6283 => 0.6604, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.07% (4.3801 => 4.6020, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.05% (0.4791 => 0.5033, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.01% (0.4113 => 0.4319, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.85% (4.4433 => 4.6588, std. dev.: 0.0033) MultiSource/Applications/treecc/treecc: 4.84% (1.9270 => 2.0203, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (13.2842 => 13.9197, std. dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.74% (0.6135 => 0.6426, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 4.72% (0.3220 => 0.3372, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.71% (16.6129 => 17.3957, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 4.68% (2.1791 => 2.2810, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.49% (0.8818 => 0.9214, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 4.38% (14.8535 => 15.5041, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.27% (0.8698 => 0.9069, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.22% (0.3131 => 0.3263, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.16% (0.3245 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.10% (1.1333 => 1.1798, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.89% (8.4961 => 8.8265, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.87% (4.9865 => 5.1797, std. dev.: 0.0040) MultiSource/Applications/d/make_dparser: 3.81% (3.1889 => 3.3104, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.76% (4.6629 => 4.8380, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (6.5754 => 6.8173, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.33% (3.2742 => 3.3832, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7858, std. dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 3.18% (14.5298 => 14.9912, std. dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.00% (1.5188 => 1.5644, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.99% (0.6250 => 0.6437, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.82% (0.9108 => 0.9365, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.1007 => 2.1501, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.19% (6.2785 => 6.4159, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.16% (0.4805 => 0.4909, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 2.12% (3.7467 => 3.8260, std. dev.: 0.0027) MultiSource/Applications/minisat/minisat: 2.06% (0.6744 => 0.6883, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.99% (1.0313 => 1.0518, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.73% (33.2944 => 33.8709, std. dev.: 0.0289) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2523, std. dev.: 0.0229) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 8.72% (1.2998 => 1.4131, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6592, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7407, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8180, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.40% (10.7476 => 11.0059, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5957, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3400, std. dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.97% (1.4298 => 1.4580, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5089 => 1.5309, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5722, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6415, std. dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.51% (22.5627 => 21.3202, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2308 => 1.1035, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5105, std. dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.05% (1.3780 => 1.3222, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -3.22% (1.1560 => 1.1188, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6013, std. dev.: 0.0165) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9287, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2291, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: -1.76% (3.0263 => 2.9729, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.72% (5.3167 => 5.2254, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.66% (7.3305 => 7.2090, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.31% (9.9194 => 9.7897, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4228, std. dev.: 0.0070) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2277, std. dev.: 0.0404) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.09% (20.3410 => 20.1203, std. dev.: 0.0407) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.06% (5.5401 => 5.4813, std. dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 16:58:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 26 Aug 2012 18:58:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120826235838.9EBB72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3216?compare_to=3212&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3216, Order: 162649, Start Time: 2012-08-26 22:39:58, End Time: 2012-08-26 23:59:36 To: 3212, Order: 162643, Start Time: 2012-08-25 07:56:24, End Time: 2012-08-25 09:15:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (134 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (703 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.18% (79.4647 => 81.1937, std. dev.: 0.3830) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.65% (10.3673 => 13.6483, std. dev.: 0.0091) SingleSource/UnitTests/ObjC/trivial-interface: 13.91% (0.3473 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.81% (0.3497 => 0.3980, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.77% (0.3543 => 0.4031, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.66% (0.3543 => 0.4027, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.65% (0.3561 => 0.4047, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.51% (0.3516 => 0.3991, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.02% (0.3694 => 0.4175, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.94% (1.1194 => 1.2643, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.94% (0.3927 => 0.4435, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.75% (0.3828 => 0.4316, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.61% (0.3886 => 0.4376, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.33% (1.7609 => 1.9780, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 10.41% (0.1432 => 0.1581, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.37% (2.2022 => 2.4306, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5925 => 0.6419, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.25% (0.1892 => 0.2048, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 8.16% (0.6030 => 0.6522, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.89% (0.1584 => 0.1709, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 7.13% (0.3282 => 0.3516, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.98% (0.7326 => 0.7837, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.4879 => 0.5211, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 6.65% (0.1655 => 0.1765, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.54% (0.4615 => 0.4917, std. dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.28% (7.0540 => 7.4971, std. dev.: 0.0142) MultiSource/Benchmarks/McCat/08-main/main: 6.26% (0.2554 => 0.2714, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (0.7433 => 0.7882, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.02% (0.3307 => 0.3506, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.85% (4.9449 => 5.2343, std. dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (9.4845 => 10.0395, std. dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.69% (5.0018 => 5.2865, std. dev.: 0.0107) MultiSource/Benchmarks/McCat/05-eks/eks: 5.63% (0.4299 => 0.4541, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 5.63% (0.3109 => 0.3284, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2905 => 0.3064, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.33% (0.2891 => 0.3045, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3121 => 0.3287, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.25% (0.8172 => 0.8601, std. dev.: 0.0126) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.24% (4.2646 => 4.4881, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.19% (0.2756 => 0.2899, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (10.4361 => 10.9727, std. dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/strcat: 5.12% (0.2831 => 0.2976, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.10% (0.5569 => 0.5853, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.09% (0.4103 => 0.4312, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.06% (1.3050 => 1.3710, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 5.02% (1.5603 => 1.6387, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.01% (0.2872 => 0.3016, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.98% (0.3052 => 0.3204, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.97% (0.3098 => 0.3252, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.97% (0.3423 => 0.3593, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.3232 => 0.3392, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 4.91% (0.2871 => 0.3012, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.86% (0.2714 => 0.2846, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.85% (0.5860 => 0.6144, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.84% (0.3865 => 0.4052, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.83% (0.2793 => 0.2928, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.83% (0.2877 => 0.3016, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.81% (0.3283 => 0.3441, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.81% (8.1363 => 8.5277, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4636 => 0.4859, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.81% (0.3162 => 0.3314, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.79% (0.3422 => 0.3586, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.74% (5.7591 => 6.0322, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.74% (0.3650 => 0.3823, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.74% (2.0665 => 2.1644, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 4.73% (0.4289 => 0.4492, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.69% (0.3136 => 0.3283, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 4.68% (0.2802 => 0.2933, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.67% (0.2700 => 0.2826, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.63% (0.3826 => 0.4003, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 4.62% (0.7835 => 0.8197, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sieve: 4.61% (0.3603 => 0.3769, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.4064 => 0.4245, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.45% (0.3684 => 0.3848, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.39% (0.3441 => 0.3592, std. dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 4.37% (0.3092 => 0.3227, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.36% (0.6450 => 0.6731, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.35% (0.5105 => 0.5327, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3935 => 0.4106, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.29% (0.3379 => 0.3524, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.24% (0.9765 => 1.0179, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/moments: 4.20% (0.4048 => 0.4218, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.19% (0.4203 => 0.4379, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.16% (1.1861 => 1.2354, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 4.14% (0.6456 => 0.6723, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.13% (0.4620 => 0.4811, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.09% (1.2842 => 1.3367, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.8067 => 0.8393, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.02% (1.5415 => 1.6035, std. dev.: 0.0054) MultiSource/Applications/Burg/burg: 4.02% (1.1642 => 1.2110, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.93% (0.6675 => 0.6937, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.84% (0.3387 => 0.3517, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.74% (2.0273 => 2.1032, std. dev.: 0.0047) MultiSource/Applications/d/make_dparser: 3.67% (3.3354 => 3.4579, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5981 => 0.6199, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 3.64% (3.8723 => 4.0131, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.4186 => 1.4682, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.39% (0.5020 => 0.5190, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 3.35% (0.8921 => 0.9220, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 3.34% (2.2969 => 2.3737, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.31% (14.3668 => 14.8427, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.15% (1.5859 => 1.6358, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.79% (2.2024 => 2.2639, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.1840 => 1.2163, std. dev.: 0.0057) MultiSource/Applications/minisat/minisat: 2.68% (0.7115 => 0.7306, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.55% (17.1811 => 17.6184, std. dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (7.9617 => 8.1448, std. dev.: 0.0144) MultiSource/Applications/lemon/lemon: 2.15% (1.0722 => 1.0953, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.99% (21.9371 => 22.3740, std. dev.: 0.0334) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (0.8101 => 0.8222, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (4.2280 => 4.4429, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7501, std. dev.: 0.0047) MultiSource/Benchmarks/llubenchmark/llu: 2.56% (3.7781 => 3.8749, std. dev.: 0.0251) MultiSource/Applications/siod/siod: 1.78% (3.2827 => 3.3411, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.70% (26.0924 => 26.5359, std. dev.: 0.0144) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.51% (1.5086 => 1.5314, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.45% (9.1159 => 9.2480, std. dev.: 0.0302) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7977, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 1.25% (3.1578 => 3.1973, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.89% (5.2763 => 3.2243, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.49% (5.3855 => 3.7436, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.06% (5.3526 => 3.7438, std. dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1006, std. dev.: 0.0409) MultiSource/Applications/ClamAV/clamscan: -13.78% (22.1758 => 19.1206, std. dev.: 0.0519) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.45% (2.9384 => 2.5727, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std. dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: -10.64% (1.2373 => 1.1056, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -7.05% (1.5373 => 1.4289, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std. dev.: 0.0021) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4767, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4229, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9987, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9585, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5111, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3497, std. dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4228, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7068, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (1.6805 => 1.6632, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 18:22:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 26 Aug 2012 20:22:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120827012206.4CC782A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3217?compare_to=3214&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3217, Order: 162649, Start Time: 2012-08-26 22:39:28, End Time: 2012-08-27 01:23:02 To: 3214, Order: 162643, Start Time: 2012-08-25 08:07:51, End Time: 2012-08-25 10:51:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.54% (0.2187 => 0.2330, std. dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.99% (0.3446 => 0.3928, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.97% (0.3442 => 0.3923, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.76% (0.3488 => 0.3968, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.70% (0.3496 => 0.3975, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.18% (0.3650 => 0.4131, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3724 => 0.4203, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.53% (0.5826 => 0.6323, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 8.00% (0.5889 => 0.6360, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.44% (1.5932 => 1.7117, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (3.5627 => 3.7970, std. dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 6.57% (0.7171 => 0.7642, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.50% (1.6211 => 1.7265, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.14% (1.3152 => 1.3960, std. dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (0.2014 => 0.2134, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.85% (0.4994 => 0.5286, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.84% (0.2875 => 0.3043, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (0.4361 => 0.4613, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 5.67% (0.9697 => 1.0247, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (0.5000 => 0.5282, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.62% (0.2792 => 0.2949, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2729 => 0.2880, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 5.53% (0.2750 => 0.2902, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.51% (0.3195 => 0.3371, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.49% (0.3004 => 0.3169, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.45% (0.3930 => 0.4144, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 5.44% (0.2811 => 0.2964, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.44% (0.2738 => 0.2887, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.41% (0.5026 => 0.5298, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 5.41% (1.0781 => 1.1364, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2803 => 0.2954, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.36% (4.2109 => 4.4367, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: 5.36% (0.4029 => 0.4245, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.36% (0.2780 => 0.2929, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.35% (0.2823 => 0.2974, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.33% (0.2813 => 0.2963, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.33% (2.0673 => 2.1774, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.32% (0.5900 => 0.6214, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 5.30% (0.3096 => 0.3260, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 5.28% (0.9909 => 1.0432, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.28% (0.3317 => 0.3492, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 5.22% (0.3678 => 0.3870, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 5.17% (0.3267 => 0.3436, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.13% (0.3258 => 0.3425, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.12% (0.2911 => 0.3060, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.97% (0.3060 => 0.3212, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.96% (0.3124 => 0.3279, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.95% (2.7292 => 2.8642, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 4.87% (0.3348 => 0.3511, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 4.86% (0.3726 => 0.3907, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.85% (0.3362 => 0.3525, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.81% (0.3282 => 0.3440, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.3625 => 0.3799, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.75% (0.3477 => 0.3642, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.2736 => 0.2863, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 4.56% (0.4251 => 0.4445, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.51% (0.4146 => 0.4333, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.48% (1.9694 => 2.0577, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 4.40% (0.2566 => 0.2679, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (0.3890 => 0.4061, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3690 => 0.3852, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.33% (1.9966 => 2.0831, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.32% (0.3981 => 0.4153, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (2.1013 => 2.1908, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.25% (0.4658 => 0.4856, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.24% (5.5417 => 5.7766, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (4.4195 => 4.6023, std. dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.06% (0.3845 => 0.4001, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 3.90% (4.6177 => 4.7977, std. dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 3.86% (2.1653 => 2.2488, std. dev.: 0.0033) MultiSource/Applications/lua/lua: 3.77% (1.4269 => 1.4807, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.77% (1.8794 => 1.9502, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.72% (0.4139 => 0.4293, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.72% (0.3903 => 0.4048, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 3.61% (0.5012 => 0.5193, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.47% (0.7875 => 0.8148, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.45% (0.6435 => 0.6657, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.3271 => 0.3383, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.41% (23.5202 => 24.3234, std. dev.: 0.0256) MultiSource/Applications/siod/siod: 3.33% (0.6634 => 0.6855, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.3084 => 0.3186, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.17% (0.5546 => 0.5722, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 2.31% (2.0346 => 2.0815, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (4.6926 => 4.7421, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.80% (0.2122 => 0.2330, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6811, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8965, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1720, std. dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6371, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1959, std. dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5028, std. dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2264, std. dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4389, std. dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2793, std. dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5792, std. dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.11% (2.4764 => 2.3995, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5904, std. dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8033, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8050, std. dev.: 0.0078) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std. dev.: 0.0028) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8426, std. dev.: 0.0495) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (16.2163 => 15.9692, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 18:43:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 26 Aug 2012 20:43:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827014348.02F342A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3218?compare_to=3215&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3218, Order: 162650, Start Time: 2012-08-27 00:30:42, End Time: 2012-08-27 01:44:45 To: 3215, Order: 162649, Start Time: 2012-08-26 22:39:32, End Time: 2012-08-26 23:53:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (157 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 950 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.50% (3.7525 => 3.8464, std. dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.08% (79.1309 => 80.7777, std. dev.: 0.4909) SingleSource/Benchmarks/Misc/mandel-2: 1.42% (1.4131 => 1.4332, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 1.19% (3.7018 => 3.7457, std. dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.12% (2.0176 => 2.3226, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.33% (0.5818 => 0.6477, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.59% (0.3578 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.50% (0.3601 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.48% (0.3646 => 0.4028, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.46% (0.3663 => 0.4046, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3650 => 0.4031, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.43% (0.3623 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.28% (0.7061 => 0.7787, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.22% (0.3914 => 0.4314, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.19% (0.3789 => 0.4175, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.07% (0.4003 => 0.4406, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.97% (0.3940 => 0.4333, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.52% (0.2781 => 0.3018, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.50% (1.3693 => 1.4857, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.43% (0.4328 => 0.4693, std. dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1819 => 0.1970, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2782 => 0.3012, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4062 => 0.4390, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.00% (3.9660 => 4.2831, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.90% (0.2607 => 0.2813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.84% (0.2690 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.84% (0.2628 => 0.2834, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.83% (0.7710 => 0.8314, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.80% (0.2937 => 0.3166, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.78% (0.2765 => 0.2980, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.76% (0.2655 => 0.2861, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2761 => 0.2974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.68% (0.2760 => 0.2972, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.68% (0.3022 => 0.3254, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2726 => 0.2934, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.2966 => 0.3192, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.55% (1.9828 => 2.1326, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.53% (0.3107 => 0.3341, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2596 => 0.2790, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.46% (0.7038 => 0.7563, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.45% (0.5265 => 0.5657, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.40% (0.3485 => 0.3743, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.38% (0.2696 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3149 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.31% (0.3899 => 0.4184, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3580 => 0.3841, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2988 => 0.3204, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3489 => 0.3741, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.10% (1.2193 => 1.3059, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.07% (0.3453 => 0.3697, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.07% (0.9199 => 0.9849, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.06% (0.2721 => 0.2913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.05% (0.3192 => 0.3417, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.4379 => 0.4681, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.68% (0.1588 => 0.1694, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.62% (0.6959 => 0.7420, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.1789 => 0.1907, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3534 => 0.3767, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.54% (0.4390 => 0.4677, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.47% (1.1364 => 1.2099, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.46% (0.3868 => 0.4118, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.40% (0.4016 => 0.4273, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.39% (0.2127 => 0.2263, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.34% (0.3756 => 0.3994, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 6.25% (0.2945 => 0.3129, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.21% (0.5637 => 0.5987, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.15% (13.8202 => 14.6702, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.13% (0.5577 => 0.5919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.94% (0.2914 => 0.3087, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (7.2180 => 7.6457, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.91% (0.2925 => 0.3098, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.91% (1.2292 => 1.3018, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.86% (1.4563 => 1.5417, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.62% (0.2243 => 0.2369, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (1.3813 => 1.4575, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (1.3819 => 1.4577, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 5.41% (0.2995 => 0.3157, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.41% (1.3245 => 1.3961, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.37% (0.8310 => 0.8756, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.34% (0.7506 => 0.7907, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.33% (3.8646 => 4.0706, std. dev.: 0.0109) MultiSource/Applications/Burg/burg: 5.30% (1.1061 => 1.1647, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.7460 => 0.7855, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (3.6692 => 3.8585, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.16% (0.6283 => 0.6607, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.13% (1.0594 => 1.1138, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.01% (0.4113 => 0.4319, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.00% (4.3801 => 4.5991, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.4791 => 0.5030, std. dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.96% (4.4433 => 4.6639, std. dev.: 0.0029) MultiSource/Applications/treecc/treecc: 4.88% (1.9270 => 2.0210, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.86% (0.6135 => 0.6433, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 4.84% (0.3220 => 0.3376, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (13.2842 => 13.9205, std. dev.: 0.0122) MultiSource/Applications/siod/siod: 4.75% (2.1791 => 2.2826, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 4.64% (16.6129 => 17.3841, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.45% (0.8818 => 0.9210, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.34% (14.8535 => 15.4975, std. dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.29% (0.8698 => 0.9071, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 4.28% (0.3131 => 0.3265, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.11% (1.1333 => 1.1799, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.07% (0.3245 => 0.3377, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.89% (4.9865 => 5.1803, std. dev.: 0.0160) MultiSource/Applications/d/make_dparser: 3.88% (3.1889 => 3.3125, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.86% (8.4961 => 8.8242, std. dev.: 0.0161) MultiSource/Benchmarks/Olden/bh/bh: 3.71% (0.2859 => 0.2965, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (6.5754 => 6.8188, std. dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 3.66% (4.6629 => 4.8334, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.31% (3.2742 => 3.3827, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 3.22% (16.2614 => 16.7852, std. dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: 3.16% (14.5298 => 14.9883, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 2.93% (0.6250 => 0.6433, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.90% (0.9108 => 0.9372, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.86% (1.5188 => 1.5622, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.32% (3.7467 => 3.8337, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.25% (0.4805 => 0.4913, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.21% (6.2785 => 6.4172, std. dev.: 0.0024) MultiSource/Applications/minisat/minisat: 2.03% (0.6744 => 0.6881, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.00% (1.0313 => 1.0519, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.70% (33.2944 => 33.8607, std. dev.: 0.0141) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std. dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.26% (1.2998 => 1.4332, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6592, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.38% (11.2619 => 11.7548, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4271 => 7.6097, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.35% (10.7476 => 11.0006, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.06% (3.2729 => 3.3404, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.96% (1.4298 => 1.4578, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std. dev.: 0.0068) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.42% (1.5089 => 1.5304, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 1.30% (3.6975 => 3.7457, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5729, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.50% (22.5627 => 21.3215, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.32% (0.2670 => 0.2528, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2308 => 1.0960, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.40% (1.3780 => 1.3173, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8058, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -3.22% (1.1560 => 1.1188, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.75% (8.8259 => 8.5836, std. dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2299, std. dev.: 0.0112) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9714, std. dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3305 => 7.2008, std. dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.3167 => 5.2259, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4341, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2260, std. dev.: 0.0347) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8719, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4766, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.14% (20.3410 => 20.1098, std. dev.: 0.0217) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 18:48:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 26 Aug 2012 20:48:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827014856.0BCE92A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3219?compare_to=3216&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3219, Order: 162650, Start Time: 2012-08-27 00:30:51, End Time: 2012-08-27 01:49:54 To: 3216, Order: 162649, Start Time: 2012-08-26 22:39:58, End Time: 2012-08-26 23:59:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (135 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (701 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.47% (3.8749 => 3.7792, std. dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.62% (81.1937 => 79.8810, std. dev.: 0.2069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.79% (10.3673 => 13.6630, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: 13.94% (0.3473 => 0.3957, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3561 => 0.4054, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.71% (0.3516 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3497 => 0.3974, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.60% (0.3543 => 0.4025, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.60% (0.3543 => 0.4025, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3694 => 0.4180, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.90% (1.1194 => 1.2638, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.77% (0.3828 => 0.4317, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.76% (0.3886 => 0.4382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3927 => 0.4427, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.35% (1.7609 => 1.9784, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 10.34% (0.1432 => 0.1580, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.33% (2.2022 => 2.4297, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.21% (0.6030 => 0.6525, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.03% (0.1892 => 0.2044, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.83% (0.1584 => 0.1708, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.46% (0.3177 => 0.3414, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.16% (0.3282 => 0.3517, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.10% (0.7326 => 0.7846, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 6.65% (0.1655 => 0.1765, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.4615 => 0.4915, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.25% (7.0540 => 7.4951, std. dev.: 0.0140) MultiSource/Applications/lambda-0_1_3/lambda: 5.96% (0.7433 => 0.7876, std. dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.2554 => 0.2706, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.90% (0.3307 => 0.3502, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.82% (9.4845 => 10.0364, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.78% (0.2891 => 0.3058, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.72% (4.9449 => 5.2277, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.65% (5.0018 => 5.2846, std. dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 5.58% (0.4299 => 0.4539, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.41% (0.1940 => 0.2045, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 5.40% (0.3109 => 0.3277, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.29% (0.2871 => 0.3023, std. dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.3121 => 0.3284, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (0.8172 => 0.8598, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.18% (4.2646 => 4.4856, std. dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 5.16% (0.2905 => 0.3055, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.16% (1.5603 => 1.6408, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 5.16% (0.2831 => 0.2977, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.03% (10.4361 => 10.9612, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.03% (0.2725 => 0.2862, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.01% (0.2714 => 0.2850, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.01% (0.2756 => 0.2894, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.4103 => 0.4308, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.96% (0.3283 => 0.3446, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.3232 => 0.3392, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.95% (1.3050 => 1.3696, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.94% (0.2872 => 0.3014, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.94% (0.3098 => 0.3251, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.91% (0.3423 => 0.3591, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: 4.88% (0.3052 => 0.3201, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (8.1363 => 8.5328, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.85% (0.5860 => 0.6144, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2793 => 0.2927, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.79% (0.3865 => 0.4050, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.78% (0.2802 => 0.2936, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.5569 => 0.5835, std. dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.78% (0.3162 => 0.3313, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.77% (2.0665 => 2.1651, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 4.76% (0.2877 => 0.3014, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2700 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.73% (0.3422 => 0.3584, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.68% (5.7591 => 6.0285, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.66% (0.3136 => 0.3282, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 4.64% (0.4289 => 0.4488, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.63% (0.3650 => 0.3819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.60% (0.3826 => 0.4002, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3180 => 0.3326, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 4.55% (0.3603 => 0.3767, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.47% (0.7835 => 0.8185, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.4064 => 0.4244, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.42% (0.3441 => 0.3593, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 4.40% (0.3092 => 0.3228, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.36% (0.6450 => 0.6731, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.35% (0.3379 => 0.3526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3935 => 0.4106, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.34% (0.3684 => 0.3844, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.33% (0.5105 => 0.5326, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2758 => 0.2877, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.29% (0.4620 => 0.4818, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.24% (0.4203 => 0.4381, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.21% (0.9765 => 1.0176, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.20% (0.6456 => 0.6727, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.18% (1.1861 => 1.2357, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 4.16% (1.2842 => 1.3376, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/moments: 4.15% (0.4048 => 0.4216, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.11% (1.1642 => 1.2121, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.8067 => 0.8391, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.5415 => 1.6011, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.6675 => 0.6933, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.81% (0.3387 => 0.3516, std. dev.: 0.0047) MultiSource/Applications/d/make_dparser: 3.70% (3.3354 => 3.4589, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.70% (2.0273 => 2.1023, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 3.63% (3.8723 => 4.0129, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.49% (0.5981 => 0.6190, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.48% (1.4186 => 1.4679, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (14.3668 => 14.8473, std. dev.: 0.0157) MultiSource/Applications/siod/siod: 3.30% (2.2969 => 2.3727, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/football/football: 3.28% (0.8921 => 0.9214, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.13% (1.5859 => 1.6355, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.07% (0.5020 => 0.5174, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.74% (1.1840 => 1.2165, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.72% (2.2024 => 2.2623, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 2.68% (0.7115 => 0.7306, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.60% (17.1811 => 17.6285, std. dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.32% (7.9617 => 8.1461, std. dev.: 0.0112) MultiSource/Applications/lemon/lemon: 2.20% (1.0722 => 1.0958, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.98% (21.9371 => 22.3719, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (0.8101 => 0.8214, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.48% (2.6778 => 2.9583, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.86% (4.2280 => 4.4336, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7573, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 1.72% (3.2827 => 3.3393, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.57% (26.0924 => 26.5029, std. dev.: 0.0260) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (1.5086 => 1.5304, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2464, std. dev.: 0.0232) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.33% (19.9488 => 20.2134, std. dev.: 0.0330) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7969, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.1578 => 3.1952, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5789, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1260, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.89% (5.2763 => 3.2244, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.49% (5.3855 => 3.7432, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.07% (5.3526 => 3.7432, std. dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1224, std. dev.: 0.0198) MultiSource/Applications/ClamAV/clamscan: -13.84% (22.1758 => 19.1065, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.56% (2.9384 => 2.5693, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.17% (1.6925 => 1.4188, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -11.69% (1.2373 => 1.0927, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: -8.25% (1.5373 => 1.4105, std. dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.10% (1.1396 => 1.0701, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std. dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4709, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4159, std. dev.: 0.0293) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9937, std. dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9577, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5091, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (12.5348 => 12.3437, std. dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8130, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7068, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.03% (1.4460 => 1.4311, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 20:43:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 26 Aug 2012 22:43:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827034352.C1DEF2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3220?compare_to=3218&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3220, Order: 162651, Start Time: 2012-08-27 02:30:42, End Time: 2012-08-27 03:44:48 To: 3218, Order: 162650, Start Time: 2012-08-27 00:30:42, End Time: 2012-08-27 01:44:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (158 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.35% (2.0176 => 2.3273, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.41% (0.5818 => 0.6482, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 11.29% (0.5748 => 0.6397, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.56% (0.3578 => 0.3956, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3601 => 0.3978, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3650 => 0.4030, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 10.40% (0.7061 => 0.7795, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-4: 10.37% (0.3646 => 0.4024, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3623 => 0.3998, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.32% (0.3663 => 0.4041, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.17% (0.3914 => 0.4312, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.07% (0.4003 => 0.4406, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.06% (0.3789 => 0.4170, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.97% (0.3940 => 0.4333, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.81% (1.3693 => 1.4899, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.63% (0.1413 => 0.1535, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 8.63% (0.2781 => 0.3021, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.45% (0.2782 => 0.3017, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.25% (0.1819 => 0.1969, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.12% (0.2760 => 0.2984, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.11% (0.2761 => 0.2985, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.11% (3.9660 => 4.2877, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 8.09% (0.2607 => 0.2818, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4062 => 0.4389, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.03% (0.7710 => 0.8329, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2655 => 0.2868, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.96% (0.2765 => 0.2985, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2690 => 0.2904, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3022 => 0.3262, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.85% (0.2726 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.84% (0.2628 => 0.2834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.83% (0.2937 => 0.3167, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.82% (0.2966 => 0.3198, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.76% (1.9828 => 2.1366, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.69% (0.3107 => 0.3346, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.64% (0.2696 => 0.2902, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 7.62% (0.3149 => 0.3389, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.57% (0.3899 => 0.4194, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.55% (0.2596 => 0.2792, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5265 => 0.5661, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 7.49% (0.7038 => 0.7565, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.46% (0.2988 => 0.3211, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3453 => 0.3710, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (0.3485 => 0.3744, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.35% (0.3580 => 0.3843, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3489 => 0.3745, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.33% (0.3192 => 0.3426, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.26% (1.2193 => 1.3078, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.09% (0.2721 => 0.2914, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.01% (0.4379 => 0.4686, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.00% (0.9199 => 0.9843, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.1588 => 0.1696, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3534 => 0.3774, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.77% (0.4016 => 0.4288, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/moments: 6.75% (0.3868 => 0.4129, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4390 => 0.4683, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.52% (0.6959 => 0.7413, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.49% (0.2127 => 0.2265, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.44% (0.3756 => 0.3998, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.37% (1.1364 => 1.2088, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.33% (0.5577 => 0.5930, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.17% (13.8202 => 14.6730, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.10% (0.5637 => 0.5981, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.09% (7.2180 => 7.6578, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 6.06% (1.2292 => 1.3037, std. dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (0.2914 => 0.3088, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2023 => 0.2143, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.2925 => 0.3096, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 5.84% (0.2243 => 0.2374, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.82% (1.4563 => 1.5410, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (1.3819 => 1.4581, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.50% (0.7506 => 0.7919, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.46% (0.7460 => 0.7867, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.45% (1.3813 => 1.4566, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 5.44% (0.2995 => 0.3158, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.42% (0.8310 => 0.8760, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.38% (1.3245 => 1.3957, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.36% (3.6692 => 3.8660, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 5.34% (3.8646 => 4.0709, std. dev.: 0.0153) MultiSource/Applications/Burg/burg: 5.33% (1.1061 => 1.1650, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.25% (0.4113 => 0.4329, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.19% (1.0594 => 1.1144, std. dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 5.19% (0.3220 => 0.3387, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.18% (4.4433 => 4.6736, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.6283 => 0.6606, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.13% (0.4791 => 0.5037, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.11% (4.3801 => 4.6039, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (13.2842 => 13.9382, std. dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.92% (0.6135 => 0.6437, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.87% (1.9270 => 2.0208, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.69% (16.6129 => 17.3917, std. dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.60% (0.8818 => 0.9224, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 4.57% (2.1791 => 2.2787, std. dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 4.41% (14.8535 => 15.5089, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.38% (0.3245 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.28% (0.3131 => 0.3265, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.25% (0.8698 => 0.9068, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.13% (1.1333 => 1.1801, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (8.4961 => 8.8397, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 3.92% (3.1889 => 3.3138, std. dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 3.78% (6.5754 => 6.8238, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.2859 => 0.2967, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.9865 => 5.1718, std. dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 3.63% (4.6629 => 4.8321, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.33% (3.2742 => 3.3831, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 3.27% (16.2614 => 16.7924, std. dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: 3.22% (14.5298 => 14.9970, std. dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: 3.14% (0.6250 => 0.6446, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (1.5188 => 1.5630, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.90% (0.9108 => 0.9372, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.40% (6.2785 => 6.4290, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (2.1007 => 2.1491, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.16% (3.7467 => 3.8278, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: 2.15% (0.6744 => 0.6889, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.08% (0.4805 => 0.4905, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.98% (1.0313 => 1.0517, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.83% (33.2944 => 33.9031, std. dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std. dev.: 0.0441) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 10.21% (1.2998 => 1.4325, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.86% (1.5824 => 1.6593, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7425, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.74% (1.7688 => 1.8173, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3838, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.18% (10.7476 => 10.9816, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5879, std. dev.: 0.0113) MultiSource/Applications/siod/siod: 2.06% (3.2729 => 3.3404, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.06% (1.4298 => 1.4592, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.42% (1.5089 => 1.5303, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5745, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.03% (4.5928 => 4.6401, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.23% (0.4657 => 0.4041, std. dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.51% (22.5627 => 21.3186, std. dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.05% (0.3511 => 0.3404, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1041, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5099, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.71% (1.3780 => 1.3131, std. dev.: 0.0139) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.82% (0.4867 => 0.4681, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -3.20% (1.1560 => 1.1190, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6075, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2333, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: -1.78% (3.0263 => 2.9725, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3305 => 7.2018, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (5.3167 => 5.2265, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std. dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4244, std. dev.: 0.0086) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2261, std. dev.: 0.0303) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4961, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4761, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.11% (20.3410 => 20.1161, std. dev.: 0.0175) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 20:49:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 26 Aug 2012 22:49:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827034905.9D59D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3221?compare_to=3219&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3221, Order: 162651, Start Time: 2012-08-27 02:31:00, End Time: 2012-08-27 03:50:01 To: 3219, Order: 162650, Start Time: 2012-08-27 00:30:51, End Time: 2012-08-27 01:49:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (133 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (705 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.51% (5.4292 => 5.5112, std. dev.: 0.0136) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.62% (10.3673 => 13.6455, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 15.00% (0.3473 => 0.3994, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.76% (0.3497 => 0.4013, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.69% (0.3561 => 0.4084, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.68% (0.3543 => 0.4063, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.65% (0.3543 => 0.4062, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.65% (0.3516 => 0.4031, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 14.10% (0.3694 => 0.4215, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.82% (0.3828 => 0.4357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3927 => 0.4467, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.54% (0.3886 => 0.4412, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.07% (1.1194 => 1.2657, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.43% (1.7609 => 1.9797, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.38% (2.2022 => 2.4308, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 10.34% (0.1432 => 0.1580, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.6030 => 0.6555, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.02% (0.1584 => 0.1711, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.98% (0.1892 => 0.2043, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.74% (0.3177 => 0.3423, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: 7.13% (0.3282 => 0.3516, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.09% (0.1622 => 0.1737, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.73% (0.1695 => 0.1809, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.72% (0.4615 => 0.4925, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.68% (0.4879 => 0.5205, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 6.47% (0.1655 => 0.1762, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.34% (7.0540 => 7.5014, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.3307 => 0.3511, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2554 => 0.2710, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.7433 => 0.7877, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.96% (4.9449 => 5.2397, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.90% (5.0018 => 5.2970, std. dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 5.86% (9.4845 => 10.0404, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 5.79% (0.4299 => 0.4548, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.72% (0.2271 => 0.2401, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.62% (0.1940 => 0.2049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.62% (0.8172 => 0.8631, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.60% (0.2891 => 0.3053, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.48% (0.3121 => 0.3292, std. dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 5.47% (0.3109 => 0.3279, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.44% (4.2646 => 4.4964, std. dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.44% (0.4103 => 0.4326, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.40% (0.2905 => 0.3062, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.33% (0.2831 => 0.2982, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2725 => 0.2868, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2756 => 0.2900, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.20% (1.5603 => 1.6415, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 5.17% (0.3232 => 0.3399, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.15% (0.2872 => 0.3020, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.3052 => 0.3209, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.13% (0.3098 => 0.3257, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.10% (0.5569 => 0.5853, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.10% (1.3050 => 1.3715, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.09% (0.3283 => 0.3450, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 5.05% (0.3423 => 0.3596, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.05% (0.2871 => 0.3016, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.04% (10.4361 => 10.9625, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.04% (8.1363 => 8.5464, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.02% (0.5860 => 0.6154, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3162 => 0.3320, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.99% (0.3865 => 0.4058, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.98% (0.2793 => 0.2932, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 4.97% (0.2714 => 0.2849, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.96% (0.2700 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.96% (0.2802 => 0.2941, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (2.0665 => 2.1688, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/lists: 4.94% (0.3422 => 0.3591, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 4.87% (0.2877 => 0.3017, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.85% (0.4289 => 0.4497, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.85% (0.3136 => 0.3288, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.84% (0.3180 => 0.3334, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.82% (0.3650 => 0.3826, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.81% (0.4636 => 0.4859, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.80% (0.7835 => 0.8211, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.73% (0.3826 => 0.4007, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.3603 => 0.3771, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.57% (5.7591 => 6.0223, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 4.56% (0.3684 => 0.3852, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.56% (0.3379 => 0.3533, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.4064 => 0.4248, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.50% (0.2758 => 0.2882, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.42% (0.3935 => 0.4109, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.41% (0.5105 => 0.5330, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.40% (0.4203 => 0.4388, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.40% (0.3092 => 0.3228, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.38% (0.9765 => 1.0193, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.4048 => 0.4223, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.31% (0.4620 => 0.4819, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.6456 => 0.6732, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (1.1861 => 1.2362, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.18% (1.1642 => 1.2129, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.18% (1.2842 => 1.3379, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.15% (1.5415 => 1.6054, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.09% (0.8067 => 0.8397, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.06% (0.6675 => 0.6946, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.83% (2.0273 => 2.1049, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 3.73% (3.8723 => 4.0167, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.73% (0.5981 => 0.6204, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 3.69% (3.3354 => 3.4585, std. dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.4186 => 1.4693, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.41% (0.8921 => 0.9225, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.35% (2.2969 => 2.3739, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.35% (0.5020 => 0.5188, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (14.3668 => 14.8466, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.29% (1.5859 => 1.6381, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.89% (2.2024 => 2.2660, std. dev.: 0.0167) MultiSource/Benchmarks/nbench/nbench: 2.82% (1.1840 => 1.2174, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.67% (0.7115 => 0.7305, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.58% (17.1811 => 17.6237, std. dev.: 0.0156) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (7.9617 => 8.1562, std. dev.: 0.0034) MultiSource/Applications/lemon/lemon: 2.23% (1.0722 => 1.0961, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.05% (21.9371 => 22.3877, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (0.8101 => 0.8230, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.99% (4.2280 => 4.4389, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (3.6395 => 3.7560, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.73% (3.2827 => 3.3394, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.71% (26.0924 => 26.5375, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5086 => 1.5281, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1982, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2324, std. dev.: 0.0133) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.96% (5.2763 => 3.2208, std. dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.45% (5.3855 => 3.7457, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.03% (5.3526 => 3.7451, std. dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1506, std. dev.: 0.0314) MultiSource/Applications/ClamAV/clamscan: -13.76% (22.1758 => 19.1252, std. dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.39% (2.9384 => 2.5742, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2373 => 1.0946, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -8.22% (1.5373 => 1.4110, std. dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.10% (1.1396 => 1.0701, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std. dev.: 0.0010) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4599, std. dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4264, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0124, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9619, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3341, std. dev.: 0.0094) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8124, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 21:33:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 26 Aug 2012 23:33:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120827043306.CA64A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3222?compare_to=3217&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3222, Order: 162650, Start Time: 2012-08-27 01:50:28, End Time: 2012-08-27 04:34:05 To: 3217, Order: 162649, Start Time: 2012-08-26 22:39:28, End Time: 2012-08-27 01:23:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (118 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (761 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.54% (125.0366 => 129.4634, std. dev.: 0.7524) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.70% (0.6102 => 0.6206, std. dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3469 => 0.3954, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.93% (0.3446 => 0.3926, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.91% (0.3465 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.89% (0.3442 => 0.3920, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.84% (0.3496 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.76% (0.3460 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.26% (0.3650 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.26% (0.3643 => 0.4126, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3724 => 0.4203, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5826 => 0.6325, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.17% (0.5889 => 0.6370, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.48% (1.5932 => 1.7123, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.1619 => 0.1738, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (3.5627 => 3.7973, std. dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 6.58% (0.7171 => 0.7643, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.50% (1.6211 => 1.7264, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.20% (1.3152 => 1.3968, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.16% (0.2875 => 0.3052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (0.4361 => 0.4617, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.87% (0.4994 => 0.5287, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.76% (0.9697 => 1.0256, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 5.74% (0.2803 => 0.2964, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2738 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.66% (0.2811 => 0.2970, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.62% (0.2792 => 0.2949, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.60% (0.3195 => 0.3374, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2729 => 0.2880, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (0.5000 => 0.5276, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.49% (0.3258 => 0.3437, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.49% (0.3004 => 0.3169, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.49% (0.2750 => 0.2901, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.46% (0.2823 => 0.2977, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 5.42% (0.9909 => 1.0446, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2813 => 0.2965, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.40% (4.2109 => 4.4382, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 5.40% (0.2780 => 0.2930, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (0.3930 => 0.4142, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.39% (2.0673 => 2.1788, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.37% (0.5900 => 0.6217, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 5.37% (1.0781 => 1.1360, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 5.36% (0.3096 => 0.3262, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.35% (0.5026 => 0.5295, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.2911 => 0.3065, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 5.26% (0.4029 => 0.4241, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 5.19% (0.3317 => 0.3489, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 5.17% (0.3267 => 0.3436, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.08% (0.1968 => 0.2068, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.06% (0.3124 => 0.3282, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3060 => 0.3214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.02% (0.3726 => 0.3913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.98% (0.3678 => 0.3861, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.97% (0.3362 => 0.3529, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 4.93% (0.3348 => 0.3513, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.93% (2.7292 => 2.8637, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.81% (0.3282 => 0.3440, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.77% (0.3625 => 0.3798, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.72% (0.3477 => 0.3641, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.64% (0.2736 => 0.2863, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3792 => 0.3968, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.48% (1.9694 => 2.0576, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.42% (0.4251 => 0.4439, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.37% (0.4146 => 0.4327, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3690 => 0.3850, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.33% (0.2566 => 0.2677, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.32% (1.9966 => 2.0829, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.27% (0.3890 => 0.4056, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (2.1013 => 2.1901, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.22% (0.3981 => 0.4149, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.22% (5.5417 => 5.7754, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (4.4195 => 4.6044, std. dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.14% (0.3845 => 0.4004, std. dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 4.07% (4.6177 => 4.8058, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.06% (0.4658 => 0.4847, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 3.97% (2.1653 => 2.2512, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.79% (0.3903 => 0.4051, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 3.71% (1.8794 => 1.9491, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.5012 => 0.5195, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.4139 => 0.4289, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.62% (1.4269 => 1.4786, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 3.47% (0.7875 => 0.8148, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.3271 => 0.3383, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.42% (23.5202 => 24.3254, std. dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.36% (0.6435 => 0.6651, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.32% (0.6634 => 0.6854, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.3084 => 0.3186, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.25% (0.5546 => 0.5726, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 3.03% (0.3336 => 0.3437, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.27% (2.0346 => 2.0808, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 8.39% (0.2122 => 0.2300, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6718, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8963, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6511, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1978, std. dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5016, std. dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2271, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4532, std. dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2911, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (105.3826 => 106.5404, std. dev.: 0.0432) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5844, std. dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.17% (2.4764 => 2.3978, std. dev.: 0.0265) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5611, std. dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7977, std. dev.: 0.0155) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7988, std. dev.: 0.0029) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7648, std. dev.: 0.0938) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5719, std. dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9637, std. dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 22:26:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 00:26:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827052636.A36C32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3223?compare_to=3220&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3223, Order: 162653, Start Time: 2012-08-27 04:13:26, End Time: 2012-08-27 05:27:33 To: 3220, Order: 162651, Start Time: 2012-08-27 02:30:42, End Time: 2012-08-27 03:44:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (156 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (698 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.92% (78.1766 => 80.4618, std. dev.: 0.4638) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.72% (29.1084 => 29.6099, std. dev.: 0.0513) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.34% (2.0176 => 2.3272, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.29% (0.5818 => 0.6475, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.27% (0.5748 => 0.6396, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.59% (0.3578 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3601 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3646 => 0.4025, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 10.34% (0.7061 => 0.7791, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3623 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.29% (0.3663 => 0.4040, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3650 => 0.4024, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.08% (0.3789 => 0.4171, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.04% (0.3914 => 0.4307, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.82% (0.4003 => 0.4396, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.72% (0.3940 => 0.4323, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 8.85% (1.3693 => 1.4905, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.60% (0.4328 => 0.4700, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.56% (0.2781 => 0.3019, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.36% (0.1819 => 0.1971, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2782 => 0.3014, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.09% (3.9660 => 4.2870, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hello: 8.09% (0.2607 => 0.2818, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.03% (0.2690 => 0.2906, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 8.00% (0.4062 => 0.4387, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.91% (0.2655 => 0.2865, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.89% (0.7710 => 0.8318, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.82% (0.2966 => 0.3198, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.80% (0.2628 => 0.2833, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2761 => 0.2976, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.76% (0.2937 => 0.3165, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.75% (1.9828 => 2.1364, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2726 => 0.2937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.63% (0.3107 => 0.3344, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.59% (0.3899 => 0.4195, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3149 => 0.3388, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.53% (0.2696 => 0.2899, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.50% (0.5265 => 0.5660, std. dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.40% (0.7038 => 0.7559, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.40% (0.2988 => 0.3209, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.2596 => 0.2787, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.35% (0.3580 => 0.3843, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.27% (0.3453 => 0.3704, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3192 => 0.3423, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4379 => 0.4695, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.17% (0.3489 => 0.3739, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.15% (1.2193 => 1.3065, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.06% (0.9199 => 0.9848, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3534 => 0.3773, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.6959 => 0.7424, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.68% (0.1588 => 0.1694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.67% (0.4016 => 0.4284, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.1789 => 0.1908, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.65% (0.4390 => 0.4682, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.3868 => 0.4122, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.52% (0.2945 => 0.3137, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.50% (0.3756 => 0.4000, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.1364 => 1.2085, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.24% (0.5577 => 0.5925, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.21% (13.8202 => 14.6782, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.09% (7.2180 => 7.6579, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.05% (0.5637 => 0.5978, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.01% (0.2914 => 0.3089, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.96% (1.2292 => 1.3024, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.89% (1.4563 => 1.5421, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.2925 => 0.3096, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.48% (0.2995 => 0.3159, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.47% (1.3813 => 1.4569, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3755 => 0.3960, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.45% (1.3819 => 1.4572, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.3245 => 1.3963, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 5.41% (0.7506 => 0.7912, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.35% (1.1061 => 1.1653, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 5.33% (0.8310 => 0.8753, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.28% (3.8646 => 4.0687, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (0.7460 => 0.7851, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.18% (3.6692 => 3.8592, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 5.17% (1.0594 => 1.1142, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.17% (0.6283 => 0.6608, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 5.15% (0.4113 => 0.4325, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.14% (4.3801 => 4.6051, std. dev.: 0.0085) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.08% (4.4433 => 4.6692, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.01% (0.4791 => 0.5031, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.94% (1.9270 => 2.0222, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (13.2842 => 13.9337, std. dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.84% (0.6135 => 0.6432, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.78% (0.3220 => 0.3374, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.71% (16.6129 => 17.3959, std. dev.: 0.0088) MultiSource/Applications/siod/siod: 4.59% (2.1791 => 2.2791, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.55% (0.8818 => 0.9219, std. dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 4.42% (14.8535 => 15.5101, std. dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.28% (0.8698 => 0.9070, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.18% (0.3131 => 0.3262, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.15% (1.1333 => 1.1803, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.10% (0.3245 => 0.3378, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.99% (0.2859 => 0.2973, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.97% (8.4961 => 8.8336, std. dev.: 0.0092) MultiSource/Applications/d/make_dparser: 3.91% (3.1889 => 3.3136, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.77% (6.5754 => 6.8233, std. dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.74% (4.9865 => 5.1729, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.59% (4.6629 => 4.8302, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.36% (3.2742 => 3.3842, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 3.31% (16.2614 => 16.8000, std. dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 3.18% (14.5298 => 14.9924, std. dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.6250 => 0.6441, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.90% (0.9108 => 0.9372, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.87% (1.5188 => 1.5624, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (6.2785 => 6.4274, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.34% (2.1007 => 2.1499, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.20% (3.7467 => 3.8290, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.08% (0.6744 => 0.6884, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.02% (1.0313 => 1.0521, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.82% (33.2944 => 33.9013, std. dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2937, std. dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5184, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std. dev.: 0.0464) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 9.77% (1.2998 => 1.4268, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.86% (1.5824 => 1.6593, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7401, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6016, std. dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9935, std. dev.: 0.0462) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.04% (3.2729 => 3.3397, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 2.01% (1.4298 => 1.4585, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.04% (5.5130 => 5.5706, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.03% (4.5928 => 4.6401, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.13% (0.4657 => 0.4092, std. dev.: 0.0078) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.59% (22.5627 => 21.3018, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.13% (0.2670 => 0.2533, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2308 => 1.0886, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3130, std. dev.: 0.0091) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.49% (0.4867 => 0.4697, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -3.18% (1.1560 => 1.1192, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5863, std. dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.21% (6.3560 => 6.2156, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3305 => 7.2001, std. dev.: 0.0026) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9728, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.74% (5.3167 => 5.2241, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8629, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4230, std. dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2387, std. dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Aug 26 22:35:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 00:35:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827053551.415122A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3224?compare_to=3221&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3224, Order: 162653, Start Time: 2012-08-27 04:17:39, End Time: 2012-08-27 05:36:47 To: 3221, Order: 162651, Start Time: 2012-08-27 02:31:00, End Time: 2012-08-27 03:50:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (138 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (698 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.71% (54.8340 => 56.3180, std. dev.: 0.2069) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.0946 => 1.1076, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.39% (5.5112 => 5.4347, std. dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.58% (10.3673 => 13.6409, std. dev.: 0.0146) SingleSource/UnitTests/ObjC/trivial-interface: 14.97% (0.3473 => 0.3993, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.70% (0.3497 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.65% (0.3543 => 0.4062, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.63% (0.3561 => 0.4082, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.59% (0.3543 => 0.4060, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.53% (0.3516 => 0.4027, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.08% (0.3694 => 0.4214, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.78% (0.3927 => 0.4468, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.77% (0.3828 => 0.4355, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.59% (0.3886 => 0.4414, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.96% (1.1194 => 1.2645, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.37% (1.7609 => 1.9787, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 10.34% (0.1432 => 0.1580, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.32% (2.2022 => 2.4294, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.54% (0.3817 => 0.4181, std. dev.: 0.0076) SingleSource/UnitTests/ObjC++/Hello: 8.88% (0.5925 => 0.6451, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.6030 => 0.6554, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.95% (0.1584 => 0.1710, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.88% (0.1892 => 0.2041, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 7.16% (0.3282 => 0.3517, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 6.71% (0.1655 => 0.1766, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.4615 => 0.4924, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.30% (7.0540 => 7.4984, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.3307 => 0.3511, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.07% (0.2554 => 0.2709, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 5.99% (0.7433 => 0.7878, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.89% (0.4299 => 0.4552, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.88% (4.9449 => 5.2355, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (9.4845 => 10.0395, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.82% (5.0018 => 5.2929, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.68% (0.2271 => 0.2400, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.50% (0.2891 => 0.3050, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.44% (0.2905 => 0.3063, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.8172 => 0.8614, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 5.40% (0.3109 => 0.3277, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.38% (0.3121 => 0.3289, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.38% (4.2646 => 4.4940, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 5.37% (0.2831 => 0.2983, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.24% (0.4103 => 0.4318, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2725 => 0.2867, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.20% (1.5603 => 1.6415, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.3232 => 0.3398, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.14% (0.5569 => 0.5855, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2756 => 0.2897, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.11% (10.4361 => 10.9699, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3098 => 0.3256, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.10% (1.3050 => 1.3715, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.08% (0.3052 => 0.3207, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.05% (0.2872 => 0.3017, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.03% (0.3162 => 0.3321, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 5.02% (0.3423 => 0.3595, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.02% (0.2871 => 0.3015, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.00% (0.3283 => 0.3447, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.98% (0.2793 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.97% (0.3865 => 0.4057, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.96% (8.1363 => 8.5401, std. dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.95% (0.5860 => 0.6150, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.92% (0.4636 => 0.4864, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 4.91% (0.3603 => 0.3780, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.91% (0.3422 => 0.3590, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.87% (2.0665 => 2.1672, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 4.87% (0.4289 => 0.4498, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.87% (0.2877 => 0.3017, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.86% (0.2714 => 0.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.85% (0.2802 => 0.2938, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.85% (0.2700 => 0.2831, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.85% (0.3136 => 0.3288, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.81% (0.3826 => 0.4010, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.79% (0.3650 => 0.3825, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.78% (0.3180 => 0.3332, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.71% (0.7835 => 0.8204, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 4.58% (5.7591 => 6.0231, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.5105 => 0.5339, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 4.53% (0.3684 => 0.3851, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.53% (0.2758 => 0.2883, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.4064 => 0.4247, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.50% (0.3379 => 0.3531, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.48% (0.3441 => 0.3595, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.47% (0.3935 => 0.4111, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.47% (0.6450 => 0.6738, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.42% (0.4048 => 0.4227, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.40% (0.4203 => 0.4388, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 4.37% (0.3092 => 0.3227, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.36% (0.9765 => 1.0191, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.24% (0.4620 => 0.4816, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (1.1861 => 1.2361, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.21% (0.6456 => 0.6728, std. dev.: 0.0091) MultiSource/Applications/Burg/burg: 4.17% (1.1642 => 1.2128, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2842 => 1.3377, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.15% (0.8067 => 0.8402, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.09% (0.6675 => 0.6948, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (1.5415 => 1.6025, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 3.86% (2.0273 => 2.1055, std. dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 3.81% (0.3387 => 0.3516, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.76% (3.3354 => 3.4608, std. dev.: 0.0109) MultiSource/Applications/lua/lua: 3.70% (3.8723 => 4.0154, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.61% (0.5981 => 0.6197, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.4186 => 1.4681, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.43% (14.3668 => 14.8590, std. dev.: 0.0048) MultiSource/Applications/siod/siod: 3.42% (2.2969 => 2.3755, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.33% (0.8921 => 0.9218, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.31% (0.5020 => 0.5186, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.20% (1.5859 => 1.6366, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.87% (2.2024 => 2.2656, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.1840 => 1.2170, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.71% (0.7115 => 0.7308, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.60% (17.1811 => 17.6278, std. dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.43% (7.9617 => 8.1552, std. dev.: 0.0046) MultiSource/Applications/lemon/lemon: 2.14% (1.0722 => 1.0951, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.04% (21.9371 => 22.3842, std. dev.: 0.0204) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.44% (0.8101 => 0.8218, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (3.8922 => 3.9314, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.18% (4.2280 => 4.4470, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.79% (26.0924 => 26.5597, std. dev.: 0.0201) MultiSource/Applications/siod/siod: 1.72% (3.2827 => 3.3392, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (1.5086 => 1.5304, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 1.35% (2.2771 => 2.3079, std. dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.22% (6.5088 => 6.5881, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2209, std. dev.: 0.0184) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.11% (3.1578 => 3.1928, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1261, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.95% (5.2763 => 3.2212, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.46% (5.3855 => 3.7452, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.03% (5.3526 => 3.7453, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1351, std. dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: -13.75% (22.1758 => 19.1257, std. dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.34% (2.9384 => 2.5759, std. dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2373 => 1.1076, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -9.37% (1.5373 => 1.3932, std. dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.10% (1.1396 => 1.0701, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0504, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4690, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4221, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0010, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.28% (8.1563 => 7.9701, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3457, std. dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4248, std. dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8125, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8559, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (1.6805 => 1.6629, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.00% (1.4460 => 1.4315, std. dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 00:45:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 02:45:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120827074517.9619E2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3225?compare_to=3222&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3225, Order: 162653, Start Time: 2012-08-27 05:01:31, End Time: 2012-08-27 07:46:13 To: 3222, Order: 162650, Start Time: 2012-08-27 01:50:28, End Time: 2012-08-27 04:34:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (764 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.02% (1.6065 => 1.6229, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 14.88% (0.3442 => 0.3954, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.86% (0.3465 => 0.3980, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.83% (0.3446 => 0.3957, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 14.83% (0.3460 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.73% (0.3496 => 0.4011, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.73% (0.3469 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3488 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.30% (0.3643 => 0.4164, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 14.30% (0.3650 => 0.4172, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.80% (0.3724 => 0.4238, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5826 => 0.6354, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.5889 => 0.6402, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.1620 => 0.1755, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.03% (0.7171 => 0.7675, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.92% (1.5932 => 1.7034, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.86% (3.5627 => 3.8072, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (1.6211 => 1.7293, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.31% (0.2014 => 0.2141, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.22% (0.3792 => 0.4028, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.21% (1.3152 => 1.3969, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2875 => 0.3053, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.05% (0.2792 => 0.2961, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: 6.02% (0.2725 => 0.2889, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.01% (0.2714 => 0.2877, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.96% (0.4361 => 0.4621, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 5.96% (0.3004 => 0.3183, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2738 => 0.2901, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.88% (0.5900 => 0.6247, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2729 => 0.2889, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.78% (0.2803 => 0.2965, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.76% (0.2813 => 0.2975, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.75% (0.4994 => 0.5281, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 5.75% (0.2750 => 0.2908, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.74% (0.5000 => 0.5287, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.68% (0.3096 => 0.3272, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (0.3930 => 0.4152, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.2780 => 0.2937, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.63% (0.2823 => 0.2982, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.62% (0.3258 => 0.3441, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.62% (2.0673 => 2.1834, std. dev.: 0.0136) MultiSource/Applications/hbd/hbd: 5.59% (0.9697 => 1.0239, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 5.59% (0.2811 => 0.2968, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.56% (0.9909 => 1.0460, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 5.49% (0.4029 => 0.4250, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 5.45% (0.3267 => 0.3445, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (0.5026 => 0.5299, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 5.40% (0.3317 => 0.3496, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.36% (0.2911 => 0.3067, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.33% (1.0781 => 1.1356, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 5.31% (4.2109 => 4.4344, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.23% (0.3060 => 0.3220, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3124 => 0.3287, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.20% (2.7292 => 2.8712, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3678 => 0.3868, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 5.14% (0.3348 => 0.3520, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.07% (0.3726 => 0.3915, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.03% (0.3282 => 0.3447, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.03% (0.3362 => 0.3531, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01% (0.2736 => 0.2873, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3477 => 0.3649, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.85% (0.3690 => 0.3869, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.72% (1.9694 => 2.0624, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.62% (1.9966 => 2.0889, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 4.56% (5.5417 => 5.7946, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash: 4.56% (0.4146 => 0.4335, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 4.54% (0.4251 => 0.4444, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.45% (0.3890 => 0.4063, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (0.4658 => 0.4863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.35% (0.3981 => 0.4154, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 4.29% (1.8794 => 1.9600, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.29% (0.2566 => 0.2676, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.22% (2.1013 => 2.1899, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.3845 => 0.4007, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.3903 => 0.4060, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.96% (4.4195 => 4.5944, std. dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 3.92% (4.6177 => 4.7989, std. dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 3.80% (2.1653 => 2.2475, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.77% (0.4139 => 0.4295, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 3.74% (1.4269 => 1.4803, std. dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.73% (0.3271 => 0.3393, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.53% (0.7875 => 0.8153, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.45% (0.6634 => 0.6863, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.44% (0.3084 => 0.3190, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.41% (0.5546 => 0.5735, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.39% (23.5202 => 24.3187, std. dev.: 0.0236) MultiSource/Applications/minisat/minisat: 3.12% (0.3336 => 0.3440, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 2.01% (2.0346 => 2.0755, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.67% (0.2122 => 0.2306, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6732, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1645, std. dev.: 0.0315) SingleSource/Benchmarks/Misc/flops-2: 4.40% (1.8057 => 1.8851, std. dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6491, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2105, std. dev.: 0.0436) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5034, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2232, std. dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4371, std. dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2850, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6011, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.03% (105.3826 => 106.4706, std. dev.: 0.0712) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.25% (2.4764 => 2.3960, std. dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5846, std. dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std. dev.: 0.0978) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.50% (0.2402 => 0.2270, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8006, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std. dev.: 0.0052) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.94% (3.6262 => 3.5197, std. dev.: 0.0160) SingleSource/Benchmarks/Dhrystone/fldry: -2.03% (17.2379 => 16.8875, std. dev.: 0.0372) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5712, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.59% (16.2163 => 15.9577, std. dev.: 0.0643) MultiSource/Benchmarks/Olden/bh/bh: -1.41% (5.5810 => 5.5023, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 01:05:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 03:05:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827080539.9DDCE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3226?compare_to=3223&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3226, Order: 162654, Start Time: 2012-08-27 06:49:11, End Time: 2012-08-27 08:06:35 To: 3223, Order: 162653, Start Time: 2012-08-27 04:13:26, End Time: 2012-08-27 05:27:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (133 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.25% (55.1178 => 56.3594, std. dev.: 0.1150) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.14% (2.0176 => 2.3231, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 13.08% (0.0826 => 0.0934, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.77% (0.5818 => 0.6503, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 11.60% (0.5748 => 0.6415, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.43% (0.7061 => 0.7868, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.07% (0.3650 => 0.4054, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 10.93% (0.3578 => 0.3969, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.83% (0.3601 => 0.3991, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3663 => 0.4058, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3646 => 0.4039, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.65% (0.3623 => 0.4009, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3789 => 0.4192, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3914 => 0.4322, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.4003 => 0.4415, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 10.13% (0.3940 => 0.4339, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.01% (0.3130 => 0.3412, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 8.66% (1.3693 => 1.4879, std. dev.: 0.0412) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.64% (0.7710 => 0.8376, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.63% (0.1413 => 0.1535, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.55% (0.4328 => 0.4698, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.2781 => 0.3017, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.45% (0.2782 => 0.3017, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.19% (0.1819 => 0.1968, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.18% (3.9660 => 4.2904, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4062 => 0.4390, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.01% (0.2596 => 0.2804, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.91% (0.2655 => 0.2865, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.88% (0.2690 => 0.2902, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.86% (0.2607 => 0.2812, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.81% (0.7038 => 0.7588, std. dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3022 => 0.3257, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.74% (1.9828 => 2.1363, std. dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/fibo: 7.72% (0.2628 => 0.2831, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2726 => 0.2936, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.69% (0.2966 => 0.3194, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 7.66% (0.2937 => 0.3162, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2761 => 0.2972, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.57% (0.3899 => 0.4194, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary: 7.56% (0.3107 => 0.3342, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.49% (0.3149 => 0.3385, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.46% (0.5265 => 0.5658, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.46% (0.2696 => 0.2897, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.36% (0.2988 => 0.3208, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.36% (0.3192 => 0.3427, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3580 => 0.3842, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.32% (0.3485 => 0.3740, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3489 => 0.3741, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.22% (1.2193 => 1.3073, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 7.12% (0.3453 => 0.3699, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.10% (0.9199 => 0.9852, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.06% (0.6959 => 0.7450, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.97% (0.4379 => 0.4684, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3534 => 0.3773, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.71% (0.3293 => 0.3514, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.1789 => 0.1908, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.63% (0.4390 => 0.4681, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.57% (0.4016 => 0.4280, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.47% (0.3756 => 0.3999, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.45% (1.1364 => 1.2097, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.32% (0.2945 => 0.3131, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.31% (0.5577 => 0.5929, std. dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.20% (13.8202 => 14.6773, std. dev.: 0.2994) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3246 => 0.3446, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (0.2914 => 0.3090, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.01% (0.5637 => 0.5976, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.98% (0.2023 => 0.2144, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.95% (7.2180 => 7.6478, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.82% (1.4563 => 1.5411, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.58% (1.3245 => 1.3984, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 5.51% (3.8646 => 4.0774, std. dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 5.44% (0.2995 => 0.3158, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.44% (1.3819 => 1.4571, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.42% (1.3813 => 1.4562, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.35% (0.3755 => 0.3956, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 5.34% (0.8310 => 0.8754, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.7460 => 0.7855, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.22% (0.6283 => 0.6611, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.19% (3.6692 => 3.8597, std. dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 5.13% (1.0594 => 1.1138, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (4.3801 => 4.6034, std. dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (4.4433 => 4.6659, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.2140 => 0.2247, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.4791 => 0.5030, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.97% (0.6135 => 0.6440, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (13.2842 => 13.9397, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.50% (0.8818 => 0.9215, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.28% (0.3245 => 0.3384, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.28% (0.3131 => 0.3265, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.28% (0.8698 => 0.9070, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.13% (1.1333 => 1.1801, std. dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (8.4961 => 8.8246, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.79% (4.9865 => 5.1755, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.41% (3.2742 => 3.3860, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.6250 => 0.6443, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.04% (1.5188 => 1.5650, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.87% (0.9108 => 0.9369, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1509, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (6.2785 => 6.4261, std. dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 1.97% (33.2944 => 33.9505, std. dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5146, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std. dev.: 0.0444) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.52% (1.2998 => 1.4236, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (0.2093 => 0.2202, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.87% (1.5824 => 1.6594, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7407, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9636, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4271 => 7.6083, std. dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5315, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std. dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5715, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (3.1071 => 3.1386, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.57% (22.5627 => 21.3057, std. dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.02% (0.3511 => 0.3405, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.05% (1.2308 => 1.0948, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.32% (2.6470 => 2.5062, std. dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.87% (1.3780 => 1.3109, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.40% (0.3139 => 0.3001, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -3.24% (1.1560 => 1.1186, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5784, std. dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.85% (3.0263 => 2.9702, std. dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: -1.84% (5.3167 => 5.2187, std. dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3305 => 7.1980, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9921, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0202) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7923, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (84.4286 => 83.4190, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.10% (5.5401 => 5.4793, std. dev.: 0.0096) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 01:11:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 03:11:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827081110.833382A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3227?compare_to=3224&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3227, Order: 162654, Start Time: 2012-08-27 06:49:14, End Time: 2012-08-27 08:12:05 To: 3224, Order: 162653, Start Time: 2012-08-27 04:17:39, End Time: 2012-08-27 05:36:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (122 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.01% (0.8614 => 0.8787, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.64% (78.7148 => 80.7911, std. dev.: 0.1299) SingleSource/Benchmarks/Misc/mandel-2: 2.45% (1.3932 => 1.4273, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.58% (10.3673 => 13.6414, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 14.94% (0.3473 => 0.3992, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 14.83% (0.3561 => 0.4089, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.73% (0.3497 => 0.4012, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.71% (0.3543 => 0.4064, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 14.70% (0.3516 => 0.4033, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.56% (0.3543 => 0.4059, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.05% (0.3694 => 0.4213, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.85% (0.3927 => 0.4471, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 13.82% (0.3828 => 0.4357, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.61% (0.3886 => 0.4415, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.94% (1.1194 => 1.2642, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.40% (1.7609 => 1.9793, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.38% (2.2022 => 2.4307, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 10.20% (0.1432 => 0.1578, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5925 => 0.6456, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.76% (0.6030 => 0.6558, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3177 => 0.3437, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std. dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.95% (0.1584 => 0.1710, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.93% (0.1892 => 0.2042, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.53% (0.8172 => 0.8787, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.39% (0.4615 => 0.4956, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: 7.22% (0.3282 => 0.3519, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 6.71% (0.1655 => 0.1766, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.55% (0.1695 => 0.1806, std. dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.34% (0.1940 => 0.2063, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.33% (7.0540 => 7.5008, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.29% (0.3307 => 0.3515, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.07% (0.2554 => 0.2709, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.07% (5.0018 => 5.3053, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.97% (4.9449 => 5.2401, std. dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (9.4845 => 10.0503, std. dev.: 0.0153) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4299 => 0.4553, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.72% (0.2271 => 0.2401, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.67% (0.2891 => 0.3055, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.65% (0.2107 => 0.2226, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.61% (0.4103 => 0.4333, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (4.2646 => 4.4987, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 5.48% (0.4289 => 0.4524, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2905 => 0.3064, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.47% (0.3162 => 0.3335, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2871 => 0.3026, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.37% (0.2756 => 0.2904, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.37% (0.2831 => 0.2983, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.33% (0.2758 => 0.2905, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4636 => 0.4882, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.29% (0.3232 => 0.3403, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.28% (0.3865 => 0.4069, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.25% (1.3050 => 1.3735, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.22% (0.8067 => 0.8488, std. dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 5.20% (10.4361 => 10.9791, std. dev.: 0.1959) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.19% (2.0665 => 2.1737, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 5.17% (0.2725 => 0.2866, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.15% (0.2872 => 0.3020, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.3052 => 0.3209, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.14% (0.3423 => 0.3599, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.12% (0.5569 => 0.5854, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2877 => 0.3024, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.11% (8.1363 => 8.5520, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3098 => 0.3256, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.08% (0.2793 => 0.2935, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 5.06% (0.3283 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.04% (0.3650 => 0.3834, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.04% (0.3136 => 0.3294, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.95% (0.5860 => 0.6150, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 4.94% (0.3422 => 0.3591, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 4.94% (0.3180 => 0.3337, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.93% (0.2700 => 0.2833, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 4.93% (0.2802 => 0.2940, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.91% (0.3826 => 0.4014, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3379 => 0.3542, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 4.72% (0.3603 => 0.3773, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.68% (0.4064 => 0.4254, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.65% (0.3935 => 0.4118, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3684 => 0.3855, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.64% (0.6450 => 0.6749, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 4.61% (5.7591 => 6.0246, std. dev.: 0.0985) SingleSource/Benchmarks/Shootout-C++/hash2: 4.52% (0.4620 => 0.4829, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.48% (0.3441 => 0.3595, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.43% (0.5105 => 0.5331, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.40% (0.4203 => 0.4388, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 4.40% (0.3092 => 0.3228, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 4.37% (0.6456 => 0.6738, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.35% (0.9765 => 1.0190, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 4.27% (0.4048 => 0.4221, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.26% (1.1861 => 1.2366, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.24% (1.5415 => 1.6068, std. dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.16% (0.6675 => 0.6953, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 3.97% (3.8723 => 4.0259, std. dev.: 0.0321) MultiSource/Benchmarks/sim/sim: 3.84% (0.3387 => 0.3517, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.69% (1.4186 => 1.4709, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.63% (0.5981 => 0.6198, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 3.59% (0.8921 => 0.9241, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.47% (0.5020 => 0.5194, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (14.3668 => 14.8555, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.37% (1.5859 => 1.6394, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.83% (2.2024 => 2.2647, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.81% (1.1840 => 1.2173, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (7.9617 => 8.1572, std. dev.: 0.0211) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.46% (0.8101 => 0.8219, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.18% (4.2280 => 4.4471, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (3.6395 => 3.7465, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5654, std. dev.: 0.0211) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5313, std. dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7978, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1578 => 3.1967, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.22% (6.5088 => 6.5880, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1305, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.93% (5.2763 => 3.2224, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.35% (5.3855 => 3.7508, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.94% (5.3526 => 3.7502, std. dev.: 0.0086) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1300, std. dev.: 0.0264) MultiSource/Applications/ClamAV/clamscan: -13.59% (22.1758 => 19.1617, std. dev.: 0.4292) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.34% (2.9384 => 2.5758, std. dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.2373 => 1.0998, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -7.16% (1.5373 => 1.4273, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -6.08% (1.1396 => 1.0703, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -3.42% (3.1595 => 3.0515, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4675, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4154, std. dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.64% (10.2830 => 10.0111, std. dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (8.1563 => 7.9584, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std. dev.: 0.0132) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4199, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3500, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.09% (1.7254 => 1.7066, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 02:47:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 04:47:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827094743.9BC0F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3228?compare_to=3226&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3228, Order: 162660, Start Time: 2012-08-27 08:34:36, End Time: 2012-08-27 09:48:39 To: 3226, Order: 162654, Start Time: 2012-08-27 06:49:11, End Time: 2012-08-27 08:06:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (158 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.17% (1.4236 => 1.4403, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.83% (3.8942 => 3.7841, std. dev.: 0.0411) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.27% (2.0176 => 2.3256, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 11.29% (0.5818 => 0.6475, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.24% (0.5748 => 0.6394, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.82% (0.3578 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3601 => 0.3982, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3646 => 0.4031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3623 => 0.4004, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.51% (0.3663 => 0.4048, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.48% (0.7061 => 0.7801, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3650 => 0.4032, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.24% (0.3789 => 0.4177, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3914 => 0.4313, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.92% (0.3940 => 0.4331, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.92% (0.4003 => 0.4400, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.83% (0.4328 => 0.4710, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.74% (0.2781 => 0.3024, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.63% (0.2782 => 0.3022, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 8.45% (1.3693 => 1.4850, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.32% (0.2607 => 0.2824, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.29% (0.2690 => 0.2913, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.25% (0.1819 => 0.1969, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.22% (0.4062 => 0.4396, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2628 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.17% (0.2655 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.15% (0.2761 => 0.2986, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.11% (0.7710 => 0.8335, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.06% (3.9660 => 4.2858, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.04% (0.3022 => 0.3265, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.04% (0.2937 => 0.3173, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.97% (0.2696 => 0.2911, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.97% (0.2760 => 0.2980, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.92% (0.2726 => 0.2942, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2765 => 0.2984, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.91% (1.9828 => 2.1397, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary: 7.79% (0.3107 => 0.3349, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.79% (0.2966 => 0.3197, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.78% (0.3149 => 0.3394, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.62% (0.3899 => 0.4196, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.52% (0.3485 => 0.3747, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.51% (0.3580 => 0.3849, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3489 => 0.3751, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2596 => 0.2789, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 7.43% (0.2988 => 0.3210, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.43% (0.5265 => 0.5656, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 7.42% (0.3192 => 0.3429, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.42% (0.7038 => 0.7560, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.18% (0.3453 => 0.3701, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.08% (0.3293 => 0.3526, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.06% (1.2193 => 1.3054, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.00% (0.6959 => 0.7446, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.97% (0.9199 => 0.9840, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.4379 => 0.4681, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4390 => 0.4691, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3868 => 0.4133, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3534 => 0.3775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.69% (0.2945 => 0.3142, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.60% (0.3756 => 0.4004, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.57% (0.4016 => 0.4280, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.54% (0.1789 => 0.1906, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.42% (0.1588 => 0.1690, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.39% (0.2127 => 0.2263, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (1.1364 => 1.2082, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.19% (0.3246 => 0.3447, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.15% (0.5577 => 0.5920, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.08% (13.8202 => 14.6606, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 6.05% (1.2292 => 1.3036, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.04% (0.2914 => 0.3090, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.03% (0.5637 => 0.5977, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 5.88% (0.2243 => 0.2375, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (7.2180 => 7.6416, std. dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.79% (0.1865 => 0.1973, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.77% (1.4563 => 1.5404, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.67% (0.3755 => 0.3968, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.45% (0.7506 => 0.7915, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 5.42% (3.8646 => 4.0740, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.41% (1.3819 => 1.4567, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.38% (1.1061 => 1.1656, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.32% (0.8310 => 0.8752, std. dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.7460 => 0.7855, std. dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 5.28% (0.2995 => 0.3153, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (1.3813 => 1.4540, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.20% (1.3245 => 1.3934, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.13% (3.6692 => 3.8574, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 5.06% (1.0594 => 1.1130, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2140 => 0.2248, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.01% (0.6283 => 0.6598, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.01% (0.4113 => 0.4319, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (4.3801 => 4.5982, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.97% (4.4433 => 4.6643, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 4.97% (0.3220 => 0.3380, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.86% (0.4791 => 0.5024, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.82% (0.6135 => 0.6431, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (13.2842 => 13.9202, std. dev.: 0.0273) MultiSource/Applications/treecc/treecc: 4.74% (1.9270 => 2.0184, std. dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 4.60% (16.6129 => 17.3767, std. dev.: 0.0130) MultiSource/Applications/siod/siod: 4.59% (2.1791 => 2.2792, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.37% (0.8818 => 0.9203, std. dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 4.31% (14.8535 => 15.4940, std. dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.29% (0.8698 => 0.9071, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.13% (0.3245 => 0.3379, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.09% (0.3131 => 0.3259, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.00% (4.9865 => 5.1862, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.93% (1.1333 => 1.1778, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.86% (3.1889 => 3.3119, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 3.75% (8.4961 => 8.8149, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 3.67% (6.5754 => 6.8165, std. dev.: 0.0145) MultiSource/Benchmarks/Olden/bh/bh: 3.64% (0.2859 => 0.2963, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.63% (4.6629 => 4.8321, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.49% (3.2742 => 3.3885, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 3.21% (14.5298 => 14.9967, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.02% (0.6250 => 0.6439, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.02% (16.2614 => 16.7519, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.94% (1.5188 => 1.5634, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.67% (0.9108 => 0.9351, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (6.2785 => 6.4261, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.1007 => 2.1468, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.16% (0.4805 => 0.4909, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.16% (3.7467 => 3.8277, std. dev.: 0.0128) MultiSource/Applications/minisat/minisat: 2.03% (0.6744 => 0.6881, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.98% (33.2944 => 33.9551, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.90% (1.0313 => 1.0509, std. dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5118, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 24.77% (1.8175 => 2.2677, std. dev.: 0.0413) SingleSource/Benchmarks/Misc/mandel-2: 10.81% (1.2998 => 1.4403, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6592, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7420, std. dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3835, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5940, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.19% (10.7476 => 10.9831, std. dev.: 0.0336) MultiSource/Applications/siod/siod: 2.06% (3.2729 => 3.3403, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.01% (1.4298 => 1.4585, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5089 => 1.5309, std. dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1836, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.03% (4.5928 => 4.6400, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.58% (22.5627 => 21.3040, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0973, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std. dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -3.20% (1.1560 => 1.1190, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (8.8259 => 8.5932, std. dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2277, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: -1.81% (5.3167 => 5.2205, std. dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9738, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2071, std. dev.: 0.0343) SingleSource/Benchmarks/Misc/ReedSolomon: -1.66% (7.1097 => 6.9920, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std. dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7919, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4224, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4768, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.06% (20.3410 => 20.1258, std. dev.: 0.0206) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 03:04:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 05:04:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827100421.2C5752A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3229?compare_to=3227&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3229, Order: 162661, Start Time: 2012-08-27 08:44:39, End Time: 2012-08-27 10:04:37 To: 3227, Order: 162654, Start Time: 2012-08-27 06:49:14, End Time: 2012-08-27 08:12:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (136 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (701 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5599 => 56.4381, std. dev.: 0.1727) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.80% (0.8787 => 0.8629, std. dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: -1.48% (13.6414 => 13.4398, std. dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.64% (10.3673 => 13.4398, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 14.54% (0.3473 => 0.3978, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.45% (0.3543 => 0.4055, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.36% (0.3497 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.27% (0.3561 => 0.4069, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3543 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3516 => 0.4014, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3694 => 0.4199, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.47% (0.3927 => 0.4456, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.43% (0.3828 => 0.4342, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.15% (0.3886 => 0.4397, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.14% (1.1194 => 1.2665, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.44% (1.7609 => 1.9799, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 10.41% (0.1432 => 0.1581, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.25% (2.2022 => 2.4280, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 8.74% (0.5925 => 0.6443, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.28% (0.3177 => 0.3440, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.14% (0.1584 => 0.1713, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 7.77% (0.1622 => 0.1748, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7326 => 0.7894, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.51% (0.1892 => 0.2034, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 6.98% (0.3282 => 0.3511, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.91% (0.4615 => 0.4934, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.53% (7.0540 => 7.5149, std. dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 6.47% (0.1655 => 0.1762, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.14% (0.1695 => 0.1799, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.06% (9.4845 => 10.0594, std. dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.86% (4.9449 => 5.2346, std. dev.: 0.0130) MultiSource/Applications/lambda-0_1_3/lambda: 5.81% (0.7433 => 0.7865, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.80% (5.0018 => 5.2918, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: 5.79% (0.2554 => 0.2702, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.77% (0.4299 => 0.4547, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.8172 => 0.8629, std. dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2271 => 0.2397, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.52% (0.3423 => 0.3612, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.51% (1.5603 => 1.6462, std. dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.41% (0.4636 => 0.4887, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 5.37% (0.3109 => 0.3276, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.31% (0.1940 => 0.2043, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.24% (0.5569 => 0.5861, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 5.19% (0.7835 => 0.8242, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.17% (0.5860 => 0.6163, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.16% (4.2646 => 4.4847, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (10.4361 => 10.9723, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.05% (0.5105 => 0.5363, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.01% (1.3050 => 1.3704, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.88% (8.1363 => 8.5330, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2756 => 0.2890, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.84% (0.2891 => 0.3031, std. dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2905 => 0.3045, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 4.78% (0.4289 => 0.4494, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.76% (0.8067 => 0.8451, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.75% (0.4103 => 0.4298, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.68% (0.3826 => 0.4005, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.67% (0.2700 => 0.2826, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 4.63% (0.2831 => 0.2962, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 4.62% (0.3098 => 0.3241, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 4.58% (0.3232 => 0.3380, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 4.56% (5.7591 => 6.0217, std. dev.: 0.0159) MultiSource/Benchmarks/Olden/bh/bh: 4.53% (0.3092 => 0.3232, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.53% (0.2872 => 0.3002, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.51% (0.2725 => 0.2848, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3865 => 0.4039, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2871 => 0.3000, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.47% (0.3422 => 0.3575, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 4.42% (0.3052 => 0.3187, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.42% (0.3283 => 0.3428, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.40% (0.3162 => 0.3301, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.35% (2.0665 => 2.1564, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 4.35% (0.2714 => 0.2832, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.34% (0.6450 => 0.6730, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2758 => 0.2877, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.30% (0.2793 => 0.2913, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3650 => 0.3806, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.24% (0.3136 => 0.3269, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 4.24% (0.2877 => 0.2999, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.22% (0.9765 => 1.0177, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (0.4064 => 0.4235, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.19% (1.1642 => 1.2130, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.16% (1.1861 => 1.2355, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.16% (1.5415 => 1.6056, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 4.14% (0.2802 => 0.2918, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.14% (0.3603 => 0.3752, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.12% (0.3935 => 0.4097, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.07% (0.6675 => 0.6947, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 4.00% (0.6456 => 0.6714, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2842 => 1.3351, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 3.91% (0.3684 => 0.3828, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.90% (0.3387 => 0.3519, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.85% (2.0273 => 2.1053, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.81% (0.4620 => 0.4796, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.80% (1.1840 => 1.2290, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.78% (0.4048 => 0.4201, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4203 => 0.4360, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.73% (3.8723 => 4.0167, std. dev.: 0.0093) MultiSource/Applications/d/make_dparser: 3.66% (3.3354 => 3.4575, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.64% (0.5981 => 0.6199, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.56% (1.4186 => 1.4691, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (14.3668 => 14.8522, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (0.8921 => 0.9222, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 3.33% (2.2969 => 2.3735, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.20% (1.5859 => 1.6366, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.17% (0.5020 => 0.5179, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.71% (2.2024 => 2.2621, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.66% (17.1811 => 17.6382, std. dev.: 0.0200) MultiSource/Applications/minisat/minisat: 2.60% (0.7115 => 0.7300, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (7.9617 => 8.1577, std. dev.: 0.0124) MultiSource/Applications/lemon/lemon: 2.18% (1.0722 => 1.0956, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.16% (21.9371 => 22.4117, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.39% (0.8101 => 0.8214, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9575, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.15% (4.2280 => 4.4458, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (3.6395 => 3.7475, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 1.75% (3.2827 => 3.3400, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5086 => 1.5336, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.58% (26.0924 => 26.5058, std. dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.33% (9.1159 => 9.2371, std. dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/hash2: 1.30% (3.1578 => 3.1987, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.07% (2.6546 => 2.6829, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5768, std. dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2301, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.37% (5.3855 => 3.7499, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.92% (5.3526 => 3.7513, std. dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -14.88% (54.1659 => 46.1043, std. dev.: 0.0411) MultiSource/Applications/ClamAV/clamscan: -13.73% (22.1758 => 19.1320, std. dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.37% (2.9384 => 2.5748, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: -11.17% (1.2373 => 1.0991, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -6.95% (1.5373 => 1.4304, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0511, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4722, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4231, std. dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.69% (10.2830 => 10.0068, std. dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9625, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5111, std. dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (12.5348 => 12.3488, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8127, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (1.6805 => 1.6631, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 03:56:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 05:56:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120827105652.32D422A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3230?compare_to=3225&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3230, Order: 162659, Start Time: 2012-08-27 08:14:09, End Time: 2012-08-27 10:57:51 To: 3225, Order: 162653, Start Time: 2012-08-27 05:01:31, End Time: 2012-08-27 07:46:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (111 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 951 (767 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.53% (2.0202 => 2.1319, std. dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -7.59% (0.2306 => 0.2131, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.03% (2.3073 => 2.2836, std. dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.09% (0.3446 => 0.3966, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 14.96% (0.3442 => 0.3957, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.86% (0.3465 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.83% (0.3460 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.79% (0.3488 => 0.4004, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 14.79% (0.3496 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.73% (0.3469 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.22% (0.3643 => 0.4161, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.16% (0.3650 => 0.4167, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 13.88% (0.3724 => 0.4241, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5826 => 0.6354, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.63% (0.5889 => 0.6397, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.15% (0.1620 => 0.1752, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.01% (0.7171 => 0.7674, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 6.84% (1.5932 => 1.7022, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.83% (3.5627 => 3.8061, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (1.6211 => 1.7286, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2875 => 0.3053, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.16% (1.3152 => 1.3962, std. dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (0.2014 => 0.2138, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.13% (0.3004 => 0.3188, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2738 => 0.2901, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (0.4361 => 0.4617, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3195 => 0.3382, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.84% (0.2792 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.83% (0.2729 => 0.2888, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.78% (0.2750 => 0.2909, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.77% (0.4994 => 0.5282, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.5900 => 0.6237, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2911 => 0.3077, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.67% (0.2803 => 0.2962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.3096 => 0.3271, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.65% (0.2813 => 0.2972, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.64% (0.9909 => 1.0468, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (0.5000 => 0.5282, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.63% (0.2823 => 0.2982, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.61% (2.0673 => 2.1833, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.59% (0.2811 => 0.2968, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.58% (0.2780 => 0.2935, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.51% (0.4029 => 0.4251, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.46% (0.9697 => 1.0226, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 5.42% (0.3267 => 0.3444, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3258 => 0.3433, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.34% (4.2109 => 4.4359, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: 5.34% (0.3317 => 0.3494, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.24% (0.3282 => 0.3454, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 5.24% (1.0781 => 1.1346, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (0.5026 => 0.5289, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.16% (0.3060 => 0.3218, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.13% (2.7292 => 2.8692, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.12% (0.3124 => 0.3284, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.11% (0.3678 => 0.3866, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 5.11% (0.3348 => 0.3519, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.06% (0.3362 => 0.3532, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.02% (0.3625 => 0.3807, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.99% (0.3726 => 0.3912, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.95% (0.2866 => 0.3008, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.86% (0.3477 => 0.3646, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.2736 => 0.2867, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.70% (1.9694 => 2.0619, std. dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.59% (1.9966 => 2.0883, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.55% (0.3690 => 0.3858, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.51% (0.4146 => 0.4333, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 4.49% (0.4251 => 0.4442, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.45% (0.3890 => 0.4063, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.40% (0.2566 => 0.2679, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.29% (0.4658 => 0.4858, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.27% (0.3981 => 0.4151, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (2.1013 => 2.1901, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 4.22% (5.5417 => 5.7755, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.3903 => 0.4060, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.95% (4.6177 => 4.8000, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.93% (4.4195 => 4.5933, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 3.91% (1.8794 => 1.9528, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 3.81% (2.1653 => 2.2479, std. dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.5012 => 0.5201, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.72% (0.4139 => 0.4293, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 3.65% (1.4269 => 1.4790, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.3271 => 0.3386, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.48% (0.6435 => 0.6659, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.34% (0.7875 => 0.8138, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.3084 => 0.3186, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.28% (0.5546 => 0.5728, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 3.27% (23.5202 => 24.2888, std. dev.: 0.0218) MultiSource/Applications/siod/siod: 3.14% (0.6634 => 0.6842, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.82% (2.0346 => 2.0717, std. dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6776, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1714, std. dev.: 0.0540) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6328, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.40% (2.0820 => 2.1319, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1946, std. dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5052, std. dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2264, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4403, std. dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2808, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5847, std. dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.05% (2.4764 => 2.4009, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5559, std. dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ary2: -9.37% (0.2402 => 0.2177, std. dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: -7.73% (28.1477 => 25.9731, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8102, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std. dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7913, std. dev.: 0.0143) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0047) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7852, std. dev.: 0.0596) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5688, std. dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9677, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 04:29:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 06:29:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827112920.9B11A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3231?compare_to=3228&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3231, Order: 162664, Start Time: 2012-08-27 10:16:09, End Time: 2012-08-27 11:30:19 To: 3228, Order: 162660, Start Time: 2012-08-27 08:34:36, End Time: 2012-08-27 09:48:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (159 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (695 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.88% (2.0176 => 2.3379, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.88% (0.5818 => 0.6509, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.80% (0.5748 => 0.6426, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.38% (0.3578 => 0.3985, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.20% (0.7061 => 0.7852, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 11.14% (0.3646 => 0.4052, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-2: 11.11% (0.3601 => 0.4001, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.08% (0.3663 => 0.4069, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.99% (0.3650 => 0.4051, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.99% (0.3623 => 0.4021, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.79% (0.3789 => 0.4198, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3914 => 0.4332, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.4003 => 0.4424, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.38% (0.3940 => 0.4349, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.92% (0.4328 => 0.4714, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.87% (1.3693 => 1.4908, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 8.81% (0.2781 => 0.3026, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.81% (0.2782 => 0.3027, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.78% (0.1413 => 0.1537, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.55% (0.2607 => 0.2830, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.55% (0.2690 => 0.2920, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.40% (3.9660 => 4.2990, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/fibo: 8.33% (0.2628 => 0.2847, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.32% (0.2655 => 0.2876, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.31% (0.7710 => 0.8351, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 8.30% (0.4062 => 0.4399, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 8.29% (0.2761 => 0.2990, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.25% (0.1819 => 0.1969, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.21% (0.2937 => 0.3178, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.17% (0.3022 => 0.3269, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.10% (0.2765 => 0.2989, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.09% (0.2696 => 0.2914, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2760 => 0.2983, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.00% (0.2726 => 0.2944, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.97% (1.9828 => 2.1409, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.92% (0.2966 => 0.3201, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.3899 => 0.4207, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.88% (0.3149 => 0.3397, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.86% (0.2596 => 0.2800, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 7.85% (0.3107 => 0.3351, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.72% (0.7038 => 0.7581, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.71% (0.5265 => 0.5671, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.71% (0.3580 => 0.3856, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.66% (0.2988 => 0.3217, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.63% (0.3485 => 0.3751, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.3489 => 0.3754, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3192 => 0.3431, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.32% (0.9199 => 0.9872, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 7.30% (0.3453 => 0.3705, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.19% (1.2193 => 1.3070, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3293 => 0.3527, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 7.03% (0.3868 => 0.4140, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.98% (0.6959 => 0.7445, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 6.93% (0.3534 => 0.3779, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4390 => 0.4693, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 6.86% (0.2945 => 0.3147, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.1588 => 0.1696, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.75% (0.4016 => 0.4287, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.74% (0.3756 => 0.4009, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.71% (1.1364 => 1.2126, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.68% (0.2127 => 0.2269, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.49% (0.5577 => 0.5939, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 6.34% (13.8202 => 14.6961, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 6.29% (1.2292 => 1.3065, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.2914 => 0.3097, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.19% (0.5637 => 0.5986, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.17% (0.1865 => 0.1980, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.12% (0.2925 => 0.3104, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.09% (7.2180 => 7.6579, std. dev.: 0.0117) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.08% (0.2023 => 0.2146, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.04% (1.4563 => 1.5443, std. dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 6.02% (0.2243 => 0.2378, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.83% (0.3755 => 0.3974, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.81% (0.7506 => 0.7942, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 5.73% (1.1061 => 1.1695, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.59% (1.3245 => 1.3985, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.54% (3.8646 => 4.0788, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.53% (1.3819 => 1.4583, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.49% (1.3813 => 1.4571, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.47% (0.4113 => 0.4338, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.40% (3.6692 => 3.8675, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.40% (0.8310 => 0.8759, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 5.38% (0.2995 => 0.3156, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.36% (0.7460 => 0.7860, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 5.31% (0.3220 => 0.3391, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 5.29% (1.0594 => 1.1154, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.28% (4.3801 => 4.6115, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.26% (0.4791 => 0.5043, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.21% (4.4433 => 4.6749, std. dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.6283 => 0.6606, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.14% (1.9270 => 2.0260, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.09% (0.6135 => 0.6447, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (13.2842 => 13.9352, std. dev.: 0.0144) MultiSource/Applications/siod/siod: 4.90% (2.1791 => 2.2858, std. dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.89% (0.8818 => 0.9249, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.84% (16.6129 => 17.4176, std. dev.: 0.0343) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.62% (0.8698 => 0.9100, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.61% (14.8535 => 15.5387, std. dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 4.47% (0.3131 => 0.3271, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.28% (1.1333 => 1.1818, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.19% (0.3245 => 0.3381, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 4.10% (3.1889 => 3.3195, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 4.06% (0.2859 => 0.2975, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (8.4961 => 8.8388, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 3.86% (6.5754 => 6.8290, std. dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.9865 => 5.1785, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.51% (3.2742 => 3.3891, std. dev.: 0.0172) MultiSource/Applications/oggenc/oggenc: 3.48% (4.6629 => 4.8254, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.31% (14.5298 => 15.0114, std. dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/bigfib: 3.22% (0.6250 => 0.6451, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.19% (16.2614 => 16.7804, std. dev.: 0.0228) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.99% (0.9108 => 0.9380, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.97% (1.5188 => 1.5639, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.52% (6.2785 => 6.4368, std. dev.: 0.0033) MultiSource/Applications/lua/lua: 2.44% (3.7467 => 3.8383, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (2.1007 => 2.1503, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.31% (0.4805 => 0.4916, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.27% (0.6744 => 0.6897, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.07% (1.0313 => 1.0526, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.01% (33.2944 => 33.9642, std. dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 1.71% (1.2749 => 1.2967, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2621, std. dev.: 0.0542) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 9.69% (1.2998 => 1.4258, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.87% (1.5824 => 1.6594, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.39% (11.2619 => 11.7563, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7765, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3849, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6025, std. dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 2.28% (10.7476 => 10.9924, std. dev.: 0.0461) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.03% (3.2729 => 3.3395, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.95% (1.4298 => 1.4577, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.00% (3.1071 => 3.1383, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6388, std. dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -9.79% (0.4657 => 0.4201, std. dev.: 0.0135) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.32% (22.5627 => 21.3633, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2308 => 1.0977, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -3.18% (1.1560 => 1.1192, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5870, std. dev.: 0.0222) MultiSource/Benchmarks/Olden/bh/bh: -2.43% (1.9762 => 1.9281, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9715, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2434, std. dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2032, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.69% (5.3167 => 5.2267, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9925, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7921, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4213, std. dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.09% (20.3410 => 20.1193, std. dev.: 0.0097) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2413, std. dev.: 0.0053) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 04:52:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 06:52:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827115207.B8D442A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3232?compare_to=3229&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3232, Order: 162664, Start Time: 2012-08-27 10:33:29, End Time: 2012-08-27 11:53:06 To: 3229, Order: 162661, Start Time: 2012-08-27 08:44:39, End Time: 2012-08-27 10:04:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (702 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.62% (10.3673 => 13.4378, std. dev.: 0.0192) SingleSource/UnitTests/ObjC/trivial-interface: 14.54% (0.3473 => 0.3978, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 14.38% (0.3497 => 0.4000, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3561 => 0.4067, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3516 => 0.4014, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.14% (0.3543 => 0.4044, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.11% (0.3543 => 0.4043, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3694 => 0.4197, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.43% (0.3828 => 0.4342, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3927 => 0.4452, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.28% (1.1194 => 1.2681, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 13.15% (0.3886 => 0.4397, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.45% (1.7609 => 1.9801, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 10.41% (0.1432 => 0.1581, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.30% (2.2022 => 2.4291, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1584 => 0.1712, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.61% (0.1892 => 0.2036, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.48% (0.7326 => 0.7874, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2065 => 0.2219, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 7.27% (0.1622 => 0.1740, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 7.10% (0.3282 => 0.3515, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 6.53% (0.1655 => 0.1763, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.52% (0.4615 => 0.4916, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.30% (7.0540 => 7.4984, std. dev.: 0.0151) MultiSource/Benchmarks/Olden/em3d/em3d: 6.19% (0.1695 => 0.1800, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.01% (0.7433 => 0.7880, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (9.4845 => 10.0495, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.91% (4.9449 => 5.2373, std. dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: 5.87% (0.2554 => 0.2704, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.78% (5.0018 => 5.2908, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 5.68% (0.4299 => 0.4543, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.57% (0.1940 => 0.2048, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.55% (0.2107 => 0.2224, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2271 => 0.2397, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.46% (0.8172 => 0.8618, std. dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 5.44% (0.3109 => 0.3278, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3121 => 0.3288, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (4.2646 => 4.4896, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.20% (0.4636 => 0.4877, std. dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (10.4361 => 10.9721, std. dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.07% (0.2700 => 0.2837, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.04% (0.7835 => 0.8230, std. dev.: 0.0030) MultiSource/Applications/hbd/hbd: 5.02% (1.5603 => 1.6387, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.98% (0.5860 => 0.6152, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.97% (1.3050 => 1.3699, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.95% (0.2891 => 0.3034, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 4.94% (0.4289 => 0.4501, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 4.94% (0.3423 => 0.3592, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.90% (0.4103 => 0.4304, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.5569 => 0.5839, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 4.78% (0.2905 => 0.3044, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2831 => 0.2965, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.71% (8.1363 => 8.5194, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.5105 => 0.5339, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 4.58% (0.3232 => 0.3380, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.57% (0.2756 => 0.2882, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.55% (0.3098 => 0.3239, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.53% (5.7591 => 6.0198, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: 4.49% (0.2871 => 0.3000, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.49% (0.2872 => 0.3001, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.48% (0.3865 => 0.4038, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.46% (0.3052 => 0.3188, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.45% (0.6450 => 0.6737, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.45% (0.3441 => 0.3594, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 4.42% (0.3283 => 0.3428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.40% (0.3162 => 0.3301, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.37% (0.2793 => 0.2915, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.32% (0.9765 => 1.0187, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.32% (2.0665 => 2.1558, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.31% (0.3826 => 0.3991, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 4.31% (0.2714 => 0.2831, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.30% (0.3136 => 0.3271, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 4.28% (0.2877 => 0.3000, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3650 => 0.3806, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3422 => 0.3568, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (1.5415 => 1.6071, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 4.25% (0.2802 => 0.2921, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2758 => 0.2875, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.23% (0.4064 => 0.4236, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.22% (0.3603 => 0.3755, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.21% (1.1861 => 1.2360, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.3092 => 0.3222, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.09% (0.3935 => 0.4096, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.07% (0.3684 => 0.3834, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.07% (0.8067 => 0.8395, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.06% (0.6675 => 0.6946, std. dev.: 0.0047) MultiSource/Applications/Burg/burg: 4.01% (1.1642 => 1.2109, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 3.97% (0.3379 => 0.3513, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.90% (0.6456 => 0.6708, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 3.87% (0.3387 => 0.3518, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.4048 => 0.4203, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.82% (1.4186 => 1.4728, std. dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 3.81% (1.2842 => 1.3331, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.81% (0.4203 => 0.4363, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.79% (0.4620 => 0.4795, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.77% (2.0273 => 2.1037, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 3.76% (3.8723 => 4.0179, std. dev.: 0.0158) MultiSource/Applications/d/make_dparser: 3.73% (3.3354 => 3.4597, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.39% (14.3668 => 14.8539, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 3.37% (0.8921 => 0.9222, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.36% (2.2969 => 2.3740, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.34% (0.5981 => 0.6181, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.20% (1.5859 => 1.6366, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.19% (0.5020 => 0.5180, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.87% (0.7115 => 0.7319, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 2.81% (1.1840 => 1.2173, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.80% (2.2024 => 2.2640, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 2.72% (17.1811 => 17.6483, std. dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.53% (7.9617 => 8.1630, std. dev.: 0.0076) MultiSource/Applications/lemon/lemon: 2.22% (1.0722 => 1.0960, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.09% (21.9371 => 22.3965, std. dev.: 0.0221) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.27% (0.8101 => 0.8204, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.10% (4.2280 => 4.4435, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7507, std. dev.: 0.0043) MultiSource/Applications/lua/lua: 1.75% (26.0924 => 26.5487, std. dev.: 0.0345) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3398, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.49% (0.9540 => 0.9682, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (1.5086 => 1.5301, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2360, std. dev.: 0.0376) SingleSource/Benchmarks/Shootout-C++/hash2: 1.27% (3.1578 => 3.1979, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.74% (5.2763 => 3.2323, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.36% (5.3855 => 3.7503, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.96% (5.3526 => 3.7491, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1201, std. dev.: 0.0243) MultiSource/Applications/ClamAV/clamscan: -13.74% (22.1758 => 19.1296, std. dev.: 0.0335) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.41% (2.9384 => 2.5738, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.37% (1.2373 => 1.1090, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -7.10% (1.5373 => 1.4281, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/richards_benchmark: -6.06% (1.1396 => 1.0705, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std. dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0021) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4672, std. dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4125, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9899, std. dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9655, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3279, std. dev.: 0.0096) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.08% (1.4460 => 1.4304, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.03% (1.8329 => 1.8141, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 06:11:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 08:11:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827131117.C0C512A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3233?compare_to=3231&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3233, Order: 162665, Start Time: 2012-08-27 11:58:02, End Time: 2012-08-27 13:12:14 To: 3231, Order: 162664, Start Time: 2012-08-27 10:16:09, End Time: 2012-08-27 11:30:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (159 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.89% (2.0176 => 2.3381, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 11.92% (0.7061 => 0.7903, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.89% (0.5818 => 0.6510, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.80% (0.5748 => 0.6426, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3578 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.08% (0.3646 => 0.4050, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.08% (0.3601 => 0.4000, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3650 => 0.4052, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.97% (0.3663 => 0.4065, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.96% (0.3623 => 0.4020, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.79% (0.3789 => 0.4198, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.73% (0.3914 => 0.4334, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.4003 => 0.4422, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.41% (0.3940 => 0.4350, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.87% (0.7710 => 0.8394, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 8.86% (1.3693 => 1.4906, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 8.85% (0.4328 => 0.4711, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2781 => 0.3027, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.84% (0.2782 => 0.3028, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.78% (0.1413 => 0.1537, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 8.59% (0.2607 => 0.2831, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.48% (0.2690 => 0.2918, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.1819 => 0.1973, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2628 => 0.2848, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.32% (0.4062 => 0.4400, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 8.29% (0.2761 => 0.2990, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.29% (0.2655 => 0.2875, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.27% (0.2937 => 0.3180, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.18% (3.9660 => 4.2904, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 8.15% (0.2760 => 0.2985, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.14% (0.3022 => 0.3268, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.06% (1.9828 => 2.1427, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.05% (0.2696 => 0.2913, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.03% (0.2765 => 0.2987, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.00% (0.2726 => 0.2944, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.96% (0.2966 => 0.3202, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.95% (0.3107 => 0.3354, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.94% (0.2596 => 0.2802, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 7.91% (0.3149 => 0.3398, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.72% (0.3899 => 0.4200, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.71% (0.3580 => 0.3856, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.66% (0.3485 => 0.3752, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3489 => 0.3755, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.58% (0.3192 => 0.3434, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.56% (0.2988 => 0.3214, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.56% (0.5265 => 0.5663, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 7.50% (0.7038 => 0.7566, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.44% (0.9199 => 0.9883, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 7.36% (0.3453 => 0.3707, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.15% (1.2193 => 1.3065, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.4379 => 0.4690, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.08% (0.3868 => 0.4142, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.05% (0.3293 => 0.3525, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.99% (0.3534 => 0.3781, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.95% (0.4390 => 0.4695, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.86% (0.1588 => 0.1697, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.86% (0.2945 => 0.3147, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.83% (0.6959 => 0.7434, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.72% (0.4016 => 0.4286, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.60% (0.3756 => 0.4004, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.58% (0.2127 => 0.2267, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.55% (1.1364 => 1.2108, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.44% (0.5577 => 0.5936, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.32% (1.2292 => 1.3069, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.23% (13.8202 => 14.6818, std. dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (0.2914 => 0.3093, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 6.12% (0.2925 => 0.3104, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.08% (0.2023 => 0.2146, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (7.2180 => 7.6561, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.07% (0.5637 => 0.5979, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.00% (1.4563 => 1.5437, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.91% (0.3246 => 0.3438, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.78% (0.3755 => 0.3972, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.75% (0.2243 => 0.2372, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.74% (0.7506 => 0.7937, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.49% (0.4113 => 0.4339, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 5.47% (3.8646 => 4.0760, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.44% (1.3245 => 1.3965, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.40% (1.1061 => 1.1658, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.39% (1.3819 => 1.4564, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.36% (1.3813 => 1.4553, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.34% (0.7460 => 0.7858, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.32% (0.4791 => 0.5046, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (3.6692 => 3.8636, std. dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: 5.28% (0.2995 => 0.3153, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.27% (0.8310 => 0.8748, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.24% (1.0594 => 1.1149, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.19% (0.6283 => 0.6609, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.14% (4.3801 => 4.6053, std. dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 5.06% (0.3220 => 0.3383, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (4.4433 => 4.6681, std. dev.: 0.0089) MultiSource/Applications/treecc/treecc: 4.97% (1.9270 => 2.0227, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.96% (0.6135 => 0.6439, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (13.2842 => 13.9385, std. dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.84% (0.8818 => 0.9245, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3939, std. dev.: 0.0072) MultiSource/Applications/siod/siod: 4.69% (2.1791 => 2.2813, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 4.54% (14.8535 => 15.5272, std. dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.39% (0.8698 => 0.9080, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.18% (0.3131 => 0.3262, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.14% (1.1333 => 1.1802, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.10% (0.3245 => 0.3378, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.97% (3.1889 => 3.3156, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (8.4961 => 8.8323, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.2859 => 0.2970, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.9865 => 5.1783, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (6.5754 => 6.8243, std. dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 3.61% (4.6629 => 4.8310, std. dev.: 0.0074) MultiSource/Applications/ClamAV/clamscan: 3.36% (14.5298 => 15.0179, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.30% (3.2742 => 3.3822, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 3.26% (0.6250 => 0.6454, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 3.13% (16.2614 => 16.7696, std. dev.: 0.0220) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.83% (0.9108 => 0.9366, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.79% (1.5188 => 1.5611, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.57% (6.2785 => 6.4397, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.25% (0.6744 => 0.6896, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.22% (3.7467 => 3.8297, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.14% (0.4805 => 0.4908, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.97% (1.0313 => 1.0516, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.91% (33.2944 => 33.9319, std. dev.: 0.0104) MultiSource/Applications/SIBsim4/SIBsim4: 1.74% (1.2749 => 1.2971, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 24.93% (1.8175 => 2.2706, std. dev.: 0.0446) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 9.99% (1.2998 => 1.4297, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.84% (1.5824 => 1.6590, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7426, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-6: 3.30% (1.9199 => 1.9833, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.72% (1.7688 => 1.8169, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4271 => 7.6114, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.22% (10.7476 => 10.9865, std. dev.: 0.0051) MultiSource/Applications/lemon/lemon: 2.14% (1.4298 => 1.4604, std. dev.: 0.0047) MultiSource/Applications/siod/siod: 2.06% (3.2729 => 3.3402, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5177, std. dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5089 => 1.5310, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5726, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6848, std. dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.02% (4.5928 => 4.6395, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.41% (22.5627 => 21.3423, std. dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.16% (0.3511 => 0.3400, std. dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.17% (1.2308 => 1.1056, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.21% (0.3139 => 0.3007, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.94% (1.3780 => 1.3237, std. dev.: 0.0070) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -3.21% (1.1560 => 1.1189, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5841, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -2.45% (1.9762 => 1.9277, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -2.03% (5.3167 => 5.2089, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2305, std. dev.: 0.0047) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9714, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3305 => 7.2003, std. dev.: 0.0233) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std. dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.20% (5.5401 => 5.4738, std. dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4336, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 06:39:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 08:39:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827133927.B688F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3234?compare_to=3232&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3234, Order: 162665, Start Time: 2012-08-27 12:21:04, End Time: 2012-08-27 13:40:25 To: 3232, Order: 162664, Start Time: 2012-08-27 10:33:29, End Time: 2012-08-27 11:53:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (134 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (704 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.67% (56.5356 => 54.4606, std. dev.: 0.7192) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.64% (10.3673 => 13.4403, std. dev.: 0.0168) SingleSource/UnitTests/ObjC/trivial-interface: 14.48% (0.3473 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.25% (0.3516 => 0.4017, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3561 => 0.4067, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3543 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.17% (0.3543 => 0.4045, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.15% (0.3497 => 0.3992, std. dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 13.75% (0.3694 => 0.4202, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.38% (0.3828 => 0.4340, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3927 => 0.4452, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.23% (0.3886 => 0.4400, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.11% (1.1194 => 1.2662, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.44% (1.7609 => 1.9800, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 10.41% (0.1432 => 0.1581, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.29% (2.2022 => 2.4288, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.62% (0.6030 => 0.6550, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1584 => 0.1712, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7326 => 0.7902, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.3177 => 0.3419, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.56% (0.1892 => 0.2035, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 7.27% (0.1622 => 0.1740, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 7.07% (0.3282 => 0.3514, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.4879 => 0.5209, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.73% (0.1695 => 0.1809, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.8172 => 0.8704, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 6.47% (0.1655 => 0.1762, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.44% (0.4615 => 0.4912, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.42% (7.0540 => 7.5070, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.99% (0.2554 => 0.2707, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (9.4845 => 10.0492, std. dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: 5.88% (0.7433 => 0.7870, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.88% (4.9449 => 5.2355, std. dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 5.84% (0.4299 => 0.4550, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.75% (5.0018 => 5.2892, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1940 => 0.2046, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 5.44% (0.3109 => 0.3278, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.21% (4.2646 => 4.4868, std. dev.: 0.0064) MultiSource/Applications/hbd/hbd: 5.18% (1.5603 => 1.6411, std. dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 5.16% (10.4361 => 10.9745, std. dev.: 0.0116) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3121 => 0.3280, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.07% (0.4636 => 0.4871, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.95% (1.3050 => 1.3696, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.5860 => 0.6149, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.91% (0.2891 => 0.3033, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.90% (0.5569 => 0.5842, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 4.88% (0.3423 => 0.3590, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.82% (0.2905 => 0.3045, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.82% (8.1363 => 8.5281, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.75% (0.4103 => 0.4298, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.74% (0.2700 => 0.2828, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 4.73% (0.2831 => 0.2965, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.69% (0.3180 => 0.3329, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.62% (0.7835 => 0.8197, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 4.61% (5.7591 => 6.0246, std. dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary: 4.55% (0.3232 => 0.3379, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.52% (0.5105 => 0.5336, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.49% (0.2872 => 0.3001, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.48% (0.3283 => 0.3430, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.46% (0.2756 => 0.2879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.46% (0.2871 => 0.2999, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.3098 => 0.3236, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.45% (0.3865 => 0.4037, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.44% (0.2725 => 0.2846, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 4.43% (0.4289 => 0.4479, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.34% (0.9765 => 1.0189, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.34% (0.3136 => 0.3272, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.33% (0.3162 => 0.3299, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.33% (0.2793 => 0.2914, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.33% (0.3441 => 0.3590, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.33% (0.6450 => 0.6729, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.31% (0.2758 => 0.2877, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 4.31% (0.2877 => 0.3001, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 4.30% (0.3092 => 0.3225, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.29% (0.3052 => 0.3183, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.28% (2.0665 => 2.1549, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 4.27% (0.3603 => 0.3757, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.27% (0.2714 => 0.2830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.27% (0.3422 => 0.3568, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.25% (0.3650 => 0.3805, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3826 => 0.3988, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.22% (1.1861 => 1.2362, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 4.21% (0.2802 => 0.2920, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.10% (0.6675 => 0.6949, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.10% (1.5415 => 1.6047, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.08% (0.4064 => 0.4230, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.04% (0.6456 => 0.6717, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.8067 => 0.8393, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.02% (0.3935 => 0.4093, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.99% (1.1642 => 1.2107, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.96% (0.3684 => 0.3830, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.92% (1.2842 => 1.3346, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 3.91% (0.3379 => 0.3511, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.85% (0.4203 => 0.4365, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.84% (2.0273 => 2.1052, std. dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 3.84% (0.3387 => 0.3517, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.83% (0.4620 => 0.4797, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.4048 => 0.4203, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 3.68% (3.3354 => 3.4581, std. dev.: 0.0059) MultiSource/Applications/lua/lua: 3.67% (3.8723 => 4.0144, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.54% (1.4186 => 1.4688, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 3.53% (0.8921 => 0.9236, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.43% (0.5981 => 0.6186, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.38% (2.2969 => 2.3746, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (14.3668 => 14.8491, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.16% (1.5859 => 1.6360, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.15% (0.5020 => 0.5178, std. dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 2.83% (1.1840 => 1.2175, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 2.73% (17.1811 => 17.6509, std. dev.: 0.0094) MultiSource/Applications/minisat/minisat: 2.67% (0.7115 => 0.7305, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (7.9617 => 8.1507, std. dev.: 0.0069) MultiSource/Applications/lemon/lemon: 2.16% (1.0722 => 1.0954, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.05% (21.9371 => 22.3873, std. dev.: 0.0229) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.32% (0.8101 => 0.8208, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2180, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.83% (4.2280 => 4.4322, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.86% (3.6395 => 3.7437, std. dev.: 0.0070) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3397, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (1.5086 => 1.5317, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.51% (26.0924 => 26.4851, std. dev.: 0.0325) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.50% (0.9540 => 0.9683, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.29% (3.1578 => 3.1984, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2288, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/fbench: 1.14% (2.2771 => 2.3031, std. dev.: 0.0060) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2299, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.44% (5.3855 => 3.7463, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.94% (5.3526 => 3.7498, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1152, std. dev.: 0.0696) MultiSource/Applications/ClamAV/clamscan: -13.72% (22.1758 => 19.1341, std. dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.33% (2.9384 => 2.5760, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -11.15% (1.2373 => 1.0994, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -7.11% (1.5373 => 1.4280, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.1396 => 1.0707, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std. dev.: 0.0037) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4746, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4155, std. dev.: 0.0170) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9940, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (8.1563 => 7.9566, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3337, std. dev.: 0.0087) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.10% (1.8329 => 1.8127, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (1.6805 => 1.6629, std. dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 07:08:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 09:08:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120827140803.E9F9C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3235?compare_to=3230&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3235, Order: 162665, Start Time: 2012-08-27 11:25:29, End Time: 2012-08-27 14:09:02 To: 3230, Order: 162659, Start Time: 2012-08-27 08:14:09, End Time: 2012-08-27 10:57:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.71% (2.1319 => 2.0742, std. dev.: 0.0181) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.82% (0.3446 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.82% (0.3465 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.81% (0.3460 => 0.4007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.80% (0.3442 => 0.3986, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.68% (0.3496 => 0.4044, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.65% (0.3488 => 0.4034, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.62% (0.3469 => 0.4011, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.21% (0.3650 => 0.4205, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.15% (0.3643 => 0.4195, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.72% (0.3724 => 0.4272, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1063 => 0.1168, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.29% (0.5826 => 0.6367, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.5889 => 0.6419, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.1620 => 0.1758, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.60% (1.5932 => 1.7143, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.54% (1.6211 => 1.7433, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (3.5627 => 3.8262, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7171 => 0.7699, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.25% (0.3792 => 0.4067, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.94% (1.3152 => 1.4065, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.2014 => 0.2149, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.37% (0.4361 => 0.4639, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.37% (0.4994 => 0.5312, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.31% (0.5026 => 0.5343, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.25% (0.5900 => 0.6269, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.23% (0.3930 => 0.4175, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2875 => 0.3053, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (0.5000 => 0.5305, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.07% (1.0781 => 1.1435, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.04% (0.3195 => 0.3388, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2792 => 0.2960, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.00% (4.2109 => 4.4634, std. dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 5.99% (0.3004 => 0.3184, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2738 => 0.2902, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.96% (0.4029 => 0.4269, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2725 => 0.2887, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.93% (2.7292 => 2.8910, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2803 => 0.2967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.83% (0.2729 => 0.2888, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 5.77% (0.9697 => 1.0257, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 5.75% (0.2750 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2823 => 0.2985, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.71% (0.9909 => 1.0475, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.69% (0.2813 => 0.2973, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.2780 => 0.2937, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2811 => 0.2969, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.59% (2.0673 => 2.1829, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.58% (0.3890 => 0.4107, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 5.52% (0.3096 => 0.3267, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.43% (0.2911 => 0.3069, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.3258 => 0.3433, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.37% (0.3317 => 0.3495, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.36% (0.3267 => 0.3442, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.35% (1.9694 => 2.0747, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.32% (1.9966 => 2.1028, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.23% (0.2736 => 0.2879, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3124 => 0.3287, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.20% (0.2866 => 0.3015, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.19% (0.3678 => 0.3869, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.16% (0.3060 => 0.3218, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.11% (0.3348 => 0.3519, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.09% (0.3362 => 0.3533, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (0.3625 => 0.3809, std. dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 5.03% (5.5417 => 5.8207, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.03% (0.3282 => 0.3447, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.02% (0.3726 => 0.3913, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.01% (2.1013 => 2.2066, std. dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 4.99% (0.2566 => 0.2694, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.98% (0.4658 => 0.4890, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.3477 => 0.3649, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.81% (4.4195 => 4.6320, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.77% (4.6177 => 4.8378, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3690 => 0.3863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.66% (0.4251 => 0.4449, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.63% (2.1653 => 2.2656, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 4.63% (0.4146 => 0.4338, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.50% (0.3981 => 0.4160, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.45% (1.8794 => 1.9631, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.32% (0.3845 => 0.4011, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 4.30% (1.4269 => 1.4882, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.3271 => 0.3411, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.28% (0.3903 => 0.4070, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.11% (0.7875 => 0.8199, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.11% (0.4139 => 0.4309, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.02% (0.2737 => 0.2847, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.95% (0.5546 => 0.5765, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 3.89% (0.6634 => 0.6892, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.5012 => 0.5203, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.76% (0.3084 => 0.3200, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.70% (23.5202 => 24.3896, std. dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.67% (0.6435 => 0.6671, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.68% (2.0346 => 2.0892, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 2.25% (0.4847 => 0.4956, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (0.7426 => 0.7546, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (4.6926 => 4.7445, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.10% (11.6398 => 11.7680, std. dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6773, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std. dev.: 0.0229) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6526, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1900, std. dev.: 0.0164) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5017, std. dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2211, std. dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4393, std. dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2841, std. dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5892, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4447, std. dev.: 0.0277) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5685, std. dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8077, std. dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std. dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7979, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0071) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7634, std. dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5813, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.56% (16.2163 => 15.9639, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std. dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 07:53:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 09:53:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827145313.323722A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3236?compare_to=3233&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3236, Order: 162669, Start Time: 2012-08-27 13:40:00, End Time: 2012-08-27 14:54:11 To: 3233, Order: 162665, Start Time: 2012-08-27 11:58:02, End Time: 2012-08-27 13:12:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (160 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.12% (2.1427 => 2.1188, std. dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.90% (2.0176 => 2.3383, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.89% (0.5818 => 0.6510, std. dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 11.84% (0.7061 => 0.7897, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.73% (0.5748 => 0.6422, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 10.96% (0.3578 => 0.3970, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 10.80% (0.3601 => 0.3990, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3646 => 0.4038, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.68% (0.3623 => 0.4010, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.65% (0.3663 => 0.4053, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3650 => 0.4036, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.4003 => 0.4422, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3789 => 0.4185, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3914 => 0.4323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.18% (0.3940 => 0.4341, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.06% (0.1986 => 0.2166, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.85% (0.1819 => 0.1980, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.77% (3.9660 => 4.3140, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1413 => 0.1536, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.65% (0.7710 => 0.8377, std. dev.: 0.0031) MultiSource/Applications/hbd/hbd: 8.00% (1.3693 => 1.4788, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.98% (0.4062 => 0.4386, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.90% (0.2596 => 0.2801, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.86% (0.4328 => 0.4668, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 7.69% (0.7038 => 0.7579, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.65% (0.5265 => 0.5668, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.51% (0.4379 => 0.4708, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.44% (1.2193 => 1.3100, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.42% (0.9199 => 0.9882, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.35% (0.2721 => 0.2921, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.24% (0.1588 => 0.1703, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.13% (0.6959 => 0.7455, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.11% (0.3022 => 0.3237, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.03% (0.3899 => 0.4173, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2655 => 0.2840, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.92% (0.2760 => 0.2951, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2761 => 0.2952, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.88% (0.2966 => 0.3170, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 6.86% (0.1589 => 0.1698, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.86% (1.9828 => 2.1188, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.81% (0.4390 => 0.4689, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.80% (0.2765 => 0.2953, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.78% (1.1364 => 1.2135, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3489 => 0.3725, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.76% (0.3580 => 0.3822, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.72% (0.2127 => 0.2270, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.66% (0.3485 => 0.3717, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.49% (0.5577 => 0.5939, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 6.48% (13.8202 => 14.7159, std. dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 6.41% (0.2995 => 0.3187, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.38% (0.2914 => 0.3100, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3192 => 0.3393, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.29% (1.4563 => 1.5479, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.23% (0.5637 => 0.5988, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.20% (0.3453 => 0.3667, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.2925 => 0.3106, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.13% (0.3293 => 0.3495, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.13% (0.3246 => 0.3445, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.13% (0.2023 => 0.2147, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 6.13% (0.7506 => 0.7966, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: 6.13% (0.4113 => 0.4365, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2243 => 0.2380, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.07% (7.2180 => 7.6561, std. dev.: 0.0031) MultiSource/Applications/Burg/burg: 5.98% (1.1061 => 1.1722, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.3534 => 0.3745, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.3756 => 0.3977, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.85% (0.4016 => 0.4251, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.85% (0.8310 => 0.8796, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 5.84% (0.3868 => 0.4094, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (1.3819 => 1.4624, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 5.78% (3.8646 => 4.0881, std. dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.78% (3.6692 => 3.8813, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (1.3813 => 1.4600, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.66% (0.4791 => 0.5062, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.64% (0.7460 => 0.7881, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.3245 => 1.3992, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.59% (0.6283 => 0.6634, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.56% (1.0594 => 1.1183, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.44% (4.3801 => 4.6184, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.40% (0.8818 => 0.9294, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.36% (1.2292 => 1.2951, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.35% (0.6135 => 0.6463, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.31% (4.4433 => 4.6792, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.28% (0.2140 => 0.2253, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 5.23% (1.9270 => 2.0278, std. dev.: 0.0075) MultiSource/Applications/siod/siod: 5.19% (2.1791 => 2.2922, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 5.19% (0.3220 => 0.3387, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.01% (16.6129 => 17.4459, std. dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.01% (0.3755 => 0.3943, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.92% (14.8535 => 15.5837, std. dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (13.2842 => 13.9195, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 4.57% (0.3131 => 0.3274, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.50% (0.2243 => 0.2344, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.46% (1.1333 => 1.1839, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 4.39% (8.4961 => 8.8691, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.31% (0.2321 => 0.2421, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.3245 => 0.3383, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.22% (4.6629 => 4.8599, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.22% (0.8698 => 0.9065, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.20% (4.9865 => 5.1960, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 4.20% (3.1889 => 3.3227, std. dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 4.12% (6.5754 => 6.8466, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.10% (3.2742 => 3.4086, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 4.09% (0.2859 => 0.2976, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.65% (0.9108 => 0.9440, std. dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.45% (14.5298 => 15.0312, std. dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 3.44% (16.2614 => 16.8205, std. dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.44% (1.5188 => 1.5710, std. dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 2.80% (0.6250 => 0.6425, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.71% (2.1007 => 2.1577, std. dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.66% (6.2785 => 6.4458, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.66% (0.4805 => 0.4933, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 2.54% (0.6744 => 0.6915, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.47% (3.7467 => 3.8394, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 2.34% (1.0313 => 1.0554, std. dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.01% (1.2749 => 1.3005, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.92% (33.2944 => 33.9346, std. dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std. dev.: 0.0499) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.21% (1.2998 => 1.4325, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.86% (1.5824 => 1.6593, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7422, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3840, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6007, std. dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 2.26% (10.7476 => 10.9904, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.09% (3.2729 => 3.3412, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.95% (1.4298 => 1.4577, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.27% (1.0895 => 1.1033, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6392, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.21% (22.5627 => 21.3863, std. dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.42% (1.2308 => 1.1025, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5153, std. dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.72% (1.3780 => 1.3268, std. dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -3.18% (1.1560 => 1.1192, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6007, std. dev.: 0.0289) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2385, std. dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.84% (5.3167 => 5.2189, std. dev.: 0.0046) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9718, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3305 => 7.2080, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8603, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7915, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4223, std. dev.: 0.0112) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2261, std. dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (5.5401 => 5.4769, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.11% (20.3410 => 20.1158, std. dev.: 0.0507) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 08:26:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 10:26:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827152629.C47702A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3237?compare_to=3234&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3237, Order: 162669, Start Time: 2012-08-27 14:08:14, End Time: 2012-08-27 15:27:28 To: 3234, Order: 162665, Start Time: 2012-08-27 12:21:04, End Time: 2012-08-27 13:40:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (125 on baseline) Performance Improvements: 2 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.37% (78.8205 => 79.9009, std. dev.: 0.4162) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.39% (1.6411 => 1.6183, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.37% (1.9800 => 1.9529, std. dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.69% (10.3673 => 13.5494, std. dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 13.56% (0.3473 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.45% (0.3561 => 0.4040, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.27% (0.3497 => 0.3961, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3543 => 0.4013, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 13.23% (0.3516 => 0.3981, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.21% (0.3543 => 0.4011, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.75% (0.3694 => 0.4165, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3828 => 0.4302, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.32% (0.3927 => 0.4411, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.07% (1.1194 => 1.2545, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.90% (1.7609 => 1.9529, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.82% (2.2022 => 2.4184, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5925 => 0.6420, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.34% (0.6030 => 0.6533, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.31% (0.2065 => 0.2216, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.29% (0.1892 => 0.2030, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.26% (0.1584 => 0.1699, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7326 => 0.7848, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.97% (0.1622 => 0.1735, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 6.46% (0.3282 => 0.3494, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.15% (0.4615 => 0.4899, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.08% (0.8172 => 0.8669, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.94% (0.4879 => 0.5169, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.93% (7.0540 => 7.4726, std. dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.64% (0.3121 => 0.3297, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.47% (0.3307 => 0.3488, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.44% (9.4845 => 10.0004, std. dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: 5.32% (0.2554 => 0.2690, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.31% (0.7433 => 0.7828, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.28% (4.9449 => 5.2062, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2271 => 0.2390, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.17% (0.2107 => 0.2216, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (5.0018 => 5.2568, std. dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 4.91% (0.4299 => 0.4510, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.82% (0.3109 => 0.3259, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.82% (0.2758 => 0.2891, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.5569 => 0.5835, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.77% (4.2646 => 4.4679, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.51% (1.3050 => 1.3639, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.51% (0.5860 => 0.6124, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 4.50% (10.4361 => 10.9062, std. dev.: 0.0099) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.3423 => 0.3577, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.44% (8.1363 => 8.4975, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/09-vor/vor: 4.28% (0.3180 => 0.3316, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.27% (0.4636 => 0.4834, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.26% (5.7591 => 6.0046, std. dev.: 0.0133) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.26% (0.2700 => 0.2815, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.05% (0.7835 => 0.8152, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.8067 => 0.8391, std. dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 3.96% (0.2905 => 0.3020, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.95% (0.3441 => 0.3577, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.94% (0.6450 => 0.6704, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.91% (0.2891 => 0.3004, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.90% (0.9765 => 1.0146, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.90% (0.5105 => 0.5304, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.83% (1.1861 => 1.2315, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.76% (1.5415 => 1.5994, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 3.72% (1.5603 => 1.6183, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.70% (0.4103 => 0.4255, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.70% (0.3865 => 0.4008, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 3.67% (0.2831 => 0.2935, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.66% (0.2872 => 0.2977, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3232 => 0.3350, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 3.60% (0.3052 => 0.3162, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.58% (0.3098 => 0.3209, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.58% (1.1642 => 1.2059, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3826 => 0.3963, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.58% (0.6675 => 0.6914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.57% (0.3422 => 0.3544, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.53% (0.3283 => 0.3399, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.52% (0.4289 => 0.4440, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.48% (0.3650 => 0.3777, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.45% (0.3387 => 0.3504, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.44% (0.3136 => 0.3244, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.42% (0.3162 => 0.3270, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.41% (2.0665 => 2.1370, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 3.30% (3.3354 => 3.4456, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 3.28% (0.3684 => 0.3805, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.27% (0.4064 => 0.4197, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.25% (0.3935 => 0.4063, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.25% (0.3603 => 0.3720, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.6456 => 0.6665, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.22% (2.0273 => 2.0926, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 3.16% (3.8723 => 3.9948, std. dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash2: 3.16% (0.4620 => 0.4766, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.13% (0.5981 => 0.6168, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.09% (0.5020 => 0.5175, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.09% (1.4186 => 1.4624, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.07% (0.4203 => 0.4332, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.05% (0.3379 => 0.3482, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8020, std. dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 3.00% (1.2842 => 1.3227, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 2.99% (0.8921 => 0.9188, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.4048 => 0.4167, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 2.73% (2.2969 => 2.3597, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.56% (1.5859 => 1.6265, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.30% (2.2024 => 2.2531, std. dev.: 0.0065) MultiSource/Applications/minisat/minisat: 2.28% (0.7115 => 0.7277, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.26% (1.1840 => 1.2108, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.18% (17.1811 => 17.5548, std. dev.: 0.0258) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.84% (7.9617 => 8.1084, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.71% (1.0722 => 1.0905, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.54% (21.9371 => 22.2745, std. dev.: 0.0147) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (4.2280 => 4.4332, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.24% (3.6395 => 3.7575, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.73% (3.2827 => 3.3396, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 1.67% (26.0924 => 26.5274, std. dev.: 0.0474) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.33% (1.5086 => 1.5286, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2279, std. dev.: 0.0188) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.13% (3.1578 => 3.1935, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5746, std. dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6814, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1276, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.23% (5.2763 => 3.2066, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.99% (5.3855 => 3.7166, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7181, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0485, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -14.15% (22.1758 => 19.0370, std. dev.: 0.0282) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5542, std. dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std. dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2373 => 1.1085, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: -9.80% (1.5373 => 1.3867, std. dev.: 0.0278) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.1396 => 1.0698, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std. dev.: 0.0013) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4716, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4279, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9852, std. dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9569, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3371, std. dev.: 0.0079) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8130, std. dev.: 0.0072) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4313, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 09:35:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 11:35:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827163519.068632A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/3238?compare_to=3236&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3238, Order: 162672, Start Time: 2012-08-27 15:21:55, End Time: 2012-08-27 16:36:16 To: 3236, Order: 162669, Start Time: 2012-08-27 13:40:00, End Time: 2012-08-27 14:54:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (160 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (694 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.4820 => 56.4009, std. dev.: 0.1056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.51% (79.9312 => 81.1389, std. dev.: 0.3386) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.61% (2.0176 => 2.3325, std. dev.: 0.0152) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.96% (0.5818 => 0.6514, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.95% (0.7061 => 0.7905, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.88% (0.5748 => 0.6431, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 11.07% (0.3578 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.89% (0.3646 => 0.4043, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.77% (0.3601 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3663 => 0.4056, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.71% (0.3623 => 0.4011, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.68% (0.3650 => 0.4040, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3789 => 0.4190, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3914 => 0.4320, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.17% (0.4003 => 0.4410, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.08% (0.3940 => 0.4337, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.57% (0.1819 => 0.1993, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.66% (0.7710 => 0.8378, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.63% (0.1413 => 0.1535, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.54% (1.3693 => 1.4862, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.22% (3.9660 => 4.2919, std. dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.95% (0.4328 => 0.4672, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.75% (0.5265 => 0.5673, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.74% (0.2596 => 0.2797, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.45% (0.7038 => 0.7562, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.28% (1.2193 => 1.3081, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.20% (0.2721 => 0.2917, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4379 => 0.4694, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.17% (0.9199 => 0.9859, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.11% (0.3022 => 0.3237, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.04% (0.2726 => 0.2918, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.98% (0.3899 => 0.4171, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.2966 => 0.3172, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.92% (0.3485 => 0.3726, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.90% (0.3580 => 0.3827, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.89% (1.9828 => 2.1195, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.83% (0.6959 => 0.7434, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3489 => 0.3726, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.72% (0.2127 => 0.2270, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.68% (0.1588 => 0.1694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.55% (1.1364 => 1.2108, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.5577 => 0.5934, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.36% (13.8202 => 14.6991, std. dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/sieve: 6.31% (0.3453 => 0.3671, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.29% (0.4390 => 0.4666, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.24% (0.5637 => 0.5989, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.17% (0.3534 => 0.3752, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2243 => 0.2381, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.14% (0.2914 => 0.3093, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 6.13% (0.3293 => 0.3495, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.12% (7.2180 => 7.6601, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.11% (0.1865 => 0.1979, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 6.09% (0.2925 => 0.3103, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.98% (0.4016 => 0.4256, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (1.4563 => 1.5432, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 5.95% (0.3868 => 0.4098, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (1.3813 => 1.4634, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.91% (1.3819 => 1.4636, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.3756 => 0.3976, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.74% (0.4113 => 0.4349, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.73% (0.7506 => 0.7936, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.62% (0.7460 => 0.7879, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 5.60% (3.8646 => 4.0809, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.53% (1.3245 => 1.3978, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 5.52% (0.8310 => 0.8769, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.51% (1.1061 => 1.1670, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 5.48% (0.2995 => 0.3159, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.45% (3.6692 => 3.8692, std. dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 5.41% (1.2292 => 1.2957, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6135, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.31% (4.4433 => 4.6794, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 5.13% (1.0594 => 1.1137, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.12% (0.3220 => 0.3385, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.11% (0.6283 => 0.6604, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.4791 => 0.5035, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.06% (1.9270 => 2.0246, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.04% (13.2842 => 13.9538, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.98% (0.3755 => 0.3942, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.94% (0.6135 => 0.6438, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 4.85% (2.1791 => 2.2847, std. dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 4.78% (16.6129 => 17.4070, std. dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 4.69% (14.8535 => 15.5499, std. dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 4.54% (0.3131 => 0.3273, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.51% (0.8818 => 0.9216, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.29% (1.1333 => 1.1819, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (8.4961 => 8.8493, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.13% (0.3245 => 0.3379, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.09% (0.8698 => 0.9054, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.08% (6.5754 => 6.8438, std. dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 4.06% (4.6629 => 4.8524, std. dev.: 0.0052) MultiSource/Applications/d/make_dparser: 4.03% (3.1889 => 3.3174, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 3.92% (0.2859 => 0.2971, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.86% (4.9865 => 5.1791, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.46% (3.2742 => 3.3874, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 3.31% (14.5298 => 15.0114, std. dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: 3.23% (16.2614 => 16.7871, std. dev.: 0.0162) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.13% (0.9108 => 0.9393, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.11% (1.5188 => 1.5661, std. dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/bigfib: 2.74% (0.6250 => 0.6421, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.59% (6.2785 => 6.4411, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1007 => 2.1518, std. dev.: 0.0067) MultiSource/Applications/lua/lua: 2.40% (3.7467 => 3.8365, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.33% (0.4805 => 0.4917, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.30% (0.6744 => 0.6899, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.76% (33.2944 => 33.8807, std. dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (1.2749 => 1.2921, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5165, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/fbench: 24.70% (1.8175 => 2.2665, std. dev.: 0.0344) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.26% (1.2998 => 1.4201, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.87% (1.5824 => 1.6595, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7419, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9637, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.82% (1.7688 => 1.8187, std. dev.: 0.0150) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.32% (10.7476 => 10.9971, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5965, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.08% (3.2729 => 3.3409, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 1.91% (1.4298 => 1.4571, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5157, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (1.5089 => 1.5291, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6858, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6389, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.47% (22.5627 => 21.3287, std. dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2308 => 1.1002, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.14% (1.3780 => 1.3209, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -3.20% (1.1560 => 1.1190, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5956, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2217, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: -1.74% (3.0263 => 2.9736, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (5.3167 => 5.2256, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2051, std. dev.: 0.0269) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7918, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4268, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2269, std. dev.: 0.0262) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.14% (20.3410 => 20.1092, std. dev.: 0.0357) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.13% (5.5401 => 5.4773, std. dev.: 0.0183) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 10:13:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 12:13:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827171345.177C12A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3239?compare_to=3237&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3239, Order: 162672, Start Time: 2012-08-27 15:55:30, End Time: 2012-08-27 17:14:40 To: 3237, Order: 162669, Start Time: 2012-08-27 14:08:14, End Time: 2012-08-27 15:27:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (123 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.76% (10.9062 => 11.0981, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.86% (1.3867 => 1.4402, std. dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.6749 => 56.4733, std. dev.: 0.0713) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.16% (13.5494 => 13.2574, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.88% (10.3673 => 13.2574, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 14.37% (0.3473 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.08% (0.3543 => 0.4042, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.07% (0.3561 => 0.4062, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.06% (0.3543 => 0.4041, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.04% (0.3497 => 0.3988, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.02% (0.3516 => 0.4009, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.54% (0.3694 => 0.4194, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.19% (0.3828 => 0.4333, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 13.11% (0.3927 => 0.4442, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.89% (0.3886 => 0.4387, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.60% (1.1194 => 1.2493, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.26% (1.7609 => 1.9416, std. dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.79% (2.2022 => 2.4177, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 9.36% (0.1432 => 0.1566, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.79% (0.6030 => 0.6560, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.49% (0.7326 => 0.7875, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.45% (0.1892 => 0.2033, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1584 => 0.1701, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.74% (0.3177 => 0.3391, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.3282 => 0.3496, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 6.34% (10.4361 => 11.0981, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.4615 => 0.4905, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 5.96% (0.1695 => 0.1796, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.81% (7.0540 => 7.4636, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3307 => 0.3497, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.7433 => 0.7855, std. dev.: 0.0112) MultiSource/Benchmarks/McCat/08-main/main: 5.68% (0.2554 => 0.2699, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2271 => 0.2396, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.49% (4.9449 => 5.2163, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.4879 => 0.5146, std. dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.32% (0.2107 => 0.2219, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.26% (9.4845 => 9.9835, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.23% (0.8172 => 0.8599, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.22% (5.0018 => 5.2628, std. dev.: 0.0110) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.97% (4.2646 => 4.4765, std. dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.90% (0.3121 => 0.3274, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.81% (0.5569 => 0.5837, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.74% (0.5860 => 0.6138, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 4.72% (0.4299 => 0.4502, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.70% (0.3423 => 0.3584, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.66% (0.3109 => 0.3254, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.58% (8.1363 => 8.5092, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.57% (1.3050 => 1.3646, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: 4.47% (0.7835 => 0.8185, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 4.47% (0.3180 => 0.3322, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.44% (0.2700 => 0.2820, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 4.40% (5.7591 => 6.0123, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.30% (0.3441 => 0.3589, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.21% (0.2758 => 0.2874, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.3092 => 0.3222, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.10% (1.1642 => 1.2119, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.08% (0.4636 => 0.4825, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.06% (1.1861 => 1.2343, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.01% (0.9765 => 1.0157, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.98% (0.5105 => 0.5308, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.5415 => 1.6012, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.6450 => 0.6699, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 3.85% (0.4289 => 0.4454, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.84% (0.2891 => 0.3002, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.83% (0.8067 => 0.8376, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 3.79% (0.2905 => 0.3015, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.3098 => 0.3213, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.69% (3.3354 => 3.4584, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.67% (1.5603 => 1.6176, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.66% (0.6675 => 0.6919, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.65% (2.0273 => 2.1012, std. dev.: 0.0059) MultiSource/Applications/lua/lua: 3.59% (3.8723 => 4.0115, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.59% (0.2872 => 0.2975, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.57% (0.3387 => 0.3508, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.56% (0.3650 => 0.3780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3865 => 0.4001, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.50% (0.3826 => 0.3960, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.44% (2.0665 => 2.1376, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.41% (1.4186 => 1.4670, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.38% (0.3162 => 0.3269, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 3.37% (0.3052 => 0.3155, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 3.36% (0.3422 => 0.3537, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (14.3668 => 14.8491, std. dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/ary3: 3.35% (0.3283 => 0.3393, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.35% (0.3136 => 0.3241, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.4064 => 0.4200, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.6456 => 0.6665, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5981 => 0.6174, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.20% (0.3684 => 0.3802, std. dev.: 0.0010) MultiSource/Applications/siod/siod: 3.18% (2.2969 => 2.3700, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 3.16% (0.3603 => 0.3717, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.15% (0.3935 => 0.4059, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4203 => 0.4335, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 3.05% (0.4620 => 0.4761, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.01% (0.4048 => 0.4170, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.94% (1.2842 => 1.3220, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.93% (0.5020 => 0.5167, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 2.93% (0.8921 => 0.9182, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.84% (1.5859 => 1.6310, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.72% (17.1811 => 17.6491, std. dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.59% (2.2024 => 2.2595, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 2.49% (0.7115 => 0.7292, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 2.30% (1.1840 => 1.2112, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.01% (1.0722 => 1.0938, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.73% (7.9617 => 8.0998, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.62% (21.9371 => 22.2928, std. dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.44% (2.6778 => 2.9574, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (4.2280 => 4.4339, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7519, std. dev.: 0.0051) MultiSource/Applications/siod/siod: 1.75% (3.2827 => 3.3401, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 1.69% (26.0924 => 26.5324, std. dev.: 0.0126) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.49% (1.5086 => 1.5311, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1982, std. dev.: 0.0065) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2313, std. dev.: 0.0304) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6813, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.52% (5.2763 => 3.1913, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.00% (5.3855 => 3.7162, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7140, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0426, std. dev.: 0.0238) MultiSource/Applications/ClamAV/clamscan: -14.01% (22.1758 => 19.0699, std. dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.15% (2.9384 => 2.5521, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1009, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.32% (1.5373 => 1.4402, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -6.09% (1.1396 => 1.0702, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4714, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (8.6802 => 8.4209, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0071, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9594, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6779, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3343, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5146, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std. dev.: 0.0083) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (1.6805 => 1.6632, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.01% (1.4460 => 1.4314, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 10:19:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 12:19:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120827171925.3C0BC2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3240?compare_to=3235&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3240, Order: 162672, Start Time: 2012-08-27 14:36:48, End Time: 2012-08-27 17:20:23 To: 3235, Order: 162665, Start Time: 2012-08-27 11:25:29, End Time: 2012-08-27 14:09:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (124 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 950 (754 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.58% (0.2120 => 0.2302, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.70% (2.0742 => 2.1303, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.82% (53.3127 => 54.2854, std. dev.: 0.3301) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.36% (1.0257 => 1.0117, std. dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 15.09% (0.3446 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.04% (0.3465 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.00% (0.3460 => 0.3979, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.99% (0.3442 => 0.3958, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.99% (0.3496 => 0.4020, std. dev.: 0.0051) SingleSource/UnitTests/ObjC/synchronized: 14.96% (0.3469 => 0.3988, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.94% (0.3488 => 0.4009, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.58% (0.3643 => 0.4174, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 14.38% (0.3650 => 0.4175, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/parameter-passing: 14.10% (0.3724 => 0.4249, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1063 => 0.1167, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5826 => 0.6365, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.85% (0.5889 => 0.6410, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.1620 => 0.1758, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.39% (1.5932 => 1.7268, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.92% (3.5627 => 3.8447, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.75% (1.6211 => 1.7468, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.33% (1.3152 => 1.4116, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 7.27% (0.7171 => 0.7692, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.20% (0.4361 => 0.4675, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.02% (0.5026 => 0.5379, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.97% (0.4994 => 0.5342, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.82% (0.3930 => 0.4198, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.68% (0.5000 => 0.5334, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 6.55% (4.2109 => 4.4868, std. dev.: 0.0101) MultiSource/Applications/spiff/spiff: 6.38% (0.4029 => 0.4286, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.31% (1.0781 => 1.1461, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.29% (2.7292 => 2.9008, std. dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.12% (0.5900 => 0.6261, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.86% (0.2866 => 0.3034, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.80% (2.1013 => 2.2231, std. dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 5.73% (0.2566 => 0.2713, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.70% (0.2736 => 0.2892, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.64% (5.5417 => 5.8541, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (1.9694 => 2.0788, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (0.3890 => 0.4103, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.47% (1.9966 => 2.1058, std. dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 5.32% (4.6177 => 4.8634, std. dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.26% (0.4658 => 0.4903, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.20% (2.1653 => 2.2778, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.11% (0.2875 => 0.3022, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.07% (0.3903 => 0.4101, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.03% (0.9909 => 1.0407, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (4.4195 => 4.6389, std. dev.: 0.0091) SingleSource/Regression/C++/ofstream_ctor: 4.96% (0.3004 => 0.3153, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.95% (0.2040 => 0.2141, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.91% (1.8794 => 1.9717, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 4.91% (1.4269 => 1.4969, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3195 => 0.3351, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2792 => 0.2927, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.83% (0.2714 => 0.2845, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 4.81% (0.2725 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.73% (0.2729 => 0.2858, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.71% (0.2738 => 0.2867, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.71% (2.0673 => 2.1647, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 4.68% (0.2780 => 0.2910, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.65% (0.2750 => 0.2878, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.61% (0.3060 => 0.3201, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.60% (0.7875 => 0.8237, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 4.59% (0.2811 => 0.2940, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 4.59% (0.3096 => 0.3238, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.57% (0.6634 => 0.6937, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 4.57% (0.2803 => 0.2931, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.3271 => 0.3420, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 4.55% (0.2813 => 0.2941, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.51% (0.3348 => 0.3499, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3625 => 0.3787, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.47% (0.2911 => 0.3041, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 4.46% (0.3317 => 0.3465, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.46% (0.3362 => 0.3512, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.46% (0.3678 => 0.3842, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.4139 => 0.4322, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3267 => 0.3411, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.40% (0.4251 => 0.4438, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.39% (0.3258 => 0.3401, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.38% (0.5546 => 0.5789, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.35% (0.3726 => 0.3888, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 4.33% (0.9697 => 1.0117, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 4.29% (0.3477 => 0.3626, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.27% (0.3282 => 0.3422, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.25% (0.3084 => 0.3215, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (0.2691 => 0.2803, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.11% (0.2969 => 0.3091, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.08% (0.4146 => 0.4315, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.04% (0.3690 => 0.3839, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 4.02% (23.5202 => 24.4666, std. dev.: 0.0167) MultiSource/Applications/minisat/minisat: 3.96% (0.3336 => 0.3468, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.95% (0.2737 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.72% (0.3981 => 0.4129, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (0.3845 => 0.3986, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.6435 => 0.6666, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.58% (2.0346 => 2.1075, std. dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 2.91% (0.4847 => 0.4988, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.78% (0.5361 => 0.5510, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (0.7426 => 0.7610, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.26% (0.5584 => 0.5710, std. dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.79% (11.6398 => 11.8484, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.63% (4.6926 => 4.7692, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.48% (0.2122 => 0.2302, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1669, std. dev.: 0.0510) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6415, std. dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.32% (2.0820 => 2.1303, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1969, std. dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5066, std. dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4430, std. dev.: 0.0150) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.51% (3.1722 => 3.2202, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5387, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5877, std. dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.87% (2.4764 => 2.4054, std. dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5574, std. dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8013, std. dev.: 0.0079) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9569, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8033, std. dev.: 0.0021) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -2.19% (17.2379 => 16.8598, std. dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5733, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9567, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 11:17:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 13:17:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827181711.25E3A2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3241?compare_to=3238&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3241, Order: 162678, Start Time: 2012-08-27 17:03:53, End Time: 2012-08-27 18:18:09 To: 3238, Order: 162672, Start Time: 2012-08-27 15:21:55, End Time: 2012-08-27 16:36:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (160 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (696 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 2.46% (0.5325 => 0.5456, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.68% (81.1389 => 78.9641, std. dev.: 0.7877) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.65% (2.0176 => 2.3334, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.94% (0.7061 => 0.7904, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.93% (0.5818 => 0.6512, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.86% (0.5748 => 0.6430, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.12% (0.3578 => 0.3976, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.00% (0.3601 => 0.3997, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3646 => 0.4044, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3663 => 0.4056, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.68% (0.3650 => 0.4040, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.65% (0.3623 => 0.4009, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3914 => 0.4326, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3789 => 0.4187, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.28% (0.1819 => 0.2006, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.27% (0.4003 => 0.4414, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.18% (0.3940 => 0.4341, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.07% (0.3130 => 0.3414, std. dev.: 0.0072) MultiSource/Applications/hbd/hbd: 8.90% (1.3693 => 1.4912, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.39% (0.7710 => 0.8357, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.30% (3.9660 => 4.2951, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.28% (0.2596 => 0.2811, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 8.20% (0.4062 => 0.4395, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.97% (0.4328 => 0.4673, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.90% (0.5265 => 0.5681, std. dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.64% (0.7038 => 0.7576, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.42% (1.2193 => 1.3098, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.35% (0.9199 => 0.9875, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: 7.29% (0.2607 => 0.2797, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4379 => 0.4694, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2690 => 0.2883, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.2721 => 0.2916, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3022 => 0.3238, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.06% (1.9828 => 2.1227, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.2966 => 0.3175, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.01% (0.6959 => 0.7447, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.01% (0.2726 => 0.2917, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.95% (0.3899 => 0.4170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.79% (0.2988 => 0.3191, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.77% (0.3485 => 0.3721, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.71% (0.3489 => 0.3723, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.59% (1.1364 => 1.2113, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.58% (0.2127 => 0.2267, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3192 => 0.3399, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.42% (0.5637 => 0.5999, std. dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 6.42% (13.8202 => 14.7077, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.5577 => 0.5934, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.2914 => 0.3098, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.31% (7.2180 => 7.6731, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 6.23% (0.3293 => 0.3498, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.23% (0.3534 => 0.3754, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.20% (0.4390 => 0.4662, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.13% (0.2023 => 0.2147, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.10% (0.3246 => 0.3444, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.06% (0.1865 => 0.1978, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 6.05% (0.2925 => 0.3102, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (1.4563 => 1.5441, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.4016 => 0.4257, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (0.3756 => 0.3981, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.97% (0.2243 => 0.2377, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.96% (0.7506 => 0.7953, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.92% (0.3868 => 0.4097, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.86% (1.3819 => 1.4629, std. dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 5.84% (0.2995 => 0.3170, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.84% (1.3813 => 1.4619, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.79% (0.4113 => 0.4351, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.68% (3.8646 => 4.0843, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 5.66% (1.1061 => 1.1687, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.66% (0.7460 => 0.7882, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.65% (1.3245 => 1.3993, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.50% (0.8310 => 0.8767, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.43% (3.6692 => 3.8683, std. dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 5.41% (1.2292 => 1.2957, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 5.37% (0.3220 => 0.3393, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.3801 => 4.6139, std. dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 5.31% (1.0594 => 1.1157, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.22% (4.4433 => 4.6751, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.07% (0.4791 => 0.5034, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.05% (1.9270 => 2.0243, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.04% (13.2842 => 13.9532, std. dev.: 0.0162) MultiSource/Applications/siod/siod: 5.02% (2.1791 => 2.2884, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.01% (0.3755 => 0.3943, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.96% (0.6135 => 0.6439, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.92% (0.6283 => 0.6592, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.87% (0.8818 => 0.9247, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4021, std. dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 4.65% (14.8535 => 15.5438, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 4.38% (0.3131 => 0.3268, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.30% (1.1333 => 1.1820, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (8.4961 => 8.8582, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 4.08% (4.6629 => 4.8532, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.05% (0.8698 => 0.9050, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.03% (3.1889 => 3.3173, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.01% (0.3245 => 0.3375, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.93% (6.5754 => 6.8341, std. dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.2859 => 0.2970, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.9865 => 5.1784, std. dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 3.42% (14.5298 => 15.0274, std. dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.42% (3.2742 => 3.3863, std. dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 3.17% (16.2614 => 16.7761, std. dev.: 0.0203) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.12% (0.9108 => 0.9392, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.90% (1.5188 => 1.5628, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.86% (0.6250 => 0.6429, std. dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.83% (6.2785 => 6.4560, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.48% (0.6744 => 0.6911, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.35% (2.1007 => 2.1501, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.33% (3.7467 => 3.8341, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.27% (0.4805 => 0.4914, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.13% (1.0313 => 1.0533, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 1.80% (33.2944 => 33.8921, std. dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5186, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.67% (1.8175 => 2.2659, std. dev.: 0.0506) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 8.63% (1.2998 => 1.4120, std. dev.: 0.0185) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.88% (1.5824 => 1.6596, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7408, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8159, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5972, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.22% (1.4298 => 1.4616, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3401, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.04% (10.7476 => 10.9664, std. dev.: 0.0267) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5089 => 1.5319, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5727, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6422, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.49% (22.5627 => 21.3244, std. dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.29% (1.2308 => 1.1042, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3097, std. dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -3.19% (1.1560 => 1.1191, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5949, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.22% (0.6589 => 0.6443, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2356, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9734, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.74% (5.3167 => 5.2244, std. dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.66% (7.3305 => 7.2085, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8678, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4341, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.06% (20.3410 => 20.1260, std. dev.: 0.0209) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 11:52:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 13:52:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120827185203.7C7C62A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3242?baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 To: (none) Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 79 (0 on baseline) Added Tests: 815 (0 on baseline) Existing Failures: 0 (79 on baseline) Unchanged Tests: 74 (889 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment New Failures - Execution Time ----------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/treecc/treecc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 12:00:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 14:00:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827190052.03B8D2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3243?compare_to=3239&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3243, Order: 162678, Start Time: 2012-08-27 17:42:39, End Time: 2012-08-27 19:01:49 To: 3239, Order: 162672, Start Time: 2012-08-27 15:55:30, End Time: 2012-08-27 17:14:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (725 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.78% (10.3673 => 13.2471, std. dev.: 0.0130) SingleSource/UnitTests/ObjC/trivial-interface: 14.31% (0.3473 => 0.3970, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 14.18% (0.3497 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.14% (0.3543 => 0.4044, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.11% (0.3543 => 0.4043, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.10% (0.3561 => 0.4063, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3516 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.51% (0.3694 => 0.4193, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3927 => 0.4452, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.27% (0.3828 => 0.4336, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.94% (0.3886 => 0.4389, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2502, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.26% (1.7609 => 1.9415, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.77% (2.2022 => 2.4173, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.22% (0.1432 => 0.1564, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.00% (0.5925 => 0.6458, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.6030 => 0.6565, std. dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.66% (0.1892 => 0.2037, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.58% (0.7326 => 0.7881, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.45% (0.1584 => 0.1702, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 6.46% (0.3282 => 0.3494, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.35% (0.4615 => 0.4908, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.33% (10.4361 => 11.0965, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 6.08% (0.1695 => 0.1798, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.91% (7.0540 => 7.4712, std. dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.84% (0.3307 => 0.3500, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.79% (0.7433 => 0.7863, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 5.72% (0.2554 => 0.2700, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.59% (0.2271 => 0.2398, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.47% (0.4879 => 0.5146, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.46% (0.2107 => 0.2222, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.41% (4.9449 => 5.2124, std. dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 5.27% (9.4845 => 9.9842, std. dev.: 0.0194) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.24% (5.0018 => 5.2640, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.8172 => 0.8597, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.03% (4.2646 => 4.4790, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.93% (0.5860 => 0.6149, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.90% (0.3121 => 0.3274, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.5569 => 0.5841, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 4.82% (0.3423 => 0.3588, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 4.69% (0.3180 => 0.3329, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 4.68% (0.4299 => 0.4500, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.67% (8.1363 => 8.5161, std. dev.: 0.0087) MultiSource/Applications/sgefa/sgefa: 4.63% (0.3109 => 0.3253, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.61% (1.3050 => 1.3652, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.53% (0.7835 => 0.8190, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.52% (0.2700 => 0.2822, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.43% (5.7591 => 6.0144, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.42% (0.3441 => 0.3593, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.34% (0.4103 => 0.4281, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.24% (0.2758 => 0.2875, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.23% (0.4636 => 0.4832, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.3092 => 0.3222, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.01% (0.2891 => 0.3007, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.00% (1.1861 => 1.2336, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.00% (1.5415 => 1.6032, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.00% (0.5105 => 0.5309, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.99% (0.9765 => 1.0155, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.98% (1.1642 => 1.2105, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.88% (0.6450 => 0.6700, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.82% (0.6675 => 0.6930, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3098 => 0.3216, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.80% (3.3354 => 3.4622, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.79% (0.3826 => 0.3971, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.78% (1.5603 => 1.6193, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.8067 => 0.8372, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.77% (0.2756 => 0.2860, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3865 => 0.4009, std. dev.: 0.0040) MultiSource/Applications/treecc/treecc: 3.71% (2.0273 => 2.1025, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2831 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4289 => 0.4448, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 3.69% (0.2871 => 0.2977, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.3136 => 0.3250, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.63% (0.3387 => 0.3510, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.62% (0.2872 => 0.2976, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 3.61% (3.8723 => 4.0120, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.57% (0.3162 => 0.3275, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3232 => 0.3347, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.52% (0.4064 => 0.4207, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.50% (2.0665 => 2.1389, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 3.45% (0.3422 => 0.3540, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.41% (0.3603 => 0.3726, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (14.3668 => 14.8572, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3935 => 0.4068, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.35% (2.2969 => 2.3738, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.29% (0.5981 => 0.6178, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (1.4186 => 1.4648, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 3.23% (0.3684 => 0.3803, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.4203 => 0.4334, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.11% (0.4048 => 0.4174, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4620 => 0.4763, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.08% (1.2842 => 1.3238, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5859 => 1.6332, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 2.93% (0.8921 => 0.9182, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.89% (0.5020 => 0.5165, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.2024 => 2.2630, std. dev.: 0.0063) MultiSource/Applications/minisat/minisat: 2.73% (0.7115 => 0.7309, std. dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 2.65% (17.1811 => 17.6370, std. dev.: 0.0330) MultiSource/Benchmarks/nbench/nbench: 2.20% (1.1840 => 1.2100, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 2.07% (1.0722 => 1.0944, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.80% (7.9617 => 8.1052, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.61% (21.9371 => 22.2908, std. dev.: 0.0302) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.32% (0.8101 => 0.8208, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (4.2280 => 4.4497, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (3.6395 => 3.7452, std. dev.: 0.0059) MultiSource/Applications/siod/siod: 1.79% (3.2827 => 3.3415, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.71% (26.0924 => 26.5397, std. dev.: 0.0381) SingleSource/Benchmarks/Misc/fbench: 1.50% (2.2771 => 2.3112, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (1.5086 => 1.5289, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7978, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2304, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 1.25% (3.1578 => 3.1972, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1256, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.56% (5.2763 => 3.1890, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.02% (5.3855 => 3.7147, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7169, std. dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0803, std. dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: -13.92% (22.1758 => 19.0879, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.06% (2.9384 => 2.5547, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2373 => 1.1023, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -8.87% (1.5373 => 1.4009, std. dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4680, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std. dev.: 0.0020) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4661, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -2.79% (10.2830 => 9.9961, std. dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.6802 => 8.4408, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9627, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std. dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3370, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.2636 => 5.2049, std. dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8126, std. dev.: 0.0058) MultiSource/Applications/lemon/lemon: -1.06% (1.4460 => 1.4307, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 13:00:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 15:00:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827200017.57CEA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3244?compare_to=3241&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3244, Order: 162683, Start Time: 2012-08-27 18:47:06, End Time: 2012-08-27 20:01:14 To: 3241, Order: 162678, Start Time: 2012-08-27 17:03:53, End Time: 2012-08-27 18:18:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (160 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 966 (708 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.94% (3.7698 => 3.8431, std. dev.: 0.0241) SingleSource/Benchmarks/Misc/mandel-2: 1.80% (1.4120 => 1.4374, std. dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.70% (2.0176 => 2.3142, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.35% (0.0826 => 0.0928, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.83% (0.5818 => 0.6506, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.77% (0.7061 => 0.7892, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.74% (0.5748 => 0.6423, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.51% (0.3578 => 0.3990, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3646 => 0.4064, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.39% (0.3601 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.27% (0.3663 => 0.4076, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3650 => 0.4061, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3623 => 0.4027, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.06% (0.3789 => 0.4208, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.99% (0.3914 => 0.4344, std. dev.: 0.0074) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.4003 => 0.4434, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.69% (0.3940 => 0.4361, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.60% (0.7710 => 0.8373, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.42% (0.1413 => 0.1532, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.02% (3.9660 => 4.2842, std. dev.: 0.0078) MultiSource/Applications/hbd/hbd: 7.87% (1.3693 => 1.4770, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.81% (0.1819 => 0.1961, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.77% (0.5265 => 0.5674, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.70% (0.2596 => 0.2796, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (0.4328 => 0.4655, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.48% (0.2781 => 0.2989, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.37% (0.2726 => 0.2927, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7038 => 0.7554, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4062 => 0.4352, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.10% (0.9199 => 0.9852, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 7.05% (0.3149 => 0.3371, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.99% (0.4379 => 0.4685, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.2193 => 1.3043, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.80% (0.3899 => 0.4164, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.78% (0.3022 => 0.3227, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2966 => 0.3165, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.70% (0.6959 => 0.7425, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.67% (1.9828 => 2.1151, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.61% (0.2937 => 0.3131, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.48% (0.3489 => 0.3715, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2988 => 0.3180, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.5577 => 0.5934, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.40% (0.3580 => 0.3809, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.36% (0.1588 => 0.1689, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.24% (0.4390 => 0.4664, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.24% (1.1364 => 1.2073, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.2925 => 0.3106, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3453 => 0.3663, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.06% (0.1865 => 0.1978, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.05% (0.5637 => 0.5978, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 6.04% (0.3293 => 0.3492, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1657 => 0.1757, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.02% (13.8202 => 14.6525, std. dev.: 0.0188) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (7.2180 => 7.6460, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.91% (0.3246 => 0.3438, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.90% (0.2914 => 0.3086, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.88% (0.2243 => 0.2375, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.86% (1.4563 => 1.5416, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.83% (0.3534 => 0.3740, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.79% (0.3868 => 0.4092, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.72% (0.7506 => 0.7935, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (0.3756 => 0.3967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.60% (0.4016 => 0.4241, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.55% (1.3813 => 1.4579, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.43% (1.3819 => 1.4569, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 5.38% (3.8646 => 4.0727, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.37% (1.3245 => 1.3956, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.2945 => 0.3103, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (0.7460 => 0.7857, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 5.30% (0.4113 => 0.4331, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 5.28% (0.2995 => 0.3153, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.23% (1.1061 => 1.1639, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 5.20% (0.8310 => 0.8742, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.17% (1.2292 => 1.2928, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 5.12% (0.3220 => 0.3385, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.12% (4.4433 => 4.6706, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (4.3801 => 4.6030, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (3.6692 => 3.8556, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.84% (1.9270 => 2.0203, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.81% (1.0594 => 1.1104, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.74% (0.4791 => 0.5018, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.73% (13.2842 => 13.9125, std. dev.: 0.0093) MultiSource/Applications/siod/siod: 4.69% (2.1791 => 2.2814, std. dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.68% (0.6135 => 0.6422, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.65% (0.6283 => 0.6575, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.58% (0.3755 => 0.3927, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.50% (0.2243 => 0.2344, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3601, std. dev.: 0.0235) MultiSource/Applications/JM/lencod/lencod: 4.28% (14.8535 => 15.4894, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.21% (0.8818 => 0.9189, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.03% (1.1333 => 1.1790, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.02% (0.3131 => 0.3257, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.88% (0.3245 => 0.3371, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (8.4961 => 8.8246, std. dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (6.5754 => 6.8176, std. dev.: 0.0056) MultiSource/Applications/d/make_dparser: 3.63% (3.1889 => 3.3047, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.61% (0.8698 => 0.9012, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.9865 => 5.1554, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.19% (4.6629 => 4.8118, std. dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 3.14% (14.5298 => 14.9859, std. dev.: 0.0253) MultiSource/Applications/sqlite3/sqlite3: 3.08% (16.2614 => 16.7627, std. dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (3.2742 => 3.3744, std. dev.: 0.0188) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.77% (0.9108 => 0.9360, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.58% (1.5188 => 1.5580, std. dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.53% (6.2785 => 6.4372, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.42% (0.6250 => 0.6401, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.22% (3.7467 => 3.8297, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.1007 => 2.1434, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.87% (0.6744 => 0.6870, std. dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.81% (1.0313 => 1.0500, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.40% (33.2944 => 33.7609, std. dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 1.26% (1.2749 => 1.2910, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0415) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.59% (1.2998 => 1.4374, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.83% (1.5824 => 1.6589, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.41% (11.2619 => 11.7584, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7769, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.78% (1.7688 => 1.8180, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4271 => 7.6091, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.20% (10.7476 => 10.9838, std. dev.: 0.0494) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3401, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.93% (1.4298 => 1.4574, std. dev.: 0.0040) MultiSource/Benchmarks/llubenchmark/llu: 1.86% (3.7731 => 3.8431, std. dev.: 0.0241) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5721, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5928 => 4.6412, std. dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.82% (22.5627 => 21.2489, std. dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.10% (0.3511 => 0.3402, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.60% (1.2308 => 1.1003, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.73% (1.3780 => 1.3266, std. dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.39% (0.4867 => 0.4702, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -3.21% (1.1560 => 1.1189, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (8.8259 => 8.5821, std. dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9283, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2276, std. dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: -1.81% (5.3167 => 5.2205, std. dev.: 0.0028) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9722, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2070, std. dev.: 0.0260) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.34% (9.3358 => 9.2103, std. dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std. dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4296, std. dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.12% (20.3410 => 20.1139, std. dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 13:18:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 15:18:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120827201808.B8BBC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3245?compare_to=3242&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3245, Order: 162689, Start Time: 2012-08-27 19:08:23, End Time: 2012-08-27 20:19:08 To: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 10 (10 on baseline) Performance Improvements: 5 (5 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 874 (874 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 10.70% (3.0256 => 3.3494, std. dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.84% (3.6023 => 3.8486, std. dev.: 0.0514) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (0.3301 => 0.3506, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.22% (2.6656 => 2.7513, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.98% (40.4792 => 41.6851, std. dev.: 0.3869) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.47% (1.2726 => 1.3040, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.42% (2.5669 => 2.6291, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.21% (22.3381 => 22.8323, std. dev.: 0.0624) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (4.2246 => 4.2838, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: 1.17% (4.3016 => 4.3519, std. dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.20% (0.7738 => 0.7568, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.20% (0.7784 => 0.7613, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.05% (0.4880 => 0.4780, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: -1.30% (1.8798 => 1.8554, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.56% (15.8312 => 14.7922, std. dev.: 0.3358) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 10.70% (3.0256 => 3.3494, std. dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.84% (3.6023 => 3.8486, std. dev.: 0.0514) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (0.3301 => 0.3506, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.22% (2.6656 => 2.7513, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.98% (40.4792 => 41.6851, std. dev.: 0.3869) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.47% (1.2726 => 1.3040, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.42% (2.5669 => 2.6291, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.21% (22.3381 => 22.8323, std. dev.: 0.0624) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (4.2246 => 4.2838, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: 1.17% (4.3016 => 4.3519, std. dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.20% (0.7738 => 0.7568, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.20% (0.7784 => 0.7613, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.05% (0.4880 => 0.4780, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: -1.30% (1.8798 => 1.8554, std. dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.56% (15.8312 => 14.7922, std. dev.: 0.3358) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 13:30:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 15:30:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120827203042.D5FFB2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3246?compare_to=3240&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3246, Order: 162678, Start Time: 2012-08-27 17:48:09, End Time: 2012-08-27 20:31:42 To: 3240, Order: 162672, Start Time: 2012-08-27 14:36:48, End Time: 2012-08-27 17:20:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (127 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 966 (765 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 3.87% (0.4034 => 0.4190, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.37% (54.2854 => 55.0305, std. dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 15.15% (0.3465 => 0.3990, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.12% (0.3446 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.11% (0.3488 => 0.4015, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 15.09% (0.3460 => 0.3982, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 14.99% (0.3442 => 0.3958, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.99% (0.3496 => 0.4020, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.96% (0.3469 => 0.3988, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.52% (0.3643 => 0.4172, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.47% (0.3650 => 0.4178, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.12% (0.3724 => 0.4250, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.50% (0.3792 => 0.4190, std. dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1063 => 0.1167, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5826 => 0.6366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.91% (0.5889 => 0.6414, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1620 => 0.1756, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.37% (1.5932 => 1.7266, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (3.5627 => 3.8418, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.76% (1.6211 => 1.7469, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.43% (1.3152 => 1.4129, std. dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 7.31% (0.7171 => 0.7695, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.15% (0.4361 => 0.4673, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.12% (0.5026 => 0.5384, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.2014 => 0.2157, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.89% (0.4994 => 0.5338, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.77% (0.3930 => 0.4196, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.66% (0.5000 => 0.5333, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 6.54% (4.2109 => 4.4862, std. dev.: 0.0073) MultiSource/Applications/spiff/spiff: 6.35% (0.4029 => 0.4285, std. dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.35% (1.0781 => 1.1466, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.35% (0.1968 => 0.2093, std. dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.26% (2.7292 => 2.9000, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.07% (0.5900 => 0.6258, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.04% (0.2566 => 0.2721, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.74% (2.1013 => 2.2219, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.72% (0.2866 => 0.3030, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 5.68% (5.5417 => 5.8564, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.67% (0.2736 => 0.2891, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.50% (1.9694 => 2.0778, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.49% (1.9966 => 2.1062, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.48% (0.3890 => 0.4103, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.41% (0.4658 => 0.4910, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.36% (4.6177 => 4.8650, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 5.24% (2.1653 => 2.2787, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.22% (0.2875 => 0.3025, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.05% (4.4195 => 4.6429, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.01% (0.3195 => 0.3355, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.00% (0.2040 => 0.2142, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.00% (0.3903 => 0.4098, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 4.99% (1.4269 => 1.4981, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.94% (0.9909 => 1.0399, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.94% (0.2714 => 0.2848, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.92% (0.2725 => 0.2859, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.91% (0.2792 => 0.2929, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 4.89% (0.3004 => 0.3151, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 4.88% (1.8794 => 1.9712, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2738 => 0.2871, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2729 => 0.2860, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.78% (0.2780 => 0.2913, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.76% (2.0673 => 2.1658, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.71% (0.2823 => 0.2956, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.70% (0.6634 => 0.6946, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 4.69% (0.2750 => 0.2879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 4.67% (0.2803 => 0.2934, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3060 => 0.3203, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.67% (0.9697 => 1.0150, std. dev.: 0.0055) MultiSource/Applications/treecc/treecc: 4.66% (0.7875 => 0.8242, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 4.66% (0.2811 => 0.2942, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.66% (0.2813 => 0.2944, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.65% (0.3271 => 0.3423, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.64% (0.3124 => 0.3269, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.61% (0.4139 => 0.4330, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3258 => 0.3408, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.58% (0.3317 => 0.3469, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.54% (0.3726 => 0.3895, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.53% (0.2911 => 0.3043, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.53% (0.3267 => 0.3415, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.52% (0.3362 => 0.3514, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.49% (0.3096 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.48% (0.3348 => 0.3498, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.40% (0.5546 => 0.5790, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.33% (0.4251 => 0.4435, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.31% (0.3477 => 0.3627, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3282 => 0.3423, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.28% (0.3625 => 0.3780, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.25% (0.4146 => 0.4322, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.22% (0.3084 => 0.3214, std. dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 4.16% (0.2691 => 0.2803, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.12% (0.3690 => 0.3842, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 4.11% (0.3336 => 0.3473, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.05% (23.5202 => 24.4726, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.95% (0.2737 => 0.2845, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.82% (0.3981 => 0.4133, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.81% (0.2969 => 0.3082, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.3845 => 0.3985, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 3.53% (2.0346 => 2.1065, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.50% (0.6435 => 0.6660, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.41% (0.5012 => 0.5183, std. dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (0.4847 => 0.4990, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (0.5361 => 0.5503, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (0.7426 => 0.7617, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.71% (11.6398 => 11.8385, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.65% (4.6926 => 4.7698, std. dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.57% (0.2122 => 0.2325, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6683, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std. dev.: 0.0285) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6253, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2099, std. dev.: 0.0417) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5018, std. dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2271, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (41.7953 => 42.4420, std. dev.: 0.0170) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (8.4155 => 8.5105, std. dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5929, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4512, std. dev.: 0.0423) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.76% (2.4764 => 2.4081, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5791, std. dev.: 0.0106) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7924, std. dev.: 0.0112) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7960, std. dev.: 0.0097) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.43% (17.2379 => 16.8187, std. dev.: 0.0405) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.24% (0.6293 => 0.6152, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5732, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.55% (16.2163 => 15.9656, std. dev.: 0.0109) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4967, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 13:48:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 15:48:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120827204805.67E5C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3247?compare_to=3243&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3247, Order: 162690, Start Time: 2012-08-27 19:29:56, End Time: 2012-08-27 20:49:03 To: 3243, Order: 162678, Start Time: 2012-08-27 17:42:39, End Time: 2012-08-27 19:01:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (107 on baseline) Performance Improvements: 6 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 941 (743 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.15% (1.4009 => 1.4310, std. dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.89% (0.6458 => 0.6336, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -1.84% (0.6565 => 0.6444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.57% (0.7881 => 0.7757, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -1.28% (11.0965 => 10.9549, std. dev.: 0.0345) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (13.2471 => 13.0791, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (2.1389 => 2.1162, std. dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.16% (10.3673 => 13.0791, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: 13.59% (0.3473 => 0.3945, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.41% (0.3543 => 0.4018, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 13.37% (0.3561 => 0.4037, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.30% (0.3497 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.27% (0.3543 => 0.4013, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.83% (0.3694 => 0.4168, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3828 => 0.4303, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.30% (1.1194 => 1.2571, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3927 => 0.4410, std. dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 12.20% (0.3886 => 0.4360, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.12% (1.7609 => 1.9568, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.69% (2.2022 => 2.4155, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 9.22% (0.1432 => 0.1564, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.2065 => 0.2221, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.39% (0.1584 => 0.1701, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.08% (0.1892 => 0.2026, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 6.94% (0.5925 => 0.6336, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 6.87% (0.6030 => 0.6444, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 6.58% (0.3282 => 0.3498, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.02% (0.4615 => 0.4893, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 5.88% (0.7326 => 0.7757, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 5.68% (0.2554 => 0.2699, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.64% (7.0540 => 7.4521, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.4879 => 0.5150, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.46% (0.2271 => 0.2395, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.44% (0.3307 => 0.3487, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.26% (0.7433 => 0.7824, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.22% (9.4845 => 9.9795, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.21% (4.9449 => 5.2023, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.18% (0.8172 => 0.8595, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2107 => 0.2215, std. dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (10.4361 => 10.9549, std. dev.: 0.0345) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.95% (5.0018 => 5.2496, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.3121 => 0.3272, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 4.73% (0.3423 => 0.3585, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.70% (4.2646 => 4.4649, std. dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 4.66% (0.3109 => 0.3254, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5569 => 0.5828, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.53% (1.3050 => 1.3641, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.50% (8.1363 => 8.5027, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 4.49% (0.4299 => 0.4492, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.44% (0.5860 => 0.6120, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.31% (0.7835 => 0.8173, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.30% (0.2700 => 0.2816, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.25% (0.3180 => 0.3315, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.21% (5.7591 => 6.0013, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.17% (0.2758 => 0.2873, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3441 => 0.3583, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.00% (0.5105 => 0.5309, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.92% (0.6450 => 0.6703, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.3092 => 0.3212, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.87% (1.5415 => 1.6012, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.86% (0.9765 => 1.0142, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.84% (0.4636 => 0.4814, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (1.1861 => 1.2316, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.78% (0.3387 => 0.3515, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.66% (0.6675 => 0.6919, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.65% (1.1642 => 1.2067, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.59% (0.8067 => 0.8357, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 3.48% (3.8723 => 4.0070, std. dev.: 0.0063) MultiSource/Applications/d/make_dparser: 3.47% (3.3354 => 3.4512, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 3.37% (2.0273 => 2.0956, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 3.26% (2.2969 => 2.3718, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.19% (0.5981 => 0.6172, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (14.3668 => 14.8206, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.14% (0.4103 => 0.4232, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.11% (1.5603 => 1.6088, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.4186 => 1.4620, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.4289 => 0.4418, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.94% (1.5859 => 1.6325, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.90% (0.3865 => 0.3977, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.88% (0.3826 => 0.3936, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.85% (0.5020 => 0.5163, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 2.85% (0.8921 => 0.9175, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.83% (0.6456 => 0.6639, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.67% (2.2024 => 2.2612, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (0.4064 => 0.4171, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.54% (17.1811 => 17.6171, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4620 => 0.4732, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.41% (2.0665 => 2.1162, std. dev.: 0.0018) MultiSource/Applications/minisat/minisat: 2.40% (0.7115 => 0.7286, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.28% (1.2842 => 1.3135, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 2.23% (1.1840 => 1.2104, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.77% (7.9617 => 8.1027, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.42% (21.9371 => 22.2488, std. dev.: 0.0156) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.32% (0.8101 => 0.8208, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.00% (4.2280 => 4.4395, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (3.6395 => 3.7548, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 1.73% (3.2827 => 3.3395, std. dev.: 0.0063) MultiSource/Applications/lua/lua: 1.70% (26.0924 => 26.5352, std. dev.: 0.0228) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5086 => 1.5307, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2257, std. dev.: 0.0114) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.11% (3.1578 => 3.1928, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6815, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.45% (5.2763 => 3.1949, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.93% (5.3855 => 3.7195, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.52% (5.3526 => 3.7189, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0607, std. dev.: 0.0455) MultiSource/Applications/ClamAV/clamscan: -14.00% (22.1758 => 19.0704, std. dev.: 0.0364) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.89% (2.9384 => 2.5596, std. dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.65% (1.6925 => 1.4277, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2373 => 1.1075, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.91% (1.5373 => 1.4310, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -6.09% (1.1396 => 1.0702, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.29% (1.5835 => 1.4997, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4701, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4142, std. dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.66% (10.2830 => 10.0093, std. dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9595, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6824, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.71% (2.5528 => 2.5092, std. dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: -1.49% (12.5348 => 12.3483, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.14% (1.8329 => 1.8120, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.07% (1.0313 => 1.0203, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std. dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 14:41:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 16:41:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827214157.C279E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3248?compare_to=3244&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3248, Order: 162693, Start Time: 2012-08-27 20:28:54, End Time: 2012-08-27 21:42:55 To: 3244, Order: 162683, Start Time: 2012-08-27 18:47:06, End Time: 2012-08-27 20:01:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (157 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 968 (710 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.01% (2.0176 => 2.3205, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 12.35% (0.0826 => 0.0928, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.74% (0.5818 => 0.6443, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3578 => 0.3960, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.59% (0.7061 => 0.7809, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3601 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3646 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.46% (0.3663 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3650 => 0.4031, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3623 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.27% (0.3789 => 0.4178, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.17% (0.3914 => 0.4312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.07% (0.4003 => 0.4406, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.87% (0.3940 => 0.4329, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.85% (0.3130 => 0.3407, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.66% (0.7710 => 0.8378, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.63% (0.1413 => 0.1535, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.03% (0.1819 => 0.1965, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.99% (3.9660 => 4.2828, std. dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.82% (0.2596 => 0.2799, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 7.78% (1.3693 => 1.4758, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 7.67% (0.4328 => 0.4660, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.58% (0.5265 => 0.5664, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.34% (0.2781 => 0.2985, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2782 => 0.2984, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.15% (0.9199 => 0.9857, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.12% (1.2193 => 1.3061, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 7.12% (0.7038 => 0.7539, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4062 => 0.4350, std. dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.03% (0.4379 => 0.4687, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.88% (0.3022 => 0.3230, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.77% (0.2690 => 0.2872, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.3899 => 0.4162, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.74% (0.2761 => 0.2947, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2696 => 0.2877, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2726 => 0.2909, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.70% (0.2628 => 0.2804, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2765 => 0.2950, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.68% (0.2966 => 0.3164, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.65% (0.2721 => 0.2902, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.1789 => 0.1907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.60% (0.6959 => 0.7418, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.59% (1.9828 => 2.1134, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 6.57% (0.2937 => 0.3130, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.54% (0.3485 => 0.3713, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3107 => 0.3309, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.49% (0.2127 => 0.2265, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.49% (0.1588 => 0.1691, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.48% (0.3580 => 0.3812, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (0.3149 => 0.3351, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.36% (0.3489 => 0.3711, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.35% (0.5577 => 0.5931, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.1364 => 1.2084, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.19% (0.5637 => 0.5986, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.15% (13.8202 => 14.6703, std. dev.: 0.0104) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.11% (0.2914 => 0.3092, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3453 => 0.3661, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.1865 => 0.1976, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.95% (0.2925 => 0.3099, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2023 => 0.2143, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (7.2180 => 7.6460, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 5.92% (0.3293 => 0.3488, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.91% (0.3534 => 0.3743, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.4563 => 1.5423, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.88% (0.7506 => 0.7947, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 5.80% (0.2243 => 0.2373, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.79% (0.3868 => 0.4092, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.63% (0.4016 => 0.4242, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.3756 => 0.3965, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (1.3819 => 1.4586, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.51% (0.2995 => 0.3160, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.48% (1.3245 => 1.3971, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 5.44% (3.8646 => 4.0748, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (1.3813 => 1.4564, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4113 => 0.4334, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.34% (1.1061 => 1.1652, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.31% (0.7460 => 0.7856, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.29% (3.6692 => 3.8633, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.26% (0.8310 => 0.8747, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.20% (4.4433 => 4.6742, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (0.2945 => 0.3097, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (4.3801 => 4.6061, std. dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 5.10% (1.2292 => 1.2919, std. dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 5.08% (1.0594 => 1.1132, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 5.07% (2.1791 => 2.2895, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.97% (0.6283 => 0.6595, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.95% (1.9270 => 2.0224, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.95% (0.4791 => 0.5028, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.91% (0.2140 => 0.2245, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 4.84% (0.3220 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.78% (0.6135 => 0.6428, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (13.2842 => 13.9158, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.63% (0.3755 => 0.3929, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3604, std. dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.49% (0.8818 => 0.9214, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.37% (14.8535 => 15.5027, std. dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 4.18% (0.3131 => 0.3262, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.09% (1.1333 => 1.1796, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.89% (0.8698 => 0.9036, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (8.4961 => 8.8258, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 3.87% (3.1889 => 3.3123, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.3245 => 0.3367, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (6.5754 => 6.8188, std. dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.62% (4.9865 => 5.1668, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 3.57% (4.6629 => 4.8294, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.30% (3.2742 => 3.3823, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 3.29% (16.2614 => 16.7969, std. dev.: 0.0126) MultiSource/Applications/ClamAV/clamscan: 3.19% (14.5298 => 14.9933, std. dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.90% (0.9108 => 0.9372, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5188 => 1.5603, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.45% (0.6250 => 0.6403, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (6.2785 => 6.4229, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.25% (0.4805 => 0.4913, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.17% (3.7467 => 3.8279, std. dev.: 0.0090) MultiSource/Applications/lemon/lemon: 2.15% (1.0313 => 1.0535, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.1007 => 2.1436, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.99% (0.6744 => 0.6878, std. dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 1.78% (1.2749 => 1.2976, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.66% (33.2944 => 33.8481, std. dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 25.89% (1.8175 => 2.2881, std. dev.: 0.0351) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 10.57% (1.2998 => 1.4372, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6592, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0056, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.44% (11.2619 => 11.7621, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4271 => 7.6147, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3841, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.14% (10.7476 => 10.9781, std. dev.: 0.0692) MultiSource/Applications/lemon/lemon: 2.04% (1.4298 => 1.4590, std. dev.: 0.0020) MultiSource/Applications/siod/siod: 2.04% (3.2729 => 3.3397, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std. dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.44% (1.5089 => 1.5306, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6388, std. dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.81% (0.2670 => 0.2515, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.65% (22.5627 => 21.2886, std. dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.13% (0.3511 => 0.3401, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.57% (1.2308 => 1.1007, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -3.23% (1.1560 => 1.1187, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (8.8259 => 8.5763, std. dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.43% (1.9762 => 1.9281, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2277, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9718, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3305 => 7.1986, std. dev.: 0.0240) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (5.3167 => 5.2265, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.53% (3.9173 => 3.8572, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.27% (20.3410 => 20.0826, std. dev.: 0.0430) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2177, std. dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (84.4286 => 83.4149, std. dev.: 0.0127) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.11% (5.5401 => 5.4787, std. dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 14:43:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 16:43:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120827214354.DBB302A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3249?compare_to=3245&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3249, Order: 162694, Start Time: 2012-08-27 20:34:12, End Time: 2012-08-27 21:44:52 To: 3245, Order: 162689, Start Time: 2012-08-27 19:08:23, End Time: 2012-08-27 20:19:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 9 (7 on baseline) Performance Improvements: 2 (2 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 878 (880 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.12% (0.0688 => 0.0792, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.06% (0.7526 => 0.7982, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.82% (1.8554 => 1.8891, std. dev.: 0.0061) MultiSource/Applications/Burg/burg: 1.70% (1.1334 => 1.1527, std. dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.46% (1.4018 => 1.4223, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 31.50% (0.0454 => 0.0597, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: 14.47% (3.1444 => 3.5994, std. dev.: 0.1156) SingleSource/Benchmarks/Misc/ffbench: 2.61% (1.3806 => 1.4166, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.41% (4.5444 => 4.6083, std. dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.83% (9.0569 => 8.5289, std. dev.: 0.1696) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.63% (22.8323 => 22.2314, std. dev.: 0.1143) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.37% (0.7722 => 0.7982, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.08% (1.5150 => 1.5314, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 11.93% (3.2159 => 3.5994, std. dev.: 0.1156) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.28% (3.0256 => 3.3064, std. dev.: 0.0374) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (0.3301 => 0.3474, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.17% (1.2726 => 1.3002, std. dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.56% (4.5374 => 4.6083, std. dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.21% (8.9977 => 8.5289, std. dev.: 0.1696) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.35% (1.7361 => 1.7126, std. dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 16:09:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 18:09:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120827230948.43FBD2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3250?compare_to=3249&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3250, Order: 162701, Start Time: 2012-08-27 21:59:56, End Time: 2012-08-27 23:10:48 To: 3249, Order: 162694, Start Time: 2012-08-27 20:34:12, End Time: 2012-08-27 21:44:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 7 (2 on baseline) Performance Improvements: 5 (3 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 877 (884 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.69% (8.5289 => 9.0992, std. dev.: 0.0714) MultiSource/Applications/ClamAV/clamscan: 1.13% (14.4803 => 14.6434, std. dev.: 0.0337) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 12.83% (3.3592 => 3.7901, std. dev.: 0.1461) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.40% (1.7590 => 1.8540, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.00% (0.7573 => 0.7952, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.73% (2.5558 => 2.6255, std. dev.: 0.0115) MultiSource/Benchmarks/PAQ8p/paq8p: 1.03% (92.4787 => 93.4348, std. dev.: 0.2377) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.78% (0.7982 => 0.7760, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.47% (1.4518 => 1.4305, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -21.27% (0.0597 => 0.0470, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.84% (4.6083 => 4.5236, std. dev.: 0.0206) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.26% (4.1032 => 4.0514, std. dev.: 0.0183) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 2.28% (2.5669 => 2.6255, std. dev.: 0.0115) SingleSource/Benchmarks/Misc/ffbench: 1.03% (1.4117 => 1.4263, std. dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.27% (0.4880 => 0.4769, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.00% (15.8312 => 14.8815, std. dev.: 0.1980) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.06% (1.8739 => 1.8540, std. dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 0.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 16:24:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 18:24:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120827232409.386782A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3251?compare_to=3248&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3251, Order: 162701, Start Time: 2012-08-27 22:10:58, End Time: 2012-08-27 23:25:07 To: 3248, Order: 162693, Start Time: 2012-08-27 20:28:54, End Time: 2012-08-27 21:42:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (160 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 968 (707 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.86% (2.0176 => 2.3175, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.91% (0.5818 => 0.6511, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.78% (0.7061 => 0.7893, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.69% (0.5748 => 0.6420, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3578 => 0.3986, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.22% (0.3601 => 0.4005, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.19% (0.3646 => 0.4054, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.14% (0.3663 => 0.4071, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.10% (0.3650 => 0.4055, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3623 => 0.4023, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.85% (0.3789 => 0.4200, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3914 => 0.4335, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.4003 => 0.4429, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.51% (0.3940 => 0.4354, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.72% (0.7710 => 0.8382, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.50% (0.3130 => 0.3396, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.17% (1.3693 => 1.4812, std. dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.09% (3.9660 => 4.2867, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 8.06% (0.4328 => 0.4677, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.05% (0.2781 => 0.3005, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1819 => 0.1963, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.80% (0.2782 => 0.2999, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.79% (0.5265 => 0.5675, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2726 => 0.2937, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.4390 => 0.4728, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 7.56% (0.2607 => 0.2804, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.55% (0.2596 => 0.2792, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.50% (0.2760 => 0.2967, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.40% (0.2690 => 0.2889, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.38% (0.3022 => 0.3245, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.37% (0.7038 => 0.7557, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2628 => 0.2821, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2761 => 0.2963, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.31% (0.3899 => 0.4184, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2765 => 0.2967, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2696 => 0.2892, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.25% (0.2937 => 0.3150, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.24% (1.2193 => 1.3076, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3107 => 0.3332, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.21% (0.3149 => 0.3376, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.18% (0.2966 => 0.3179, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.15% (1.9828 => 2.1246, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.14% (0.3489 => 0.3738, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.13% (0.9199 => 0.9855, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.03% (0.4379 => 0.4687, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3580 => 0.3830, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.94% (0.3485 => 0.3727, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.86% (0.3192 => 0.3411, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.78% (0.6959 => 0.7431, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.60% (0.3453 => 0.3681, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.59% (0.3293 => 0.3510, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.58% (0.2127 => 0.2267, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.49% (0.1588 => 0.1691, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.45% (1.1364 => 1.2097, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.40% (0.3534 => 0.3760, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 6.36% (0.1589 => 0.1690, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.28% (0.3868 => 0.4111, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5577 => 0.5922, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.2914 => 0.3094, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.16% (0.5637 => 0.5984, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.15% (0.4016 => 0.4263, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.12% (0.2925 => 0.3104, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.11% (1.4563 => 1.5453, std. dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 6.06% (13.8202 => 14.6583, std. dev.: 0.0158) MultiSource/Benchmarks/McCat/08-main/main: 6.06% (0.2243 => 0.2379, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.06% (0.1865 => 0.1978, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.04% (0.3756 => 0.3983, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2023 => 0.2145, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.98% (0.3246 => 0.3440, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (7.2180 => 7.6460, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 5.93% (0.7506 => 0.7951, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.87% (1.3245 => 1.4022, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.2945 => 0.3117, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.71% (1.2292 => 1.2994, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.62% (0.4113 => 0.4344, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.60% (3.8646 => 4.0812, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.54% (1.3819 => 1.4585, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 5.54% (0.2995 => 0.3161, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.46% (0.7460 => 0.7867, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (1.3813 => 1.4564, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.42% (1.1061 => 1.1661, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 5.42% (0.8310 => 0.8760, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.3801 => 4.6135, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (3.6692 => 3.8611, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.20% (0.4791 => 0.5040, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.14% (0.3755 => 0.3948, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.11% (1.9270 => 2.0254, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.09% (1.0594 => 1.1133, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.08% (4.4433 => 4.6688, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.05% (0.6283 => 0.6600, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 4.94% (0.3220 => 0.3379, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.92% (0.6135 => 0.6437, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 4.87% (2.1791 => 2.2853, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 4.81% (16.6129 => 17.4126, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.67% (13.2842 => 13.9040, std. dev.: 0.0167) MultiSource/Applications/JM/lencod/lencod: 4.51% (14.8535 => 15.5228, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.45% (0.8818 => 0.9210, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.22% (0.3131 => 0.3263, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.19% (1.1333 => 1.1808, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.18% (3.1889 => 3.3223, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.8698 => 0.9057, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.10% (0.3245 => 0.3378, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.98% (8.4961 => 8.8340, std. dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: 3.95% (0.2859 => 0.2972, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.70% (6.5754 => 6.8186, std. dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (4.9865 => 5.1653, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 3.53% (4.6629 => 4.8273, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.49% (3.2742 => 3.3885, std. dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 3.32% (14.5298 => 15.0128, std. dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 3.27% (16.2614 => 16.7935, std. dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.92% (1.5188 => 1.5632, std. dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.88% (0.9108 => 0.9370, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.85% (0.6250 => 0.6428, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.4805 => 0.4920, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.39% (6.2785 => 6.4286, std. dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.1007 => 2.1505, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.32% (3.7467 => 3.8335, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.15% (0.6744 => 0.6889, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.98% (1.0313 => 1.0517, std. dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.91% (33.2944 => 33.9319, std. dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.2749 => 1.2923, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std. dev.: 0.0276) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.63% (1.2998 => 1.4250, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.86% (1.5824 => 1.6593, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7433, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.53% (10.7476 => 11.0199, std. dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.41% (1.5089 => 1.5453, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6019, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.07% (3.2729 => 3.3405, std. dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.97% (1.4298 => 1.4580, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0082) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6469 => 3.6860, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6388, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.88% (0.2670 => 0.2513, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.58% (22.5627 => 21.3033, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.2308 => 1.0970, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.22% (1.3780 => 1.3198, std. dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0217, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -3.18% (1.1560 => 1.1192, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (8.8259 => 8.6069, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: -2.46% (1.9762 => 1.9275, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2353, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -1.82% (5.3167 => 5.2201, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3305 => 7.2014, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9734, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9924, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2213, std. dev.: 0.0304) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (84.4286 => 83.4165, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.12% (5.5401 => 5.4782, std. dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.10% (20.3410 => 20.1165, std. dev.: 0.0140) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 16:41:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 18:41:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120827234152.671562A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3252?compare_to=3246&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3252, Order: 162696, Start Time: 2012-08-27 20:59:24, End Time: 2012-08-27 23:42:51 To: 3246, Order: 162678, Start Time: 2012-08-27 17:48:09, End Time: 2012-08-27 20:31:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 967 (773 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.47% (55.0305 => 54.2209, std. dev.: 0.3117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.94% (0.3446 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.92% (0.3465 => 0.3982, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.82% (0.3488 => 0.4005, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.80% (0.3460 => 0.3972, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.79% (0.3442 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.70% (0.3496 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.22% (0.3650 => 0.4169, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.16% (0.3643 => 0.4159, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.78% (0.3724 => 0.4237, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.21% (0.3792 => 0.4179, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.75% (0.5826 => 0.6336, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.5889 => 0.6386, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.1620 => 0.1755, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.97% (0.1619 => 0.1748, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.58% (1.5932 => 1.7139, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.23% (3.5627 => 3.8202, std. dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (1.6211 => 1.7376, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.15% (1.3152 => 1.4092, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 6.78% (0.7171 => 0.7657, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.71% (0.4994 => 0.5329, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.2014 => 0.2149, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.40% (0.4361 => 0.4640, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.5000 => 0.5317, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (0.5026 => 0.5341, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.13% (0.3930 => 0.4171, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.10% (0.5900 => 0.6260, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 6.04% (4.2109 => 4.4651, std. dev.: 0.0094) MultiSource/Applications/d/make_dparser: 5.83% (1.0781 => 1.1410, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.81% (0.4029 => 0.4263, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.64% (2.7292 => 2.8832, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.44% (0.2866 => 0.3022, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.14% (1.9694 => 2.0706, std. dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 5.03% (0.3004 => 0.3155, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.97% (2.1013 => 2.2058, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.91% (0.2566 => 0.2692, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.91% (0.3890 => 0.4081, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.90% (0.2875 => 0.3016, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (1.9966 => 2.0945, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 4.86% (5.5417 => 5.8112, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.73% (0.2792 => 0.2924, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (4.4195 => 4.6265, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.68% (0.4658 => 0.4876, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 4.68% (0.2714 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.67% (0.2738 => 0.2866, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.63% (0.3195 => 0.3343, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.62% (0.2725 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.57% (0.2780 => 0.2907, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.56% (0.9909 => 1.0361, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3362 => 0.3515, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.55% (2.1653 => 2.2638, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2750 => 0.2875, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.53% (2.0673 => 2.1609, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.51% (0.2813 => 0.2940, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.51% (0.2729 => 0.2852, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.50% (0.2911 => 0.3042, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.48% (0.3124 => 0.3264, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2803 => 0.2928, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 4.45% (4.6177 => 4.8230, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/objinst: 4.43% (0.2823 => 0.2948, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.3096 => 0.3232, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.38% (0.3903 => 0.4074, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.32% (1.8794 => 1.9605, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.23% (0.4139 => 0.4314, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 4.22% (0.3317 => 0.3457, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 4.21% (0.3348 => 0.3489, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.19% (0.3678 => 0.3832, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.18% (0.3060 => 0.3188, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.16% (0.3267 => 0.3403, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.14% (0.3258 => 0.3393, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 4.12% (1.4269 => 1.4857, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.11% (0.3282 => 0.3417, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.06% (0.3625 => 0.3772, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 4.05% (0.3726 => 0.3877, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.03% (0.3477 => 0.3617, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.01% (0.7875 => 0.8191, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.3845 => 0.3994, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.80% (0.6634 => 0.6886, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: 3.79% (0.9697 => 1.0065, std. dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 3.78% (23.5202 => 24.4097, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash: 3.76% (0.4146 => 0.4302, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 3.71% (0.5546 => 0.5752, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.71% (0.3690 => 0.3827, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.4251 => 0.4407, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.57% (0.3981 => 0.4123, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.34% (0.3084 => 0.3187, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.30% (0.3336 => 0.3446, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.09% (0.6435 => 0.6634, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.5012 => 0.5164, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.62% (2.0346 => 2.0880, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (0.4847 => 0.4950, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.47% (0.7426 => 0.7535, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.59% (0.2122 => 0.2283, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6774, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1644, std. dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6513, std. dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1997, std. dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5017, std. dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2229, std. dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4474, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2876, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std. dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.69% (2.4764 => 2.4097, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5733, std. dev.: 0.0153) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7994, std. dev.: 0.0163) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.16% (0.2402 => 0.2254, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8033, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -3.03% (17.2379 => 16.7153, std. dev.: 0.1144) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7760, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5695, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4965, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (16.2163 => 15.9735, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 17:23:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 19:23:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828002312.3C4B72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3253?compare_to=3247&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3253, Order: 162703, Start Time: 2012-08-27 23:04:52, End Time: 2012-08-28 00:24:08 To: 3247, Order: 162690, Start Time: 2012-08-27 19:29:56, End Time: 2012-08-27 20:49:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 948 (731 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 26.37% (10.3673 => 13.1010, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 13.42% (0.3473 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3561 => 0.4029, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.13% (0.3497 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.12% (0.3543 => 0.4008, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.04% (0.3543 => 0.4005, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3516 => 0.3974, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.59% (0.3694 => 0.4159, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.35% (1.1194 => 1.2576, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.25% (0.3828 => 0.4297, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.25% (0.3927 => 0.4408, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (1.7609 => 1.9480, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.03% (2.2022 => 2.4230, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.28% (0.6030 => 0.6469, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.26% (0.1584 => 0.1699, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.76% (0.3121 => 0.3332, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.46% (0.4615 => 0.4913, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 6.43% (0.3282 => 0.3493, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.34% (0.1892 => 0.2012, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 6.14% (0.7326 => 0.7776, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.12% (7.0540 => 7.4860, std. dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 5.95% (10.4361 => 11.0568, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.59% (0.3307 => 0.3492, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.43% (0.4879 => 0.5144, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 5.26% (0.7433 => 0.7824, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.21% (4.9449 => 5.2027, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 5.17% (9.4845 => 9.9753, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.15% (0.2271 => 0.2388, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2107 => 0.2215, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.94% (5.0018 => 5.2491, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.88% (0.5569 => 0.5841, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.83% (0.8172 => 0.8567, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.75% (0.2758 => 0.2889, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.66% (4.2646 => 4.4634, std. dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 4.54% (0.3109 => 0.3250, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.51% (0.5860 => 0.6124, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.49% (0.8067 => 0.8429, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 4.41% (0.3423 => 0.3574, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 4.37% (0.4299 => 0.4487, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2700 => 0.2817, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.33% (1.3050 => 1.3615, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.28% (8.1363 => 8.4843, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.4103 => 0.4276, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.20% (0.7835 => 0.8164, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 4.18% (0.3180 => 0.3313, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 4.14% (0.3092 => 0.3220, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.5415 => 1.6042, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.01% (0.3441 => 0.3579, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.91% (5.7591 => 5.9845, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.86% (0.4636 => 0.4815, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 3.84% (1.1642 => 1.2089, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.83% (0.3136 => 0.3256, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.5105 => 0.5299, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.75% (0.9765 => 1.0131, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.70% (0.2891 => 0.2998, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.67% (0.6450 => 0.6687, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.67% (1.1861 => 1.2296, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.66% (0.3826 => 0.3966, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 3.60% (0.3387 => 0.3509, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.51% (0.6675 => 0.6909, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.47% (3.3354 => 3.4511, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 3.44% (1.5603 => 1.6140, std. dev.: 0.0052) MultiSource/Applications/lua/lua: 3.41% (3.8723 => 4.0044, std. dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.31% (0.3865 => 0.3993, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.31% (0.3232 => 0.3339, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.29% (2.0273 => 2.0940, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.21% (0.3650 => 0.3767, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.19% (0.4289 => 0.4426, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3603 => 0.3718, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.18% (14.3668 => 14.8236, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 3.13% (0.3422 => 0.3529, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.08% (1.4186 => 1.4623, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.06% (0.5981 => 0.6164, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.00% (0.4064 => 0.4186, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.99% (0.6456 => 0.6649, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.96% (2.0665 => 2.1276, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 2.94% (2.2969 => 2.3644, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.93% (0.4203 => 0.4326, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.90% (0.4620 => 0.4754, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.88% (0.3684 => 0.3790, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8921 => 0.9171, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.4048 => 0.4161, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.72% (1.2842 => 1.3191, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.70% (1.5859 => 1.6287, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.59% (0.5020 => 0.5150, std. dev.: 0.0021) MultiSource/Applications/minisat/minisat: 2.56% (0.7115 => 0.7297, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.50% (17.1811 => 17.6104, std. dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.2024 => 2.2534, std. dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 2.05% (1.1840 => 1.2083, std. dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 1.80% (21.9371 => 22.3321, std. dev.: 0.0218) MultiSource/Applications/lemon/lemon: 1.79% (1.0722 => 1.0914, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (7.9617 => 8.0892, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.23% (0.8101 => 0.8201, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.23% (4.2280 => 4.4492, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7563, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 1.72% (3.2827 => 3.3390, std. dev.: 0.0027) MultiSource/Applications/lua/lua: 1.67% (26.0924 => 26.5293, std. dev.: 0.0199) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5086 => 1.5306, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2309, std. dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash2: 1.22% (3.1578 => 3.1964, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 1.13% (2.2771 => 2.3028, std. dev.: 0.0094) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5772, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6813, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.00% (1.3045 => 1.3176, std. dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.50% (5.2763 => 3.1922, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.69% (5.3855 => 3.7325, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.27% (5.3526 => 3.7325, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0536, std. dev.: 0.0207) MultiSource/Applications/ClamAV/clamscan: -13.97% (22.1758 => 19.0780, std. dev.: 0.0311) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.76% (2.9384 => 2.5636, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.79% (1.2373 => 1.1038, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -9.17% (1.5373 => 1.3964, std. dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.10% (1.1396 => 1.0701, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5648, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4655, std. dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.95% (8.6802 => 8.4243, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: -2.90% (10.2830 => 9.9846, std. dev.: 0.0253) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9630, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3433, std. dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8134, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (1.6805 => 1.6630, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 17:36:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 19:36:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828003646.7843B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3254?compare_to=3250&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3254, Order: 162704, Start Time: 2012-08-27 23:26:27, End Time: 2012-08-28 00:37:45 To: 3250, Order: 162701, Start Time: 2012-08-27 21:59:56, End Time: 2012-08-27 23:10:48 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 6 (8 on baseline) Performance Improvements: 4 (2 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 879 (879 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.88% (0.4407 => 0.4578, std. dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.17% (0.3383 => 0.3558, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.46% (2.6648 => 2.7571, std. dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.38% (4.2254 => 4.2839, std. dev.: 0.0178) MultiSource/Applications/SPASS/SPASS: 1.32% (8.3413 => 8.4516, std. dev.: 0.0232) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.04% (2.8737 => 2.9036, std. dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.45% (0.1854 => 0.1753, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: -1.96% (0.7770 => 0.7618, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: -1.08% (1.8804 => 1.8601, std. dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.46% (46.4307 => 44.8245, std. dev.: 0.3785) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.79% (0.3301 => 0.3558, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.64% (0.2857 => 0.2961, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.43% (2.6656 => 2.7571, std. dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.95% (0.8498 => 0.8664, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (4.2246 => 4.2839, std. dev.: 0.0178) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.38% (1.2726 => 1.2902, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 1.09% (1.5605 => 1.5775, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 1.08% (1.7330 => 1.7518, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.55% (0.7738 => 0.7618, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: -1.05% (1.8798 => 1.8601, std. dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 19:51:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 21:51:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828025109.EC6232A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3255?compare_to=3254&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3255, Order: 162722, Start Time: 2012-08-28 01:41:22, End Time: 2012-08-28 02:52:10 To: 3254, Order: 162704, Start Time: 2012-08-27 23:26:27, End Time: 2012-08-28 00:37:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 2 (2 on baseline) Performance Improvements: 5 (13 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 882 (874 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 3.55% (0.3129 => 0.3240, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.90% (1.6804 => 1.7124, std. dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.36% (0.7707 => 0.7525, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: -1.28% (3.8862 => 3.8365, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: -1.20% (1.0856 => 1.0726, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.22% (2.4771 => 2.4220, std. dev.: 0.0200) MultiSource/Benchmarks/llubenchmark/llu: -1.22% (2.0143 => 1.9897, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.84% (21.1721 => 23.8899, std. dev.: 1.0227) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (0.3301 => 0.3510, std. dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.33% (0.7784 => 0.7525, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.93% (0.5740 => 0.5572, std. dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (1.0689 => 1.0445, std. dev.: 0.0086) MultiSource/Applications/lua/lua: -2.07% (3.5980 => 3.5234, std. dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.05% (0.4880 => 0.4780, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.01% (0.5963 => 0.5843, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.94% (1.2742 => 1.2495, std. dev.: 0.0066) MultiSource/Applications/spiff/spiff: -1.31% (0.7738 => 0.7637, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.22% (4.2616 => 4.2095, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: -1.11% (3.8796 => 3.8365, std. dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.36% (15.8312 => 14.6666, std. dev.: 0.2958) MultiSource/Benchmarks/llubenchmark/llu: -1.46% (2.0192 => 1.9897, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.37% (1.7361 => 1.7124, std. dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 20:22:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 22:22:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828032251.E11332A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3256?compare_to=3251&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3256, Order: 162723, Start Time: 2012-08-28 02:09:30, End Time: 2012-08-28 03:23:50 To: 3251, Order: 162701, Start Time: 2012-08-27 22:10:58, End Time: 2012-08-27 23:25:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (163 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 965 (706 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.43% (54.2684 => 56.6709, std. dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.07% (78.3929 => 80.0126, std. dev.: 0.1063) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.00% (1.5453 => 1.5298, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.54% (2.0176 => 2.3109, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.26% (0.5818 => 0.6531, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.98% (0.7061 => 0.7907, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.88% (0.5748 => 0.6431, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.71% (0.3578 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.55% (0.3646 => 0.4067, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.41% (0.3601 => 0.4012, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.34% (0.3650 => 0.4064, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.30% (0.3663 => 0.4077, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3623 => 0.4032, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 11.27% (0.3789 => 0.4216, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.01% (0.3914 => 0.4345, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.84% (0.4003 => 0.4437, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.71% (0.3940 => 0.4362, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.42% (0.1986 => 0.2173, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.33% (0.7710 => 0.8429, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.27% (0.3130 => 0.3420, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.96% (0.1819 => 0.1982, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.78% (0.1413 => 0.1537, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.63% (0.2781 => 0.3021, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.60% (3.9660 => 4.3069, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash2: 8.53% (0.4328 => 0.4697, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.49% (0.4062 => 0.4407, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.38% (0.2782 => 0.3015, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.33% (0.2760 => 0.2990, std. dev.: 0.0044) MultiSource/Applications/hbd/hbd: 8.30% (1.3693 => 1.4829, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 7.99% (0.1589 => 0.1716, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.98% (0.2655 => 0.2867, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.94% (0.2596 => 0.2802, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.92% (0.5265 => 0.5682, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 7.90% (0.2761 => 0.2979, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.81% (0.2765 => 0.2981, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.73% (0.2690 => 0.2898, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.71% (0.3022 => 0.3255, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2726 => 0.2936, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.70% (0.7038 => 0.7580, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 7.69% (0.2628 => 0.2830, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.63% (1.9828 => 2.1341, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.56% (1.2193 => 1.3115, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.55% (0.2966 => 0.3190, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.51% (0.3899 => 0.4192, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.47% (0.4379 => 0.4706, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.45% (0.4390 => 0.4717, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.44% (0.9199 => 0.9883, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3107 => 0.3338, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.35% (0.2937 => 0.3153, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3149 => 0.3380, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.31% (0.2696 => 0.2893, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3192 => 0.3425, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2988 => 0.3206, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.3580 => 0.3840, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.19% (0.3489 => 0.3740, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 7.18% (0.3453 => 0.3701, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3485 => 0.3734, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.11% (0.3756 => 0.4023, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.06% (0.6959 => 0.7450, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.98% (0.2721 => 0.2911, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2127 => 0.2275, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.92% (0.4016 => 0.4294, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.86% (0.1588 => 0.1697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.83% (0.3293 => 0.3518, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3534 => 0.3773, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.74% (13.8202 => 14.7523, std. dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.69% (0.2914 => 0.3109, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.69% (1.1364 => 1.2124, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.67% (0.5577 => 0.5949, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 6.64% (0.3868 => 0.4125, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.49% (1.4563 => 1.5508, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.43% (0.2023 => 0.2153, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.40% (0.5637 => 0.5998, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 6.39% (0.2925 => 0.3112, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.35% (0.2945 => 0.3132, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.35% (0.3246 => 0.3452, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.34% (7.2180 => 7.6755, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.33% (0.1865 => 0.1983, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.29% (0.2243 => 0.2384, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.24% (0.7506 => 0.7974, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 6.10% (0.4113 => 0.4364, std. dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 6.10% (0.1657 => 0.1758, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 6.08% (0.2995 => 0.3177, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 5.95% (1.2292 => 1.3023, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.86% (1.3245 => 1.4021, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 5.86% (3.8646 => 4.0910, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 5.78% (1.1061 => 1.1700, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.75% (0.2140 => 0.2263, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (0.7460 => 0.7885, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.68% (0.8310 => 0.8782, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.66% (1.3813 => 1.4595, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.66% (1.3819 => 1.4601, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.66% (3.6692 => 3.8767, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.62% (4.3801 => 4.6263, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 5.59% (0.3220 => 0.3400, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.53% (0.4791 => 0.5056, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (4.4433 => 4.6884, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.43% (0.3755 => 0.3959, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 5.41% (1.9270 => 2.0312, std. dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.40% (0.6283 => 0.6622, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 5.34% (2.1791 => 2.2954, std. dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 5.31% (1.0594 => 1.1157, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.31% (0.6135 => 0.6461, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 5.15% (16.6129 => 17.4677, std. dev.: 0.0226) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (13.2842 => 13.9611, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.88% (0.8818 => 0.9248, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.83% (14.8535 => 15.5709, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.65% (0.3245 => 0.3396, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.55% (1.1333 => 1.1849, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.48% (0.8698 => 0.9088, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (8.4961 => 8.8661, std. dev.: 0.0111) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.35% (0.2321 => 0.2422, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 4.31% (0.3131 => 0.3266, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 4.30% (0.2859 => 0.2982, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.25% (3.1889 => 3.3245, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.06% (6.5754 => 6.8422, std. dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 3.91% (4.6629 => 4.8451, std. dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1773, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.70% (3.2742 => 3.3955, std. dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: 3.57% (14.5298 => 15.0485, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.38% (1.5188 => 1.5702, std. dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 3.33% (16.2614 => 16.8026, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.21% (0.9108 => 0.9400, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.10% (0.6250 => 0.6444, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.04% (0.4805 => 0.4951, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: 2.89% (0.6744 => 0.6939, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.69% (6.2785 => 6.4471, std. dev.: 0.0057) MultiSource/Applications/lua/lua: 2.56% (3.7467 => 3.8428, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.1007 => 2.1536, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 2.39% (1.0313 => 1.0559, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.83% (33.2944 => 33.9026, std. dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5146, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2648, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 10.59% (1.2998 => 1.4375, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.87% (1.5824 => 1.6595, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7436, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.07% (1.7081 => 1.7776, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9629, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std. dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 2.88% (3.7731 => 3.8819, std. dev.: 0.0322) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4271 => 7.6025, std. dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 2.30% (10.7476 => 10.9946, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.04% (3.2729 => 3.3397, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 2.01% (1.4298 => 1.4585, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (1.5089 => 1.5298, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1838, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.10% (3.6469 => 3.6871, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5737, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.08% (4.5928 => 4.6423, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.28% (22.5627 => 21.3721, std. dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2308 => 1.0955, std. dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5153, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.20% (1.3780 => 1.3201, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -3.20% (1.1560 => 1.1190, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.50% (8.8259 => 8.6049, std. dev.: 0.0203) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.22% (6.3560 => 6.2147, std. dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (0.8342 => 0.8164, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.77% (5.3167 => 5.2224, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9727, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2046, std. dev.: 0.0076) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7922, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std. dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4257, std. dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.09% (5.5401 => 5.4799, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 20:32:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 22:32:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828033215.193D12A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3257?compare_to=3253&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3257, Order: 162723, Start Time: 2012-08-28 02:13:52, End Time: 2012-08-28 03:33:14 To: 3253, Order: 162703, Start Time: 2012-08-27 23:04:52, End Time: 2012-08-28 00:24:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (725 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (13.1010 => 13.2336, std. dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.65% (10.3673 => 13.2336, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.90% (0.3543 => 0.4071, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.68% (0.3473 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.36% (0.3497 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.34% (0.3543 => 0.4051, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.32% (0.3561 => 0.4071, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.31% (0.3516 => 0.4019, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.81% (0.3694 => 0.4204, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 13.56% (0.3828 => 0.4347, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.18% (0.3886 => 0.4398, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.17% (0.3927 => 0.4444, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.14% (1.1194 => 1.2553, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.60% (1.7609 => 1.9476, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 9.85% (0.1432 => 0.1573, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.58% (2.2022 => 2.4132, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5925 => 0.6430, std. dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference-object: 8.41% (0.6030 => 0.6537, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1584 => 0.1700, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.18% (0.7326 => 0.7852, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1892 => 0.2024, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 6.65% (10.4361 => 11.1302, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: 6.61% (0.3282 => 0.3499, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.05% (0.4879 => 0.5174, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4615 => 0.4889, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.76% (7.0540 => 7.4601, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3307 => 0.3493, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2271 => 0.2390, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.18% (9.4845 => 9.9760, std. dev.: 0.0106) MultiSource/Benchmarks/McCat/08-main/main: 5.17% (0.2554 => 0.2686, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (4.9449 => 5.1972, std. dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.04% (5.0018 => 5.2537, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.99% (0.8172 => 0.8580, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.94% (0.2107 => 0.2211, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.90% (0.7433 => 0.7797, std. dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: 4.82% (0.3109 => 0.3259, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.3121 => 0.3269, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.65% (4.2646 => 4.4631, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.49% (8.1363 => 8.5016, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.45% (0.5569 => 0.5817, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.45% (1.3050 => 1.3631, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 4.38% (0.3423 => 0.3573, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.33% (0.5860 => 0.6114, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 4.33% (0.4299 => 0.4485, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.26% (0.2700 => 0.2815, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.21% (0.4636 => 0.4831, std. dev.: 0.0019) MultiSource/Applications/spiff/spiff: 4.14% (0.7835 => 0.8159, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 4.06% (0.2905 => 0.3023, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.03% (0.3180 => 0.3308, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.98% (0.3092 => 0.3215, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.97% (0.8067 => 0.8387, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 3.96% (0.2831 => 0.2943, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.95% (0.2758 => 0.2867, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.92% (0.3441 => 0.3576, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (0.5105 => 0.5305, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.87% (5.7591 => 5.9820, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.86% (1.5415 => 1.6010, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3865 => 0.4014, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.82% (0.2725 => 0.2829, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.74% (0.3098 => 0.3214, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3232 => 0.3353, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.68% (1.1861 => 1.2297, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.66% (0.2872 => 0.2977, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.64% (0.6450 => 0.6685, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 3.64% (0.4289 => 0.4445, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.63% (0.2756 => 0.2856, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.59% (0.3283 => 0.3401, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2871 => 0.2974, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.58% (0.2793 => 0.2893, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.57% (0.9765 => 1.0114, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.55% (0.6675 => 0.6912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.54% (0.3052 => 0.3160, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.53% (0.4103 => 0.4248, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.52% (0.4064 => 0.4207, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.51% (0.3387 => 0.3506, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.51% (1.5603 => 1.6151, std. dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.50% (1.1642 => 1.2050, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.50% (0.3826 => 0.3960, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.50% (2.0665 => 2.1388, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.48% (0.3162 => 0.3272, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.48% (0.3422 => 0.3541, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.47% (3.3354 => 3.4513, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.39% (0.3603 => 0.3725, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.32% (0.3136 => 0.3240, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.31% (0.6456 => 0.6670, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.26% (2.0273 => 2.0934, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3684 => 0.3804, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4620 => 0.4770, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.4203 => 0.4337, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.19% (0.4048 => 0.4177, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.17% (3.8723 => 3.9950, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (14.3668 => 14.8216, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 3.08% (0.3379 => 0.3483, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.01% (1.2842 => 1.3229, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (1.4186 => 1.4606, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.96% (0.5981 => 0.6158, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.85% (0.5020 => 0.5163, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8921 => 0.9164, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.60% (2.2969 => 2.3566, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 2.35% (17.1811 => 17.5851, std. dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.2024 => 2.2532, std. dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.19% (0.7115 => 0.7271, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 2.18% (1.1840 => 1.2098, std. dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.87% (7.9617 => 8.1104, std. dev.: 0.0044) MultiSource/Applications/lemon/lemon: 1.62% (1.0722 => 1.0896, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.57% (21.9371 => 22.2819, std. dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (4.2280 => 4.4408, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.11% (3.6395 => 3.7527, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 1.74% (26.0924 => 26.5469, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3398, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5313, std. dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1983, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2314, std. dev.: 0.0279) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std. dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1255, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.50% (5.2763 => 3.1921, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.01% (5.3855 => 3.7157, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7170, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0511, std. dev.: 0.0391) MultiSource/Applications/ClamAV/clamscan: -14.03% (22.1758 => 19.0652, std. dev.: 0.0265) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.16% (2.9384 => 2.5516, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -7.79% (1.5373 => 1.4175, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4674, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.1396 => 1.0698, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.03% (2.7294 => 2.5647, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std. dev.: 0.0018) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.23% (32.5116 => 31.4612, std. dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4156, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0028, std. dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (8.1563 => 7.9533, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.55% (12.5348 => 12.3410, std. dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (1.6805 => 1.6632, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 21:18:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 23:18:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828041813.0739B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3258?compare_to=3255&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3258, Order: 162728, Start Time: 2012-08-28 03:07:41, End Time: 2012-08-28 04:19:12 To: 3255, Order: 162722, Start Time: 2012-08-28 01:41:22, End Time: 2012-08-28 02:52:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 35 (34 on baseline) Performance Improvements: 29 (31 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 825 (824 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 4.80% (1.0445 => 1.0946, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.8772 => 0.8979, std. dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.90% (0.5843 => 0.5954, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.72% (4.2095 => 4.2817, std. dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.84% (0.0807 => 0.0951, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 15.59% (1.7315 => 2.0014, std. dev.: 0.0277) SingleSource/Benchmarks/McGill/queens: 12.69% (1.6283 => 1.8350, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 12.55% (0.3745 => 0.4215, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.90% (2.4220 => 2.6859, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.49% (0.1531 => 0.1661, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.46% (1.0079 => 1.0831, std. dev.: 0.0279) MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.35% (2.8936 => 3.0772, std. dev.: 0.0063) MultiSource/Benchmarks/FreeBench/mason/mason: 6.01% (0.4939 => 0.5236, std. dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.19% (5.2461 => 5.4661, std. dev.: 0.0341) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (27.1829 => 28.3125, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/dt: 4.09% (0.9851 => 1.0254, std. dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 3.94% (3.9037 => 4.0577, std. dev.: 0.0238) SingleSource/Benchmarks/Misc/whetstone: 3.75% (2.3624 => 2.4511, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.57% (0.3526 => 0.3652, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.37% (6.6304 => 6.8539, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 3.23% (14.4303 => 14.8965, std. dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.78% (0.5180 => 0.5324, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (62.3820 => 64.0800, std. dev.: 0.3794) SingleSource/Benchmarks/Stanford/FloatMM: 2.63% (0.8135 => 0.8349, std. dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.48% (41.4167 => 42.4422, std. dev.: 0.1336) MultiSource/Benchmarks/BitBench/five11/five11: 2.18% (5.1583 => 5.2706, std. dev.: 0.0234) MultiSource/Applications/lua/lua: 2.16% (29.4783 => 30.1157, std. dev.: 0.1037) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.76% (25.6667 => 26.1188, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 1.72% (2.5204 => 2.5638, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: 1.62% (1.7331 => 1.7611, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.60% (2.7117 => 2.7550, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.51% (3.4137 => 3.4654, std. dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 1.49% (2.4044 => 2.4403, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.48% (1.6153 => 1.6392, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 1.25% (4.6410 => 4.6992, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.04% (0.7637 => 0.7481, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -20.15% (1.7281 => 1.3799, std. dev.: 0.0412) SingleSource/Benchmarks/Shootout-C++/ackermann: -16.11% (3.9114 => 3.2812, std. dev.: 0.2070) SingleSource/Benchmarks/Shootout-C++/matrix: -14.08% (3.4640 => 2.9763, std. dev.: 0.0198) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.77% (14.6666 => 12.6463, std. dev.: 0.0780) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1631 => 7.1613, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/pi: -9.91% (1.6550 => 1.4910, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.13% (1.4447 => 1.3273, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.87% (3.9353 => 3.6650, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.99% (1.1628 => 1.0931, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9724 => 2.7945, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -5.11% (0.3838 => 0.3642, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: -5.09% (0.2652 => 0.2517, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: -5.00% (1.4169 => 1.3460, std. dev.: 0.0166) MultiSource/Applications/lambda-0_1_3/lambda: -4.79% (7.6825 => 7.3143, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -4.47% (9.5483 => 9.1218, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.31% (0.4567 => 0.4416, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -3.11% (6.4675 => 6.2664, std. dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.00% (1.1728 => 1.1376, std. dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.81% (1.0760 => 1.0458, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -2.25% (2.9268 => 2.8609, std. dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.12% (3.7580 => 3.6784, std. dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (9.3716 => 9.1846, std. dev.: 0.0067) MultiSource/Applications/aha/aha: -1.75% (3.4325 => 3.3725, std. dev.: 0.0097) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.57% (2.3559 => 2.3188, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.37% (4.6054 => 4.5423, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/oourafft: -1.24% (3.8117 => 3.7645, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -1.18% (3.4755 => 3.4346, std. dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 2.40% (1.0689 => 1.0946, std. dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.15% (0.0766 => 0.0951, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0014, std. dev.: 0.0277) SingleSource/Benchmarks/McGill/queens: 12.85% (1.6261 => 1.8350, std. dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.72% (2.4042 => 2.6859, std. dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.92% (0.1525 => 0.1661, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.63% (1.0063 => 1.0831, std. dev.: 0.0279) MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.24% (2.8964 => 3.0772, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (0.3301 => 0.3505, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.85% (40.4792 => 42.4422, std. dev.: 0.1336) MultiSource/Benchmarks/FreeBench/mason/mason: 4.64% (0.5004 => 0.5236, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 4.51% (2.3453 => 2.4511, std. dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 4.29% (3.8907 => 4.0577, std. dev.: 0.0238) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.20% (27.1724 => 28.3125, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.10% (0.3508 => 0.3652, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/dt: 4.09% (0.9851 => 1.0254, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.79% (5.2665 => 5.4661, std. dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (6.6312 => 6.8539, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.35% (2.6656 => 2.7550, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.31% (0.7609 => 0.7861, std. dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 2.82% (14.4877 => 14.8965, std. dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.80% (0.5179 => 0.5324, std. dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 2.67% (62.4126 => 64.0800, std. dev.: 0.3794) SingleSource/Benchmarks/Stanford/FloatMM: 2.13% (0.8175 => 0.8349, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.01% (29.5232 => 30.1157, std. dev.: 0.1037) MultiSource/Benchmarks/Olden/bh/bh: 1.88% (2.5166 => 2.5638, std. dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.76% (25.6658 => 26.1188, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.75% (1.6110 => 1.6392, std. dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.68% (3.4080 => 3.4654, std. dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 1.62% (2.4013 => 2.4403, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 1.62% (1.7330 => 1.7611, std. dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: 1.48% (5.1938 => 5.2706, std. dev.: 0.0234) MultiSource/Benchmarks/Olden/em3d/em3d: 1.25% (4.6414 => 4.6992, std. dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.32% (0.7738 => 0.7481, std. dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: -1.57% (14.6079 => 14.3780, std. dev.: 0.0557) MultiSource/Applications/lua/lua: -1.23% (3.5980 => 3.5539, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -1.16% (3.8796 => 3.8347, std. dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -21.03% (1.7473 => 1.3799, std. dev.: 0.0412) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.12% (15.8312 => 12.6463, std. dev.: 0.0780) SingleSource/Benchmarks/Shootout-C++/matrix: -14.05% (3.4629 => 2.9763, std. dev.: 0.0198) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1613, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/pi: -9.84% (1.6538 => 1.4910, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.09% (1.4441 => 1.3273, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -7.01% (3.9413 => 3.6650, std. dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.15% (1.1647 => 1.0931, std. dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: -5.52% (0.2664 => 0.2517, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -5.06% (0.3836 => 0.3642, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -4.80% (7.6833 => 7.3143, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: -4.65% (1.4117 => 1.3460, std. dev.: 0.0166) SingleSource/Benchmarks/Misc/flops: -4.46% (9.5474 => 9.1218, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.24% (0.4564 => 0.4416, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.79% (1.2722 => 1.2367, std. dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.63% (1.1683 => 1.1376, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.14% (9.3855 => 9.1846, std. dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.13% (1.0686 => 1.0458, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.90% (3.7496 => 3.6784, std. dev.: 0.0154) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -1.64% (3.4286 => 3.3725, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.3569 => 2.3188, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.53% (4.6127 => 4.5423, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.8200 => 3.7645, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (1.1116 => 1.0969, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: -1.07% (2.8599 => 2.8294, std. dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 21:44:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 27 Aug 2012 23:44:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120828044429.AA0952A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3259?compare_to=3252&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3259, Order: 162723, Start Time: 2012-08-28 02:01:22, End Time: 2012-08-28 04:45:27 To: 3252, Order: 162696, Start Time: 2012-08-27 20:59:24, End Time: 2012-08-27 23:42:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (117 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 966 (775 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.66% (124.5699 => 131.6187, std. dev.: 0.2330) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.12% (54.2209 => 54.8262, std. dev.: 0.0542) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 16.17% (0.3488 => 0.4052, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 16.10% (0.3442 => 0.3996, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 16.08% (0.3465 => 0.4022, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 16.05% (0.3446 => 0.3999, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 16.01% (0.3460 => 0.4014, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.97% (0.3469 => 0.4023, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.93% (0.3496 => 0.4053, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 15.37% (0.3643 => 0.4203, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 15.37% (0.3650 => 0.4211, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.93% (0.3724 => 0.4280, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.07% (0.1063 => 0.1170, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5826 => 0.6359, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.78% (0.5889 => 0.6406, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.52% (0.1619 => 0.1757, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.1620 => 0.1758, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (3.5627 => 3.8321, std. dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 7.49% (0.7171 => 0.7708, std. dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 7.25% (1.5932 => 1.7087, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.22% (1.6211 => 1.7381, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.13% (1.3152 => 1.4090, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.2014 => 0.2149, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.50% (0.4029 => 0.4291, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.46% (0.5900 => 0.6281, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.44% (0.5000 => 0.5322, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (0.5026 => 0.5341, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.26% (0.4361 => 0.4634, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.18% (0.3930 => 0.4173, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.13% (0.4994 => 0.5300, std. dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.05% (2.7292 => 2.8943, std. dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 5.79% (4.2109 => 4.4547, std. dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 5.69% (1.0781 => 1.1394, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.41% (0.2866 => 0.3021, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.10% (1.9694 => 2.0698, std. dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.08% (1.9966 => 2.0980, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 5.02% (2.1013 => 2.2067, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.01% (0.2875 => 0.3019, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2750 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.86% (0.2714 => 0.2846, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.85% (0.3195 => 0.3350, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 4.84% (0.2725 => 0.2857, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.82% (5.5417 => 5.8086, std. dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.81% (0.4139 => 0.4338, std. dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 4.79% (0.3004 => 0.3148, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2780 => 0.2912, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.75% (0.2738 => 0.2868, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.73% (0.2792 => 0.2924, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/random: 4.71% (0.2803 => 0.2935, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (0.3890 => 0.4073, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.69% (0.9909 => 1.0374, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.65% (0.2729 => 0.2856, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.64% (0.2823 => 0.2954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.62% (0.2813 => 0.2943, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.59% (0.4658 => 0.4872, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.58% (2.0673 => 2.1619, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 4.55% (0.2811 => 0.2939, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.53% (0.2911 => 0.3043, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.52% (4.6177 => 4.8262, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 4.50% (0.3267 => 0.3414, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.49% (2.1653 => 2.2625, std. dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 4.48% (0.2566 => 0.2681, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (4.4195 => 4.6167, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 4.42% (0.3258 => 0.3402, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3096 => 0.3231, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.31% (0.3060 => 0.3192, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.27% (0.3845 => 0.4009, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.23% (0.3124 => 0.3256, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.22% (0.3362 => 0.3504, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 4.22% (0.4146 => 0.4321, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.3271 => 0.3409, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.21% (1.8794 => 1.9585, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.20% (0.3282 => 0.3420, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.20% (0.3903 => 0.4067, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.09% (0.2691 => 0.2801, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.08% (0.7875 => 0.8196, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3317 => 0.3452, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.3678 => 0.3827, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 4.05% (1.4269 => 1.4847, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 4.00% (0.3477 => 0.3616, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.97% (0.3348 => 0.3481, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3625 => 0.3768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.84% (0.3726 => 0.3869, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.77% (0.9697 => 1.0063, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 3.62% (0.5546 => 0.5747, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.60% (0.4251 => 0.4404, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.57% (0.6634 => 0.6871, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3690 => 0.3820, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.51% (23.5202 => 24.3469, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.42% (0.3981 => 0.4117, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.89% (0.5012 => 0.5157, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.66% (0.6435 => 0.6606, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.07% (2.0346 => 2.0767, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.56% (0.2122 => 0.2346, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6126, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6784, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1746, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.68% (1.8057 => 1.8902, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6295, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2121, std. dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5077, std. dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4402, std. dev.: 0.0123) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2203, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5894, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (105.3826 => 106.4570, std. dev.: 0.0684) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.50% (2.4764 => 2.4146, std. dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5603, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7985, std. dev.: 0.0108) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8068, std. dev.: 0.0036) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7753, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.48% (17.2379 => 16.8104, std. dev.: 0.0724) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9623, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4969, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 22:04:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 00:04:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828050459.5E0542A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3260?compare_to=3256&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3260, Order: 162733, Start Time: 2012-08-28 03:51:35, End Time: 2012-08-28 05:05:56 To: 3256, Order: 162723, Start Time: 2012-08-28 02:09:30, End Time: 2012-08-28 03:23:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (160 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 968 (708 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.27% (2.0176 => 2.3256, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 13.20% (0.0826 => 0.0935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 12.22% (0.5818 => 0.6529, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.16% (0.5748 => 0.6447, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.04% (0.7061 => 0.7911, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.68% (0.3578 => 0.3996, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3601 => 0.4017, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.55% (0.3646 => 0.4067, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3650 => 0.4066, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.33% (0.3663 => 0.4078, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3623 => 0.4031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.14% (0.3789 => 0.4211, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.91% (0.3914 => 0.4341, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.84% (0.4003 => 0.4437, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.71% (0.3940 => 0.4362, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.31% (0.7710 => 0.8428, std. dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 8.74% (0.2781 => 0.3024, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3130 => 0.3403, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1413 => 0.1536, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.69% (0.4328 => 0.4704, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.52% (0.2782 => 0.3019, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.40% (1.3693 => 1.4843, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.38% (3.9660 => 4.2984, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.36% (0.1819 => 0.1971, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.34% (0.5265 => 0.5704, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.10% (0.4062 => 0.4391, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 8.03% (0.2690 => 0.2906, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.02% (0.2607 => 0.2816, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 8.00% (0.2761 => 0.2982, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.94% (0.2596 => 0.2802, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2655 => 0.2864, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.84% (0.2628 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2760 => 0.2976, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2726 => 0.2939, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2765 => 0.2979, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.4390 => 0.4728, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.68% (0.2696 => 0.2903, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.68% (1.2193 => 1.3129, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.66% (0.3107 => 0.3345, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.64% (0.3022 => 0.3253, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 7.59% (0.2937 => 0.3160, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.59% (1.9828 => 2.1333, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3149 => 0.3388, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.2966 => 0.3191, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.54% (0.4379 => 0.4709, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.52% (0.7038 => 0.7567, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.44% (0.3899 => 0.4189, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.43% (0.3580 => 0.3846, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.38% (0.9199 => 0.9878, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.32% (0.1789 => 0.1920, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3489 => 0.3743, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.2988 => 0.3205, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.24% (0.1588 => 0.1703, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.20% (0.3485 => 0.3736, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.11% (0.3192 => 0.3419, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.04% (0.6959 => 0.7449, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 7.04% (0.3453 => 0.3696, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2127 => 0.2275, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 6.77% (0.3293 => 0.3516, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.76% (0.5577 => 0.5954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.71% (0.3534 => 0.3771, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.67% (1.1364 => 1.2122, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.57% (0.4016 => 0.4280, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.55% (0.3756 => 0.4002, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 6.55% (13.8202 => 14.7252, std. dev.: 0.0143) SingleSource/Benchmarks/McGill/chomp: 6.54% (0.1589 => 0.1693, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.51% (0.3868 => 0.4120, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.49% (0.2914 => 0.3103, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 6.49% (0.2945 => 0.3136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.46% (0.5637 => 0.6001, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.38% (7.2180 => 7.6784, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.37% (1.4563 => 1.5490, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.33% (0.2023 => 0.2151, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.26% (0.7506 => 0.7976, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3246 => 0.3449, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.24% (0.2995 => 0.3182, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 6.24% (0.2243 => 0.2383, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.20% (0.4113 => 0.4368, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.15% (0.2925 => 0.3105, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.97% (1.3813 => 1.4637, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 5.92% (1.2292 => 1.3020, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.90% (1.3819 => 1.4634, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.79% (3.6692 => 3.8815, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.78% (0.7460 => 0.7891, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.69% (4.3801 => 4.6295, std. dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.69% (1.3245 => 1.3999, std. dev.: 0.0143) MultiSource/Applications/Burg/burg: 5.66% (1.1061 => 1.1687, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 5.63% (0.8310 => 0.8778, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.62% (0.3755 => 0.3966, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 5.62% (3.8646 => 4.0816, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.61% (0.2140 => 0.2260, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.50% (4.4433 => 4.6876, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.49% (0.4791 => 0.5054, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.49% (0.8818 => 0.9302, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.44% (1.0594 => 1.1170, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6135 => 0.6468, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.30% (1.9270 => 2.0291, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.28% (0.6283 => 0.6615, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 5.12% (0.3220 => 0.3385, std. dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 5.09% (16.6129 => 17.4591, std. dev.: 0.0056) MultiSource/Applications/siod/siod: 4.97% (2.1791 => 2.2874, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.95% (13.2842 => 13.9422, std. dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 4.89% (14.8535 => 15.5802, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.53% (0.3245 => 0.3392, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.51% (1.1333 => 1.1844, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (8.4961 => 8.8657, std. dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.33% (0.8698 => 0.9075, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 4.28% (0.3131 => 0.3265, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.10% (6.5754 => 6.8448, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 3.99% (0.2859 => 0.2973, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 3.95% (3.1889 => 3.3150, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (3.2742 => 3.4007, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (4.9865 => 5.1676, std. dev.: 0.0194) MultiSource/Applications/oggenc/oggenc: 3.59% (4.6629 => 4.8304, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.50% (0.9108 => 0.9427, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.46% (14.5298 => 15.0332, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 3.29% (16.2614 => 16.7961, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (1.5188 => 1.5659, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.6250 => 0.6443, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.88% (6.2785 => 6.4592, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (2.1007 => 2.1529, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.45% (0.6744 => 0.6909, std. dev.: 0.0035) MultiSource/Applications/lua/lua: 2.43% (3.7467 => 3.8378, std. dev.: 0.0040) MultiSource/Applications/lemon/lemon: 2.35% (1.0313 => 1.0555, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.83% (33.2944 => 33.9038, std. dev.: 0.0231) MultiSource/Applications/SIBsim4/SIBsim4: 1.68% (1.2749 => 1.2963, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 25.58% (1.8175 => 2.2825, std. dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 9.90% (1.2998 => 1.4285, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (0.2093 => 0.2217, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.89% (1.5824 => 1.6598, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7415, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7763, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.76% (1.7688 => 1.8177, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6020, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.15% (10.7476 => 10.9782, std. dev.: 0.0600) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3401, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.96% (1.4298 => 1.4578, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (1.5089 => 1.5284, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5724, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6392, std. dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.44% (22.5627 => 21.3358, std. dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.64% (0.2670 => 0.2546, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.2308 => 1.0984, std. dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8056, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.09% (1.3780 => 1.3217, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -3.21% (1.1560 => 1.1189, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (8.8259 => 8.5869, std. dev.: 0.0147) MultiSource/Benchmarks/Olden/bh/bh: -2.43% (1.9762 => 1.9282, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2262, std. dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -1.84% (5.3167 => 5.2190, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: -1.74% (3.0263 => 2.9735, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2069, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.30% (9.9194 => 9.7904, std. dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.25% (20.3410 => 20.0873, std. dev.: 0.0238) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std. dev.: 0.0166) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4222, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.17% (5.5401 => 5.4753, std. dev.: 0.0080) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2321, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 22:21:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 00:21:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828052147.8FCE02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3261?compare_to=3257&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3261, Order: 162734, Start Time: 2012-08-28 04:03:40, End Time: 2012-08-28 05:22:46 To: 3257, Order: 162723, Start Time: 2012-08-28 02:13:52, End Time: 2012-08-28 03:33:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (128 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (723 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.86% (13.2336 => 13.7449, std. dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -4.34% (3.9267 => 3.7563, std. dev.: 0.0435) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.58% (10.3673 => 13.7449, std. dev.: 0.0086) SingleSource/UnitTests/ObjC/trivial-interface: 14.51% (0.3473 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.18% (0.3561 => 0.4066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.17% (0.3543 => 0.4045, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.15% (0.3497 => 0.3992, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.14% (0.3516 => 0.4013, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.11% (0.3543 => 0.4043, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3694 => 0.4198, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.32% (0.3828 => 0.4338, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.14% (0.3927 => 0.4443, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.10% (0.3886 => 0.4395, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.96% (1.1194 => 1.2533, std. dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.12% (1.7609 => 1.9391, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.02% (2.2022 => 2.4229, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 9.85% (0.1432 => 0.1573, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std. dev.: 0.0084) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1584 => 0.1700, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.00% (0.7326 => 0.7839, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1892 => 0.2024, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.58% (0.3177 => 0.3386, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.48% (10.4361 => 11.1125, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/oourafft: 6.40% (0.3282 => 0.3492, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.28% (0.4615 => 0.4905, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.04% (7.0540 => 7.4804, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.72% (0.3307 => 0.3496, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.57% (0.4879 => 0.5151, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 5.40% (0.2554 => 0.2692, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.33% (0.2271 => 0.2392, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.32% (0.2107 => 0.2219, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 5.30% (0.7433 => 0.7827, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 5.26% (9.4845 => 9.9833, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.22% (4.9449 => 5.2030, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.20% (5.0018 => 5.2618, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.04% (4.2646 => 4.4797, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.00% (0.8172 => 0.8581, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.85% (0.5569 => 0.5839, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 4.82% (0.3109 => 0.3259, std. dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.71% (0.3121 => 0.3268, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.66% (0.5860 => 0.6133, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (8.1363 => 8.5129, std. dev.: 0.0106) MultiSource/Benchmarks/McCat/18-imp/imp: 4.62% (0.3423 => 0.3581, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.53% (1.3050 => 1.3641, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.42% (0.4299 => 0.4489, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.34% (0.7835 => 0.8175, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2700 => 0.2817, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.28% (0.3180 => 0.3316, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.23% (0.4636 => 0.4832, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.19% (0.2891 => 0.3012, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.14% (5.7591 => 5.9975, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.13% (0.2758 => 0.2872, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.2905 => 0.3025, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.11% (0.5105 => 0.5315, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3441 => 0.3581, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 4.01% (0.3092 => 0.3216, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.98% (1.5415 => 1.6029, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.97% (1.1861 => 1.2332, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.88% (0.4103 => 0.4262, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.86% (0.3865 => 0.4014, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.85% (0.9765 => 1.0141, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 3.81% (0.2831 => 0.2939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.81% (0.2756 => 0.2861, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.81% (0.8067 => 0.8374, std. dev.: 0.0041) MultiSource/Applications/Burg/burg: 3.72% (1.1642 => 1.2075, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 3.71% (0.3098 => 0.3213, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6450 => 0.6689, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.67% (0.3650 => 0.3784, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.67% (0.6675 => 0.6920, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.67% (0.4064 => 0.4213, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.66% (0.4289 => 0.4446, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.66% (0.2872 => 0.2977, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3232 => 0.3350, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.63% (0.3387 => 0.3510, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 3.62% (0.3283 => 0.3402, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.62% (0.3422 => 0.3546, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.62% (0.2793 => 0.2894, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 3.59% (0.2871 => 0.2974, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (0.3935 => 0.4076, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3826 => 0.3962, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.54% (0.3136 => 0.3247, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.54% (2.0665 => 2.1396, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.52% (1.5603 => 1.6153, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.52% (2.0273 => 2.0986, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.49% (0.6456 => 0.6681, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 3.48% (0.2877 => 0.2977, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.44% (0.3603 => 0.3727, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.44% (3.3354 => 3.4501, std. dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.42% (0.3162 => 0.3270, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (14.3668 => 14.8570, std. dev.: 0.0030) MultiSource/Applications/lua/lua: 3.40% (3.8723 => 4.0039, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.3684 => 0.3808, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5981 => 0.6173, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.4203 => 0.4336, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.16% (0.4048 => 0.4176, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.4186 => 1.4630, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4620 => 0.4763, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.08% (1.2842 => 1.3238, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.02% (0.3379 => 0.3481, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.88% (2.2969 => 2.3631, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 2.87% (0.8921 => 0.9177, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.84% (1.5859 => 1.6309, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.79% (0.5020 => 0.5160, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (2.2024 => 2.2571, std. dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 2.46% (17.1811 => 17.6044, std. dev.: 0.0121) MultiSource/Applications/minisat/minisat: 2.46% (0.7115 => 0.7290, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.1840 => 1.2122, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.95% (1.0722 => 1.0931, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.85% (7.9617 => 8.1089, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.79% (21.9371 => 22.3307, std. dev.: 0.0200) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.28% (0.8101 => 0.8205, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.89% (4.2280 => 4.4348, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.12% (3.6395 => 3.7530, std. dev.: 0.0027) MultiSource/Applications/siod/siod: 1.78% (3.2827 => 3.3411, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.72% (26.0924 => 26.5403, std. dev.: 0.0337) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5313, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7986, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2351, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.21% (6.5088 => 6.5874, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.10% (3.1578 => 3.1924, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.68% (5.2763 => 3.1829, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7254, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.38% (5.3526 => 3.7264, std. dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.91% (54.1659 => 46.0887, std. dev.: 0.0085) MultiSource/Applications/ClamAV/clamscan: -13.94% (22.1758 => 19.0844, std. dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5507, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.09% (1.2373 => 1.1001, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -7.79% (1.5373 => 1.4175, std. dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.19% (4.8142 => 4.4679, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std. dev.: 0.0033) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4718, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (8.6802 => 8.4147, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: -2.81% (10.2830 => 9.9942, std. dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (8.1563 => 7.9608, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std. dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists: -1.44% (12.5348 => 12.3539, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std. dev.: 0.0089) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 22:44:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 00:44:29 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828054429.C08902A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3262?compare_to=3258&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3262, Order: 162737, Start Time: 2012-08-28 04:34:55, End Time: 2012-08-28 05:45:29 To: 3258, Order: 162728, Start Time: 2012-08-28 03:07:41, End Time: 2012-08-28 04:19:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 9 (29 on baseline) Performance Improvements: 13 (38 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 867 (822 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.10% (0.2097 => 0.2204, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.5489 => 0.5643, std. dev.: 0.0059) MultiSource/Applications/hbd/hbd: 1.50% (1.3028 => 1.3224, std. dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 8.66% (1.4910 => 1.6201, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.53% (4.3204 => 4.4297, std. dev.: 0.0207) SingleSource/Benchmarks/Misc/fp-convert: 2.07% (15.5809 => 15.9038, std. dev.: 0.0384) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.93% (1.2688 => 1.2933, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 1.78% (9.1218 => 9.2846, std. dev.: 0.0310) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (2.4591 => 2.4960, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -2.83% (1.0946 => 1.0636, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.36% (0.5626 => 0.5493, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ks/ks: -18.36% (1.4214 => 1.1605, std. dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: -17.65% (0.4215 => 0.3471, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.57% (2.6859 => 2.4288, std. dev.: 0.0383) MultiSource/Benchmarks/Olden/bisort/bisort: -6.93% (0.7116 => 0.6623, std. dev.: 0.0138) MultiSource/Applications/SIBsim4/SIBsim4: -4.64% (3.4241 => 3.2652, std. dev.: 0.0199) MultiSource/Applications/lua/lua: -3.23% (30.1157 => 29.1429, std. dev.: 0.0423) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.19% (4.6524 => 4.5039, std. dev.: 0.0417) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.83% (42.4422 => 41.2418, std. dev.: 0.3411) MultiSource/Benchmarks/sim/sim: -2.00% (4.0577 => 3.9767, std. dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -1.42% (6.7076 => 6.6126, std. dev.: 0.0273) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.14% (3.6784 => 3.6364, std. dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.27% (0.0766 => 0.0883, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std. dev.: 0.0744) SingleSource/Benchmarks/McGill/queens: 12.80% (1.6261 => 1.8342, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.57% (1.0063 => 1.0925, std. dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.6308 => 0.6755, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.95% (2.8964 => 3.0687, std. dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (0.3301 => 0.3496, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/mason/mason: 5.62% (0.5004 => 0.5285, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 5.17% (2.3453 => 2.4666, std. dev.: 0.0173) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.15% (4.2129 => 4.4297, std. dev.: 0.0207) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.52% (5.2665 => 5.5048, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: 4.46% (15.2242 => 15.9038, std. dev.: 0.0384) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (27.1724 => 28.1734, std. dev.: 0.0659) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (6.6312 => 6.8474, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.11% (2.6656 => 2.7485, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.05% (0.5179 => 0.5337, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (62.4126 => 64.1097, std. dev.: 0.2252) MultiSource/Applications/hexxagon/hexxagon: 2.49% (14.4877 => 14.8478, std. dev.: 0.0299) SingleSource/Benchmarks/Stanford/FloatMM: 2.25% (0.8175 => 0.8359, std. dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 2.21% (3.8907 => 3.9767, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (2.4455 => 2.4960, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/five11/five11: 1.93% (5.1938 => 5.2942, std. dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.77% (25.6658 => 26.1190, std. dev.: 0.0087) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.63% (1.2726 => 1.2933, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.30% (3.4080 => 3.4523, std. dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 1.16% (2.4013 => 2.4291, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.15% (1.6110 => 1.6295, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (38.9255 => 39.3303, std. dev.: 0.0946) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.00% (8.9977 => 8.7274, std. dev.: 0.0298) MultiSource/Applications/ClamAV/clamscan: -1.62% (14.6079 => 14.3716, std. dev.: 0.0272) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.44% (0.9029 => 0.8899, std. dev.: 0.0036) MultiSource/Applications/lua/lua: -1.33% (3.5980 => 3.5501, std. dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -21.64% (15.8312 => 12.4052, std. dev.: 0.2199) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.31% (1.4034 => 1.1605, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: -14.31% (3.4629 => 2.9673, std. dev.: 0.0541) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1588, std. dev.: 0.0475) MultiSource/Benchmarks/FreeBench/distray/distray: -9.23% (0.2664 => 0.2418, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.24% (3.2007 => 2.9371, std. dev.: 0.0377) SingleSource/Benchmarks/Misc/richards_benchmark: -7.81% (1.4441 => 1.3313, std. dev.: 0.0156) MultiSource/Applications/sgefa/sgefa: -7.34% (0.3746 => 0.3471, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -7.01% (3.9413 => 3.6651, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std. dev.: 0.0204) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.98% (1.1647 => 1.0951, std. dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -5.14% (0.3836 => 0.3639, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -4.91% (7.6833 => 7.3064, std. dev.: 0.0410) MultiSource/Applications/SIBsim4/SIBsim4: -4.61% (3.4230 => 3.2652, std. dev.: 0.0199) SingleSource/Benchmarks/Misc/ffbench: -4.36% (1.4117 => 1.3501, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.32% (1.4021 => 1.3556, std. dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.05% (0.4564 => 0.4425, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.02% (3.7496 => 3.6364, std. dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (9.3855 => 9.1201, std. dev.: 0.0366) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std. dev.: 0.0310) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.74% (1.1683 => 1.1363, std. dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: -2.61% (8.5323 => 8.3092, std. dev.: 0.0513) SingleSource/Benchmarks/McGill/misr: -2.42% (0.4296 => 0.4192, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.33% (1.2722 => 1.2426, std. dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.13% (1.0686 => 1.0458, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/pi: -2.04% (1.6538 => 1.6201, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -1.97% (6.7458 => 6.6126, std. dev.: 0.0273) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.97% (2.3569 => 2.3104, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -1.73% (1.0926 => 1.0737, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -1.42% (3.4286 => 3.3798, std. dev.: 0.0108) MultiSource/Applications/lua/lua: -1.29% (29.5232 => 29.1429, std. dev.: 0.0423) SingleSource/Benchmarks/Misc/oourafft: -1.22% (3.8200 => 3.7734, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.01% (2.0027 => 1.9825, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -1.01% (3.4659 => 3.4310, std. dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Aug 27 23:47:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 01:47:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828064718.2F1D02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3263?compare_to=3260&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3263, Order: 162737, Start Time: 2012-08-28 05:33:54, End Time: 2012-08-28 06:48:16 To: 3260, Order: 162733, Start Time: 2012-08-28 03:51:35, End Time: 2012-08-28 05:05:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (159 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 967 (709 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.10% (2.2825 => 2.2574, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.28% (2.0176 => 2.3258, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.71% (0.5748 => 0.6421, std. dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 11.64% (0.5818 => 0.6495, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 11.54% (0.7061 => 0.7876, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3578 => 0.3989, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.19% (0.3646 => 0.4054, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.16% (0.3601 => 0.4003, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3623 => 0.4023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.03% (0.3789 => 0.4207, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 11.03% (0.3663 => 0.4067, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3650 => 0.4052, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.81% (0.3914 => 0.4337, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.4003 => 0.4426, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.51% (0.3940 => 0.4354, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.77% (0.7710 => 0.8386, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1413 => 0.1536, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.33% (3.9660 => 4.2963, std. dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 8.27% (0.2781 => 0.3011, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.22% (1.3693 => 1.4819, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 7.97% (0.4328 => 0.4673, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.74% (0.2596 => 0.2797, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.70% (0.1819 => 0.1959, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.66% (0.2782 => 0.2995, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.65% (0.5265 => 0.5668, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 7.63% (0.7038 => 0.7575, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.43% (0.4062 => 0.4364, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.32% (1.2193 => 1.3085, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 7.28% (0.2761 => 0.2962, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.20% (0.9199 => 0.9861, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 7.15% (0.2726 => 0.2921, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2966 => 0.3178, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.4379 => 0.4690, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2765 => 0.2961, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.04% (0.2628 => 0.2813, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.98% (0.6959 => 0.7445, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.2937 => 0.3142, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.96% (1.9828 => 2.1208, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.95% (0.3899 => 0.4170, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3107 => 0.3322, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.88% (0.1789 => 0.1912, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.86% (0.1588 => 0.1697, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 6.86% (0.3149 => 0.3365, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.77% (0.3192 => 0.3408, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.69% (0.3485 => 0.3718, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.66% (0.3453 => 0.3683, std. dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.65% (0.3489 => 0.3721, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.63% (0.2127 => 0.2268, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 6.63% (0.2988 => 0.3186, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1865 => 0.1986, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 6.48% (0.3534 => 0.3763, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.47% (0.5577 => 0.5938, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.46% (1.1364 => 1.2098, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.29% (0.4390 => 0.4666, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.24% (13.8202 => 14.6821, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.20% (0.4016 => 0.4265, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.2914 => 0.3094, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 6.16% (0.3293 => 0.3496, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2243 => 0.2381, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.14% (0.5637 => 0.5983, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.13% (0.2023 => 0.2147, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.11% (1.4563 => 1.5453, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 6.10% (0.3868 => 0.4104, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.07% (0.3756 => 0.3984, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.01% (0.2945 => 0.3122, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.01% (0.3246 => 0.3441, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.00% (7.2180 => 7.6509, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: 5.95% (0.2925 => 0.3099, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.76% (0.4113 => 0.4350, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.72% (0.7506 => 0.7935, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.65% (1.3245 => 1.3993, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.65% (1.3813 => 1.4593, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.62% (0.8310 => 0.8777, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 5.61% (0.2995 => 0.3163, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.58% (3.8646 => 4.0802, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.58% (0.7460 => 0.7876, std. dev.: 0.0016) MultiSource/Applications/Burg/burg: 5.53% (1.1061 => 1.1673, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (1.3819 => 1.4581, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (3.6692 => 3.8713, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 5.42% (1.2292 => 1.2958, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.37% (4.3801 => 4.6154, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.34% (0.4791 => 0.5047, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.30% (1.0594 => 1.1156, std. dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.30% (4.4433 => 4.6789, std. dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.25% (0.6283 => 0.6613, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.13% (1.9270 => 2.0259, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 5.09% (0.3220 => 0.3384, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (13.2842 => 13.9569, std. dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.02% (0.6135 => 0.6443, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 4.91% (2.1791 => 2.2861, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3755 => 0.3938, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.82% (16.6129 => 17.4143, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 4.79% (14.8535 => 15.5646, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.69% (0.8818 => 0.9232, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.31% (1.1333 => 1.1821, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 4.28% (0.3131 => 0.3265, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.22% (0.3245 => 0.3382, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.18% (0.8698 => 0.9062, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (8.4961 => 8.8470, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 4.07% (3.1889 => 3.3186, std. dev.: 0.0123) MultiSource/Applications/JM/ldecod/ldecod: 4.01% (6.5754 => 6.8390, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: 3.92% (0.2859 => 0.2971, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.74% (4.9865 => 5.1731, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.58% (3.2742 => 3.3915, std. dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 3.38% (16.2614 => 16.8111, std. dev.: 0.0173) MultiSource/Applications/ClamAV/clamscan: 3.34% (14.5298 => 15.0158, std. dev.: 0.0159) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.19% (0.9108 => 0.9399, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.13% (4.6629 => 4.8088, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.07% (1.5188 => 1.5655, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 2.90% (0.6250 => 0.6431, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.70% (6.2785 => 6.4478, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.1007 => 2.1521, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 2.40% (0.6744 => 0.6906, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 2.34% (3.7467 => 3.8343, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.4805 => 0.4912, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.79% (33.2944 => 33.8898, std. dev.: 0.0162) MultiSource/Applications/SIBsim4/SIBsim4: 1.42% (1.2749 => 1.2930, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2574, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: 11.13% (1.2998 => 1.4445, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.02% (0.2093 => 0.2219, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.86% (1.5824 => 1.6593, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.32% (11.2619 => 11.7479, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3845, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.27% (10.7476 => 10.9919, std. dev.: 0.0237) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5954, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.04% (3.2729 => 3.3398, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.96% (1.4298 => 1.4578, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.48% (1.5089 => 1.5313, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5749, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.09% (4.5928 => 4.6429, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.36% (22.5627 => 21.3527, std. dev.: 0.0208) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.02% (0.2670 => 0.2536, std. dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.2308 => 1.0940, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.35% (1.3780 => 1.3180, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.55% (0.4867 => 0.4694, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -3.23% (1.1560 => 1.1187, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.73% (8.8259 => 8.5849, std. dev.: 0.0153) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2201, std. dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9716, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.74% (5.3167 => 5.2240, std. dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2048, std. dev.: 0.0248) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.55% (20.3410 => 20.0262, std. dev.: 0.0593) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4285, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2269, std. dev.: 0.0323) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.12% (5.5401 => 5.4778, std. dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 00:11:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 02:11:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828071150.550BE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3264?compare_to=3261&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3264, Order: 162737, Start Time: 2012-08-28 05:50:47, End Time: 2012-08-28 07:12:47 To: 3261, Order: 162734, Start Time: 2012-08-28 04:03:40, End Time: 2012-08-28 05:22:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (81 on baseline) Performance Improvements: 1 (31 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (775 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.74% (13.7449 => 13.9846, std. dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.93% (54.9305 => 56.5427, std. dev.: 0.0358) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (1.3068 => 1.3285, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.19% (1.4175 => 1.4006, std. dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.89% (10.3673 => 13.9846, std. dev.: 0.0116) SingleSource/UnitTests/ObjC/trivial-interface: 13.91% (0.3473 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.62% (0.3561 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3497 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.55% (0.3543 => 0.4023, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.52% (0.3543 => 0.4022, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.48% (0.3516 => 0.3990, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 13.05% (0.3694 => 0.4176, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.77% (0.3828 => 0.4317, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.40% (0.3886 => 0.4368, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.30% (1.1194 => 1.2571, std. dev.: 0.0232) SingleSource/Benchmarks/Misc/flops: 10.68% (0.1432 => 0.1585, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.59% (2.2022 => 2.4355, std. dev.: 0.0439) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.39% (1.7609 => 1.9438, std. dev.: 0.0316) SingleSource/Benchmarks/Misc/richards_benchmark: 8.01% (0.1622 => 0.1752, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std. dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 7.84% (0.6030 => 0.6503, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.22% (10.4361 => 11.1895, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/oourafft: 6.89% (0.3282 => 0.3508, std. dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 6.69% (0.7326 => 0.7816, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.40% (7.0540 => 7.5052, std. dev.: 0.1655) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.75% (0.3307 => 0.3497, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.66% (9.4845 => 10.0217, std. dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 5.45% (0.7433 => 0.7838, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 4.79% (0.3109 => 0.3258, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.41% (0.5105 => 0.5330, std. dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.21% (0.7835 => 0.8165, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.18% (0.4636 => 0.4830, std. dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 4.11% (5.7591 => 5.9960, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.91% (0.6675 => 0.6936, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 3.72% (3.3354 => 3.4595, std. dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.66% (1.1642 => 1.2068, std. dev.: 0.0079) MultiSource/Applications/hbd/hbd: 3.65% (1.5603 => 1.6173, std. dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.52% (2.0273 => 2.0987, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 3.52% (3.8723 => 4.0085, std. dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.51% (0.4103 => 0.4247, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3865 => 0.3998, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.43% (0.4289 => 0.4436, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.6456 => 0.6672, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.32% (0.3650 => 0.3771, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 3.29% (0.3098 => 0.3200, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.27% (0.3422 => 0.3534, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3826 => 0.3951, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3935 => 0.4058, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.01% (2.0665 => 2.1286, std. dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/sieve: 3.00% (0.3603 => 0.3711, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3684 => 0.3793, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.89% (2.2969 => 2.3632, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.86% (0.4203 => 0.4323, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.84% (1.5859 => 1.6310, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 2.84% (0.4620 => 0.4751, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.83% (1.2842 => 1.3205, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 2.81% (0.7115 => 0.7315, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 2.79% (0.4048 => 0.4161, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.77% (0.5020 => 0.5159, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.75% (17.1811 => 17.6542, std. dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.2024 => 2.2614, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.11% (1.0722 => 1.0948, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.01% (21.9371 => 22.3791, std. dev.: 0.0231) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (4.2280 => 4.4195, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.04% (3.6395 => 3.7502, std. dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.84% (1.3045 => 1.3285, std. dev.: 0.0068) MultiSource/Applications/siod/siod: 1.75% (3.2827 => 3.3403, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2415, std. dev.: 0.0200) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/hash2: 1.22% (3.1578 => 3.1963, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.19% (6.5088 => 6.5862, std. dev.: 0.0172) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6814, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1262, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.59% (5.2763 => 3.1876, std. dev.: 0.0526) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.50% (5.3855 => 3.7430, std. dev.: 0.0528) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.04% (5.3526 => 3.7445, std. dev.: 0.0498) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0684, std. dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: -13.88% (22.1758 => 19.0981, std. dev.: 0.0230) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.03% (2.9384 => 2.5556, std. dev.: 0.0576) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -8.89% (1.5373 => 1.4006, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7609, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5117, std. dev.: 0.0017) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0505, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4769, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.63% (10.2830 => 10.0124, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.31% (8.1563 => 7.9677, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3432, std. dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4230, std. dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 00:58:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 02:58:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120828075853.E9B8C352400D@llvm.org> http://llvm.org/perf/db_default/v4/nts/3265?compare_to=3259&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3265, Order: 162737, Start Time: 2012-08-28 05:13:07, End Time: 2012-08-28 07:59:50 To: 3259, Order: 162723, Start Time: 2012-08-28 02:01:22, End Time: 2012-08-28 04:45:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 2 (14 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 966 (788 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.43% (1.7087 => 1.6843, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.11% (3.8321 => 3.7896, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.45% (0.3446 => 0.3944, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-4: 14.40% (0.3465 => 0.3964, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/trivial-interface: 14.35% (0.3442 => 0.3936, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.31% (0.3488 => 0.3987, std. dev.: 0.0068) SingleSource/UnitTests/ObjC/synchronized: 14.30% (0.3469 => 0.3965, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-3: 14.28% (0.3460 => 0.3954, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/property: 13.67% (0.3650 => 0.4149, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3724 => 0.4219, std. dev.: 0.0071) SingleSource/UnitTests/ObjC++/Hello: 8.94% (0.5826 => 0.6347, std. dev.: 0.0146) SingleSource/UnitTests/ObjC++/property-reference-object: 8.58% (0.5889 => 0.6394, std. dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.03% (0.7171 => 0.7675, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.37% (3.5627 => 3.7896, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.26% (1.6211 => 1.7225, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.23% (1.3152 => 1.3972, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.05% (0.5026 => 0.5330, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (0.4361 => 0.4618, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.88% (0.5900 => 0.6247, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: 5.73% (0.4029 => 0.4260, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 5.72% (1.5932 => 1.6843, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.2014 => 0.2128, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.53% (0.4994 => 0.5270, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (0.3930 => 0.4142, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 5.25% (4.2109 => 4.4319, std. dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.16% (0.5000 => 0.5258, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.15% (2.7292 => 2.8698, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.11% (0.2875 => 0.3022, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.11% (0.2566 => 0.2697, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 4.90% (0.2714 => 0.2847, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.90% (0.2736 => 0.2870, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.84% (0.2725 => 0.2857, std. dev.: 0.0034) MultiSource/Applications/d/make_dparser: 4.76% (1.0781 => 1.1294, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.73% (0.2729 => 0.2858, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.67% (0.2803 => 0.2934, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2750 => 0.2875, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.45% (0.9909 => 1.0350, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.41% (0.3195 => 0.3336, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 4.37% (0.2813 => 0.2936, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 4.36% (0.2823 => 0.2946, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.35% (0.2780 => 0.2901, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.31% (5.5417 => 5.7806, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.29% (1.9966 => 2.0823, std. dev.: 0.0289) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.23% (2.0673 => 2.1548, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.22% (1.9694 => 2.0526, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/except: 4.20% (0.2811 => 0.2929, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 4.16% (0.3267 => 0.3403, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 4.16% (0.3317 => 0.3455, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.16% (0.2911 => 0.3032, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.11% (0.3258 => 0.3392, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (0.4658 => 0.4848, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.07% (0.3903 => 0.4062, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.05% (0.4146 => 0.4314, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.01% (0.3890 => 0.4046, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3348 => 0.3482, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 3.97% (0.3678 => 0.3824, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.96% (0.3362 => 0.3495, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.94% (0.3124 => 0.3247, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3282 => 0.3408, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.79% (0.3690 => 0.3830, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 3.78% (0.3726 => 0.3867, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.78% (0.3625 => 0.3762, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 3.78% (1.8794 => 1.9504, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3477 => 0.3607, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.68% (4.4195 => 4.5821, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 3.66% (4.6177 => 4.7866, std. dev.: 0.0181) MultiSource/Applications/lua/lua: 3.63% (1.4269 => 1.4787, std. dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 3.61% (2.1653 => 2.2434, std. dev.: 0.0055) MultiSource/Applications/siod/siod: 3.56% (0.6634 => 0.6870, std. dev.: 0.0051) MultiSource/Applications/hbd/hbd: 3.55% (0.9697 => 1.0041, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.2969 => 0.3074, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 3.51% (0.4251 => 0.4400, std. dev.: 0.0052) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 3.45% (0.7875 => 0.8147, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.43% (0.4139 => 0.4281, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.33% (0.3271 => 0.3380, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.26% (0.5546 => 0.5727, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.3981 => 0.4108, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.75% (0.6435 => 0.6612, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.5012 => 0.5149, std. dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.82% (2.0346 => 2.0717, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.2122 => 0.2292, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6775, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8968, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2017, std. dev.: 0.0119) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5019, std. dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std. dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (41.7953 => 42.4457, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2816, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5849, std. dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5458, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary2: -9.12% (0.2402 => 0.2183, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7894, std. dev.: 0.0137) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7972, std. dev.: 0.1504) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std. dev.: 0.0051) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9575, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 01:42:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 03:42:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828084208.94AD22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3266?compare_to=3262&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3266, Order: 162738, Start Time: 2012-08-28 07:31:51, End Time: 2012-08-28 08:43:08 To: 3262, Order: 162737, Start Time: 2012-08-28 04:34:55, End Time: 2012-08-28 05:45:29 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 7 (29 on baseline) Performance Improvements: 4 (33 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 878 (827 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 8.53% (0.2791 => 0.3029, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 11.05% (3.0786 => 3.4188, std. dev.: 0.1318) MultiSource/Benchmarks/FreeBench/distray/distray: 4.47% (0.2418 => 0.2526, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.15% (61.1563 => 62.4735, std. dev.: 0.2472) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.98% (12.4052 => 12.6504, std. dev.: 0.0407) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.66% (22.1958 => 22.5651, std. dev.: 0.0791) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.24% (1.2426 => 1.2580, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.01% (1.4485 => 1.4339, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -2.99% (0.6755 => 0.6553, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.51% (1.3116 => 1.2918, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.17% (2.4666 => 2.4378, std. dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 15.11% (1.7426 => 2.0059, std. dev.: 0.0297) SingleSource/Benchmarks/McGill/queens: 12.80% (1.6261 => 1.8343, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.98% (1.0063 => 1.1067, std. dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.85% (0.1525 => 0.1660, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.48% (0.3301 => 0.3515, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.22% (2.8964 => 3.0765, std. dev.: 0.0071) MultiSource/Benchmarks/FreeBench/mason/mason: 6.02% (0.5004 => 0.5305, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: 3.94% (2.3453 => 2.4378, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash: 3.88% (0.6308 => 0.6553, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.77% (27.1724 => 28.1979, std. dev.: 0.0625) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.71% (0.3508 => 0.3638, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (40.4792 => 41.8969, std. dev.: 0.3436) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.37% (2.6656 => 2.7554, std. dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.25% (6.6312 => 6.8464, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/fp-convert: 3.19% (15.2242 => 15.7097, std. dev.: 0.1381) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.07% (0.5179 => 0.5338, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.65% (14.4877 => 14.8723, std. dev.: 0.0272) MultiSource/Benchmarks/mafft/pairlocalalign: 2.59% (62.4126 => 64.0263, std. dev.: 0.0611) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.13% (61.1734 => 62.4735, std. dev.: 0.2472) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.93% (38.9255 => 39.6775, std. dev.: 0.1524) SingleSource/Benchmarks/Shootout/matrix: 1.85% (1.5605 => 1.5894, std. dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.82% (25.6658 => 26.1319, std. dev.: 0.0339) SingleSource/Benchmarks/Dhrystone/dry: 1.57% (2.4013 => 2.4389, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.48% (2.4455 => 2.4816, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.43% (3.4080 => 3.4566, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 1.24% (2.5166 => 2.5478, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/tsp/tsp: 1.20% (1.7330 => 1.7538, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.02% (22.3381 => 22.5651, std. dev.: 0.0791) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.13% (0.4880 => 0.4776, std. dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -21.12% (1.7473 => 1.3782, std. dev.: 0.0387) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.09% (15.8312 => 12.6504, std. dev.: 0.0407) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.26% (1.4034 => 1.1612, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -14.19% (3.4629 => 2.9716, std. dev.: 0.0248) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std. dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.50% (3.2007 => 2.9287, std. dev.: 0.0507) SingleSource/Benchmarks/Misc/richards_benchmark: -8.14% (1.4441 => 1.3266, std. dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: -7.13% (0.3746 => 0.3479, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -7.01% (3.9413 => 3.6651, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.41% (1.1647 => 1.0900, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: -5.53% (1.4117 => 1.3337, std. dev.: 0.0160) MultiSource/Benchmarks/FreeBench/distray/distray: -5.18% (0.2664 => 0.2526, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -4.86% (7.6833 => 7.3099, std. dev.: 0.0398) MultiSource/Applications/SIBsim4/SIBsim4: -4.80% (3.4230 => 3.2588, std. dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -4.59% (0.3836 => 0.3660, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.16% (0.4564 => 0.4420, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.02% (3.7496 => 3.6365, std. dev.: 0.0299) SingleSource/Benchmarks/Misc/flops: -2.60% (9.5474 => 9.2996, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -2.32% (6.7458 => 6.5891, std. dev.: 0.0207) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.20% (4.6127 => 4.5110, std. dev.: 0.0239) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.16% (9.3855 => 9.1826, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.12% (1.1683 => 1.1435, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.09% (1.0686 => 1.0463, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/pi: -2.00% (1.6538 => 1.6207, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.89% (1.0926 => 1.0719, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std. dev.: 0.0036) MultiSource/Applications/aha/aha: -1.67% (3.4286 => 3.3712, std. dev.: 0.0186) MultiSource/Applications/spiff/spiff: -1.57% (2.8599 => 2.8149, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/oourafft: -1.16% (3.8200 => 3.7758, std. dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.12% (1.2722 => 1.2580, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -1.03% (16.5617 => 16.3917, std. dev.: 0.0523) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 01:57:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 03:57:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828085753.4BCC92A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3267?compare_to=3263&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3267, Order: 162738, Start Time: 2012-08-28 07:44:04, End Time: 2012-08-28 08:58:49 To: 3263, Order: 162737, Start Time: 2012-08-28 05:33:54, End Time: 2012-08-28 06:48:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (161 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 968 (708 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.43% (2.0176 => 2.3289, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.67% (0.5818 => 0.6497, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.66% (0.5748 => 0.6418, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3578 => 0.3981, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.16% (0.3601 => 0.4003, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3650 => 0.4056, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 11.11% (0.3646 => 0.4051, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3663 => 0.4063, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.87% (0.3623 => 0.4017, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.82% (0.3789 => 0.4199, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.65% (0.3914 => 0.4331, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.54% (0.7061 => 0.7805, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.4003 => 0.4423, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.30% (0.3940 => 0.4346, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.70% (0.1413 => 0.1536, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.31% (3.9660 => 4.2954, std. dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.20% (0.7710 => 0.8342, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 8.08% (1.3693 => 1.4800, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 7.91% (0.2781 => 0.3001, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (0.4328 => 0.4670, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.70% (0.1819 => 0.1959, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.60% (0.5265 => 0.5665, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.59% (0.2596 => 0.2793, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.53% (0.7038 => 0.7568, std. dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4062 => 0.4363, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.25% (0.9199 => 0.9866, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.23% (1.2193 => 1.3075, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.21% (0.3899 => 0.4180, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.14% (0.2761 => 0.2958, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (0.4379 => 0.4691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2655 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.01% (0.2726 => 0.2917, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.99% (0.2760 => 0.2953, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.92% (0.3022 => 0.3231, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.90% (0.6959 => 0.7439, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.88% (0.1789 => 0.1912, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.79% (0.2914 => 0.3112, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.78% (1.9828 => 2.1172, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.77% (0.2127 => 0.2271, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.74% (0.1588 => 0.1695, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.70% (0.3580 => 0.3820, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.63% (0.3485 => 0.3716, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.63% (1.1364 => 1.2117, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.62% (0.3489 => 0.3720, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.59% (0.2988 => 0.3185, std. dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 6.50% (13.8202 => 14.7182, std. dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.49% (0.1865 => 0.1986, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3192 => 0.3398, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.42% (0.3534 => 0.3761, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.42% (0.5577 => 0.5935, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.29% (0.4390 => 0.4666, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (1.4563 => 1.5476, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 6.26% (0.3293 => 0.3499, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.18% (0.2023 => 0.2148, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3246 => 0.3446, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.15% (0.2925 => 0.3105, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 6.15% (0.2243 => 0.2381, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.10% (0.5637 => 0.5981, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.08% (0.4016 => 0.4260, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.04% (7.2180 => 7.6542, std. dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (0.3756 => 0.3978, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 5.89% (0.3868 => 0.4096, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.87% (1.3819 => 1.4630, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.85% (1.1061 => 1.1708, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 5.84% (0.7506 => 0.7944, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (1.3813 => 1.4608, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.74% (0.4113 => 0.4349, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 5.68% (0.8310 => 0.8782, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.68% (0.4791 => 0.5063, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 5.64% (0.2995 => 0.3164, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 5.64% (3.8646 => 4.0826, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.64% (1.3245 => 1.3992, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.62% (3.6692 => 3.8755, std. dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.61% (0.2140 => 0.2260, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.52% (0.7460 => 0.7872, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 5.48% (1.2292 => 1.2965, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.46% (0.6283 => 0.6626, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6135 => 0.6468, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.43% (1.0594 => 1.1169, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.34% (4.3801 => 4.6138, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.32% (4.4433 => 4.6796, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.29% (13.2842 => 13.9866, std. dev.: 0.0157) MultiSource/Applications/treecc/treecc: 5.22% (1.9270 => 2.0275, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 5.12% (0.3220 => 0.3385, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3755 => 0.3940, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 4.92% (2.1791 => 2.2863, std. dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4233, std. dev.: 0.0192) MultiSource/Applications/JM/lencod/lencod: 4.73% (14.8535 => 15.5561, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.60% (0.8818 => 0.9224, std. dev.: 0.0118) MultiSource/Benchmarks/Olden/bh/bh: 4.37% (0.2859 => 0.2984, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.31% (1.1333 => 1.1821, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.28% (0.3245 => 0.3384, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.25% (0.3131 => 0.3264, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.24% (0.8698 => 0.9067, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.20% (8.4961 => 8.8530, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 4.11% (3.1889 => 3.3201, std. dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: 4.02% (6.5754 => 6.8398, std. dev.: 0.0176) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.75% (4.9865 => 5.1736, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.58% (3.2742 => 3.3914, std. dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 3.45% (14.5298 => 15.0305, std. dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 3.29% (16.2614 => 16.7966, std. dev.: 0.0182) MultiSource/Applications/oggenc/oggenc: 3.25% (4.6629 => 4.8143, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.19% (1.5188 => 1.5672, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.10% (0.9108 => 0.9390, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.85% (0.6250 => 0.6428, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (6.2785 => 6.4468, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.1007 => 2.1540, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.51% (0.6744 => 0.6913, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.48% (3.7467 => 3.8396, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.4805 => 0.4920, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.37% (1.0313 => 1.0557, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.99% (33.2944 => 33.9563, std. dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 1.45% (1.2749 => 1.2934, std. dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 25.84% (1.8175 => 2.2871, std. dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.51% (1.2998 => 1.4364, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.88% (1.5824 => 1.6596, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7407, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7772, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9637, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9872, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.70% (1.7688 => 1.8165, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5953, std. dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 2.26% (10.7476 => 10.9905, std. dev.: 0.0472) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.08% (1.4298 => 1.4596, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 2.06% (3.2729 => 3.3402, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.41% (1.5089 => 1.5302, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.11% (5.5130 => 5.5740, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1394, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6391, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.16% (22.5627 => 21.3987, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.31% (1.2308 => 1.1039, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5106, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3148, std. dev.: 0.0084) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.41% (0.4867 => 0.4701, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -3.19% (1.1560 => 1.1191, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6079, std. dev.: 0.0167) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9312, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2208, std. dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: -1.82% (3.0263 => 2.9712, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2031, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (5.3167 => 5.2263, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7918, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std. dev.: 0.0082) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4348, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.13% (20.3410 => 20.1106, std. dev.: 0.0294) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.09% (5.5401 => 5.4796, std. dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 02:03:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 04:03:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828090303.A643E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3268?compare_to=3264&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3268, Order: 162738, Start Time: 2012-08-28 07:44:12, End Time: 2012-08-28 09:04:02 To: 3264, Order: 162737, Start Time: 2012-08-28 05:50:47, End Time: 2012-08-28 07:12:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (118 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (735 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.41% (1.4006 => 1.4344, std. dev.: 0.0052) MultiSource/Benchmarks/llubenchmark/llu: 2.36% (3.7701 => 3.8590, std. dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.28% (13.9846 => 13.6664, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.04% (1.3285 => 1.3147, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.82% (10.3673 => 13.6664, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 13.82% (0.3473 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.69% (0.3543 => 0.4028, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3497 => 0.3972, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.56% (0.3561 => 0.4044, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.55% (0.3543 => 0.4023, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.51% (0.3516 => 0.3991, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.02% (0.3694 => 0.4175, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.72% (0.3828 => 0.4315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.66% (0.3927 => 0.4424, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.48% (0.3886 => 0.4371, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.20% (1.1194 => 1.2560, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.49% (2.2022 => 2.4333, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 10.27% (0.1432 => 0.1579, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.21% (1.7609 => 1.9407, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.89% (0.6030 => 0.6506, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 7.83% (0.1622 => 0.1749, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.64% (0.1584 => 0.1705, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.11% (10.4361 => 11.1779, std. dev.: 0.0225) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2065 => 0.2210, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 6.86% (0.3282 => 0.3507, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3177 => 0.3389, std. dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 6.66% (0.7326 => 0.7814, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.53% (7.0540 => 7.5143, std. dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.34% (0.1892 => 0.2012, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.20% (0.4615 => 0.4901, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.68% (0.4879 => 0.5156, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.65% (0.3307 => 0.3494, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.43% (4.9449 => 5.2133, std. dev.: 0.0141) MultiSource/Benchmarks/mafft/pairlocalalign: 5.42% (9.4845 => 9.9988, std. dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: 5.40% (0.2554 => 0.2692, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.38% (0.7433 => 0.7833, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.28% (0.2271 => 0.2391, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.28% (5.0018 => 5.2658, std. dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.26% (0.1940 => 0.2042, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.13% (0.5105 => 0.5367, std. dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2107 => 0.2215, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.04% (0.8172 => 0.8584, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.88% (0.5860 => 0.6146, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.85% (4.2646 => 4.4716, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.81% (0.2700 => 0.2830, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 4.73% (0.3109 => 0.3256, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.72% (0.5569 => 0.5832, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 4.62% (0.3423 => 0.3581, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.61% (0.3121 => 0.3265, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.58% (8.1363 => 8.5093, std. dev.: 0.0105) MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3180 => 0.3325, std. dev.: 0.0044) MultiSource/Applications/spiff/spiff: 4.56% (0.7835 => 0.8192, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.40% (1.3050 => 1.3624, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.26% (0.8067 => 0.8411, std. dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 4.21% (0.4299 => 0.4480, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.11% (1.5415 => 1.6049, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.10% (0.3441 => 0.3582, std. dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 4.08% (5.7591 => 5.9938, std. dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 4.01% (0.3092 => 0.3216, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.6450 => 0.6707, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.94% (0.9765 => 1.0150, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.6675 => 0.6933, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.84% (0.3387 => 0.3517, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (1.1861 => 1.2316, std. dev.: 0.0036) MultiSource/Applications/lua/lua: 3.83% (3.8723 => 4.0206, std. dev.: 0.0078) MultiSource/Applications/d/make_dparser: 3.75% (3.3354 => 3.4606, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.74% (0.3826 => 0.3969, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 3.69% (1.1642 => 1.2072, std. dev.: 0.0096) MultiSource/Applications/hbd/hbd: 3.69% (1.5603 => 1.6178, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (14.3668 => 14.8916, std. dev.: 0.0122) MultiSource/Applications/treecc/treecc: 3.59% (2.0273 => 2.1000, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.58% (0.4103 => 0.4250, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 3.51% (0.2905 => 0.3007, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4636 => 0.4798, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.34% (0.3865 => 0.3994, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.25% (0.3136 => 0.3238, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.4186 => 1.4647, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.23% (0.3650 => 0.3768, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.4289 => 0.4427, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 3.21% (0.3422 => 0.3532, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.18% (0.5981 => 0.6171, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.17% (0.4064 => 0.4193, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.6456 => 0.6660, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.14% (2.2969 => 2.3691, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8921 => 0.9195, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.97% (2.0665 => 2.1278, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 2.95% (17.1811 => 17.6877, std. dev.: 0.0482) SingleSource/Benchmarks/Shootout-C++/sieve: 2.91% (0.3603 => 0.3708, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.88% (0.4203 => 0.4324, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.87% (0.5020 => 0.5164, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: 2.85% (0.3684 => 0.3789, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.80% (1.2842 => 1.3202, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.80% (1.5859 => 1.6303, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 2.77% (0.4048 => 0.4160, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.70% (0.7115 => 0.7307, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.67% (2.2024 => 2.2611, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 2.47% (1.1840 => 1.2132, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 2.13% (1.0722 => 1.0950, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.98% (21.9371 => 22.3718, std. dev.: 0.0368) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.86% (7.9617 => 8.1100, std. dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.89% (4.2280 => 4.4347, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0024) MultiSource/Benchmarks/llubenchmark/llu: 2.14% (3.7781 => 3.8590, std. dev.: 0.0113) MultiSource/Applications/lua/lua: 1.88% (26.0924 => 26.5826, std. dev.: 0.0165) MultiSource/Applications/siod/siod: 1.75% (3.2827 => 3.3402, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (1.5086 => 1.5317, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1983, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2272, std. dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1259, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.63% (5.2763 => 3.1855, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.40% (5.3855 => 3.7482, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.02% (5.3526 => 3.7459, std. dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1287, std. dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -13.91% (22.1758 => 19.0902, std. dev.: 0.0508) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.98% (2.9384 => 2.5570, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1073, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -6.69% (1.5373 => 1.4344, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -6.10% (1.1396 => 1.0701, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0012) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4647, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4227, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3293, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -2.68% (10.2830 => 10.0079, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.30% (8.1563 => 7.9689, std. dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5080, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3398, std. dev.: 0.0062) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 03:07:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 05:07:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828100751.CFC812A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3269?compare_to=3266&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3269, Order: 162741, Start Time: 2012-08-28 08:58:25, End Time: 2012-08-28 10:08:49 To: 3266, Order: 162738, Start Time: 2012-08-28 07:31:51, End Time: 2012-08-28 08:43:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 13 (30 on baseline) Performance Improvements: 3 (36 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 873 (823 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.69% (0.0745 => 0.0847, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.53% (0.4414 => 0.4658, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2784 => 0.2917, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 4.32% (0.2684 => 0.2800, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.28% (0.5585 => 0.5824, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.50% (0.5408 => 0.5543, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.22% (0.7715 => 0.7886, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.10% (0.7802 => 0.7966, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.88% (0.8820 => 0.8986, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (1.4053 => 1.4263, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 1.29% (3.8468 => 3.8965, std. dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 3.38% (2.5464 => 2.6324, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: 1.24% (15.7097 => 15.9039, std. dev.: 0.0285) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.28% (1.1067 => 1.0815, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.89% (22.5651 => 22.1390, std. dev.: 0.1618) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.51% (2.4968 => 2.4591, std. dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.16% (0.7722 => 0.7966, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.31% (0.7784 => 0.7886, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.30% (1.4113 => 1.4297, std. dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 32.06% (0.0499 => 0.0659, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.24% (0.0766 => 0.0944, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.68% (1.7426 => 1.9985, std. dev.: 0.0368) SingleSource/Benchmarks/McGill/queens: 12.80% (1.6261 => 1.8343, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 9.38% (21.1721 => 23.1572, std. dev.: 0.7117) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.47% (1.0063 => 1.0815, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: 5.92% (0.5004 => 0.5300, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.70% (2.8964 => 3.0616, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/whetstone: 5.12% (2.3453 => 2.4654, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/fp-convert: 4.46% (15.2242 => 15.9039, std. dev.: 0.0285) SingleSource/Benchmarks/Misc/dt: 4.15% (0.9851 => 1.0260, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.08% (0.3508 => 0.3651, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.70% (27.1724 => 28.1767, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.23% (6.6312 => 6.8451, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.97% (0.8498 => 0.8750, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.66% (0.5179 => 0.5317, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.58% (2.6656 => 2.7345, std. dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.55% (2.5669 => 2.6324, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.54% (14.4877 => 14.8562, std. dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 2.51% (62.4126 => 63.9808, std. dev.: 0.2735) SingleSource/Benchmarks/Stanford/FloatMM: 2.12% (0.8175 => 0.8348, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.75% (25.6658 => 26.1144, std. dev.: 0.0627) MultiSource/Benchmarks/BitBench/five11/five11: 1.69% (5.1938 => 5.2816, std. dev.: 0.0296) MultiSource/Benchmarks/sim/sim: 1.66% (3.8907 => 3.9554, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4455 => 2.4847, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.21% (3.4080 => 3.4493, std. dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.35% (14.6079 => 14.4110, std. dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -21.35% (1.7473 => 1.3742, std. dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.65% (15.8312 => 12.5623, std. dev.: 0.1838) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.31% (1.4034 => 1.1605, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -14.41% (3.4629 => 2.9639, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.30% (0.0917 => 0.0795, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std. dev.: 0.0221) MultiSource/Benchmarks/FreeBench/distray/distray: -9.16% (0.2664 => 0.2420, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.56% (3.2007 => 2.9268, std. dev.: 0.0433) SingleSource/Benchmarks/Misc/richards_benchmark: -7.71% (1.4441 => 1.3327, std. dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: -7.10% (0.3746 => 0.3480, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.96% (3.9413 => 3.6671, std. dev.: 0.0335) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.39% (1.1647 => 1.0903, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -5.13% (7.6833 => 7.2895, std. dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -5.08% (0.3836 => 0.3641, std. dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -4.78% (3.4230 => 3.2595, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/ffbench: -4.58% (1.4117 => 1.3470, std. dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.11% (0.4564 => 0.4422, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.98% (3.7496 => 3.6379, std. dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.82% (1.0686 => 1.0385, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2843, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.73% (1.1683 => 1.1364, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/pi: -2.55% (1.6538 => 1.6117, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/misr: -2.37% (0.4296 => 0.4194, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.30% (1.2722 => 1.2430, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.14% (4.6127 => 4.5138, std. dev.: 0.0341) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.14% (9.3855 => 9.1849, std. dev.: 0.0379) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.01% (2.3569 => 2.3095, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: -1.77% (2.8599 => 2.8093, std. dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (1.1116 => 1.0935, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -1.49% (3.4286 => 3.3774, std. dev.: 0.0034) MultiSource/Applications/lua/lua: -1.28% (29.5232 => 29.1464, std. dev.: 0.1267) SingleSource/Benchmarks/Misc/oourafft: -1.19% (3.8200 => 3.7746, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.19% (2.0027 => 1.9789, std. dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 03:40:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 05:40:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828104011.875EA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3270?compare_to=3267&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3270, Order: 162741, Start Time: 2012-08-28 09:26:42, End Time: 2012-08-28 10:41:08 To: 3267, Order: 162738, Start Time: 2012-08-28 07:44:04, End Time: 2012-08-28 08:58:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (159 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 968 (709 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.30% (2.0176 => 2.3263, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.79% (0.5818 => 0.6504, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference: 11.64% (0.7061 => 0.7883, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.52% (0.5748 => 0.6410, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3578 => 0.3986, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.16% (0.3646 => 0.4053, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.11% (0.3601 => 0.4001, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.07% (0.3623 => 0.4024, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3663 => 0.4068, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.99% (0.3650 => 0.4051, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.90% (0.3789 => 0.4202, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3914 => 0.4335, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.4003 => 0.4424, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.48% (0.3940 => 0.4353, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.82% (0.7710 => 0.8390, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.47% (0.3130 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.35% (0.1413 => 0.1531, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.92% (0.5265 => 0.5682, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.91% (3.9660 => 4.2799, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 7.86% (1.3693 => 1.4769, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 7.86% (0.4328 => 0.4668, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.59% (0.1819 => 0.1957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2782 => 0.2991, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.24% (0.4062 => 0.4356, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.09% (1.2193 => 1.3058, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4390 => 0.4699, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 7.03% (0.7038 => 0.7533, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.97% (0.9199 => 0.9840, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (0.2765 => 0.2957, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.88% (0.2760 => 0.2950, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.84% (1.9828 => 2.1185, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.82% (0.3107 => 0.3319, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.81% (0.2966 => 0.3168, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4379 => 0.4675, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.72% (0.3899 => 0.4161, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.66% (0.3485 => 0.3717, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3580 => 0.3816, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.57% (0.6959 => 0.7416, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.51% (0.3489 => 0.3716, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.46% (0.2988 => 0.3181, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.42% (0.1588 => 0.1690, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.38% (0.5577 => 0.5933, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3192 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2127 => 0.2261, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 6.28% (0.3534 => 0.3756, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.26% (1.1364 => 1.2075, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sieve: 6.23% (0.3453 => 0.3668, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.08% (13.8202 => 14.6610, std. dev.: 0.0173) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2023 => 0.2145, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.02% (1.4563 => 1.5439, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 5.98% (0.3293 => 0.3490, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (0.2914 => 0.3088, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (0.3756 => 0.3980, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.96% (0.5637 => 0.5973, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.93% (0.4016 => 0.4254, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.85% (0.3246 => 0.3436, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.80% (0.7506 => 0.7941, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.80% (7.2180 => 7.6363, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 5.74% (0.3868 => 0.4090, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.74% (0.1865 => 0.1972, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 5.71% (0.2925 => 0.3092, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.62% (0.2243 => 0.2369, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.42% (1.2292 => 1.2958, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.39% (1.3813 => 1.4557, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 5.36% (3.8646 => 4.0717, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 5.35% (0.8310 => 0.8755, std. dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.30% (3.6692 => 3.8638, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.28% (1.3245 => 1.3944, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 5.24% (0.2995 => 0.3152, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.23% (1.3819 => 1.4542, std. dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.23% (0.7460 => 0.7850, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 5.20% (1.9270 => 2.0272, std. dev.: 0.0103) MultiSource/Benchmarks/McCat/05-eks/eks: 5.18% (0.4113 => 0.4326, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.14% (1.1061 => 1.1630, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.13% (1.0594 => 1.1138, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.07% (0.4791 => 0.5034, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (4.3801 => 4.6017, std. dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.99% (0.6135 => 0.6441, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.95% (0.2140 => 0.2246, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.93% (0.6283 => 0.6593, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (4.4433 => 4.6611, std. dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (13.2842 => 13.9312, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/18-imp/imp: 4.84% (0.3220 => 0.3376, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3755 => 0.3936, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.68% (0.8818 => 0.9231, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.63% (16.6129 => 17.3828, std. dev.: 0.0209) MultiSource/Applications/siod/siod: 4.53% (2.1791 => 2.2778, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 4.45% (14.8535 => 15.5152, std. dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.13% (0.3245 => 0.3379, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.06% (0.3131 => 0.3258, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.02% (0.8698 => 0.9048, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.94% (1.1333 => 1.1779, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 3.83% (8.4961 => 8.8217, std. dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.73% (4.9865 => 5.1726, std. dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 3.73% (6.5754 => 6.8204, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 3.72% (3.1889 => 3.3076, std. dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: 3.60% (0.2859 => 0.2962, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 3.33% (16.2614 => 16.8024, std. dev.: 0.0281) MultiSource/Applications/ClamAV/clamscan: 3.26% (14.5298 => 15.0030, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.12% (3.2742 => 3.3763, std. dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 2.91% (4.6629 => 4.7988, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.89% (0.9108 => 0.9371, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (1.5188 => 1.5601, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.53% (0.6250 => 0.6408, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (6.2785 => 6.4265, std. dev.: 0.0147) MultiSource/Applications/minisat/minisat: 2.19% (0.6744 => 0.6892, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 2.10% (3.7467 => 3.8255, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.97% (2.1007 => 2.1420, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.94% (1.0313 => 1.0513, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.62% (33.2944 => 33.8339, std. dev.: 0.0210) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2749 => 1.2931, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5150, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 25.11% (1.8175 => 2.2739, std. dev.: 0.0437) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: 8.68% (1.2998 => 1.4126, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6591, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7432, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4271 => 7.6179, std. dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3852, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.25% (10.7476 => 10.9899, std. dev.: 0.0219) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.13% (1.4298 => 1.4602, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3400, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5089 => 1.5318, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5730, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5928 => 4.6411, std. dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.01% (13.3668 => 13.5015, std. dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.48% (22.5627 => 21.3260, std. dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.56% (1.2308 => 1.1008, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.27% (1.3780 => 1.3191, std. dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.21% (0.3139 => 0.3007, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0004) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.82% (0.4867 => 0.4681, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -3.19% (1.1560 => 1.1191, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (8.8259 => 8.5915, std. dev.: 0.0157) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.29% (0.6589 => 0.6438, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2242, std. dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.05% (0.8342 => 0.8171, std. dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.94% (7.3305 => 7.1883, std. dev.: 0.0092) MultiSource/Applications/spiff/spiff: -1.79% (3.0263 => 2.9720, std. dev.: 0.0097) MultiSource/Applications/lambda-0_1_3/lambda: -1.73% (5.3167 => 5.2248, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8613, std. dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7914, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2165, std. dev.: 0.0182) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std. dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4256, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.15% (5.5401 => 5.4766, std. dev.: 0.0087) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4342, std. dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 03:50:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 05:50:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828105043.678662A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3271?compare_to=3268&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3271, Order: 162741, Start Time: 2012-08-28 09:32:07, End Time: 2012-08-28 10:51:44 To: 3268, Order: 162738, Start Time: 2012-08-28 07:44:12, End Time: 2012-08-28 09:04:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (125 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (727 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.15% (54.7640 => 56.4893, std. dev.: 0.0901) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.04% (10.3673 => 13.6893, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 13.88% (0.3473 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.64% (0.3497 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.63% (0.3543 => 0.4026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.54% (0.3561 => 0.4043, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.49% (0.3543 => 0.4021, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.45% (0.3516 => 0.3989, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.94% (0.3694 => 0.4172, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.68% (0.3927 => 0.4425, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.67% (0.3828 => 0.4313, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.45% (0.3886 => 0.4370, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.45% (1.1194 => 1.2588, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 10.61% (0.1432 => 0.1584, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.54% (2.2022 => 2.4343, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.09% (1.7609 => 1.9386, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.02% (0.1584 => 0.1711, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.83% (0.6030 => 0.6502, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 7.70% (10.4361 => 11.2397, std. dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: 7.38% (0.7326 => 0.7867, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: 7.21% (0.1622 => 0.1739, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.13% (0.3282 => 0.3516, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.92% (0.1892 => 0.2023, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.41% (7.0540 => 7.5062, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.05% (0.4615 => 0.4894, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 6.02% (0.1695 => 0.1797, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.81% (0.3307 => 0.3499, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.7433 => 0.7855, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.57% (0.1940 => 0.2048, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.53% (0.4879 => 0.5149, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.51% (4.9449 => 5.2172, std. dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.46% (0.2271 => 0.2395, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.44% (0.2554 => 0.2693, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.34% (5.0018 => 5.2688, std. dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 5.34% (9.4845 => 9.9905, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2107 => 0.2218, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.21% (0.8172 => 0.8598, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.06% (4.2646 => 4.4803, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.5569 => 0.5843, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 4.85% (0.3423 => 0.3589, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.85% (0.5860 => 0.6144, std. dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.3121 => 0.3270, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.72% (8.1363 => 8.5205, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.70% (1.3050 => 1.3663, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.69% (0.3180 => 0.3329, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.68% (0.5105 => 0.5344, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.67% (0.2700 => 0.2826, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 4.57% (0.3109 => 0.3251, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.51% (1.5415 => 1.6110, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3441 => 0.3596, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 4.40% (0.4299 => 0.4488, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.39% (0.7835 => 0.8179, std. dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 4.29% (5.7591 => 6.0061, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.28% (0.2758 => 0.2876, std. dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 4.24% (0.3092 => 0.3223, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.15% (0.9765 => 1.0170, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.13% (0.8067 => 0.8400, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.08% (0.6450 => 0.6713, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.02% (1.1861 => 1.2338, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.02% (0.3136 => 0.3262, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.00% (1.1642 => 1.2108, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.97% (0.3826 => 0.3978, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.93% (3.3354 => 3.4666, std. dev.: 0.0097) MultiSource/Benchmarks/sim/sim: 3.93% (0.3387 => 0.3520, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.88% (0.4103 => 0.4262, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (14.3668 => 14.9183, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.82% (0.6675 => 0.6930, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.82% (1.5603 => 1.6199, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.77% (0.2891 => 0.3000, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 3.73% (3.8723 => 4.0168, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 3.70% (2.0273 => 2.1023, std. dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 3.68% (0.2905 => 0.3012, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.62% (1.4186 => 1.4699, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3865 => 0.4003, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.53% (0.2831 => 0.2931, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 3.50% (0.4289 => 0.4439, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (0.4636 => 0.4798, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.47% (0.4064 => 0.4205, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.42% (0.3650 => 0.3775, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.42% (0.6456 => 0.6677, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.40% (0.3232 => 0.3342, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.36% (0.5981 => 0.6182, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.32% (0.3283 => 0.3392, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 3.29% (0.3098 => 0.3200, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.26% (2.2969 => 2.3718, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.19% (0.3162 => 0.3263, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 3.18% (0.8921 => 0.9205, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.16% (0.3603 => 0.3717, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.15% (2.0665 => 2.1316, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.13% (0.5020 => 0.5177, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3935 => 0.4058, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.09% (1.5859 => 1.6349, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.05% (0.4620 => 0.4761, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.02% (0.4203 => 0.4330, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.01% (0.3427 => 0.3530, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3684 => 0.3793, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.94% (0.4048 => 0.4167, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 2.92% (1.2842 => 1.3217, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.90% (17.1811 => 17.6793, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.89% (2.2024 => 2.2660, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.77% (0.7115 => 0.7312, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.58% (1.1840 => 1.2146, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 2.33% (1.0722 => 1.0972, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.92% (7.9617 => 8.1146, std. dev.: 0.0198) MultiSource/Applications/JM/lencod/lencod: 1.85% (21.9371 => 22.3425, std. dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.00% (4.2280 => 4.4393, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7589, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.94% (26.0924 => 26.5995, std. dev.: 0.0076) MultiSource/Applications/siod/siod: 1.73% (3.2827 => 3.3395, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.41% (1.5086 => 1.5298, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7978, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2269, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.20% (1.3045 => 1.3202, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 1.20% (3.1578 => 3.1957, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6826, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5764, std. dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1257, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.69% (5.2763 => 3.1824, std. dev.: 0.0171) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.56% (5.3855 => 3.7399, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.05% (5.3526 => 3.7439, std. dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0776, std. dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: -13.88% (22.1758 => 19.0984, std. dev.: 0.0260) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.92% (2.9384 => 2.5587, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std. dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -7.31% (1.5373 => 1.4249, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.1396 => 1.0698, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (2.7294 => 2.5646, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std. dev.: 0.0016) MultiSource/Applications/aha/aha: -3.45% (3.1595 => 3.0506, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4704, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4253, std. dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.78% (1.3677 => 1.3297, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0082, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (8.1563 => 7.9650, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.90% (2.5528 => 2.5044, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6785, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.56% (12.5348 => 12.3397, std. dev.: 0.0054) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4225, std. dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.17% (1.8329 => 1.8114, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (1.6805 => 1.6632, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 04:10:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 06:10:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120828111030.0E4A02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3272?compare_to=3265&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3272, Order: 162741, Start Time: 2012-08-28 08:27:43, End Time: 2012-08-28 11:11:30 To: 3265, Order: 162737, Start Time: 2012-08-28 05:13:07, End Time: 2012-08-28 07:59:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (112 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 965 (780 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 11.90% (0.0941 => 0.1053, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.69% (126.3542 => 131.0224, std. dev.: 0.1991) SingleSource/Benchmarks/Dhrystone/dry: 2.39% (14.2961 => 14.6372, std. dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.60% (0.3465 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.45% (0.3488 => 0.3992, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 14.42% (0.3446 => 0.3943, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 14.41% (0.3442 => 0.3938, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.36% (0.3460 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.24% (0.3496 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3469 => 0.3962, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.81% (0.3643 => 0.4146, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.48% (0.3724 => 0.4226, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5826 => 0.6353, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5889 => 0.6399, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.60% (0.1619 => 0.1742, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7171 => 0.7682, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.49% (3.5627 => 3.7940, std. dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.34% (1.6211 => 1.7238, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.93% (1.3152 => 1.3932, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.85% (0.4361 => 0.4616, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.84% (1.5932 => 1.6863, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.81% (0.2014 => 0.2131, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (0.3930 => 0.4149, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.5900 => 0.6228, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (0.4994 => 0.5268, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 5.31% (0.4029 => 0.4243, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.25% (2.7292 => 2.8726, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.19% (0.5026 => 0.5287, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2875 => 0.3024, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.13% (4.2109 => 4.4270, std. dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.06% (0.5000 => 0.5253, std. dev.: 0.0019) MultiSource/Applications/d/make_dparser: 4.96% (1.0781 => 1.1316, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.84% (0.2725 => 0.2857, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2750 => 0.2883, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.82% (0.2738 => 0.2870, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 4.79% (0.2714 => 0.2844, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.2736 => 0.2867, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.73% (0.2729 => 0.2858, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 4.60% (0.2803 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3258 => 0.3406, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.53% (0.2823 => 0.2951, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.53% (0.9909 => 1.0358, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 4.53% (0.3267 => 0.3415, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (0.3195 => 0.3339, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.2780 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.41% (0.2813 => 0.2937, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.39% (0.3096 => 0.3232, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.38% (1.9694 => 2.0556, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.37% (0.2792 => 0.2914, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 4.36% (0.3004 => 0.3135, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.35% (2.0673 => 2.1572, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 4.34% (0.2811 => 0.2933, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.30% (5.5417 => 5.7801, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 4.25% (0.2566 => 0.2675, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (1.9966 => 2.0807, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.16% (0.2911 => 0.3032, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.05% (0.3362 => 0.3498, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.03% (0.3124 => 0.3250, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (2.1013 => 2.1860, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: 4.02% (0.3678 => 0.3826, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (0.4658 => 0.4844, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.98% (0.3890 => 0.4045, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3625 => 0.3768, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.92% (0.3317 => 0.3447, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.3903 => 0.4055, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.89% (0.3726 => 0.3871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.88% (0.3348 => 0.3478, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.84% (0.3282 => 0.3408, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.80% (0.3477 => 0.3609, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.72% (4.4195 => 4.5837, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4146 => 0.4300, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.66% (0.3690 => 0.3825, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 3.64% (1.4269 => 1.4789, std. dev.: 0.0065) MultiSource/Applications/hbd/hbd: 3.61% (0.9697 => 1.0047, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 3.60% (0.4251 => 0.4404, std. dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 3.58% (4.6177 => 4.7832, std. dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 3.58% (2.1653 => 2.2429, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 3.58% (1.8794 => 1.9467, std. dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 3.47% (23.5202 => 24.3368, std. dev.: 0.0314) MultiSource/Applications/treecc/treecc: 3.47% (0.7875 => 0.8148, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (0.3845 => 0.3977, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.3271 => 0.3383, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.41% (0.4139 => 0.4280, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.3981 => 0.4114, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.18% (0.6634 => 0.6845, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 3.14% (0.5546 => 0.5720, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 3.03% (0.3336 => 0.3437, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.83% (0.5012 => 0.5154, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.69% (0.6435 => 0.6608, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.87% (2.0346 => 2.0727, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6769, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8962, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1687, std. dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6372, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1942, std. dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5047, std. dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std. dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.53% (41.7953 => 42.4342, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2848, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5906, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (105.3826 => 106.4778, std. dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.14% (2.4764 => 2.3987, std. dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5508, std. dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8021, std. dev.: 0.0090) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std. dev.: 0.0049) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7892, std. dev.: 0.0174) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std. dev.: 0.0052) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5192, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.25% (17.2379 => 16.8497, std. dev.: 0.0228) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9680, std. dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 04:36:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 06:36:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828113633.07CE62A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3273?compare_to=3269&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3273, Order: 162743, Start Time: 2012-08-28 10:27:00, End Time: 2012-08-28 11:37:34 To: 3269, Order: 162741, Start Time: 2012-08-28 08:58:25, End Time: 2012-08-28 10:08:49 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 8 (30 on baseline) Performance Improvements: 3 (34 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 878 (825 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (4.3453 => 4.3928, std. dev.: 0.0132) MultiSource/Benchmarks/nbench/nbench: 1.06% (1.0799 => 1.0914, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.21% (2.3766 => 2.6193, std. dev.: 0.0596) SingleSource/Benchmarks/Shootout/heapsort: 7.80% (3.0559 => 3.2942, std. dev.: 0.0219) MultiSource/Benchmarks/FreeBench/distray/distray: 6.03% (0.2420 => 0.2566, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.43% (4.3507 => 4.4999, std. dev.: 0.0328) SingleSource/Benchmarks/Shootout/hash: 1.18% (4.2338 => 4.2837, std. dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.14% (41.1088 => 41.5765, std. dev.: 0.1246) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.75% (0.7886 => 0.7669, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.07% (1.4472 => 1.4317, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -21.40% (0.0659 => 0.0518, std. dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.52% (0.7722 => 0.7994, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (4.3380 => 4.3928, std. dev.: 0.0132) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.20% (6.2546 => 6.3297, std. dev.: 0.0280) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std. dev.: 0.0086) SingleSource/Benchmarks/McGill/queens: 12.79% (1.6261 => 1.8341, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.51% (1.0063 => 1.0919, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.81% (4.2129 => 4.4999, std. dev.: 0.0328) MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.37% (2.8964 => 3.0810, std. dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.76% (0.3301 => 0.3491, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 5.38% (2.3453 => 2.4715, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/fp-convert: 4.93% (15.2242 => 15.9741, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/mason/mason: 4.92% (0.5004 => 0.5250, std. dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.09% (5.2665 => 5.4821, std. dev.: 0.0531) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.05% (0.3508 => 0.3650, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.92% (6.6312 => 6.8913, std. dev.: 0.0141) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (27.1724 => 28.1880, std. dev.: 0.1332) SingleSource/Benchmarks/Misc/dt: 3.46% (0.9851 => 1.0192, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 3.30% (0.6308 => 0.6516, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.93% (2.5669 => 2.6421, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.72% (0.5179 => 0.5320, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.71% (40.4792 => 41.5765, std. dev.: 0.1246) MultiSource/Applications/hexxagon/hexxagon: 2.53% (14.4877 => 14.8546, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: 2.43% (3.2159 => 3.2942, std. dev.: 0.0219) MultiSource/Benchmarks/mafft/pairlocalalign: 2.26% (62.4126 => 63.8255, std. dev.: 0.1771) SingleSource/Benchmarks/Stanford/FloatMM: 2.26% (0.8175 => 0.8360, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.78% (25.6658 => 26.1228, std. dev.: 0.0420) MultiSource/Benchmarks/BitBench/five11/five11: 1.68% (5.1938 => 5.2813, std. dev.: 0.0209) MultiSource/Benchmarks/sim/sim: 1.46% (3.8907 => 3.9474, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.41% (3.4080 => 3.4560, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 1.22% (2.4013 => 2.4306, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.19% (0.4880 => 0.4773, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -21.50% (1.7473 => 1.3717, std. dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.71% (15.8312 => 12.5524, std. dev.: 0.1763) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.29% (1.4034 => 1.1608, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: -14.30% (3.4629 => 2.9676, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std. dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.18% (3.2007 => 2.9389, std. dev.: 0.0151) SingleSource/Benchmarks/Misc/richards_benchmark: -7.85% (1.4441 => 1.3308, std. dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -7.26% (0.3746 => 0.3474, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.54% (3.9413 => 3.6835, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.51% (1.1647 => 1.0889, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std. dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: -4.84% (3.4230 => 3.2572, std. dev.: 0.0096) MultiSource/Applications/lambda-0_1_3/lambda: -4.76% (7.6833 => 7.3179, std. dev.: 0.0339) SingleSource/Benchmarks/Misc/ffbench: -4.21% (1.4117 => 1.3523, std. dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -4.04% (0.3836 => 0.3681, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.24% (0.4564 => 0.4416, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.18% (22.3381 => 21.6286, std. dev.: 0.2728) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.07% (3.7496 => 3.6346, std. dev.: 0.0407) SingleSource/Benchmarks/Misc/flops: -2.72% (9.5474 => 9.2881, std. dev.: 0.0114) MultiSource/Applications/JM/lencod/lencod: -2.69% (6.7458 => 6.5642, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.29% (1.1683 => 1.1416, std. dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.22% (1.2722 => 1.2439, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.11% (1.0686 => 1.0461, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (9.3855 => 9.1901, std. dev.: 0.0273) SingleSource/Benchmarks/Misc/pi: -2.03% (1.6538 => 1.6203, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.97% (2.3569 => 2.3105, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.76% (4.6127 => 4.5316, std. dev.: 0.0263) MultiSource/Benchmarks/FreeBench/neural/neural: -1.71% (1.0926 => 1.0739, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.57% (1.1116 => 1.0941, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -1.53% (3.4286 => 3.3760, std. dev.: 0.0028) MultiSource/Applications/lua/lua: -1.33% (29.5232 => 29.1315, std. dev.: 0.0456) MultiSource/Benchmarks/llubenchmark/llu: -1.18% (2.0192 => 1.9954, std. dev.: 0.0064) MultiSource/Applications/spiff/spiff: -1.05% (2.8599 => 2.8299, std. dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 05:22:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 07:22:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828122215.84CAD2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3274?compare_to=3270&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3274, Order: 162743, Start Time: 2012-08-28 11:08:52, End Time: 2012-08-28 12:23:15 To: 3270, Order: 162741, Start Time: 2012-08-28 09:26:42, End Time: 2012-08-28 10:41:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (157 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 968 (711 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.11% (2.0176 => 2.3225, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.52% (0.5818 => 0.6488, std. dev.: 0.0043) SingleSource/UnitTests/ObjC++/Hello: 11.45% (0.5748 => 0.6406, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 11.37% (0.7061 => 0.7864, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.73% (0.3578 => 0.3962, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3601 => 0.3984, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3646 => 0.4031, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.48% (0.3663 => 0.4047, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3650 => 0.4031, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3623 => 0.4000, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.32% (0.3789 => 0.4180, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.12% (0.3914 => 0.4310, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.97% (0.4003 => 0.4402, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.90% (0.3940 => 0.4330, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.51% (0.1986 => 0.2155, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.05% (0.7710 => 0.8331, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 8.02% (1.3693 => 1.4791, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.80% (0.2781 => 0.2998, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.75% (3.9660 => 4.2735, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 7.74% (0.4328 => 0.4663, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.56% (0.5265 => 0.5663, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4062 => 0.4363, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.32% (0.2596 => 0.2786, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2782 => 0.2985, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.4390 => 0.4703, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.09% (1.2193 => 1.3058, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 7.06% (0.7038 => 0.7535, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2690 => 0.2879, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.97% (0.2726 => 0.2916, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.94% (0.2607 => 0.2788, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.93% (0.2628 => 0.2810, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.87% (0.9199 => 0.9831, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (1.9828 => 2.1166, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.73% (0.2721 => 0.2904, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3149 => 0.3359, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.66% (0.3485 => 0.3717, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.65% (0.3580 => 0.3818, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.62% (0.4379 => 0.4669, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.60% (0.2696 => 0.2874, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.59% (0.3899 => 0.4156, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.53% (0.3489 => 0.3717, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.46% (0.2988 => 0.3181, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3192 => 0.3396, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.32% (0.6959 => 0.7399, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 6.29% (0.3293 => 0.3500, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.19% (0.5577 => 0.5922, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.14% (1.1364 => 1.2062, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.11% (0.2127 => 0.2257, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.4016 => 0.4255, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 5.94% (0.3534 => 0.3744, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.91% (13.8202 => 14.6365, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.4563 => 1.5423, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.82% (0.5637 => 0.5965, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.78% (0.3756 => 0.3973, std. dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (0.2914 => 0.3082, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.73% (0.2023 => 0.2139, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.73% (7.2180 => 7.6313, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2945 => 0.3112, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 5.66% (0.3868 => 0.4087, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.63% (0.1865 => 0.1970, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 5.62% (0.2243 => 0.2369, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 5.54% (0.2925 => 0.3087, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.33% (1.3819 => 1.4556, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.2292 => 1.2943, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.28% (0.7506 => 0.7902, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.25% (1.3245 => 1.3940, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 5.20% (0.8310 => 0.8742, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.13% (3.8646 => 4.0628, std. dev.: 0.0135) MultiSource/Applications/Burg/burg: 5.12% (1.1061 => 1.1627, std. dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 5.11% (0.2995 => 0.3148, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (3.6692 => 3.8555, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.01% (1.3813 => 1.4505, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.00% (4.3801 => 4.5991, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.4791 => 0.5030, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.93% (1.0594 => 1.1116, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 4.89% (0.4113 => 0.4314, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.89% (0.6283 => 0.6590, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.87% (0.7460 => 0.7823, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3755 => 0.3936, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (13.2842 => 13.9218, std. dev.: 0.0211) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.78% (4.4433 => 4.6558, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 4.76% (1.9270 => 2.0187, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.72% (0.2140 => 0.2241, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 4.66% (0.3220 => 0.3370, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.56% (0.6135 => 0.6415, std. dev.: 0.0061) MultiSource/Applications/siod/siod: 4.49% (2.1791 => 2.2769, std. dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 4.47% (16.6129 => 17.3552, std. dev.: 0.0104) MultiSource/Applications/JM/lencod/lencod: 4.33% (14.8535 => 15.4964, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.07% (0.8818 => 0.9177, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.97% (1.1333 => 1.1783, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.91% (0.3245 => 0.3372, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.86% (0.8698 => 0.9034, std. dev.: 0.0076) MultiSource/Benchmarks/sim/sim: 3.74% (0.3131 => 0.3248, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.72% (8.4961 => 8.8125, std. dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.67% (4.9865 => 5.1696, std. dev.: 0.0123) MultiSource/Applications/d/make_dparser: 3.66% (3.1889 => 3.3055, std. dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: 3.58% (6.5754 => 6.8107, std. dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.20% (3.2742 => 3.3790, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 3.19% (14.5298 => 14.9927, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.11% (16.2614 => 16.7676, std. dev.: 0.0168) MultiSource/Applications/oggenc/oggenc: 2.76% (4.6629 => 4.7915, std. dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5188 => 1.5603, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.70% (0.9108 => 0.9354, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6250 => 0.6414, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.23% (6.2785 => 6.4183, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (2.1007 => 2.1469, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.14% (0.6744 => 0.6888, std. dev.: 0.0000) MultiSource/Applications/lua/lua: 1.93% (3.7467 => 3.8191, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.79% (1.0313 => 1.0498, std. dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.28% (33.2944 => 33.7207, std. dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std. dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.14% (1.2998 => 1.4186, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.07% (0.2093 => 0.2220, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.86% (1.5824 => 1.6593, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7420, std. dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7768, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3842, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4271 => 7.6013, std. dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: 2.28% (10.7476 => 10.9931, std. dev.: 0.0207) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.18% (1.4298 => 1.4610, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3400, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0128) SingleSource/Benchmarks/McGill/queens: 1.43% (2.1753 => 2.2064, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (1.5089 => 1.5299, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1861, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.5928 => 4.6464, std. dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9658, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5746, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.49% (22.5627 => 21.3240, std. dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.08% (0.3511 => 0.3403, std. dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.24% (1.2308 => 1.0924, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5122, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.86% (1.3780 => 1.3110, std. dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.56% (0.4366 => 0.4167, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -3.19% (1.1560 => 1.1191, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.8259 => 8.5598, std. dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.26% (0.6589 => 0.6440, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2243, std. dev.: 0.0075) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9738, std. dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3305 => 7.2072, std. dev.: 0.0311) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (5.3167 => 5.2288, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.51% (3.9173 => 3.8582, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7923, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (84.4286 => 83.4179, std. dev.: 0.0080) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2353, std. dev.: 0.0328) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.01% (5.5401 => 5.4843, std. dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 05:38:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 07:38:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828123801.4733C2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3275?compare_to=3271&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3275, Order: 162743, Start Time: 2012-08-28 11:19:33, End Time: 2012-08-28 12:39:00 To: 3271, Order: 162741, Start Time: 2012-08-28 09:32:07, End Time: 2012-08-28 10:51:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (115 on baseline) Performance Improvements: 3 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (736 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.03% (78.7340 => 80.3306, std. dev.: 0.5433) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.25% (13.6893 => 13.3813, std. dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -1.08% (11.2397 => 11.1179, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.05% (2.4343 => 2.4087, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.07% (10.3673 => 13.3813, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3473 => 0.3941, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.43% (0.3543 => 0.4019, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3561 => 0.4032, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.18% (0.3497 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.17% (0.3516 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.12% (0.3543 => 0.4008, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.67% (0.3694 => 0.4162, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.43% (0.3828 => 0.4304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.20% (0.3886 => 0.4360, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 12.17% (0.3927 => 0.4405, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std. dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.28% (1.7609 => 1.9419, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.38% (2.2022 => 2.4087, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.78% (0.6030 => 0.6499, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.26% (0.1584 => 0.1699, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.11% (0.3177 => 0.3403, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 6.65% (0.7326 => 0.7813, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 6.53% (10.4361 => 11.1179, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.4615 => 0.4915, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 6.41% (0.1622 => 0.1726, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.97% (0.3282 => 0.3478, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.64% (7.0540 => 7.4516, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.4879 => 0.5148, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.30% (0.8172 => 0.8605, std. dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 5.27% (0.7433 => 0.7825, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2271 => 0.2390, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2554 => 0.2685, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.08% (9.4845 => 9.9663, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.08% (4.9449 => 5.1960, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.93% (5.0018 => 5.2483, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.72% (0.5569 => 0.5832, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.71% (4.2646 => 4.4653, std. dev.: 0.0121) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.58% (0.3121 => 0.3264, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.51% (0.5860 => 0.6124, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.44% (0.3109 => 0.3247, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.33% (1.3050 => 1.3615, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.32% (0.3423 => 0.3571, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.31% (8.1363 => 8.4871, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.26% (0.2700 => 0.2815, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 4.16% (0.4299 => 0.4478, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.15% (0.3180 => 0.3312, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.03% (0.7835 => 0.8151, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.92% (0.3441 => 0.3576, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.88% (0.2758 => 0.2865, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.5105 => 0.5303, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.3092 => 0.3209, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.73% (1.5415 => 1.5990, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.73% (0.9765 => 1.0129, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.72% (5.7591 => 5.9735, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.66% (1.1861 => 1.2295, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.62% (0.8067 => 0.8359, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.58% (0.6675 => 0.6914, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.57% (1.1642 => 1.2058, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.52% (0.6450 => 0.6677, std. dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 3.51% (0.3387 => 0.3506, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.42% (3.3354 => 3.4496, std. dev.: 0.0093) MultiSource/Applications/hbd/hbd: 3.40% (1.5603 => 1.6133, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.4103 => 0.4242, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 3.31% (3.8723 => 4.0003, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 3.29% (0.4289 => 0.4430, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (14.3668 => 14.8355, std. dev.: 0.0172) MultiSource/Applications/treecc/treecc: 3.24% (2.0273 => 2.0930, std. dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.24% (0.4636 => 0.4786, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.21% (0.3865 => 0.3989, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.13% (0.3422 => 0.3529, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.08% (0.3826 => 0.3944, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.07% (0.3650 => 0.3762, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (0.4064 => 0.4188, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.04% (0.5981 => 0.6163, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 3.02% (0.6456 => 0.6651, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.96% (1.4186 => 1.4606, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (2.0665 => 2.1272, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 2.76% (2.2969 => 2.3604, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 2.75% (0.8921 => 0.9166, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (0.3935 => 0.4043, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4203 => 0.4316, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.64% (1.2842 => 1.3181, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4620 => 0.4738, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 2.54% (0.4048 => 0.4151, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.53% (0.5020 => 0.5147, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.52% (17.1811 => 17.6145, std. dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.5859 => 1.6255, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 2.43% (0.7115 => 0.7288, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.2024 => 2.2527, std. dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 2.22% (1.1840 => 1.2103, std. dev.: 0.0054) MultiSource/Applications/lemon/lemon: 1.83% (1.0722 => 1.0918, std. dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.59% (7.9617 => 8.0882, std. dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.43% (21.9371 => 22.2498, std. dev.: 0.0171) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.23% (0.8101 => 0.8201, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.75% (4.2280 => 4.4289, std. dev.: 0.0159) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7517, std. dev.: 0.0040) MultiSource/Applications/lua/lua: 1.81% (26.0924 => 26.5657, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.73% (3.2827 => 3.3396, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (1.5086 => 1.5296, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 1.27% (3.1578 => 3.1978, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2265, std. dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.07% (1.3045 => 1.3184, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5773, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1252, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.33% (0.8651 => 0.1702, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.49% (5.2763 => 3.1926, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.99% (5.3855 => 3.7168, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.59% (5.3526 => 3.7150, std. dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.85% (54.1659 => 46.1221, std. dev.: 0.0122) MultiSource/Applications/ClamAV/clamscan: -14.00% (22.1758 => 19.0721, std. dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.01% (2.9384 => 2.5561, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -10.75% (1.2373 => 1.1043, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -8.03% (1.5373 => 1.4139, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.07% (1.1396 => 1.0704, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.06% (2.7294 => 2.5639, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5044, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4720, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.10% (8.6802 => 8.4112, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: -2.82% (10.2830 => 9.9933, std. dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9569, std. dev.: 0.0103) SingleSource/UnitTests/Vector/multiplies: -1.78% (2.5528 => 2.5073, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (12.5348 => 12.3432, std. dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.06% (1.8329 => 1.8135, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 06:02:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 08:02:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828130249.83EDE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3276?compare_to=3273&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3276, Order: 162744, Start Time: 2012-08-28 11:52:41, End Time: 2012-08-28 13:03:50 To: 3273, Order: 162743, Start Time: 2012-08-28 10:27:00, End Time: 2012-08-28 11:37:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 10 (26 on baseline) Performance Improvements: 2 (32 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 877 (831 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.09% (0.4359 => 0.4581, std. dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: 1.92% (0.6830 => 0.6961, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.73% (0.5829 => 0.5930, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 50.24% (0.0205 => 0.0308, std. dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 11.61% (20.7791 => 23.1912, std. dev.: 0.5091) SingleSource/Benchmarks/Shootout/ary3: 2.49% (1.9968 => 2.0465, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.96% (1.4182 => 1.4460, std. dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.77% (61.2350 => 62.3213, std. dev.: 0.4137) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.13% (1.6165 => 1.6347, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 1.05% (1.0192 => 1.0299, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.92% (9.1032 => 8.7465, std. dev.: 0.0977) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -2.34% (2.6421 => 2.5804, std. dev.: 0.0199) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 17.44% (1.7426 => 2.0465, std. dev.: 0.0053) SingleSource/Benchmarks/McGill/queens: 12.79% (1.6261 => 1.8341, std. dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 9.54% (21.1721 => 23.1912, std. dev.: 0.5091) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.95% (0.1525 => 0.1631, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.76% (0.3301 => 0.3524, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.38% (2.8964 => 3.0813, std. dev.: 0.0106) MultiSource/Benchmarks/FreeBench/mason/mason: 5.88% (0.5004 => 0.5298, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 4.70% (2.3453 => 2.4555, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/fp-convert: 4.64% (15.2242 => 15.9313, std. dev.: 0.0463) SingleSource/Benchmarks/Misc/dt: 4.55% (0.9851 => 1.0299, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.19% (0.6308 => 0.6572, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.18% (5.2665 => 5.4869, std. dev.: 0.0798) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.02% (6.6312 => 6.8979, std. dev.: 0.0139) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.70% (27.1724 => 28.1767, std. dev.: 0.0352) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.59% (0.3508 => 0.3634, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.19% (2.6656 => 2.7505, std. dev.: 0.0282) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.99% (0.5179 => 0.5334, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.70% (14.4877 => 14.8784, std. dev.: 0.0274) MultiSource/Benchmarks/mafft/pairlocalalign: 2.65% (62.4126 => 64.0688, std. dev.: 0.0776) SingleSource/Benchmarks/Stanford/FloatMM: 2.08% (0.8175 => 0.8345, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.88% (61.1734 => 62.3213, std. dev.: 0.4137) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.82% (25.6658 => 26.1324, std. dev.: 0.0852) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.57% (1.2726 => 1.2926, std. dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.47% (1.6110 => 1.6347, std. dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.42% (3.4080 => 3.4565, std. dev.: 0.0030) MultiSource/Benchmarks/BitBench/five11/five11: 1.42% (5.1938 => 5.2674, std. dev.: 0.0219) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.32% (0.4880 => 0.4767, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -21.23% (15.8312 => 12.4698, std. dev.: 0.2284) SingleSource/Benchmarks/Shootout-C++/ary3: -20.98% (1.7473 => 1.3808, std. dev.: 0.0348) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.36% (1.4034 => 1.1598, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/17-bintr/bintr: -14.72% (0.0917 => 0.0782, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: -14.24% (3.4629 => 2.9698, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1614, std. dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.39% (3.2007 => 2.9322, std. dev.: 0.0225) SingleSource/Benchmarks/Misc/richards_benchmark: -7.85% (1.4441 => 1.3307, std. dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: -7.05% (0.3746 => 0.3482, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.85% (1.1647 => 1.0849, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.55% (3.9413 => 3.6832, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std. dev.: 0.0128) MultiSource/Benchmarks/FreeBench/distray/distray: -5.44% (0.2664 => 0.2519, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -4.86% (3.4230 => 3.2568, std. dev.: 0.0254) MultiSource/Applications/lambda-0_1_3/lambda: -4.77% (7.6833 => 7.3170, std. dev.: 0.0557) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -4.38% (0.3836 => 0.3668, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: -3.70% (0.4296 => 0.4137, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: -3.50% (1.4117 => 1.3623, std. dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.46% (3.7496 => 3.6199, std. dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.40% (0.4564 => 0.4409, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2869, std. dev.: 0.0257) MultiSource/Applications/JM/lencod/lencod: -2.61% (6.7458 => 6.5694, std. dev.: 0.0650) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.38% (1.1683 => 1.1405, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.26% (9.3855 => 9.1732, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.11% (1.0686 => 1.0460, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: -2.02% (1.6538 => 1.6204, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3119, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -1.47% (2.8599 => 2.8178, std. dev.: 0.0100) MultiSource/Applications/aha/aha: -1.41% (3.4286 => 3.3803, std. dev.: 0.0164) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.33% (4.6127 => 4.5514, std. dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 07:04:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 09:04:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828140430.06AD62A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3277?compare_to=3274&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3277, Order: 162744, Start Time: 2012-08-28 12:51:08, End Time: 2012-08-28 14:05:29 To: 3274, Order: 162743, Start Time: 2012-08-28 11:08:52, End Time: 2012-08-28 12:23:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (158 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 967 (710 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.6976 => 56.5321, std. dev.: 0.0809) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.07% (2.0176 => 2.3217, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 12.47% (0.0826 => 0.0929, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.58% (0.5818 => 0.6492, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.54% (0.7061 => 0.7876, std. dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 11.38% (0.5748 => 0.6402, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.90% (0.3578 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3646 => 0.4038, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.66% (0.3601 => 0.3985, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3623 => 0.4004, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.49% (0.3650 => 0.4033, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.48% (0.3663 => 0.4047, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3789 => 0.4183, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3914 => 0.4313, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.97% (0.4003 => 0.4402, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.82% (0.3940 => 0.4327, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.28% (0.1413 => 0.1530, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.91% (0.2781 => 0.3001, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.90% (0.7710 => 0.8319, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.85% (3.9660 => 4.2774, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4328 => 0.4664, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.76% (1.3693 => 1.4755, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2782 => 0.2988, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.40% (0.2596 => 0.2788, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4062 => 0.4360, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.20% (0.5265 => 0.5644, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7038 => 0.7534, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (0.2765 => 0.2959, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.92% (0.2760 => 0.2951, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.91% (1.2193 => 1.3035, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.90% (0.2726 => 0.2914, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.88% (0.9199 => 0.9832, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.85% (0.3022 => 0.3229, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.83% (0.6959 => 0.7434, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.2721 => 0.2906, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.2937 => 0.3136, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4390 => 0.4687, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.76% (0.4379 => 0.4675, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.73% (1.9828 => 2.1163, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.73% (0.3107 => 0.3316, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3149 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.62% (0.3899 => 0.4157, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3580 => 0.3816, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.52% (0.3192 => 0.3400, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.42% (0.3489 => 0.3713, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.2988 => 0.3179, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1789 => 0.1903, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.36% (0.1588 => 0.1689, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.28% (0.3453 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.21% (0.2127 => 0.2259, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3534 => 0.3750, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.10% (1.1364 => 1.2057, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.00% (13.8202 => 14.6489, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.98% (0.5637 => 0.5974, std. dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (0.2914 => 0.3088, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.97% (0.5577 => 0.5910, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.4016 => 0.4255, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.90% (0.1865 => 0.1975, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.88% (0.3246 => 0.3437, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.3756 => 0.3976, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.74% (0.2925 => 0.3093, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.74% (7.2180 => 7.6323, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.73% (0.2023 => 0.2139, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.69% (0.3868 => 0.4088, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.67% (1.4563 => 1.5388, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 5.57% (0.2243 => 0.2368, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.37% (0.7506 => 0.7909, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.34% (1.3819 => 1.4557, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 5.27% (3.8646 => 4.0681, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.25% (1.3245 => 1.3941, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 5.20% (0.8310 => 0.8742, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.20% (1.2292 => 1.2931, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.14% (3.6692 => 3.8579, std. dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 5.14% (0.2995 => 0.3149, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.11% (1.1061 => 1.1626, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.09% (0.7460 => 0.7840, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.03% (0.6283 => 0.6599, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.02% (1.3813 => 1.4506, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.01% (4.3801 => 4.5997, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.4791 => 0.5030, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 4.96% (0.4113 => 0.4317, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.94% (1.0594 => 1.1117, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (13.2842 => 13.9359, std. dev.: 0.0137) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.87% (4.4433 => 4.6599, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.74% (0.3755 => 0.3933, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.69% (1.9270 => 2.0173, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 4.63% (0.3220 => 0.3369, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.61% (0.6135 => 0.6418, std. dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 4.57% (16.6129 => 17.3714, std. dev.: 0.0156) MultiSource/Applications/siod/siod: 4.50% (2.1791 => 2.2771, std. dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 4.30% (14.8535 => 15.4926, std. dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.11% (0.8818 => 0.9180, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.3245 => 0.3376, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.97% (0.8698 => 0.9043, std. dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.92% (1.1333 => 1.1777, std. dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 3.80% (0.3131 => 0.3250, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.77% (8.4961 => 8.8162, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 3.69% (3.1889 => 3.3066, std. dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.66% (4.9865 => 5.1692, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 3.62% (6.5754 => 6.8136, std. dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.25% (3.2742 => 3.3807, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 3.08% (16.2614 => 16.7623, std. dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: 3.06% (14.5298 => 14.9746, std. dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 2.86% (4.6629 => 4.7964, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.80% (1.5188 => 1.5614, std. dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.73% (0.9108 => 0.9357, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6250 => 0.6410, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (2.1007 => 2.1502, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.19% (6.2785 => 6.4159, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: 2.11% (0.6744 => 0.6886, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.00% (3.7467 => 3.8215, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.85% (1.0313 => 1.0504, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.36% (33.2944 => 33.7460, std. dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 1.15% (1.2749 => 1.2896, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std. dev.: 0.0376) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 8.37% (1.2998 => 1.4086, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6592, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7446, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (1.7081 => 1.7764, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.69% (1.7688 => 1.8164, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.40% (12.0921 => 12.3825, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4271 => 7.6035, std. dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.36% (10.7476 => 11.0013, std. dev.: 0.0434) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3399, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.97% (1.4298 => 1.4579, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.46% (1.5089 => 1.5310, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1847, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.07% (5.5130 => 5.5722, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6389, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.45% (22.5627 => 21.3324, std. dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0961, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.81% (1.3780 => 1.3117, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -3.16% (1.1560 => 1.1195, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.88% (8.8259 => 8.5715, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4681, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2299, std. dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: -1.88% (5.3167 => 5.2167, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: -1.78% (3.0263 => 2.9724, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3305 => 7.2030, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8609, std. dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.19% (20.3410 => 20.0983, std. dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4300, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.11% (5.5401 => 5.4788, std. dev.: 0.0049) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2423, std. dev.: 0.0327) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 07:21:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 09:21:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120828142137.60BC02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3278?compare_to=3272&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3278, Order: 162743, Start Time: 2012-08-28 11:39:07, End Time: 2012-08-28 14:22:37 To: 3272, Order: 162741, Start Time: 2012-08-28 08:27:43, End Time: 2012-08-28 11:11:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 967 (774 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.33% (0.2138 => 0.2316, std. dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 15.32% (0.3465 => 0.3996, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.18% (0.3446 => 0.3969, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.14% (0.3460 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.11% (0.3488 => 0.4015, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.08% (0.3469 => 0.3992, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.05% (0.3496 => 0.4022, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.66% (0.3643 => 0.4177, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.58% (0.3650 => 0.4182, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.23% (0.3724 => 0.4254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5826 => 0.6358, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5889 => 0.6407, std. dev.: 0.0075) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.22% (0.7171 => 0.7689, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.09% (3.5627 => 3.8153, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (1.6211 => 1.7321, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.55% (1.3152 => 1.4014, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.45% (0.2014 => 0.2144, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.23% (0.5026 => 0.5339, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.17% (0.4361 => 0.4630, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.09% (1.5932 => 1.6902, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.83% (0.4029 => 0.4264, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.83% (0.3930 => 0.4159, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.81% (2.7292 => 2.8878, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.80% (0.5900 => 0.6242, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 5.69% (4.2109 => 4.4505, std. dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.63% (0.4994 => 0.5275, std. dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.58% (0.5000 => 0.5279, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 5.45% (1.0781 => 1.1369, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.39% (0.1968 => 0.2074, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.25% (0.2875 => 0.3026, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.16% (0.2866 => 0.3014, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.07% (1.9694 => 2.0693, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.01% (0.2736 => 0.2873, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.99% (1.9966 => 2.0963, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 4.97% (0.2714 => 0.2849, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (0.3890 => 0.4083, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.88% (0.2725 => 0.2858, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.83% (0.2566 => 0.2690, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.80% (0.2729 => 0.2860, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.75% (0.2823 => 0.2957, std. dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 4.71% (5.5417 => 5.8029, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 4.69% (0.2813 => 0.2945, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.69% (2.1013 => 2.1999, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 4.69% (0.2750 => 0.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.67% (0.2803 => 0.2934, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 4.62% (0.3096 => 0.3239, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.60% (0.3195 => 0.3342, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.59% (0.4658 => 0.4872, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.3258 => 0.3407, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.56% (0.9909 => 1.0361, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.53% (0.2780 => 0.2906, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.51% (0.2792 => 0.2918, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.50% (4.6177 => 4.8253, std. dev.: 0.0131) SingleSource/Regression/C++/ofstream_ctor: 4.49% (0.3004 => 0.3139, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.45% (2.0673 => 2.1592, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.42% (2.1653 => 2.2609, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.36% (0.2911 => 0.3038, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.35% (0.3267 => 0.3409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.34% (0.2811 => 0.2933, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.3903 => 0.4071, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.28% (4.4195 => 4.6085, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 4.26% (1.8794 => 1.9594, std. dev.: 0.0027) MultiSource/Applications/hbd/hbd: 4.22% (0.9697 => 1.0106, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.18% (0.3060 => 0.3188, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 4.16% (1.4269 => 1.4863, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.3124 => 0.3253, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.12% (0.3348 => 0.3486, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.11% (0.3678 => 0.3829, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3317 => 0.3452, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 4.06% (0.3477 => 0.3618, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.99% (0.3282 => 0.3413, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.96% (0.7875 => 0.8187, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3690 => 0.3836, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.95% (0.3726 => 0.3873, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.94% (0.3625 => 0.3768, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.93% (0.3362 => 0.3494, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.3271 => 0.3397, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.77% (0.4139 => 0.4295, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.71% (23.5202 => 24.3918, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/hash2: 3.69% (0.4251 => 0.4408, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.63% (0.3336 => 0.3457, std. dev.: 0.0038) MultiSource/Applications/Burg/burg: 3.61% (0.5546 => 0.5746, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 3.57% (0.6634 => 0.6871, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 3.57% (0.4146 => 0.4294, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.3981 => 0.4118, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.40% (0.3084 => 0.3189, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (0.3845 => 0.3975, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.5012 => 0.5172, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.01% (0.6435 => 0.6629, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.44% (2.0346 => 2.0842, std. dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (0.4847 => 0.4950, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.52% (0.7426 => 0.7539, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (4.6926 => 4.7396, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 9.14% (0.2122 => 0.2316, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (12.0509 => 12.6614, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1685, std. dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6402, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1919, std. dev.: 0.0474) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5017, std. dev.: 0.0305) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4638, std. dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.29% (7.1849 => 7.2775, std. dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5800, std. dev.: 0.0172) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.19% (2.4764 => 2.3973, std. dev.: 0.0293) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5612, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8044, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2421, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8045, std. dev.: 0.0075) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7733, std. dev.: 0.0815) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.15% (0.6293 => 0.6158, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5796, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9596, std. dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4975, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 07:25:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 09:25:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828142512.E84EE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3279?compare_to=3275&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3279, Order: 162749, Start Time: 2012-08-28 13:06:46, End Time: 2012-08-28 14:26:10 To: 3275, Order: 162743, Start Time: 2012-08-28 11:19:33, End Time: 2012-08-28 12:39:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (114 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 945 (739 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.62% (13.3813 => 14.1327, std. dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.27% (1.4139 => 1.4318, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.39% (80.3306 => 79.2167, std. dev.: 0.3259) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 36.32% (10.3673 => 14.1327, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.83% (0.3543 => 0.4033, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.50% (0.3473 => 0.3942, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.31% (0.3516 => 0.3984, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3561 => 0.4032, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.18% (0.3497 => 0.3958, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.18% (0.3543 => 0.4010, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 12.67% (0.3694 => 0.4162, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.66% (1.1194 => 1.2611, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.36% (0.3828 => 0.4301, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.20% (0.3886 => 0.4360, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.20% (0.3927 => 0.4406, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 10.61% (0.1432 => 0.1584, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.32% (1.7609 => 1.9426, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.77% (2.2022 => 2.4174, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.01% (0.6030 => 0.6513, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5925 => 0.6399, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.51% (0.1584 => 0.1703, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 7.03% (0.1622 => 0.1736, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1892 => 0.2022, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.86% (10.4361 => 11.1515, std. dev.: 0.0124) SingleSource/UnitTests/ObjC++/property-reference: 6.77% (0.7326 => 0.7822, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.3177 => 0.3388, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.55% (0.3282 => 0.3497, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.45% (0.8172 => 0.8699, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.29% (7.0540 => 7.4977, std. dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.83% (0.4615 => 0.4884, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.66% (0.4879 => 0.5155, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.41% (0.3307 => 0.3486, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.28% (9.4845 => 9.9850, std. dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.7433 => 0.7822, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.20% (0.2271 => 0.2389, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.17% (4.9449 => 5.2005, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.15% (5.0018 => 5.2593, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.98% (0.2107 => 0.2212, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 4.93% (0.2554 => 0.2680, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.87% (4.2646 => 4.4721, std. dev.: 0.0172) MultiSource/Applications/sgefa/sgefa: 4.76% (0.3109 => 0.3257, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.5569 => 0.5826, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.3423 => 0.3577, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.44% (0.5860 => 0.6120, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (1.3050 => 1.3622, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.3121 => 0.3257, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.34% (8.1363 => 8.4896, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.5415 => 1.6075, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.12% (0.4299 => 0.4476, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.09% (0.5105 => 0.5314, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.08% (0.7835 => 0.8155, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3441 => 0.3581, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.04% (0.2700 => 0.2809, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.99% (0.3180 => 0.3307, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.4636 => 0.4816, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.85% (0.3092 => 0.3211, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.84% (0.2758 => 0.2864, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.83% (5.7591 => 5.9796, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.82% (1.1861 => 1.2314, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.75% (0.3387 => 0.3514, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.74% (1.5603 => 1.6187, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.69% (0.9765 => 1.0125, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.58% (2.0273 => 2.0999, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3865 => 0.4003, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.8067 => 0.8354, std. dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.55% (0.6450 => 0.6679, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 3.55% (1.1642 => 1.2055, std. dev.: 0.0061) MultiSource/Applications/d/make_dparser: 3.52% (3.3354 => 3.4529, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (14.3668 => 14.8721, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.49% (0.2891 => 0.2992, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.45% (0.6675 => 0.6905, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.37% (0.4064 => 0.4201, std. dev.: 0.0042) MultiSource/Applications/lua/lua: 3.32% (3.8723 => 4.0007, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 3.28% (0.3232 => 0.3338, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.15% (0.4289 => 0.4424, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.12% (1.4186 => 1.4628, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.07% (0.3422 => 0.3527, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.03% (0.5981 => 0.6162, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.02% (0.6456 => 0.6651, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.01% (0.3826 => 0.3941, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.98% (0.7115 => 0.7327, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.93% (2.0665 => 2.1271, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3603 => 0.3704, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.8921 => 0.9171, std. dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 2.77% (17.1811 => 17.6575, std. dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (0.3935 => 0.4044, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.3684 => 0.3786, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.4203 => 0.4319, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.75% (2.2969 => 2.3601, std. dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: 2.73% (1.2842 => 1.3193, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 2.64% (0.4048 => 0.4155, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.58% (0.4620 => 0.4739, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.48% (1.1840 => 1.2134, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.5020 => 0.5140, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.37% (2.2024 => 2.2545, std. dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.88% (7.9617 => 8.1115, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 1.65% (21.9371 => 22.2992, std. dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9576, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.05% (4.2280 => 4.4414, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7585, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.77% (3.2827 => 3.3408, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.71% (26.0924 => 26.5397, std. dev.: 0.0154) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5313, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7989, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2303, std. dev.: 0.0312) SingleSource/Benchmarks/Shootout-C++/hash2: 1.19% (3.1578 => 3.1954, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5765, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1318, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.50% (5.2763 => 3.1924, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.68% (5.3855 => 3.7331, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.24% (5.3526 => 3.7338, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0775, std. dev.: 0.0177) MultiSource/Applications/ClamAV/clamscan: -13.83% (22.1758 => 19.1084, std. dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.81% (2.9384 => 2.5620, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std. dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -10.44% (1.2373 => 1.1081, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.86% (1.5373 => 1.4318, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.07% (2.7294 => 2.5638, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.1396 => 1.0706, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8048, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4698, std. dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.91% (8.6802 => 8.4280, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0036, std. dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9655, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6780, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3458, std. dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 07:28:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 09:28:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828142854.0E0B22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3280?compare_to=3276&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3280, Order: 162749, Start Time: 2012-08-28 13:19:07, End Time: 2012-08-28 14:29:54 To: 3276, Order: 162744, Start Time: 2012-08-28 11:52:41, End Time: 2012-08-28 13:03:50 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 9 (25 on baseline) Performance Improvements: 7 (39 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 873 (825 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.42% (0.5499 => 0.5632, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.96% (0.7798 => 0.7951, std. dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 1.19% (29.2081 => 29.5565, std. dev.: 0.0356) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3553 => 0.3689, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.75% (4.3252 => 4.4443, std. dev.: 0.0336) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.97% (21.9633 => 22.3966, std. dev.: 0.0740) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.76% (5.4869 => 5.5834, std. dev.: 0.0280) SingleSource/Benchmarks/Misc/whetstone: 1.25% (2.4555 => 2.4863, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: 1.20% (9.1987 => 9.3091, std. dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.66% (0.6008 => 0.5908, std. dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -4.48% (8.6189 => 8.2329, std. dev.: 0.1440) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.17% (0.2588 => 0.2480, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.65% (4.6424 => 4.5192, std. dev.: 0.0325) MultiSource/Applications/minisat/minisat: -2.24% (6.3094 => 6.1683, std. dev.: 0.0234) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.85% (39.9788 => 39.2406, std. dev.: 0.2568) MultiSource/Applications/lua/lua: -1.01% (29.3408 => 29.0456, std. dev.: 0.0625) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.97% (0.7722 => 0.7951, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 14.54% (1.7426 => 1.9960, std. dev.: 0.0656) SingleSource/Benchmarks/McGill/queens: 12.50% (1.6261 => 1.8294, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.35% (1.0063 => 1.1004, std. dev.: 0.0255) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (0.3301 => 0.3544, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.71% (2.8964 => 3.0907, std. dev.: 0.0254) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.02% (5.2665 => 5.5834, std. dev.: 0.0280) SingleSource/Benchmarks/Misc/whetstone: 6.01% (2.3453 => 2.4863, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.49% (4.2129 => 4.4443, std. dev.: 0.0336) MultiSource/Benchmarks/FreeBench/mason/mason: 5.10% (0.5004 => 0.5259, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.97% (6.6312 => 6.8944, std. dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (27.1724 => 28.1654, std. dev.: 0.0125) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.42% (0.3508 => 0.3628, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.39% (2.6656 => 2.7560, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/dt: 3.23% (0.9851 => 1.0169, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.75% (0.8498 => 0.8732, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.74% (0.5179 => 0.5321, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.68% (62.4126 => 64.0873, std. dev.: 0.3084) MultiSource/Applications/hexxagon/hexxagon: 2.49% (14.4877 => 14.8491, std. dev.: 0.0227) SingleSource/Benchmarks/Stanford/FloatMM: 2.19% (0.8175 => 0.8354, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.17% (2.5669 => 2.6227, std. dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.03% (40.4792 => 41.3018, std. dev.: 0.3089) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.77% (25.6658 => 26.1198, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: 1.57% (2.4013 => 2.4389, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.47% (3.8907 => 3.9478, std. dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.38% (0.4880 => 0.4764, std. dev.: 0.0043) MultiSource/Applications/spiff/spiff: -2.35% (0.7738 => 0.7556, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.88% (0.5740 => 0.5632, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: -1.21% (0.8405 => 0.8303, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.17% (1.2742 => 1.2593, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -22.24% (15.8312 => 12.3099, std. dev.: 0.2301) SingleSource/Benchmarks/Shootout-C++/ary3: -21.28% (1.7473 => 1.3754, std. dev.: 0.1365) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.84% (1.4034 => 1.1531, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -14.29% (3.4629 => 2.9682, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std. dev.: 0.0176) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.78% (0.0917 => 0.0809, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.32% (3.2007 => 2.9344, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/richards_benchmark: -7.71% (1.4441 => 1.3328, std. dev.: 0.0121) MultiSource/Applications/sgefa/sgefa: -7.15% (0.3746 => 0.3478, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.70% (1.1647 => 1.0867, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.54% (3.9413 => 3.6835, std. dev.: 0.0637) MultiSource/Benchmarks/FreeBench/distray/distray: -6.23% (0.2664 => 0.2498, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -5.17% (1.4117 => 1.3387, std. dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -5.14% (0.3836 => 0.3639, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -4.90% (3.4230 => 3.2554, std. dev.: 0.0200) MultiSource/Applications/lambda-0_1_3/lambda: -4.89% (7.6833 => 7.3075, std. dev.: 0.0085) SingleSource/Benchmarks/McGill/misr: -4.28% (0.4296 => 0.4112, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.35% (3.7496 => 3.6240, std. dev.: 0.0352) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.33% (0.4564 => 0.4412, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.65% (1.1683 => 1.1373, std. dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: -2.60% (6.7458 => 6.5702, std. dev.: 0.0384) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.17% (9.3855 => 9.1814, std. dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.15% (1.0686 => 1.0456, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.04% (2.3569 => 2.3088, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/pi: -2.03% (1.6538 => 1.6202, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.91% (4.6127 => 4.5247, std. dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.85% (1.1116 => 1.0910, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -1.70% (1.0926 => 1.0740, std. dev.: 0.0001) MultiSource/Applications/lua/lua: -1.62% (29.5232 => 29.0456, std. dev.: 0.0625) MultiSource/Applications/aha/aha: -1.52% (3.4286 => 3.3764, std. dev.: 0.0064) MultiSource/Applications/spiff/spiff: -1.43% (2.8599 => 2.8189, std. dev.: 0.0056) MultiSource/Benchmarks/llubenchmark/llu: -1.41% (2.0192 => 1.9908, std. dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 08:46:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 10:46:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828154652.A0A892A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3281?compare_to=3277&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3281, Order: 162751, Start Time: 2012-08-28 14:33:14, End Time: 2012-08-28 15:47:50 To: 3277, Order: 162744, Start Time: 2012-08-28 12:51:08, End Time: 2012-08-28 14:05:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (155 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 967 (714 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.98% (1.4086 => 1.4365, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.76% (2.0176 => 2.3153, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 11.14% (0.5818 => 0.6466, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 10.98% (0.5748 => 0.6379, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.73% (0.3578 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.72% (0.7061 => 0.7818, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3601 => 0.3980, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.52% (0.3650 => 0.4034, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 10.46% (0.3663 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.45% (0.3646 => 0.4027, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 10.43% (0.3623 => 0.4001, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3789 => 0.4179, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3914 => 0.4313, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.92% (0.4003 => 0.4400, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.87% (0.3940 => 0.4329, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.14% (0.1413 => 0.1528, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.05% (0.7710 => 0.8331, std. dev.: 0.0053) MultiSource/Applications/hbd/hbd: 7.92% (1.3693 => 1.4777, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.91% (3.9660 => 4.2799, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 7.81% (0.4328 => 0.4666, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.73% (0.5265 => 0.5672, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.2596 => 0.2787, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4062 => 0.4360, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2690 => 0.2884, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.13% (0.7038 => 0.7540, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.01% (0.2655 => 0.2841, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.98% (1.2193 => 1.3044, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 6.96% (0.2760 => 0.2952, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.94% (0.2765 => 0.2957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.2937 => 0.3139, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.3899 => 0.4166, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.84% (0.2721 => 0.2907, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.79% (1.9828 => 2.1175, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4379 => 0.4676, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.76% (0.9199 => 0.9821, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.75% (0.3022 => 0.3226, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.74% (0.4390 => 0.4686, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.73% (0.6959 => 0.7427, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.3107 => 0.3315, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3149 => 0.3358, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.62% (0.3580 => 0.3817, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.56% (0.3489 => 0.3718, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.55% (0.2914 => 0.3105, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.54% (0.1789 => 0.1906, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.53% (0.2988 => 0.3183, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.44% (0.2127 => 0.2264, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.42% (0.1588 => 0.1690, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 6.35% (0.3293 => 0.3502, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3192 => 0.3393, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3453 => 0.3666, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (1.1364 => 1.2059, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.08% (0.5577 => 0.5916, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (1.4563 => 1.5441, std. dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 6.00% (13.8202 => 14.6491, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.79% (0.3246 => 0.3434, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.78% (0.2023 => 0.2140, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.78% (0.5637 => 0.5963, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.75% (0.4016 => 0.4247, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.74% (7.2180 => 7.6320, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (0.3756 => 0.3971, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.68% (0.2925 => 0.3091, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 5.62% (0.2243 => 0.2369, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 5.58% (0.3868 => 0.4084, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.58% (0.1865 => 0.1969, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.54% (1.3819 => 1.4584, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.36% (1.3245 => 1.3955, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.33% (1.3813 => 1.4549, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 5.31% (0.3220 => 0.3391, std. dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.28% (1.1061 => 1.1645, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.26% (0.7506 => 0.7901, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 5.21% (1.2292 => 1.2933, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.20% (3.8646 => 4.0657, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.19% (4.3801 => 4.6075, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 5.19% (0.8310 => 0.8741, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 5.18% (0.2995 => 0.3150, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.14% (1.0594 => 1.1139, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.6135 => 0.6450, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.12% (3.6692 => 3.8569, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 5.06% (0.4113 => 0.4321, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.04% (0.7460 => 0.7836, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.01% (0.3755 => 0.3943, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.95% (0.4791 => 0.5028, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.90% (0.6283 => 0.6591, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.85% (4.4433 => 4.6587, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (13.2842 => 13.9203, std. dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 4.72% (16.6129 => 17.3972, std. dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.67% (0.8818 => 0.9230, std. dev.: 0.0042) MultiSource/Applications/treecc/treecc: 4.65% (1.9270 => 2.0167, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 4.34% (0.2859 => 0.2983, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 4.33% (2.1791 => 2.2735, std. dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 4.32% (14.8535 => 15.4951, std. dev.: 0.0065) MultiSource/Benchmarks/sim/sim: 4.12% (0.3131 => 0.3260, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.01% (0.8698 => 0.9047, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.01% (1.1333 => 1.1787, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.98% (0.3245 => 0.3374, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (8.4961 => 8.8222, std. dev.: 0.0087) MultiSource/Applications/d/make_dparser: 3.71% (3.1889 => 3.3073, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.62% (4.9865 => 5.1668, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.61% (6.5754 => 6.8126, std. dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 3.19% (14.5298 => 14.9927, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.14% (3.2742 => 3.3769, std. dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: 3.00% (16.2614 => 16.7493, std. dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 2.86% (4.6629 => 4.7962, std. dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.80% (0.9108 => 0.9363, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (1.5188 => 1.5602, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.66% (0.6250 => 0.6416, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (6.2785 => 6.4224, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1471, std. dev.: 0.0176) MultiSource/Applications/lua/lua: 2.06% (3.7467 => 3.8238, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.94% (1.0313 => 1.0513, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.52% (33.2944 => 33.7992, std. dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/fbench: 26.21% (1.8175 => 2.2938, std. dev.: 0.0373) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.52% (1.2998 => 1.4365, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.2093 => 0.2216, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.89% (1.5824 => 1.6598, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7445, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (1.7081 => 1.7767, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.61% (2.8606 => 2.9638, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5980, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.21% (10.7476 => 10.9854, std. dev.: 0.0478) MultiSource/Applications/lemon/lemon: 2.19% (1.4298 => 1.4611, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.07% (3.2729 => 3.3405, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.04% (4.5928 => 4.6405, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.48% (22.5627 => 21.3268, std. dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.98% (0.2670 => 0.2537, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.41% (1.2308 => 1.1027, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std. dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.43% (1.3780 => 1.3170, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3139 => 0.3002, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8052, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0211, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -3.22% (1.1560 => 1.1188, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.61% (8.8259 => 8.5956, std. dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2261, std. dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -1.81% (5.3167 => 5.2205, std. dev.: 0.0051) MultiSource/Applications/spiff/spiff: -1.77% (3.0263 => 2.9727, std. dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3305 => 7.2056, std. dev.: 0.0103) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9922, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8599, std. dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.30% (9.9194 => 9.7905, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4212, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2279, std. dev.: 0.0180) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.01% (20.3410 => 20.1356, std. dev.: 0.0292) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 08:54:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 10:54:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828155427.CDBE62A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3282?compare_to=3280&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3282, Order: 162755, Start Time: 2012-08-28 14:45:04, End Time: 2012-08-28 15:55:27 To: 3280, Order: 162749, Start Time: 2012-08-28 13:19:07, End Time: 2012-08-28 14:29:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 10 (31 on baseline) Performance Improvements: 2 (40 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 877 (818 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.31% (4.7113 => 4.7732, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.20% (1.5057 => 1.5238, std. dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.07% (1.1614 => 1.1738, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.03% (1.1990 => 1.2113, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 13.82% (3.2537 => 3.7034, std. dev.: 0.0656) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.24% (0.0915 => 0.1027, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.08% (0.7537 => 0.7920, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/fp-convert: 2.86% (15.4984 => 15.9414, std. dev.: 0.0349) SingleSource/Benchmarks/Misc/dt: 1.18% (1.0169 => 1.0289, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 1.06% (1.7379 => 1.7563, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: -3.58% (0.3689 => 0.3557, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -2.02% (2.4863 => 2.4360, std. dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.68% (12.6413 => 12.8543, std. dev.: 0.0661) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.84% (0.0766 => 0.0895, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.82% (1.7426 => 2.0009, std. dev.: 0.0225) SingleSource/Benchmarks/McGill/queens: 12.80% (1.6261 => 1.8343, std. dev.: 0.0127) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.00% (0.0917 => 0.1027, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.56% (1.0063 => 1.0824, std. dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.15% (0.1525 => 0.1634, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.46% (2.8964 => 3.0836, std. dev.: 0.0117) MultiSource/Benchmarks/FreeBench/mason/mason: 5.58% (0.5004 => 0.5283, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.47% (4.2129 => 4.4432, std. dev.: 0.0390) SingleSource/Benchmarks/CoyoteBench/lpbench: 5.02% (5.2665 => 5.5308, std. dev.: 0.0267) SingleSource/Benchmarks/Misc/fp-convert: 4.71% (15.2242 => 15.9414, std. dev.: 0.0349) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (0.3301 => 0.3453, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/dt: 4.45% (0.9851 => 1.0289, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.98% (6.6312 => 6.8953, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/whetstone: 3.87% (2.3453 => 2.4360, std. dev.: 0.0141) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.76% (27.1724 => 28.1941, std. dev.: 0.0811) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.08% (2.6656 => 2.7478, std. dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.90% (40.4792 => 41.6539, std. dev.: 0.1664) MultiSource/Applications/hexxagon/hexxagon: 2.59% (14.4877 => 14.8626, std. dev.: 0.0515) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.55% (0.5179 => 0.5311, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.40% (62.4126 => 63.9082, std. dev.: 0.0249) SingleSource/Benchmarks/Stanford/FloatMM: 2.15% (0.8175 => 0.8351, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.84% (25.6658 => 26.1375, std. dev.: 0.0484) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (2.4455 => 2.4854, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: 1.62% (5.1938 => 5.2778, std. dev.: 0.0216) MultiSource/Benchmarks/Bullet/bullet: 1.49% (6.9722 => 7.0759, std. dev.: 0.0373) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.46% (3.4080 => 3.4576, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.45% (3.8907 => 3.9472, std. dev.: 0.0145) MultiSource/Benchmarks/Olden/tsp/tsp: 1.34% (1.7330 => 1.7563, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 1.30% (2.5166 => 2.5494, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.36% (0.4880 => 0.4765, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.89% (0.7738 => 0.7592, std. dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: -1.24% (14.6079 => 14.4264, std. dev.: 0.0139) MultiSource/Applications/lua/lua: -1.21% (3.5980 => 3.5545, std. dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -21.53% (15.8312 => 12.4226, std. dev.: 0.1196) SingleSource/Benchmarks/Shootout-C++/ary3: -20.60% (1.7473 => 1.3873, std. dev.: 0.0637) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.92% (1.4034 => 1.1519, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: -13.48% (3.4629 => 2.9962, std. dev.: 0.0085) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.41% (0.0917 => 0.0794, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std. dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.11% (3.2007 => 2.9411, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: -7.80% (1.4441 => 1.3314, std. dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -7.77% (0.3746 => 0.3455, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.77% (1.1647 => 1.0859, std. dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.53% (3.9413 => 3.6841, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: -5.97% (1.4117 => 1.3274, std. dev.: 0.0188) MultiSource/Applications/lambda-0_1_3/lambda: -5.23% (7.6833 => 7.2811, std. dev.: 0.0324) MultiSource/Benchmarks/FreeBench/distray/distray: -4.80% (0.2664 => 0.2536, std. dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: -4.64% (3.4230 => 3.2641, std. dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -4.07% (0.3836 => 0.3680, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -3.63% (0.4296 => 0.4140, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.44% (3.7496 => 3.6206, std. dev.: 0.0374) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.07% (0.4564 => 0.4424, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std. dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.57% (4.6127 => 4.4941, std. dev.: 0.0276) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.32% (1.1683 => 1.1412, std. dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: -2.23% (6.7458 => 6.5951, std. dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.18% (9.3855 => 9.1810, std. dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.07% (1.0686 => 1.0465, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: -2.02% (1.6538 => 1.6204, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.01% (2.3569 => 2.3095, std. dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.98% (1.4021 => 1.3744, std. dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.76% (1.1116 => 1.0920, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -1.70% (1.0926 => 1.0740, std. dev.: 0.0020) MultiSource/Applications/aha/aha: -1.68% (3.4286 => 3.3709, std. dev.: 0.0059) MultiSource/Applications/lua/lua: -1.44% (29.5232 => 29.0976, std. dev.: 0.1421) SingleSource/Benchmarks/Misc/oourafft: -1.19% (3.8200 => 3.7744, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: -1.11% (2.8599 => 2.8281, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.02% (2.9152 => 2.8856, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 09:12:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 11:12:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828161209.6E65F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/3283?compare_to=3279&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3283, Order: 162755, Start Time: 2012-08-28 14:53:53, End Time: 2012-08-28 16:13:09 To: 3279, Order: 162749, Start Time: 2012-08-28 13:06:46, End Time: 2012-08-28 14:26:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (109 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (741 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.26% (14.1327 => 13.6722, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.88% (10.3673 => 13.6722, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3473 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.18% (0.3543 => 0.4010, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.13% (0.3497 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3516 => 0.3974, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.01% (0.3543 => 0.4004, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.62% (0.3694 => 0.4160, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3828 => 0.4303, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.32% (0.3927 => 0.4411, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.24% (1.1194 => 1.2564, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.07% (0.3886 => 0.4355, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 10.47% (0.1432 => 0.1582, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.29% (2.2022 => 2.4288, std. dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.10% (1.7609 => 1.9387, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.36% (0.1892 => 0.2069, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.62% (0.3817 => 0.4146, std. dev.: 0.0095) SingleSource/UnitTests/ObjC++/Hello: 7.83% (0.5925 => 0.6389, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.74% (0.6030 => 0.6497, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 7.71% (0.1622 => 0.1747, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (10.4361 => 11.2299, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.58% (0.1584 => 0.1704, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.95% (0.3282 => 0.3510, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7326 => 0.7834, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.3177 => 0.3382, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.36% (0.8172 => 0.8692, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.08% (7.0540 => 7.4829, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4615 => 0.4889, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.70% (0.4879 => 0.5157, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.53% (0.7433 => 0.7844, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.44% (0.3307 => 0.3487, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.42% (0.2271 => 0.2394, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.9449 => 5.2118, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 5.32% (0.2554 => 0.2690, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.29% (9.4845 => 9.9865, std. dev.: 0.0147) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.18% (5.0018 => 5.2610, std. dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.94% (0.2107 => 0.2211, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.88% (4.2646 => 4.4725, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.74% (0.5569 => 0.5833, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.67% (0.2700 => 0.2826, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.60% (0.3109 => 0.3252, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.58% (0.3121 => 0.3264, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.5860 => 0.6128, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.56% (0.3423 => 0.3579, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.51% (1.3050 => 1.3638, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.40% (8.1363 => 8.4947, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.37% (0.3180 => 0.3319, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.37% (0.7835 => 0.8177, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.25% (0.5105 => 0.5322, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.24% (0.3441 => 0.3587, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 4.24% (0.3092 => 0.3223, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.17% (1.5415 => 1.6058, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 4.00% (0.4299 => 0.4471, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.99% (0.2758 => 0.2868, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.89% (5.7591 => 5.9834, std. dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.89% (0.9765 => 1.0145, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.88% (1.1861 => 1.2321, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.87% (0.6675 => 0.6933, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.8067 => 0.8377, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.80% (0.6450 => 0.6695, std. dev.: 0.0053) MultiSource/Applications/Burg/burg: 3.80% (1.1642 => 1.2084, std. dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 3.78% (0.3387 => 0.3515, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.67% (1.5603 => 1.6175, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.66% (14.3668 => 14.8928, std. dev.: 0.0080) MultiSource/Applications/d/make_dparser: 3.62% (3.3354 => 3.4561, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.61% (2.0273 => 2.1004, std. dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.58% (0.4636 => 0.4802, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.53% (3.8723 => 4.0090, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.46% (0.4103 => 0.4245, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.4186 => 1.4657, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.26% (0.3865 => 0.3991, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 3.20% (2.2969 => 2.3704, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.16% (0.5981 => 0.6170, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.10% (0.6456 => 0.6656, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.08% (0.3826 => 0.3944, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.03% (0.3427 => 0.3531, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 3.02% (0.8921 => 0.9190, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.4289 => 0.4418, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.93% (0.3650 => 0.3757, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.79% (17.1811 => 17.6610, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (2.0665 => 2.1238, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.75% (2.2024 => 2.2629, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 2.66% (0.4620 => 0.4743, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.5020 => 0.5153, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.4203 => 0.4314, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.1840 => 1.2143, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: 2.56% (0.7115 => 0.7297, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.49% (1.2842 => 1.3162, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.19% (1.0722 => 1.0957, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.74% (21.9371 => 22.3199, std. dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.64% (7.9617 => 8.0922, std. dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (4.2280 => 4.4487, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.05% (3.6395 => 3.7505, std. dev.: 0.0043) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3398, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.63% (26.0924 => 26.5178, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5086 => 1.5321, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2406, std. dev.: 0.0298) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7979, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.20% (3.1578 => 3.1958, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5767, std. dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.57% (5.2763 => 3.1883, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.61% (5.3855 => 3.7370, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.24% (5.3526 => 3.7338, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -15.02% (54.1659 => 46.0327, std. dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: -13.95% (22.1758 => 19.0831, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.96% (2.9384 => 2.5575, std. dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.34% (1.2373 => 1.0970, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -7.17% (1.5373 => 1.4270, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -6.10% (1.1396 => 1.0701, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.07% (2.7294 => 2.5638, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -5.04% (1.5835 => 1.5037, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.83% (5.0483 => 4.8045, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0014) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4661, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4129, std. dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.55% (10.2830 => 10.0209, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9625, std. dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: -1.57% (12.5348 => 12.3385, std. dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.05% (1.8329 => 1.8136, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (1.6805 => 1.6632, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 10:20:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 12:20:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828172021.088122A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3284?compare_to=3282&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3284, Order: 162763, Start Time: 2012-08-28 16:10:30, End Time: 2012-08-28 17:21:21 To: 3282, Order: 162755, Start Time: 2012-08-28 14:45:04, End Time: 2012-08-28 15:55:27 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 15 (27 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 872 (828 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.14% (0.7465 => 0.7774, std. dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.34% (0.7393 => 0.7640, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.10% (1.3762 => 1.4189, std. dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.67% (1.1432 => 1.1737, std. dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.01% (4.2715 => 4.3572, std. dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.85% (0.5842 => 0.5950, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.49% (4.2012 => 4.2637, std. dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.48% (1.0513 => 1.0669, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.0225 => 2.0474, std. dev.: 0.0028) MultiSource/Applications/Burg/burg: 1.13% (1.1324 => 1.1452, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 4.42% (22.3926 => 23.3832, std. dev.: 0.3087) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.96% (2.5637 => 2.6396, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 2.40% (1.3274 => 1.3593, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.22% (12.4226 => 12.5743, std. dev.: 0.0570) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.21% (4.4432 => 4.4970, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -12.99% (3.7034 => 3.2222, std. dev.: 0.1858) SingleSource/Benchmarks/Misc/salsa20: -1.09% (7.5184 => 7.4368, std. dev.: 0.0273) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.44% (0.0499 => 0.0601, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 15.86% (1.7426 => 2.0190, std. dev.: 0.0159) SingleSource/Benchmarks/McGill/queens: 12.83% (1.6261 => 1.8347, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 10.44% (21.1721 => 23.3832, std. dev.: 0.3087) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.74% (4.2129 => 4.4970, std. dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std. dev.: 0.0034) MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.62% (2.8964 => 3.0592, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/dt: 4.57% (0.9851 => 1.0301, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.56% (5.2665 => 5.5069, std. dev.: 0.0497) SingleSource/Benchmarks/Misc/fp-convert: 4.49% (15.2242 => 15.9078, std. dev.: 0.0916) MultiSource/Benchmarks/FreeBench/mason/mason: 4.44% (0.5004 => 0.5226, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.09% (6.6312 => 6.9026, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: 3.94% (2.3453 => 2.4378, std. dev.: 0.0258) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.69% (27.1724 => 28.1761, std. dev.: 0.0517) SingleSource/Benchmarks/Shootout-C++/hash: 3.34% (0.6308 => 0.6519, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.83% (2.5669 => 2.6396, std. dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (2.4042 => 2.4686, std. dev.: 0.0245) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.66% (0.5179 => 0.5317, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.50% (14.4877 => 14.8499, std. dev.: 0.0743) MultiSource/Benchmarks/mafft/pairlocalalign: 2.49% (62.4126 => 63.9645, std. dev.: 0.3217) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.81% (2.4455 => 2.4897, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.81% (25.6658 => 26.1293, std. dev.: 0.0880) MultiSource/Benchmarks/BitBench/five11/five11: 1.70% (5.1938 => 5.2821, std. dev.: 0.0147) SingleSource/Benchmarks/Dhrystone/dry: 1.61% (2.4013 => 2.4400, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.42% (3.4080 => 3.4564, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 1.28% (2.5166 => 2.5489, std. dev.: 0.0119) MultiSource/Benchmarks/Olden/tsp/tsp: 1.26% (1.7330 => 1.7548, std. dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -21.36% (1.7473 => 1.3740, std. dev.: 0.0217) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.57% (15.8312 => 12.5743, std. dev.: 0.0570) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.31% (1.4034 => 1.1605, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -14.29% (3.4629 => 2.9681, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std. dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.93% (3.2007 => 2.9150, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/richards_benchmark: -8.30% (1.4441 => 1.3242, std. dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.71% (1.1647 => 1.0749, std. dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: -7.21% (0.3746 => 0.3476, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.56% (3.9413 => 3.6828, std. dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/distray/distray: -5.03% (0.2664 => 0.2530, std. dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -4.90% (7.6833 => 7.3072, std. dev.: 0.0486) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -4.46% (0.3836 => 0.3665, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: -3.71% (1.4117 => 1.3593, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.48% (0.4564 => 0.4405, std. dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: -3.47% (3.4230 => 3.3042, std. dev.: 0.0224) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.36% (1.8739 => 1.8109, std. dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.83% (3.7496 => 3.6436, std. dev.: 0.0257) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.65% (4.6127 => 4.4903, std. dev.: 0.0308) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.16% (9.3855 => 9.1826, std. dev.: 0.0290) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.15% (1.0686 => 1.0456, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.11% (1.1683 => 1.1436, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: -2.06% (6.7458 => 6.6066, std. dev.: 0.0473) SingleSource/Benchmarks/Misc/pi: -2.01% (1.6538 => 1.6205, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.73% (1.1116 => 1.0924, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.70% (2.8599 => 2.8112, std. dev.: 0.0130) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0008) MultiSource/Applications/aha/aha: -1.52% (3.4286 => 3.3764, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.29% (2.9152 => 2.8775, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/oourafft: -1.18% (3.8200 => 3.7749, std. dev.: 0.0172) SingleSource/Benchmarks/Misc/fbench: -1.15% (3.4659 => 3.4261, std. dev.: 0.0114) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.3016 => 4.2572, std. dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 10:29:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 12:29:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828172904.286DB2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3285?compare_to=3281&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3285, Order: 162761, Start Time: 2012-08-28 16:15:39, End Time: 2012-08-28 17:30:02 To: 3281, Order: 162751, Start Time: 2012-08-28 14:33:14, End Time: 2012-08-28 15:47:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (158 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 968 (710 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.03% (2.0176 => 2.3208, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 12.23% (0.0826 => 0.0927, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 11.00% (0.5818 => 0.6458, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.86% (0.7061 => 0.7828, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.75% (0.5748 => 0.6366, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3578 => 0.3955, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.37% (0.3646 => 0.4024, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.30% (0.3601 => 0.3972, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3650 => 0.4024, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.21% (0.3663 => 0.4037, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.16% (0.3623 => 0.3991, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.03% (0.3789 => 0.4169, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.89% (0.3914 => 0.4301, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 9.62% (0.4003 => 0.4388, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.57% (0.3940 => 0.4317, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.31% (0.3130 => 0.3390, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.28% (0.1413 => 0.1530, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.94% (0.7710 => 0.8322, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.76% (3.9660 => 4.2739, std. dev.: 0.0029) MultiSource/Applications/hbd/hbd: 7.70% (1.3693 => 1.4748, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (0.4328 => 0.4659, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4062 => 0.4361, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.32% (0.2596 => 0.2786, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.24% (0.5265 => 0.5646, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.19% (0.2655 => 0.2846, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.00% (1.2193 => 1.3047, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.98% (0.7038 => 0.7529, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/random: 6.95% (0.2690 => 0.2877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.90% (0.2607 => 0.2787, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.89% (0.9199 => 0.9833, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4390 => 0.4691, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2761 => 0.2950, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.82% (0.3022 => 0.3228, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.74% (0.2628 => 0.2805, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.71% (0.4379 => 0.4673, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.68% (0.2966 => 0.3164, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3107 => 0.3314, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.65% (1.9828 => 2.1146, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.64% (0.2937 => 0.3132, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.1789 => 0.1907, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.57% (0.3149 => 0.3356, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.57% (0.6959 => 0.7416, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3899 => 0.4153, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.45% (0.3489 => 0.3714, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.42% (0.3580 => 0.3810, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.42% (0.1588 => 0.1690, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.2988 => 0.3179, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.35% (0.2914 => 0.3099, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.30% (0.2127 => 0.2261, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.20% (0.3453 => 0.3667, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.19% (0.3293 => 0.3497, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.19% (1.1364 => 1.2067, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 6.14% (0.3534 => 0.3751, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.11% (13.8202 => 14.6643, std. dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.08% (0.5577 => 0.5916, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.08% (1.4563 => 1.5448, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.88% (0.2023 => 0.2142, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.85% (0.4016 => 0.4251, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.84% (0.1865 => 0.1974, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.82% (7.2180 => 7.6380, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.77% (0.5637 => 0.5962, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.73% (0.3246 => 0.3432, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.71% (0.2243 => 0.2371, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (0.3756 => 0.3970, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.62% (0.7506 => 0.7928, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.61% (0.2925 => 0.3089, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 5.53% (0.3868 => 0.4082, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.2945 => 0.3105, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.42% (1.3819 => 1.4568, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 5.34% (3.8646 => 4.0711, std. dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.26% (1.3813 => 1.4540, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 5.24% (0.2995 => 0.3152, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.22% (0.4791 => 0.5041, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.21% (3.6692 => 3.8604, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 5.19% (0.8310 => 0.8741, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.13% (0.7460 => 0.7843, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 5.13% (0.4113 => 0.4324, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.13% (1.3245 => 1.3924, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.12% (4.3801 => 4.6042, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 5.11% (1.1061 => 1.1626, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.10% (1.2292 => 1.2919, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.08% (13.2842 => 13.9595, std. dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 5.01% (1.0594 => 1.1125, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (4.4433 => 4.6659, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.00% (0.6283 => 0.6597, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3755 => 0.3940, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.83% (1.9270 => 2.0201, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.81% (0.3220 => 0.3375, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.74% (0.6135 => 0.6426, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.55% (0.8818 => 0.9219, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.50% (16.6129 => 17.3610, std. dev.: 0.0194) MultiSource/Applications/siod/siod: 4.48% (2.1791 => 2.2767, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 4.39% (14.8535 => 15.5053, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.3245 => 0.3376, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.96% (0.3131 => 0.3255, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.88% (8.4961 => 8.8254, std. dev.: 0.0160) MultiSource/Applications/d/make_dparser: 3.87% (3.1889 => 3.3123, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.86% (1.1333 => 1.1771, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.86% (0.8698 => 0.9034, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.81% (4.9865 => 5.1765, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 3.80% (6.5754 => 6.8251, std. dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 3.60% (0.2859 => 0.2962, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.24% (16.2614 => 16.7889, std. dev.: 0.0378) MultiSource/Applications/ClamAV/clamscan: 3.21% (14.5298 => 14.9966, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.12% (3.2742 => 3.3762, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.83% (4.6629 => 4.7949, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.77% (1.5188 => 1.5608, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.72% (0.9108 => 0.9356, std. dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 2.50% (0.6250 => 0.6406, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (6.2785 => 6.4204, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.21% (2.1007 => 2.1472, std. dev.: 0.0086) MultiSource/Applications/minisat/minisat: 2.11% (0.6744 => 0.6886, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 2.06% (3.7467 => 3.8240, std. dev.: 0.0064) MultiSource/Applications/lemon/lemon: 1.96% (1.0313 => 1.0515, std. dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 1.55% (33.2944 => 33.8117, std. dev.: 0.0153) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.2749 => 1.2933, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std. dev.: 0.0487) SingleSource/Benchmarks/Misc/mandel-2: 10.89% (1.2998 => 1.4413, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.35% (0.2093 => 0.2226, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6591, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.55% (1.9144 => 2.0016, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.29% (11.2619 => 11.7448, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8160, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5964, std. dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 2.26% (10.7476 => 10.9903, std. dev.: 0.0314) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.09% (1.4298 => 1.4597, std. dev.: 0.0041) MultiSource/Applications/siod/siod: 2.02% (3.2729 => 3.3389, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std. dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.31% (1.5089 => 1.5287, std. dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6389, std. dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.58% (0.2670 => 0.2521, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.37% (22.5627 => 21.3503, std. dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2308 => 1.0971, std. dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std. dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.67% (1.3780 => 1.3137, std. dev.: 0.0133) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0215, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.37% (0.4867 => 0.4703, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -3.20% (1.1560 => 1.1190, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5892, std. dev.: 0.0098) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std. dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (0.8342 => 0.8165, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.85% (5.3167 => 5.2181, std. dev.: 0.0050) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9732, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2448, std. dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3305 => 7.2042, std. dev.: 0.0221) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2146, std. dev.: 0.0229) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7922, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.25% (20.3410 => 20.0873, std. dev.: 0.0385) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std. dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4206, std. dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.03% (5.5401 => 5.4829, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 10:52:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 12:52:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120828175217.E271D2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3286?compare_to=3278&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3286, Order: 162755, Start Time: 2012-08-28 14:50:08, End Time: 2012-08-28 17:53:17 To: 3278, Order: 162743, Start Time: 2012-08-28 11:39:07, End Time: 2012-08-28 14:22:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (109 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 968 (783 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 14.29% (0.3465 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.28% (0.3460 => 0.3954, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 14.26% (0.3442 => 0.3933, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 14.25% (0.3446 => 0.3937, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.24% (0.3469 => 0.3963, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.19% (0.3488 => 0.3983, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3724 => 0.4220, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5826 => 0.6345, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.5889 => 0.6389, std. dev.: 0.0083) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.39% (0.3792 => 0.4110, std. dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.1619 => 0.1741, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.86% (0.7171 => 0.7663, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.53% (3.5627 => 3.7955, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.35% (1.6211 => 1.7240, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.22% (1.3152 => 1.3970, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std. dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.93% (1.5932 => 1.6876, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.83% (0.5900 => 0.6244, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (0.5026 => 0.5319, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.78% (0.4361 => 0.4613, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.74% (0.2736 => 0.2893, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.73% (0.4994 => 0.5280, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.64% (0.5000 => 0.5282, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std. dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.47% (2.7292 => 2.8785, std. dev.: 0.0021) MultiSource/Applications/spiff/spiff: 5.44% (0.4029 => 0.4248, std. dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 5.24% (4.2109 => 4.4317, std. dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.08% (0.1968 => 0.2068, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 5.01% (1.0781 => 1.1321, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.83% (0.2875 => 0.3014, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.78% (0.2866 => 0.3003, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.72% (0.2566 => 0.2687, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.60% (0.2738 => 0.2864, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.58% (5.5417 => 5.7954, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 4.55% (0.2725 => 0.2849, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.50% (0.2714 => 0.2836, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.48% (1.9966 => 2.0860, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.46% (0.2823 => 0.2949, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.46% (1.9694 => 2.0572, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/methcall: 4.44% (0.2813 => 0.2938, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.43% (0.2729 => 0.2850, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 4.42% (0.2803 => 0.2927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 4.25% (0.2750 => 0.2867, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (2.1013 => 2.1904, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 4.23% (0.3096 => 0.3227, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.20% (2.0673 => 2.1541, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.19% (0.2792 => 0.2909, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.19% (0.3890 => 0.4053, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.19% (0.9909 => 1.0324, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.19% (0.4658 => 0.4853, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 4.14% (0.2780 => 0.2895, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.13% (0.3004 => 0.3128, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.09% (0.2911 => 0.3030, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 4.02% (0.2811 => 0.2924, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.99% (0.3258 => 0.3388, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.98% (0.3267 => 0.3397, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.93% (2.1653 => 2.2505, std. dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.92% (0.3903 => 0.4056, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.91% (0.3124 => 0.3246, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 3.86% (1.8794 => 1.9520, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.86% (0.3060 => 0.3178, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.85% (0.3348 => 0.3477, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (4.4195 => 4.5890, std. dev.: 0.0096) MultiSource/Applications/hbd/hbd: 3.81% (0.9697 => 1.0066, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 3.76% (1.4269 => 1.4806, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.3477 => 0.3607, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.74% (0.3317 => 0.3441, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.3678 => 0.3815, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.3362 => 0.3486, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3726 => 0.3863, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.66% (0.3690 => 0.3825, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.63% (0.3282 => 0.3401, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.62% (0.7875 => 0.8160, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.55% (0.3271 => 0.3387, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.53% (0.4139 => 0.4285, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 3.43% (0.4251 => 0.4397, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.43% (0.5546 => 0.5736, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.30% (0.4146 => 0.4283, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 3.29% (0.6634 => 0.6852, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 3.24% (0.3336 => 0.3444, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 3.16% (23.5202 => 24.2634, std. dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.3981 => 0.4106, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.07% (0.3845 => 0.3963, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 2.16% (2.0346 => 2.0786, std. dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6531, std. dev.: 0.0134) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std. dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6756, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std. dev.: 0.0386) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6328, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2009, std. dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5008, std. dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2216, std. dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (41.7953 => 42.4402, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std. dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5112, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5847, std. dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.20% (2.4764 => 2.3972, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5287, std. dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/ary2: -8.83% (0.2402 => 0.2190, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7918, std. dev.: 0.0130) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7928, std. dev.: 0.0156) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std. dev.: 0.0034) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.62% (17.2379 => 16.7859, std. dev.: 0.0779) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std. dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.53% (16.2163 => 15.9690, std. dev.: 0.0591) MultiSource/Benchmarks/Olden/bh/bh: -1.42% (5.5810 => 5.5016, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 10:59:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 12:59:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828175914.1B83C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3287?compare_to=3283&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3287, Order: 162763, Start Time: 2012-08-28 16:40:52, End Time: 2012-08-28 18:00:12 To: 3283, Order: 162755, Start Time: 2012-08-28 14:53:53, End Time: 2012-08-28 16:13:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (113 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 945 (737 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.06% (54.5646 => 55.6884, std. dev.: 0.4256) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.52% (13.6722 => 13.4639, std. dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: -1.13% (11.2299 => 11.1033, std. dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.87% (10.3673 => 13.4639, std. dev.: 0.0093) SingleSource/UnitTests/ObjC/trivial-interface: 13.53% (0.3473 => 0.3943, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.15% (0.3543 => 0.4009, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.13% (0.3497 => 0.3956, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.11% (0.3561 => 0.4028, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3516 => 0.3974, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.01% (0.3543 => 0.4004, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3694 => 0.4163, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.25% (0.3828 => 0.4297, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.99% (0.3927 => 0.4398, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.97% (1.1194 => 1.2534, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.91% (0.3886 => 0.4349, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.23% (1.7609 => 1.9410, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.62% (0.1892 => 0.2074, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.38% (2.2022 => 2.4088, std. dev.: 0.0094) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.88% (0.6030 => 0.6505, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.01% (0.1584 => 0.1695, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 6.67% (0.7326 => 0.7815, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.55% (0.3177 => 0.3385, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 6.39% (10.4361 => 11.1033, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.11% (0.8172 => 0.8671, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 6.09% (0.3282 => 0.3482, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.70% (0.4615 => 0.4878, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.57% (7.0540 => 7.4468, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.49% (0.4879 => 0.5147, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 5.40% (0.2554 => 0.2692, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.35% (0.3307 => 0.3484, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.06% (0.2271 => 0.2386, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.99% (4.9449 => 5.1917, std. dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 4.94% (9.4845 => 9.9530, std. dev.: 0.0154) MultiSource/Applications/lambda-0_1_3/lambda: 4.83% (0.7433 => 0.7792, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (5.0018 => 5.2401, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.66% (0.5860 => 0.6133, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.52% (0.7835 => 0.8189, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.46% (4.2646 => 4.4547, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.5569 => 0.5814, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.29% (0.3121 => 0.3255, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.15% (8.1363 => 8.4740, std. dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 4.15% (0.3109 => 0.3238, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.15% (0.3423 => 0.3565, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.08% (1.3050 => 1.3582, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.88% (0.4636 => 0.4816, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.5105 => 0.5303, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 3.86% (0.4299 => 0.4465, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.85% (0.2700 => 0.2804, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.77% (0.3180 => 0.3300, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 3.68% (0.2905 => 0.3012, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.63% (0.3441 => 0.3566, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.63% (0.2891 => 0.2996, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.57% (1.5415 => 1.5965, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.53% (0.9765 => 1.0110, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 3.50% (1.5603 => 1.6149, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1861 => 1.2271, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.44% (0.3865 => 0.3998, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.42% (5.7591 => 5.9561, std. dev.: 0.0159) MultiSource/Benchmarks/sim/sim: 3.37% (0.3387 => 0.3501, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.4103 => 0.4241, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.33% (0.6450 => 0.6665, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.27% (0.3826 => 0.3951, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.27% (0.6675 => 0.6893, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.4289 => 0.4427, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.21% (0.3422 => 0.3532, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.21% (0.8067 => 0.8326, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.16% (0.3232 => 0.3334, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 3.15% (1.1642 => 1.2009, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.14% (2.0665 => 2.1313, std. dev.: 0.0005) MultiSource/Applications/treecc/treecc: 3.13% (2.0273 => 2.0907, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.10% (3.3354 => 3.4388, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.10% (0.3650 => 0.3763, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (14.3668 => 14.8112, std. dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (0.4064 => 0.4189, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.02% (0.3935 => 0.4054, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.01% (3.8723 => 3.9889, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.6456 => 0.6650, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.86% (0.5981 => 0.6152, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.74% (1.4186 => 1.4575, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: 2.68% (0.4620 => 0.4744, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.2842 => 1.3184, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 2.64% (0.4048 => 0.4155, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8921 => 0.9138, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.5020 => 0.5140, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.30% (17.1811 => 17.5763, std. dev.: 0.0103) MultiSource/Applications/siod/siod: 2.29% (2.2969 => 2.3496, std. dev.: 0.0031) MultiSource/Applications/minisat/minisat: 2.28% (0.7115 => 0.7277, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.04% (1.5859 => 1.6183, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 2.04% (1.1840 => 1.2081, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.99% (2.2024 => 2.2463, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.51% (1.0722 => 1.0884, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.49% (7.9617 => 8.0805, std. dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 1.32% (21.9371 => 22.2261, std. dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.00% (4.2280 => 4.4393, std. dev.: 0.0113) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.98% (3.6395 => 3.7481, std. dev.: 0.0065) MultiSource/Applications/siod/siod: 1.71% (3.2827 => 3.3389, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 1.57% (26.0924 => 26.5029, std. dev.: 0.0340) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.41% (1.5086 => 1.5298, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2324, std. dev.: 0.0307) SingleSource/Benchmarks/Shootout-C++/hash2: 1.15% (3.1578 => 3.1941, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6821, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5753, std. dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1274, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.42% (5.2763 => 3.1962, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.00% (5.3855 => 3.7161, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.60% (5.3526 => 3.7149, std. dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0763, std. dev.: 0.0217) MultiSource/Applications/ClamAV/clamscan: -14.11% (22.1758 => 19.0466, std. dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.94% (2.9384 => 2.5582, std. dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -11.17% (1.2373 => 1.0991, std. dev.: 0.0314) SingleSource/Benchmarks/Misc/mandel-2: -7.44% (1.5373 => 1.4229, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4676, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.1396 => 1.0699, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.06% (2.7294 => 2.5639, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.46% (3.1595 => 3.0503, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4756, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4193, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0032, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.53% (8.1563 => 7.9498, std. dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std. dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std. dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -1.47% (12.5348 => 12.3503, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.8329 => 1.8132, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (1.6805 => 1.6631, std. dev.: 0.0030) MultiSource/Applications/lemon/lemon: -1.00% (1.4460 => 1.4315, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 11:46:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 13:46:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828184628.D27B12A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3288?compare_to=3284&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3288, Order: 162766, Start Time: 2012-08-28 17:36:47, End Time: 2012-08-28 18:47:29 To: 3284, Order: 162763, Start Time: 2012-08-28 16:10:30, End Time: 2012-08-28 17:21:21 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 7 (28 on baseline) Performance Improvements: 4 (32 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 878 (829 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 7.02% (2.9861 => 3.1956, std. dev.: 0.0725) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.69% (1.8109 => 1.8596, std. dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.54% (1.3685 => 1.4032, std. dev.: 0.0105) MultiSource/Applications/siod/siod: 2.27% (3.5630 => 3.6438, std. dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.78% (12.5743 => 12.7987, std. dev.: 0.0469) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.19% (1.0749 => 1.0877, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.18% (1.4309 => 1.4478, std. dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: -3.38% (15.9078 => 15.3699, std. dev.: 0.1692) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.45% (2.6396 => 2.5750, std. dev.: 0.0226) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.65% (0.8885 => 0.8738, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -1.30% (3.3042 => 3.2614, std. dev.: 0.0163) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std. dev.: 0.0464) SingleSource/Benchmarks/McGill/queens: 12.79% (1.6261 => 1.8341, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.52% (1.0063 => 1.0820, std. dev.: 0.0048) MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.31% (2.8964 => 3.0793, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/whetstone: 6.23% (2.3453 => 2.4913, std. dev.: 0.0264) MultiSource/Benchmarks/FreeBench/mason/mason: 5.10% (0.5004 => 0.5259, std. dev.: 0.0020) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.36% (0.3508 => 0.3661, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.99% (5.2665 => 5.4766, std. dev.: 0.0701) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.85% (6.6312 => 6.8864, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/dt: 3.84% (0.9851 => 1.0229, std. dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (27.1724 => 28.1820, std. dev.: 0.0765) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.20% (2.6656 => 2.7509, std. dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.11% (0.5179 => 0.5340, std. dev.: 0.0043) MultiSource/Benchmarks/Olden/bisort/bisort: 3.05% (0.6459 => 0.6656, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.82% (0.8498 => 0.8738, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 2.58% (3.5520 => 3.6438, std. dev.: 0.0173) MultiSource/Applications/hexxagon/hexxagon: 2.57% (14.4877 => 14.8607, std. dev.: 0.0138) SingleSource/Benchmarks/Stanford/FloatMM: 2.24% (0.8175 => 0.8358, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.81% (5.1938 => 5.2877, std. dev.: 0.0133) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (62.4126 => 63.5408, std. dev.: 0.3697) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.80% (38.9255 => 39.6264, std. dev.: 0.0945) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.74% (25.6658 => 26.1135, std. dev.: 0.0727) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.55% (1.2726 => 1.2923, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 1.45% (2.4013 => 2.4362, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (2.4455 => 2.4802, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.36% (3.4080 => 3.4545, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.0194 => 1.0310, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.08% (1.4324 => 1.4478, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.66% (0.7738 => 0.7532, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.27% (0.4880 => 0.4769, std. dev.: 0.0031) MultiSource/Applications/lemon/lemon: -1.05% (1.0046 => 0.9941, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -21.44% (1.7473 => 1.3726, std. dev.: 0.0389) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.16% (15.8312 => 12.7987, std. dev.: 0.0469) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.37% (1.4034 => 1.1596, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -14.28% (3.4629 => 2.9684, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std. dev.: 0.0366) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.15% (3.2007 => 2.9079, std. dev.: 0.0300) SingleSource/Benchmarks/Misc/richards_benchmark: -7.72% (1.4441 => 1.3326, std. dev.: 0.0126) MultiSource/Applications/sgefa/sgefa: -6.86% (0.3746 => 0.3489, std. dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.61% (1.1647 => 1.0877, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.51% (3.9413 => 3.6848, std. dev.: 0.0631) MultiSource/Benchmarks/FreeBench/distray/distray: -6.12% (0.2664 => 0.2501, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7929, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -5.08% (7.6833 => 7.2931, std. dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -4.72% (3.4230 => 3.2614, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/ffbench: -4.69% (1.4117 => 1.3455, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -4.56% (0.3836 => 0.3661, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.41% (3.7496 => 3.6218, std. dev.: 0.0387) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.05% (0.4564 => 0.4425, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.81% (4.6127 => 4.4832, std. dev.: 0.0404) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -2.46% (1.0926 => 1.0657, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/pi: -2.18% (1.6538 => 1.6178, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.17% (1.0686 => 1.0454, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (9.3855 => 9.1955, std. dev.: 0.0138) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.96% (2.3569 => 2.3107, std. dev.: 0.0079) MultiSource/Applications/aha/aha: -1.66% (3.4286 => 3.3716, std. dev.: 0.0162) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.44% (2.9152 => 2.8732, std. dev.: 0.0139) MultiSource/Applications/lua/lua: -1.35% (29.5232 => 29.1250, std. dev.: 0.0178) SingleSource/Benchmarks/Misc/oourafft: -1.24% (3.8200 => 3.7727, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 12:11:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 14:11:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828191113.B9D622A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3289?compare_to=3285&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3289, Order: 162767, Start Time: 2012-08-28 17:57:56, End Time: 2012-08-28 19:12:12 To: 3285, Order: 162761, Start Time: 2012-08-28 16:15:39, End Time: 2012-08-28 17:30:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (154 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 967 (713 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.11% (1.4413 => 1.4253, std. dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.82% (2.0176 => 2.3166, std. dev.: 0.0124) SingleSource/UnitTests/ObjC++/property-reference-object: 11.55% (0.5818 => 0.6490, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.93% (0.7061 => 0.7833, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3578 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3646 => 0.4025, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.39% (0.3601 => 0.3975, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3650 => 0.4027, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.29% (0.3663 => 0.4040, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3623 => 0.3993, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.03% (0.3789 => 0.4169, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.94% (0.3914 => 0.4303, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.89% (0.4003 => 0.4399, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 9.72% (0.3940 => 0.4323, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.21% (0.1413 => 0.1529, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.99% (0.7710 => 0.8326, std. dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.84% (1.3693 => 1.4767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.83% (0.2655 => 0.2863, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.82% (3.9660 => 4.2761, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4328 => 0.4664, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2782 => 0.2989, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.26% (0.5265 => 0.5647, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2765 => 0.2965, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.21% (0.4062 => 0.4355, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 7.21% (0.2607 => 0.2795, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 7.19% (0.7038 => 0.7544, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.12% (0.2726 => 0.2920, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2690 => 0.2880, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3022 => 0.3234, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 7.00% (0.2628 => 0.2812, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.98% (0.9199 => 0.9841, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.89% (1.2193 => 1.3033, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.87% (1.9828 => 2.1191, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.81% (0.2937 => 0.3137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.79% (0.3107 => 0.3318, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.79% (0.3580 => 0.3823, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.78% (0.2966 => 0.3167, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.75% (0.6959 => 0.7429, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4379 => 0.4674, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.72% (0.3899 => 0.4161, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.68% (0.2696 => 0.2876, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.62% (0.3489 => 0.3720, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.2721 => 0.2895, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.37% (0.3453 => 0.3673, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.32% (0.1789 => 0.1902, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.13% (0.4390 => 0.4659, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (1.1364 => 1.2059, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.11% (0.2127 => 0.2257, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.03% (0.4016 => 0.4258, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.94% (0.5577 => 0.5908, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.90% (13.8202 => 14.6353, std. dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.2914 => 0.3084, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.80% (0.3756 => 0.3974, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.77% (0.3868 => 0.4091, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.76% (0.3246 => 0.3433, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.74% (0.2945 => 0.3114, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.74% (0.1865 => 0.1972, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.73% (0.5637 => 0.5960, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.64% (7.2180 => 7.6251, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.64% (0.2023 => 0.2137, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 5.61% (0.2925 => 0.3089, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.4563 => 1.5376, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 5.57% (0.2243 => 0.2368, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.27% (0.7460 => 0.7853, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 5.26% (3.8646 => 4.0680, std. dev.: 0.0086) MultiSource/Applications/spiff/spiff: 5.26% (0.7506 => 0.7901, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 5.26% (1.2292 => 1.2938, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (1.3819 => 1.4544, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.18% (1.1061 => 1.1634, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 5.18% (0.2995 => 0.3150, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.13% (0.4113 => 0.4324, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.08% (1.3245 => 1.3918, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 5.02% (0.8310 => 0.8727, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.00% (4.4433 => 4.6653, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (1.3813 => 1.4491, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.89% (4.3801 => 4.5945, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (3.6692 => 3.8488, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.89% (0.6135 => 0.6435, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.74% (0.6283 => 0.6581, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.0594 => 1.1096, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 4.73% (1.9270 => 2.0181, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.69% (0.3755 => 0.3931, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.57% (0.4791 => 0.5010, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 4.53% (16.6129 => 17.3657, std. dev.: 0.0109) MultiSource/Benchmarks/McCat/18-imp/imp: 4.50% (0.3220 => 0.3365, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8750, std. dev.: 0.0053) MultiSource/Applications/siod/siod: 4.45% (2.1791 => 2.2760, std. dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 4.08% (14.8535 => 15.4598, std. dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.90% (1.1333 => 1.1775, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.85% (0.3245 => 0.3370, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.83% (0.8698 => 0.9031, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.77% (0.8818 => 0.9150, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.74% (0.3131 => 0.3248, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (8.4961 => 8.8027, std. dev.: 0.0051) MultiSource/Applications/d/make_dparser: 3.50% (3.1889 => 3.3005, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.44% (6.5754 => 6.8015, std. dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.30% (4.9865 => 5.1510, std. dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 3.20% (16.2614 => 16.7811, std. dev.: 0.0152) MultiSource/Applications/ClamAV/clamscan: 3.06% (14.5298 => 14.9742, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.83% (3.2742 => 3.3670, std. dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 2.59% (4.6629 => 4.7835, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.50% (0.9108 => 0.9336, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.30% (0.6250 => 0.6394, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.1007 => 2.1459, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.10% (3.7467 => 3.8255, std. dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (6.2785 => 6.4084, std. dev.: 0.0039) MultiSource/Applications/minisat/minisat: 1.85% (0.6744 => 0.6869, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.79% (1.0313 => 1.0498, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.31% (33.2944 => 33.7298, std. dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.2749 => 1.2882, std. dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std. dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.66% (1.2998 => 1.4253, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (0.2093 => 0.2200, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.87% (1.5824 => 1.6595, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7414, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (1.7081 => 1.7770, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8159, std. dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3843, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5991, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.22% (10.7476 => 10.9857, std. dev.: 0.0064) MultiSource/Applications/lemon/lemon: 2.11% (1.4298 => 1.4599, std. dev.: 0.0028) MultiSource/Applications/siod/siod: 2.09% (3.2729 => 3.3413, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.39% (1.5089 => 1.5299, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5736, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.00% (4.5928 => 4.6388, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.89% (22.5627 => 21.2329, std. dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3511 => 0.3399, std. dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std. dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.33% (0.3139 => 0.3003, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.88% (1.3780 => 1.3245, std. dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -3.22% (1.1560 => 1.1188, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4677, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.49% (8.8259 => 8.6064, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -2.45% (1.9762 => 1.9278, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (0.8342 => 0.8170, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2355, std. dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2038, std. dev.: 0.0265) MultiSource/Applications/lambda-0_1_3/lambda: -1.72% (5.3167 => 5.2255, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: -1.71% (3.0263 => 2.9744, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7926, std. dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (84.4286 => 83.4188, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.15% (20.3410 => 20.1070, std. dev.: 0.0277) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2363, std. dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.01% (5.5401 => 5.4843, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 12:46:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 14:46:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828194623.ACAAA2A6C074@llvm.org> http://llvm.org/perf/db_default/v4/nts/3290?compare_to=3287&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3290, Order: 162769, Start Time: 2012-08-28 18:28:13, End Time: 2012-08-28 19:47:23 To: 3287, Order: 162763, Start Time: 2012-08-28 16:40:52, End Time: 2012-08-28 18:00:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (117 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (734 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.08% (13.4639 => 13.1838, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.17% (10.3673 => 13.1838, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3473 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3561 => 0.4018, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 12.78% (0.3497 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.76% (0.3543 => 0.3995, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.71% (0.3516 => 0.3963, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.34% (0.3694 => 0.4150, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.26% (1.1194 => 1.2566, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.93% (1.7609 => 1.9533, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.74% (2.2022 => 2.4167, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 9.15% (0.1432 => 0.1563, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.54% (0.3817 => 0.4143, std. dev.: 0.0101) SingleSource/UnitTests/ObjC++/Hello: 7.53% (0.5925 => 0.6371, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.46% (0.6030 => 0.6480, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.26% (0.1584 => 0.1699, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.98% (10.4361 => 11.1650, std. dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.58% (0.3177 => 0.3386, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.55% (0.1892 => 0.2016, std. dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 6.40% (0.7326 => 0.7795, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.98% (0.4615 => 0.4891, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.87% (7.0540 => 7.4679, std. dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3307 => 0.3493, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.62% (0.4879 => 0.5153, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 5.26% (0.7433 => 0.7824, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (4.9449 => 5.2038, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.20% (0.2271 => 0.2389, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.18% (9.4845 => 9.9754, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (5.0018 => 5.2547, std. dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 5.05% (0.2554 => 0.2683, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.79% (4.2646 => 4.4689, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.67% (0.8172 => 0.8554, std. dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 4.66% (0.3109 => 0.3254, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.65% (0.5569 => 0.5828, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.5860 => 0.6130, std. dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3121 => 0.3263, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.54% (1.3050 => 1.3642, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 4.53% (0.3423 => 0.3578, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.39% (8.1363 => 8.4937, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.21% (0.3441 => 0.3586, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 4.19% (0.4299 => 0.4479, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 4.19% (0.7835 => 0.8163, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.13% (1.5415 => 1.6052, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 4.12% (0.3180 => 0.3311, std. dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.11% (0.2700 => 0.2811, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.2758 => 0.2871, std. dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.07% (5.7591 => 5.9934, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.04% (0.5105 => 0.5311, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.94% (0.6450 => 0.6704, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.91% (0.9765 => 1.0147, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.85% (0.3092 => 0.3211, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (1.1861 => 1.2317, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.78% (0.6675 => 0.6927, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.75% (0.3387 => 0.3514, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.73% (0.4636 => 0.4809, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.66% (1.1642 => 1.2068, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.63% (0.4103 => 0.4252, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.59% (3.3354 => 3.4551, std. dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.57% (0.8067 => 0.8355, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.52% (0.3865 => 0.4001, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.50% (2.0273 => 2.0983, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.49% (0.2891 => 0.2992, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.49% (0.6456 => 0.6681, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.44% (3.8723 => 4.0056, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.40% (0.3650 => 0.3774, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.38% (0.4289 => 0.4434, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (14.3668 => 14.8451, std. dev.: 0.0058) MultiSource/Applications/hbd/hbd: 3.30% (1.5603 => 1.6118, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 3.29% (0.3098 => 0.3200, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.4064 => 0.4195, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.21% (0.3826 => 0.3949, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (1.4186 => 1.4637, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 3.16% (0.3422 => 0.3530, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.13% (2.2969 => 2.3689, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3232 => 0.3333, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.08% (2.0665 => 2.1301, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.08% (0.5981 => 0.6165, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 3.07% (0.4620 => 0.4762, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 2.98% (0.8921 => 0.9187, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.96% (0.3684 => 0.3793, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.95% (0.3935 => 0.4051, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.94% (0.3603 => 0.3709, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.93% (0.4203 => 0.4326, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.89% (0.4048 => 0.4165, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.80% (17.1811 => 17.6615, std. dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.73% (0.5020 => 0.5157, std. dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 2.70% (1.2842 => 1.3189, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.70% (1.5859 => 1.6287, std. dev.: 0.0007) MultiSource/Applications/minisat/minisat: 2.56% (0.7115 => 0.7297, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.56% (2.2024 => 2.2587, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.1840 => 1.2122, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.04% (1.0722 => 1.0941, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.56% (21.9371 => 22.2788, std. dev.: 0.0090) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.36% (7.9617 => 8.0698, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.11% (4.2280 => 4.4442, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7546, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3399, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 1.73% (26.0924 => 26.5433, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (1.5086 => 1.5302, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2274, std. dev.: 0.0233) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 1.12% (3.1578 => 3.1931, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5814, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 1.07% (2.2771 => 2.3015, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6813, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.65% (5.2763 => 3.1840, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.79% (5.3855 => 3.7274, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.40% (5.3526 => 3.7253, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.98% (54.1659 => 46.0536, std. dev.: 0.0194) MultiSource/Applications/ClamAV/clamscan: -13.93% (22.1758 => 19.0864, std. dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.83% (2.9384 => 2.5614, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2373 => 1.1063, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -9.35% (1.5373 => 1.3935, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.06% (2.7294 => 2.5639, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -6.01% (1.1396 => 1.0711, std. dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0013) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0509, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4681, std. dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4231, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0005, std. dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (8.1563 => 7.9574, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3450, std. dev.: 0.0056) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4245, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (1.6805 => 1.6630, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8139, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 13:13:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 15:13:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828201326.6CE8E2A6C06C@llvm.org> http://llvm.org/perf/db_default/v4/nts/3291?compare_to=3288&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3291, Order: 162774, Start Time: 2012-08-28 19:03:06, End Time: 2012-08-28 20:14:26 To: 3288, Order: 162766, Start Time: 2012-08-28 17:36:47, End Time: 2012-08-28 18:47:29 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 4 (28 on baseline) Performance Improvements: 2 (48 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 883 (813 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-11-LoadConstants: 11.04% (0.0960 => 0.1066, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 9.96% (3.0698 => 3.3757, std. dev.: 0.1012) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (3.2074 => 3.4996, std. dev.: 0.0352) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.56% (4.4832 => 4.5530, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -2.32% (2.4913 => 2.4335, std. dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.20% (1.4032 => 1.3723, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 14.92% (1.7426 => 2.0026, std. dev.: 0.0420) SingleSource/Benchmarks/McGill/queens: 12.84% (1.6261 => 1.8349, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.40% (1.0063 => 1.0808, std. dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (0.3301 => 0.3496, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.65% (2.8964 => 3.0601, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.81% (5.2665 => 5.5200, std. dev.: 0.0350) MultiSource/Benchmarks/FreeBench/mason/mason: 4.38% (0.5004 => 0.5223, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/dt: 4.22% (0.9851 => 1.0267, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.02% (0.3508 => 0.3649, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.99% (6.6312 => 6.8957, std. dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 3.93% (0.6459 => 0.6713, std. dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.80% (27.1724 => 28.2053, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/whetstone: 3.76% (2.3453 => 2.4335, std. dev.: 0.0181) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.60% (2.6656 => 2.7615, std. dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.78% (0.5179 => 0.5323, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.60% (40.4792 => 41.5310, std. dev.: 0.2985) MultiSource/Applications/hexxagon/hexxagon: 2.57% (14.4877 => 14.8607, std. dev.: 0.0402) MultiSource/Benchmarks/mafft/pairlocalalign: 2.20% (62.4126 => 63.7838, std. dev.: 0.1780) SingleSource/Benchmarks/Stanford/FloatMM: 2.17% (0.8175 => 0.8352, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.85% (25.6658 => 26.1397, std. dev.: 0.0534) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.77% (2.4455 => 2.4889, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (2.5984 => 2.6431, std. dev.: 0.0145) MultiSource/Benchmarks/sim/sim: 1.61% (3.8907 => 3.9533, std. dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: 1.59% (2.4013 => 2.4396, std. dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.45% (3.4080 => 3.4574, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 1.43% (1.0194 => 1.0340, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.41% (4.0101 => 4.0666, std. dev.: 0.0178) MultiSource/Benchmarks/BitBench/five11/five11: 1.25% (5.1938 => 5.2588, std. dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.01% (0.2996 => 0.2876, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.29% (0.5740 => 0.5551, std. dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.75% (0.7784 => 0.7570, std. dev.: 0.0082) MultiSource/Applications/spiff/spiff: -2.43% (0.7738 => 0.7550, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.36% (0.5520 => 0.5390, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.17% (0.9029 => 0.8833, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.17% (1.0689 => 1.0457, std. dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.15% (0.4880 => 0.4775, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.09% (1.2742 => 1.2476, std. dev.: 0.0081) MultiSource/Applications/hbd/hbd: -1.92% (1.3268 => 1.3013, std. dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: -1.28% (3.8796 => 3.8300, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.16% (1.4189 => 1.4024, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.13% (8.2559 => 8.1629, std. dev.: 0.0295) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -22.63% (15.8312 => 12.2488, std. dev.: 0.2703) SingleSource/Benchmarks/Shootout-C++/ary3: -20.66% (1.7473 => 1.3863, std. dev.: 0.0787) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.67% (1.4034 => 1.1554, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -14.01% (3.4629 => 2.9777, std. dev.: 0.0233) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1602, std. dev.: 0.0349) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.12% (0.0917 => 0.0815, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.56% (1.4441 => 1.3205, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.39% (3.2007 => 2.9322, std. dev.: 0.0397) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3746 => 0.3487, std. dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.79% (1.1647 => 1.0856, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.52% (3.9413 => 3.6845, std. dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7925, std. dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -4.90% (7.6833 => 7.3071, std. dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: -4.79% (3.4230 => 3.2591, std. dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -4.46% (0.3836 => 0.3665, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: -4.43% (0.2664 => 0.2546, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: -4.37% (1.4117 => 1.3500, std. dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -3.42% (0.4564 => 0.4408, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.37% (3.7496 => 3.6234, std. dev.: 0.0336) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.29% (0.4140 => 0.4004, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: -2.85% (3.6023 => 3.4996, std. dev.: 0.0352) SingleSource/Benchmarks/Misc/flops: -2.66% (9.5474 => 9.2934, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.49% (1.8739 => 1.8273, std. dev.: 0.0179) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.25% (1.1683 => 1.1420, std. dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.13% (1.4021 => 1.3723, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.11% (9.3855 => 9.1874, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/pi: -2.02% (1.6538 => 1.6204, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.95% (2.3569 => 2.3110, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.89% (1.0686 => 1.0484, std. dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.79% (1.2722 => 1.2494, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -1.71% (1.0926 => 1.0739, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (1.1116 => 1.0926, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.29% (4.6127 => 4.5530, std. dev.: 0.0078) MultiSource/Applications/aha/aha: -1.18% (3.4286 => 3.3883, std. dev.: 0.0145) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.02% (2.0027 => 1.9823, std. dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 13:58:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 15:58:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828205819.97C7F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/3292?compare_to=3289&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3292, Order: 162779, Start Time: 2012-08-28 19:44:45, End Time: 2012-08-28 20:59:15 To: 3289, Order: 162767, Start Time: 2012-08-28 17:57:56, End Time: 2012-08-28 19:12:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (158 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 967 (710 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.02% (54.9128 => 56.5738, std. dev.: 0.0220) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.12% (2.0176 => 2.3226, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 12.35% (0.0826 => 0.0928, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.45% (0.5818 => 0.6484, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.24% (0.7061 => 0.7855, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.17% (0.3578 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.91% (0.3601 => 0.3958, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3663 => 0.4026, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 9.85% (0.3646 => 0.4005, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.84% (0.3650 => 0.4009, std. dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 9.77% (0.3623 => 0.3977, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 9.74% (0.3789 => 0.4158, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 9.56% (0.3914 => 0.4288, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 9.34% (0.4003 => 0.4377, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.29% (0.3940 => 0.4306, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.57% (0.7710 => 0.8371, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0032) MultiSource/Applications/hbd/hbd: 8.09% (1.3693 => 1.4801, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.05% (3.9660 => 4.2852, std. dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.97% (0.1819 => 0.1964, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (0.4328 => 0.4670, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.71% (0.5265 => 0.5671, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.67% (0.2596 => 0.2795, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2782 => 0.2992, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.43% (0.4062 => 0.4364, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.41% (0.2726 => 0.2928, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.36% (0.7038 => 0.7556, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2655 => 0.2850, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.33% (0.9199 => 0.9873, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.31% (1.2193 => 1.3084, std. dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.25% (0.2690 => 0.2885, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.13% (0.2607 => 0.2793, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2760 => 0.2955, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.06% (0.3485 => 0.3731, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.03% (0.3899 => 0.4173, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2765 => 0.2958, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.95% (0.3107 => 0.3323, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.92% (0.4379 => 0.4682, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.91% (1.9828 => 2.1199, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.86% (0.2696 => 0.2881, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.84% (0.2937 => 0.3138, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3149 => 0.3364, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3580 => 0.3824, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.81% (0.6959 => 0.7433, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3489 => 0.3726, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.1789 => 0.1908, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.63% (0.2127 => 0.2268, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.55% (0.1588 => 0.1692, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.53% (0.2988 => 0.3183, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.43% (1.1364 => 1.2095, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.40% (0.5577 => 0.5934, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.40% (0.4390 => 0.4671, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.37% (13.8202 => 14.7010, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.26% (0.3453 => 0.3669, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: 6.17% (0.3534 => 0.3752, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.13% (0.3293 => 0.3495, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.13% (0.4016 => 0.4262, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.12% (0.2925 => 0.3104, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.07% (0.2914 => 0.3091, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3246 => 0.3443, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.05% (0.5637 => 0.5978, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.03% (0.2023 => 0.2145, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.01% (0.1865 => 0.1977, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.99% (0.3756 => 0.3981, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 5.97% (0.2243 => 0.2377, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (1.4563 => 1.5433, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (7.2180 => 7.6463, std. dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/moments: 5.92% (0.3868 => 0.4097, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.85% (0.7506 => 0.7945, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.67% (0.2945 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 5.58% (3.8646 => 4.0802, std. dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.8310 => 0.8770, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.51% (1.3245 => 1.3975, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.50% (1.1061 => 1.1669, std. dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 5.44% (0.2995 => 0.3158, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.4113 => 0.4336, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.42% (1.3819 => 1.4568, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.41% (1.3813 => 1.4560, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.34% (0.7460 => 0.7858, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 5.31% (1.2292 => 1.2945, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.23% (3.6692 => 3.8610, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.21% (4.3801 => 4.6085, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.2140 => 0.2251, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.18% (1.0594 => 1.1143, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.16% (0.6283 => 0.6607, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.16% (0.4791 => 0.5038, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (13.2842 => 13.9630, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 5.09% (0.3220 => 0.3384, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 5.04% (1.9270 => 2.0241, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.03% (0.3755 => 0.3944, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.01% (4.4433 => 4.6660, std. dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.91% (0.6135 => 0.6436, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 4.86% (2.1791 => 2.2850, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.84% (0.8818 => 0.9245, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.67% (16.6129 => 17.3890, std. dev.: 0.0166) MultiSource/Applications/JM/lencod/lencod: 4.66% (14.8535 => 15.5454, std. dev.: 0.0118) MultiSource/Benchmarks/sim/sim: 4.22% (0.3131 => 0.3263, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.20% (1.1333 => 1.1809, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.16% (0.3245 => 0.3380, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.04% (0.8698 => 0.9049, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.95% (0.2859 => 0.2972, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.93% (3.1889 => 3.3141, std. dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (8.4961 => 8.8290, std. dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 3.88% (6.5754 => 6.8303, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.9865 => 5.1747, std. dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.47% (3.2742 => 3.3878, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.38% (4.6629 => 4.8207, std. dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 3.25% (14.5298 => 15.0017, std. dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.13% (1.5188 => 1.5664, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.13% (16.2614 => 16.7697, std. dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/bigfib: 2.88% (0.6250 => 0.6430, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.87% (0.9108 => 0.9369, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (2.1007 => 2.1542, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.31% (0.4805 => 0.4916, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 2.20% (1.0313 => 1.0540, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.19% (0.6744 => 0.6892, std. dev.: 0.0034) MultiSource/Applications/lua/lua: 2.17% (3.7467 => 3.8280, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.13% (6.2785 => 6.4120, std. dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 2.12% (33.2944 => 33.9989, std. dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (1.2749 => 1.2911, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std. dev.: 0.0528) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 7.91% (1.2998 => 1.4026, std. dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.88% (1.5824 => 1.6596, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7428, std. dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (1.7081 => 1.7766, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9634, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9873, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.79% (1.7688 => 1.8181, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.42% (10.7476 => 11.0082, std. dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3837, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5973, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3400, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 2.04% (1.4298 => 1.4590, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5315, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5733, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.34% (22.5627 => 21.3582, std. dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.83% (0.2670 => 0.2541, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.04% (1.3780 => 1.3223, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0216, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -3.17% (1.1560 => 1.1193, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5969, std. dev.: 0.0127) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2338, std. dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.3167 => 5.2218, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9733, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2069, std. dev.: 0.0240) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std. dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7913, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2188, std. dev.: 0.0165) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4235, std. dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.16% (5.5401 => 5.4758, std. dev.: 0.0131) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4361, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 14:03:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 16:03:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120828210358.0385A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/3293?compare_to=3286&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3293, Order: 162769, Start Time: 2012-08-28 18:21:14, End Time: 2012-08-28 21:04:57 To: 3286, Order: 162755, Start Time: 2012-08-28 14:50:08, End Time: 2012-08-28 17:53:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 967 (771 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.91% (2.1316 => 2.0908, std. dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 31.22% (0.3792 => 0.4976, std. dev.: 0.0393) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.79% (0.3488 => 0.4004, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 14.75% (0.3465 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.74% (0.3446 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.73% (0.3442 => 0.3949, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.68% (0.3460 => 0.3968, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.56% (0.3496 => 0.4005, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.53% (0.3469 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.11% (0.3650 => 0.4165, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.11% (0.3643 => 0.4157, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.72% (0.3724 => 0.4235, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5826 => 0.6362, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.83% (0.5889 => 0.6409, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.15% (0.1620 => 0.1752, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.24% (0.7171 => 0.7690, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.24% (3.5627 => 3.8205, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (1.6211 => 1.7368, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.2014 => 0.2148, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.62% (1.3152 => 1.4023, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.44% (0.4361 => 0.4642, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.31% (0.5026 => 0.5343, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 6.30% (1.5932 => 1.6935, std. dev.: 0.0074) MultiSource/Applications/spiff/spiff: 6.08% (0.4029 => 0.4274, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.06% (0.3930 => 0.4168, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 6.03% (4.2109 => 4.4650, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.01% (0.4994 => 0.5294, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.5900 => 0.6254, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.93% (1.0781 => 1.1420, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.91% (0.2875 => 0.3045, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.77% (2.7292 => 2.8866, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.76% (0.5000 => 0.5288, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 5.72% (0.2725 => 0.2881, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2738 => 0.2893, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.51% (0.2866 => 0.3024, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.46% (0.2729 => 0.2878, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2803 => 0.2956, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.1968 => 0.2075, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 5.35% (0.2750 => 0.2897, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.30% (0.2736 => 0.2881, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.30% (0.3096 => 0.3260, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.29% (0.3195 => 0.3364, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.20% (5.5417 => 5.8298, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.09% (0.2792 => 0.2934, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.08% (0.9909 => 1.0412, std. dev.: 0.0125) MultiSource/Benchmarks/nbench/nbench: 5.07% (0.2566 => 0.2696, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 5.06% (0.3004 => 0.3156, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (0.2813 => 0.2955, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.03% (1.9966 => 2.0970, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: 5.02% (0.2811 => 0.2952, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.01% (1.9694 => 2.0681, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2823 => 0.2964, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.99% (2.1013 => 2.2061, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 4.96% (0.2780 => 0.2918, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.96% (0.3890 => 0.4083, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 4.96% (0.3267 => 0.3429, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.95% (2.0673 => 2.1696, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 4.94% (0.3258 => 0.3419, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.94% (0.3625 => 0.3804, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.94% (0.4658 => 0.4888, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.91% (0.2911 => 0.3054, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.80% (2.1653 => 2.2692, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.77% (0.3124 => 0.3273, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.68% (0.3845 => 0.4025, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.67% (0.3060 => 0.3203, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.65% (4.6177 => 4.8325, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.63% (0.3282 => 0.3434, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.61% (0.3317 => 0.3470, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.61% (0.3362 => 0.3517, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (4.4195 => 4.6220, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.52% (0.3477 => 0.3634, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3690 => 0.3856, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.49% (0.3678 => 0.3843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 4.48% (0.3726 => 0.3893, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.48% (0.3348 => 0.3498, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.3903 => 0.4075, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.34% (0.4146 => 0.4326, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 4.34% (0.6634 => 0.6922, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 4.34% (1.4269 => 1.4888, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.33% (0.9697 => 1.0117, std. dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (1.8794 => 1.9608, std. dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.33% (0.7875 => 0.8216, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 4.09% (0.4251 => 0.4425, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 4.04% (23.5202 => 24.4698, std. dev.: 0.0268) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.03% (0.4139 => 0.4306, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.00% (0.5546 => 0.5768, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.92% (0.3981 => 0.4137, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.80% (0.2737 => 0.2841, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.3084 => 0.3196, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.61% (0.5012 => 0.5193, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.48% (0.3336 => 0.3452, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.2969 => 0.3071, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.37% (0.6435 => 0.6652, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.72% (2.0346 => 2.0900, std. dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 2.31% (0.4847 => 0.4959, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (0.7426 => 0.7557, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (4.6926 => 4.7551, std. dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (11.6398 => 11.7619, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6727, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1707, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6467, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2080, std. dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5025, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std. dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.57% (41.7953 => 42.4505, std. dev.: 0.0081) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.30% (7.1849 => 7.2783, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5120, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5936, std. dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.68% (2.4764 => 2.4101, std. dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5771, std. dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7900, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8008, std. dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std. dev.: 0.0008) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.43% (17.2379 => 16.8191, std. dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5798, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.58% (16.2163 => 15.9599, std. dev.: 0.0121) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std. dev.: 0.0084) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 14:33:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 16:33:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828213350.5CC0C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/3294?compare_to=3290&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3294, Order: 162781, Start Time: 2012-08-28 20:15:38, End Time: 2012-08-28 21:34:49 To: 3290, Order: 162769, Start Time: 2012-08-28 18:28:13, End Time: 2012-08-28 19:47:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (119 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 946 (732 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.63% (13.1838 => 13.3993, std. dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (0.8554 => 0.8659, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 29.25% (10.3673 => 13.3993, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3473 => 0.3927, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.90% (0.3543 => 0.4000, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.90% (0.3497 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.86% (0.3561 => 0.4019, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-3: 12.83% (0.3516 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3543 => 0.3997, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.32% (0.3694 => 0.4149, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.10% (0.3828 => 0.4291, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.03% (1.1194 => 1.2541, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.73% (0.3886 => 0.4342, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.45% (1.7609 => 1.9626, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 10.56% (0.3817 => 0.4220, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.05% (2.2022 => 2.4235, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 9.64% (0.1432 => 0.1570, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.77% (0.1892 => 0.2039, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 7.33% (0.6030 => 0.6472, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.27% (0.5925 => 0.6356, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.26% (0.1584 => 0.1699, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.88% (7.0540 => 7.5391, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 6.83% (10.4361 => 11.1486, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3177 => 0.3389, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 6.40% (0.3282 => 0.3492, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.29% (0.4879 => 0.5186, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 6.23% (0.1622 => 0.1723, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.20% (0.7326 => 0.7780, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.96% (0.8172 => 0.8659, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.83% (0.4615 => 0.4884, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3307 => 0.3493, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.51% (4.9449 => 5.2175, std. dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 5.40% (9.4845 => 9.9965, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.33% (0.2271 => 0.2392, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.7433 => 0.7822, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.12% (5.0018 => 5.2581, std. dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.08% (0.2107 => 0.2214, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.01% (0.2554 => 0.2682, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.79% (0.3109 => 0.3258, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.67% (4.2646 => 4.4637, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.59% (1.3050 => 1.3649, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (8.1363 => 8.5069, std. dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3121 => 0.3263, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.54% (0.5860 => 0.6126, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 4.51% (0.4299 => 0.4493, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.45% (0.5569 => 0.5817, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 4.37% (5.7591 => 6.0107, std. dev.: 0.0110) MultiSource/Benchmarks/McCat/18-imp/imp: 4.24% (0.3423 => 0.3568, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.12% (0.9765 => 1.0167, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.08% (0.7835 => 0.8155, std. dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.04% (0.2700 => 0.2809, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.00% (1.5415 => 1.6031, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.99% (0.4636 => 0.4821, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.95% (0.2758 => 0.2867, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.93% (0.3180 => 0.3305, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.90% (0.3387 => 0.3519, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.5105 => 0.5303, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.88% (1.1861 => 1.2321, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.87% (0.3441 => 0.3574, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.75% (0.6675 => 0.6925, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6450 => 0.6684, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 3.60% (1.1642 => 1.2061, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.58% (3.3354 => 3.4549, std. dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.56% (0.2891 => 0.2994, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.53% (0.4103 => 0.4248, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.50% (1.5603 => 1.6149, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.47% (0.8067 => 0.8347, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.47% (0.3865 => 0.3999, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.43% (14.3668 => 14.8597, std. dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.42% (0.3650 => 0.3775, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.36% (2.0273 => 2.0955, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: 3.36% (0.4289 => 0.4433, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 3.33% (3.8723 => 4.0011, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/matrix: 3.32% (0.3098 => 0.3201, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.30% (0.6456 => 0.6669, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5981 => 0.6177, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 3.27% (0.3422 => 0.3534, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.22% (2.0665 => 2.1331, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary: 3.19% (0.3232 => 0.3335, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.15% (0.4064 => 0.4192, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.14% (1.4186 => 1.4631, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.14% (0.3826 => 0.3946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3283 => 0.3385, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.05% (0.3935 => 0.4055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.01% (0.3684 => 0.3795, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (0.4620 => 0.4759, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.99% (0.8921 => 0.9188, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.95% (0.3427 => 0.3528, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.93% (0.4203 => 0.4326, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.87% (1.2842 => 1.3211, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/moments: 2.87% (0.4048 => 0.4164, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.85% (17.1811 => 17.6709, std. dev.: 0.0157) MultiSource/Applications/siod/siod: 2.83% (2.2969 => 2.3619, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.5020 => 0.5152, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.58% (1.5859 => 1.6268, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 2.42% (1.1840 => 1.2127, std. dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (2.2024 => 2.2543, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 2.33% (0.7115 => 0.7281, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (7.9617 => 8.1268, std. dev.: 0.0080) MultiSource/Applications/lemon/lemon: 1.90% (1.0722 => 1.0926, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.64% (21.9371 => 22.2966, std. dev.: 0.0288) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (4.2280 => 4.4531, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7602, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.77% (3.2827 => 3.3408, std. dev.: 0.0058) MultiSource/Applications/lua/lua: 1.73% (26.0924 => 26.5450, std. dev.: 0.0165) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (1.5086 => 1.5301, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2320, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 1.13% (3.1578 => 3.1934, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.26% (5.2763 => 3.2046, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.62% (5.3855 => 3.7366, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.16% (5.3526 => 3.7381, std. dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0963, std. dev.: 0.0249) MultiSource/Applications/ClamAV/clamscan: -13.77% (22.1758 => 19.1232, std. dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5540, std. dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std. dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -10.47% (1.2373 => 1.1077, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -9.53% (1.5373 => 1.3908, std. dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.1396 => 1.0700, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.06% (2.7294 => 2.5639, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std. dev.: 0.0005) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4711, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -2.89% (10.2830 => 9.9863, std. dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.81% (1.3677 => 1.3293, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.77% (8.6802 => 8.4397, std. dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9626, std. dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.51% (12.5348 => 12.3458, std. dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8130, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6635, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 14:41:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 16:41:53 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828214153.E0CF02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/3295?compare_to=3291&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3295, Order: 162782, Start Time: 2012-08-28 20:31:47, End Time: 2012-08-28 21:42:52 To: 3291, Order: 162774, Start Time: 2012-08-28 19:03:06, End Time: 2012-08-28 20:14:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 30 (21 on baseline) Performance Improvements: 17 (26 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 842 (842 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.70% (0.2640 => 0.2764, std. dev.: 0.0040) MultiSource/Applications/hbd/hbd: 2.16% (1.3013 => 1.3294, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.68% (1.0457 => 1.0633, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.39% (8.1629 => 8.2766, std. dev.: 0.0220) MultiSource/Applications/lua/lua: 1.35% (3.5454 => 3.5932, std. dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 75.01% (1.6204 => 2.8358, std. dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary3: 24.89% (1.3863 => 1.7314, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 21.34% (0.3487 => 0.4231, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 21.18% (2.4547 => 2.9745, std. dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.68% (12.2488 => 14.7823, std. dev.: 0.5614) SingleSource/Benchmarks/Shootout-C++/matrix: 16.33% (2.9777 => 3.4641, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/methcall: 13.08% (8.5384 => 9.6549, std. dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.69% (2.9322 => 3.2164, std. dev.: 0.0044) SingleSource/Benchmarks/Stanford/FloatMM: 6.30% (0.8352 => 0.8878, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 5.49% (15.1490 => 15.9806, std. dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.19% (0.7539 => 0.7930, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 4.60% (3.5558 => 3.7192, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 4.28% (0.3665 => 0.3822, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.18% (0.2798 => 0.2915, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.85% (4.3477 => 4.5151, std. dev.: 0.0367) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.66% (45.0059 => 46.6512, std. dev.: 0.4100) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.47% (4.5530 => 4.7111, std. dev.: 0.0368) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.38% (28.2053 => 29.1574, std. dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.04% (3.6234 => 3.7334, std. dev.: 0.0318) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.98% (2.4115 => 2.4834, std. dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 2.27% (63.7838 => 65.2326, std. dev.: 0.1871) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.15% (1.0484 => 1.0709, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.68% (2.3110 => 2.3498, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.64% (1.8273 => 1.8573, std. dev.: 0.0071) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.60% (1.9823 => 2.0140, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.80% (0.3415 => 0.2090, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -11.33% (4.6390 => 4.1136, std. dev.: 0.0242) MultiSource/Benchmarks/VersaBench/bmm/bmm: -6.74% (3.0601 => 2.8540, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout/heapsort: -6.21% (3.3757 => 3.1662, std. dev.: 0.0810) MultiSource/Applications/lambda-0_1_3/lambda: -5.11% (7.3071 => 6.9339, std. dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.56% (62.4725 => 59.6259, std. dev.: 1.0537) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.23% (26.1397 => 25.0338, std. dev.: 0.1017) SingleSource/Benchmarks/CoyoteBench/lpbench: -4.18% (5.5200 => 5.2891, std. dev.: 0.0340) SingleSource/Benchmarks/McGill/misr: -4.07% (0.4199 => 0.4028, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -3.08% (1.3205 => 1.2798, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/treeadd/treeadd: -2.93% (0.3649 => 0.3542, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/mason/mason: -2.41% (0.5223 => 0.5097, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -2.27% (0.5323 => 0.5202, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.98% (6.8957 => 6.7589, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -1.95% (0.5903 => 0.5788, std. dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.68% (2.4889 => 2.4470, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.52% (3.4574 => 3.4047, std. dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 71.47% (1.6538 => 2.8358, std. dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/recursive: 21.62% (2.4457 => 2.9745, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9975, std. dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 13.96% (1.6261 => 1.8531, std. dev.: 0.0135) MultiSource/Applications/sgefa/sgefa: 12.95% (0.3746 => 0.4231, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/methcall: 12.84% (8.5566 => 9.6549, std. dev.: 0.0100) SingleSource/Benchmarks/Stanford/FloatMM: 8.60% (0.8175 => 0.8878, std. dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.31% (27.1724 => 29.1574, std. dev.: 0.0242) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.17% (4.2129 => 4.5151, std. dev.: 0.0367) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.09% (0.3301 => 0.3502, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 5.21% (2.3453 => 2.4676, std. dev.: 0.0137) SingleSource/Benchmarks/Misc/fp-convert: 4.97% (15.2242 => 15.9806, std. dev.: 0.0105) MultiSource/Applications/siod/siod: 4.71% (3.5520 => 3.7192, std. dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 4.52% (62.4126 => 65.2326, std. dev.: 0.1871) SingleSource/Benchmarks/Misc/dt: 4.47% (0.9851 => 1.0291, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.22% (0.7609 => 0.7930, std. dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.29% (2.4042 => 2.4834, std. dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.60% (45.4683 => 46.6512, std. dev.: 0.4100) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.13% (4.6127 => 4.7111, std. dev.: 0.0368) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.93% (6.6312 => 6.7589, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.57% (1.6110 => 1.6363, std. dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.34% (0.7738 => 0.7557, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.23% (0.3497 => 0.2090, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.31% (1.4034 => 1.1465, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std. dev.: 0.0539) SingleSource/Benchmarks/Misc/richards_benchmark: -11.38% (1.4441 => 1.2798, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/fibo: -11.26% (4.6355 => 4.1136, std. dev.: 0.0242) MultiSource/Applications/lambda-0_1_3/lambda: -9.75% (7.6833 => 6.9339, std. dev.: 0.0270) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.89% (1.1647 => 1.0844, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.75% (3.9413 => 3.6754, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -6.24% (0.4296 => 0.4028, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -4.93% (3.4230 => 3.2543, std. dev.: 0.0583) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.42% (0.4140 => 0.3957, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: -3.98% (0.2664 => 0.2558, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -2.76% (9.5474 => 9.2841, std. dev.: 0.0322) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.46% (25.6658 => 25.0338, std. dev.: 0.1017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.29% (1.1683 => 1.1415, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -2.10% (2.8599 => 2.7999, std. dev.: 0.0131) MultiSource/Benchmarks/FreeBench/neural/neural: -1.82% (1.0926 => 1.0727, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -1.66% (3.8200 => 3.7564, std. dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (9.3855 => 9.2400, std. dev.: 0.0131) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (13.4743 => 13.2719, std. dev.: 0.0149) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.8964 => 2.8540, std. dev.: 0.0156) MultiSource/Applications/JM/lencod/lencod: -1.41% (6.7458 => 6.6509, std. dev.: 0.0056) MultiSource/Benchmarks/llubenchmark/llu: -1.20% (2.0192 => 1.9949, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 15:40:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 17:40:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120828224037.89BE22A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3296?compare_to=3292&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3296, Order: 162792, Start Time: 2012-08-28 21:27:11, End Time: 2012-08-28 22:41:36 To: 3292, Order: 162779, Start Time: 2012-08-28 19:44:45, End Time: 2012-08-28 20:59:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (160 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 967 (709 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.03% (2.7110 => 2.7389, std. dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.73% (2.0176 => 2.3349, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.59% (0.0826 => 0.0930, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.21% (0.3578 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.14% (0.3601 => 0.4002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.10% (0.3650 => 0.4055, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.98% (0.7061 => 0.7836, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 10.97% (0.3646 => 0.4046, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3663 => 0.4063, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.82% (0.3623 => 0.4015, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.79% (0.5818 => 0.6446, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3789 => 0.4194, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.66% (0.5748 => 0.6361, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.4003 => 0.4429, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3914 => 0.4328, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.36% (0.3940 => 0.4348, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.23% (0.3130 => 0.3419, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.16% (0.1986 => 0.2168, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.85% (0.1413 => 0.1538, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.50% (3.9660 => 4.3032, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.41% (0.1819 => 0.1972, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.38% (0.7710 => 0.8356, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.09% (1.3693 => 1.4801, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 7.99% (0.4328 => 0.4674, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.98% (0.2781 => 0.3003, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.98% (0.2782 => 0.3004, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.94% (0.5265 => 0.5683, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.82% (0.2596 => 0.2799, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 7.68% (0.4062 => 0.4374, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 7.64% (0.7038 => 0.7576, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.39% (0.2721 => 0.2922, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2607 => 0.2798, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.29% (0.2690 => 0.2886, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.27% (1.2193 => 1.3080, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.23% (0.2655 => 0.2847, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.21% (0.3899 => 0.4180, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.20% (0.9199 => 0.9861, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2628 => 0.2817, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3022 => 0.3239, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4379 => 0.4693, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2966 => 0.3178, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (0.2761 => 0.2957, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.2937 => 0.3145, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.08% (0.2726 => 0.2919, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3580 => 0.3831, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3489 => 0.3733, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.95% (0.4390 => 0.4695, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.89% (1.9828 => 2.1194, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.87% (0.6959 => 0.7437, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.86% (0.3485 => 0.3724, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.86% (0.3107 => 0.3320, std. dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.77% (0.2127 => 0.2271, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3149 => 0.3362, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.69% (0.2988 => 0.3188, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.68% (0.1588 => 0.1694, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.61% (0.3192 => 0.3403, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.60% (0.5577 => 0.5945, std. dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 6.53% (13.8202 => 14.7232, std. dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.53% (1.1364 => 1.2106, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.46% (0.3453 => 0.3676, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.35% (0.3246 => 0.3452, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.33% (0.2023 => 0.2151, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.27% (0.1865 => 0.1982, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.25% (0.2914 => 0.3096, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.23% (0.3293 => 0.3498, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.21% (7.2180 => 7.6660, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 6.20% (0.2243 => 0.2382, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.19% (1.4563 => 1.5465, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.2925 => 0.3106, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.17% (0.3534 => 0.3752, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.14% (0.5637 => 0.5983, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3756 => 0.3985, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.05% (0.4016 => 0.4259, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.90% (1.3819 => 1.4634, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.88% (3.6692 => 3.8850, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 5.87% (0.3868 => 0.4095, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.81% (0.7506 => 0.7942, std. dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.79% (1.3813 => 1.4613, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.72% (1.3245 => 1.4002, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.70% (0.2945 => 0.3113, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.70% (3.8646 => 4.0849, std. dev.: 0.0023) MultiSource/Applications/Burg/burg: 5.67% (1.1061 => 1.1688, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.63% (0.8310 => 0.8778, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.63% (0.7460 => 0.7880, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.57% (1.9270 => 2.0343, std. dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 5.48% (0.2995 => 0.3159, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (4.3801 => 4.6168, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.39% (4.4433 => 4.6828, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.37% (0.2140 => 0.2255, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4113 => 0.4334, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.35% (1.2292 => 1.2950, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.6283 => 0.6617, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 5.28% (2.1791 => 2.2941, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.26% (13.2842 => 13.9824, std. dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 5.25% (1.0594 => 1.1150, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.13% (0.4791 => 0.5037, std. dev.: 0.0087) MultiSource/Benchmarks/McCat/18-imp/imp: 5.12% (0.3220 => 0.3385, std. dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 4.98% (16.6129 => 17.4395, std. dev.: 0.0195) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.96% (0.6135 => 0.6439, std. dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 4.80% (14.8535 => 15.5664, std. dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.62% (0.8818 => 0.9225, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.59% (0.2243 => 0.2346, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.39% (0.2321 => 0.2423, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.37% (1.1333 => 1.1828, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 4.34% (0.3131 => 0.3267, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.31% (0.3245 => 0.3385, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.30% (0.8698 => 0.9072, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 4.29% (3.1889 => 3.3258, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.2859 => 0.2979, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.13% (4.9865 => 5.1922, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 4.07% (6.5754 => 6.8432, std. dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (8.4961 => 8.8421, std. dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 3.69% (4.6629 => 4.8349, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.65% (3.2742 => 3.3938, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 3.43% (14.5298 => 15.0282, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 3.32% (16.2614 => 16.8009, std. dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.15% (0.9108 => 0.9395, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.11% (1.5188 => 1.5661, std. dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.90% (0.6250 => 0.6431, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1563, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: 2.54% (0.6744 => 0.6915, std. dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.53% (6.2785 => 6.4373, std. dev.: 0.0025) MultiSource/Applications/lua/lua: 2.48% (3.7467 => 3.8395, std. dev.: 0.0102) MultiSource/Applications/lemon/lemon: 2.32% (1.0313 => 1.0552, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.4805 => 0.4912, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.98% (33.2944 => 33.9537, std. dev.: 0.0120) MultiSource/Applications/SIBsim4/SIBsim4: 1.46% (1.2749 => 1.2935, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.35% (5.7573 => 7.5046, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std. dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.05% (1.2998 => 1.4174, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.86% (1.5824 => 1.6593, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.62% (1.9144 => 2.0029, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.30% (11.2619 => 11.7465, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9630, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.62% (1.7688 => 1.8151, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.51% (10.7476 => 11.0173, std. dev.: 0.0412) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3846, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5956, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.06% (3.2729 => 3.3403, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 2.02% (1.4298 => 1.4587, std. dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std. dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.44% (1.5089 => 1.5306, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.27% (1.0895 => 1.1033, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1845, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.11% (4.5928 => 4.6437, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.08% (5.5130 => 5.5725, std. dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.16% (22.5627 => 21.3993, std. dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.94% (0.2670 => 0.2538, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0972, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.88% (1.3780 => 1.3108, std. dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.40% (0.3139 => 0.3001, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.22% (5.0168 => 4.8053, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.98% (3.1476 => 3.0222, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -3.21% (1.1560 => 1.1189, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6013, std. dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -2.47% (1.9762 => 1.9274, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.07% (6.3560 => 6.2245, std. dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: -1.81% (5.3167 => 5.2207, std. dev.: 0.0037) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9718, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3305 => 7.2249, std. dev.: 0.0196) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7916, std. dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (84.4286 => 83.4185, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2253, std. dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.03% (20.3410 => 20.1308, std. dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 16:08:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 18:08:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120828230831.EAE962A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3297?compare_to=3295&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3297, Order: 162796, Start Time: 2012-08-28 21:58:09, End Time: 2012-08-28 23:09:32 To: 3295, Order: 162782, Start Time: 2012-08-28 20:31:47, End Time: 2012-08-28 21:42:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 10 (26 on baseline) Performance Improvements: 1 (25 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 878 (838 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.33% (0.7576 => 0.7980, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.57% (0.3112 => 0.3223, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.99% (1.3890 => 1.4306, std. dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (0.7629 => 0.7752, std. dev.: 0.0036) MultiSource/Applications/siod/siod: 1.37% (2.1024 => 2.1311, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.23% (0.8535 => 0.8640, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.57% (2.4661 => 2.5787, std. dev.: 0.0379) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.26% (0.2490 => 0.2596, std. dev.: 0.0036) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.91% (2.9167 => 2.9725, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/hash: 1.55% (4.3100 => 4.3769, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.11% (7.1024 => 7.0237, std. dev.: 0.0266) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.34% (0.7722 => 0.7980, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 1.62% (2.0972 => 2.1311, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (1.4113 => 1.4306, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 72.92% (1.6538 => 2.8597, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 24.31% (2.4457 => 3.0403, std. dev.: 0.0485) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.65% (0.0499 => 0.0612, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.84% (1.7426 => 2.0012, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 13.94% (1.6261 => 1.8528, std. dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 12.95% (0.3746 => 0.4231, std. dev.: 0.0162) SingleSource/Benchmarks/Shootout/methcall: 11.14% (8.5566 => 9.5095, std. dev.: 0.0829) SingleSource/Benchmarks/Stanford/FloatMM: 8.67% (0.8175 => 0.8884, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.35% (27.1724 => 29.1709, std. dev.: 0.0468) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.06% (0.3301 => 0.3501, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 5.10% (2.3453 => 2.4650, std. dev.: 0.0174) SingleSource/Benchmarks/Misc/fp-convert: 4.97% (15.2242 => 15.9808, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 4.79% (3.5520 => 3.7222, std. dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 4.63% (62.4126 => 65.3011, std. dev.: 0.0899) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.39% (4.2129 => 4.3980, std. dev.: 0.0555) SingleSource/Benchmarks/Misc/dt: 4.11% (0.9851 => 1.0256, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: 3.18% (0.5004 => 0.5163, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.97% (4.6127 => 4.7498, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/hash: 2.58% (0.6308 => 0.6471, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.97% (2.9152 => 2.9725, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.91% (6.6312 => 6.7580, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/hash: 1.75% (4.3016 => 4.3769, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 1.26% (1.4184 => 1.4363, std. dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.62% (14.6079 => 14.3712, std. dev.: 0.0389) MultiSource/Applications/spiff/spiff: -1.62% (0.7738 => 0.7613, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.12% (0.3497 => 0.2059, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.29% (1.4034 => 1.1467, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -11.56% (1.4441 => 1.2772, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: -11.28% (4.6355 => 4.1125, std. dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: -9.86% (7.6833 => 6.9257, std. dev.: 0.0306) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.55% (15.8312 => 14.6356, std. dev.: 0.1548) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.74% (3.9413 => 3.6757, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -6.45% (0.4296 => 0.4019, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.34% (1.1647 => 1.0908, std. dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.10% (2.9728 => 2.7915, std. dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -5.95% (3.4230 => 3.2194, std. dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.06% (0.4564 => 0.4333, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.33% (0.4140 => 0.4002, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std. dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.55% (1.4021 => 1.3663, std. dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.45% (25.6658 => 25.0363, std. dev.: 0.0243) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.23% (1.1683 => 1.1423, std. dev.: 0.0060) MultiSource/Applications/spiff/spiff: -2.22% (2.8599 => 2.7963, std. dev.: 0.0196) MultiSource/Benchmarks/FreeBench/neural/neural: -1.80% (1.0926 => 1.0729, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -1.55% (3.8200 => 3.7607, std. dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (13.4743 => 13.2752, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.36% (9.3855 => 9.2583, std. dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 16:20:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 18:20:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120828232034.D73B92A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/3298?compare_to=3294&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3298, Order: 162796, Start Time: 2012-08-28 22:02:32, End Time: 2012-08-28 23:21:34 To: 3294, Order: 162781, Start Time: 2012-08-28 20:15:38, End Time: 2012-08-28 21:34:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (118 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (733 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.48% (13.3993 => 13.5980, std. dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.78% (1.3908 => 1.4434, std. dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.55% (1.3090 => 1.3293, std. dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.32% (1.9626 => 1.9366, std. dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.16% (10.3673 => 13.5980, std. dev.: 0.0184) SingleSource/UnitTests/ObjC/trivial-interface: 13.73% (0.3473 => 0.3950, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3497 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.32% (0.3543 => 0.4015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.29% (0.3543 => 0.4014, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.28% (0.3561 => 0.4034, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.17% (0.3516 => 0.3979, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.72% (0.3694 => 0.4164, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3828 => 0.4303, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.25% (0.3927 => 0.4408, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.85% (1.1194 => 1.2520, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (1.7609 => 1.9366, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.43% (2.2022 => 2.4099, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 9.29% (0.1432 => 0.1565, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.24% (0.6030 => 0.6527, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.26% (0.1584 => 0.1699, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 7.19% (10.4361 => 11.1869, std. dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.19% (0.1892 => 0.2028, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.14% (0.7326 => 0.7849, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.3177 => 0.3382, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.24% (7.0540 => 7.4943, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.92% (0.4615 => 0.4888, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 5.91% (0.3282 => 0.3476, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.81% (0.3307 => 0.3499, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.42% (0.7433 => 0.7836, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.38% (0.8172 => 0.8612, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.4879 => 0.5136, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 5.25% (0.2554 => 0.2688, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2271 => 0.2390, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.10% (9.4845 => 9.9682, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (4.9449 => 5.1964, std. dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.03% (0.2107 => 0.2213, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.99% (5.0018 => 5.2513, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.82% (4.2646 => 4.4702, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.69% (0.5860 => 0.6135, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.52% (0.3121 => 0.3262, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.51% (8.1363 => 8.5036, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.44% (1.3050 => 1.3630, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.44% (0.3109 => 0.3247, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.37% (0.2700 => 0.2818, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 4.32% (0.3423 => 0.3571, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.25% (0.3180 => 0.3315, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 4.23% (0.4299 => 0.4481, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.23% (5.7591 => 6.0026, std. dev.: 0.0010) MultiSource/Applications/spiff/spiff: 4.20% (0.7835 => 0.8164, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.11% (1.5415 => 1.6048, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.2758 => 0.2871, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 4.04% (0.3092 => 0.3217, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.04% (0.5105 => 0.5311, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.03% (0.4636 => 0.4823, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.02% (0.9765 => 1.0158, std. dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.86% (1.1861 => 1.2319, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 3.86% (1.1642 => 1.2091, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.84% (0.3441 => 0.3573, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.80% (0.2891 => 0.3001, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.78% (0.3387 => 0.3515, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 3.73% (0.4289 => 0.4449, std. dev.: 0.0048) MultiSource/Applications/d/make_dparser: 3.70% (3.3354 => 3.4589, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 3.66% (1.5603 => 1.6174, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.4103 => 0.4253, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.64% (0.3650 => 0.3783, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6450 => 0.6684, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.63% (0.6675 => 0.6917, std. dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 3.61% (0.2905 => 0.3010, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.58% (0.8067 => 0.8356, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3865 => 0.4003, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 3.54% (2.0273 => 2.0990, std. dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (14.3668 => 14.8724, std. dev.: 0.0193) MultiSource/Applications/lua/lua: 3.44% (3.8723 => 4.0055, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 3.42% (0.3098 => 0.3204, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.39% (0.3422 => 0.3538, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.32% (0.3826 => 0.3953, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.28% (0.6456 => 0.6668, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.25% (0.3232 => 0.3337, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.23% (0.5981 => 0.6174, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.22% (0.4064 => 0.4195, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.20% (2.0665 => 2.1327, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 3.19% (0.3603 => 0.3718, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.15% (0.3684 => 0.3800, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.11% (1.4186 => 1.4627, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3283 => 0.3384, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.05% (0.4203 => 0.4331, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4620 => 0.4760, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.94% (2.2969 => 2.3644, std. dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.92% (17.1811 => 17.6836, std. dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/moments: 2.87% (0.4048 => 0.4164, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.86% (0.8921 => 0.9176, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 2.86% (1.2842 => 1.3209, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.65% (1.5859 => 1.6280, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.61% (0.5020 => 0.5151, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.53% (2.2024 => 2.2582, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.50% (0.7115 => 0.7293, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.1840 => 1.2119, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.02% (1.0722 => 1.0939, std. dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.62% (7.9617 => 8.0909, std. dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.56% (21.9371 => 22.2794, std. dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9579, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.92% (4.2280 => 4.4359, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.29% (3.6395 => 3.7593, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.90% (1.3045 => 1.3293, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 1.79% (3.2827 => 3.3413, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.75% (26.0924 => 26.5495, std. dev.: 0.0185) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5086 => 1.5315, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2454, std. dev.: 0.0285) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1983, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std. dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1254, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.62% (5.2763 => 3.1856, std. dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.15% (5.3855 => 3.7078, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7066, std. dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0776, std. dev.: 0.0236) MultiSource/Applications/ClamAV/clamscan: -13.88% (22.1758 => 19.0983, std. dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.97% (2.9384 => 2.5572, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.1396 => 1.0699, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -6.11% (1.5373 => 1.4434, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.06% (2.7294 => 2.5639, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8051, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.43% (3.1595 => 3.0512, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4647, std. dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4193, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: -2.85% (10.2830 => 9.9900, std. dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (8.1563 => 7.9656, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3372, std. dev.: 0.0075) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4199, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.8329 => 1.8124, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (1.6805 => 1.6631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std. dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 17:15:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 19:15:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120829001527.E78812A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3299?compare_to=3293&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3299, Order: 162793, Start Time: 2012-08-28 21:32:40, End Time: 2012-08-29 00:16:11 To: 3293, Order: 162769, Start Time: 2012-08-28 18:21:14, End Time: 2012-08-28 21:04:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (122 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 966 (770 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.20% (1.6935 => 1.7139, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -18.23% (0.4976 => 0.4069, std. dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.63% (0.3446 => 0.3950, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.59% (0.3488 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.44% (0.3442 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.43% (0.3465 => 0.3965, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.39% (0.3460 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.38% (0.3469 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.33% (0.3496 => 0.3997, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 13.86% (0.3643 => 0.4148, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.64% (0.3724 => 0.4232, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.93% (0.5826 => 0.6346, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.5889 => 0.6388, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std. dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 7.58% (1.5932 => 1.7139, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.45% (0.2014 => 0.2164, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.30% (0.3792 => 0.4069, std. dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.17% (1.6211 => 1.7373, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.08% (3.5627 => 3.8149, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.06% (0.7171 => 0.7677, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.92% (0.5026 => 0.5374, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.89% (1.3152 => 1.4058, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.56% (0.4361 => 0.4647, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.43% (0.4994 => 0.5315, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.26% (0.5000 => 0.5313, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.16% (0.3930 => 0.4172, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.5900 => 0.6254, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 5.95% (4.2109 => 4.4615, std. dev.: 0.0085) MultiSource/Applications/spiff/spiff: 5.93% (0.4029 => 0.4268, std. dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.83% (1.0781 => 1.1409, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.59% (0.2738 => 0.2891, std. dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 5.49% (5.5417 => 5.8457, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.45% (1.9694 => 2.0768, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.2736 => 0.2885, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.33% (2.7292 => 2.8748, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.23% (0.2866 => 0.3016, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (0.3890 => 0.4088, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 5.03% (0.2566 => 0.2695, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.01% (0.2875 => 0.3019, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.92% (1.9966 => 2.0948, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (0.3195 => 0.3351, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.87% (2.1013 => 2.2037, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.81% (0.4658 => 0.4882, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (4.4195 => 4.6310, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.74% (0.3625 => 0.3797, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 4.72% (0.2714 => 0.2842, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 4.70% (0.2811 => 0.2943, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 4.66% (0.2725 => 0.2852, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.64% (0.9909 => 1.0369, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.59% (2.0673 => 2.1622, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 4.59% (0.2813 => 0.2942, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.58% (4.6177 => 4.8293, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.58% (0.2729 => 0.2854, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.57% (0.2823 => 0.2952, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.57% (0.2911 => 0.3044, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.57% (0.2780 => 0.2907, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 4.56% (0.3004 => 0.3141, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 4.55% (0.2750 => 0.2875, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.51% (0.3124 => 0.3265, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.46% (0.2803 => 0.2928, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.43% (2.1653 => 2.2612, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.3903 => 0.4075, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.40% (1.8794 => 1.9621, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.38% (0.3060 => 0.3194, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 4.36% (0.3096 => 0.3231, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 4.35% (1.4269 => 1.4890, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.30% (0.3282 => 0.3423, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.29% (0.3477 => 0.3626, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 4.29% (0.3267 => 0.3407, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3258 => 0.3397, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 4.25% (0.6634 => 0.6916, std. dev.: 0.0024) MultiSource/Applications/treecc/treecc: 4.17% (0.7875 => 0.8203, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 4.16% (0.3726 => 0.3881, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3678 => 0.3831, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3362 => 0.3501, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.12% (0.9697 => 1.0097, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 4.12% (0.3348 => 0.3486, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.07% (0.3317 => 0.3452, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.00% (0.3271 => 0.3402, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.97% (0.5546 => 0.5766, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4146 => 0.4310, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.91% (0.4139 => 0.4301, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.89% (0.3084 => 0.3204, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 3.86% (0.4251 => 0.4415, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.3690 => 0.3832, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.73% (0.2737 => 0.2839, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.60% (0.3336 => 0.3456, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.57% (23.5202 => 24.3600, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.3981 => 0.4119, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.47% (0.6435 => 0.6658, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.3845 => 0.3976, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.40% (0.2969 => 0.3070, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.39% (0.5012 => 0.5182, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 2.95% (2.0346 => 2.0946, std. dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: 2.46% (0.4847 => 0.4966, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (0.7426 => 0.7584, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.90% (0.5361 => 0.5463, std. dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.28% (11.6398 => 11.7886, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (4.6926 => 4.7452, std. dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6606, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8951, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1646, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6414, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1957, std. dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5015, std. dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std. dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (41.7953 => 42.4652, std. dev.: 0.0155) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2850, std. dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5903, std. dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.14% (2.4764 => 2.3987, std. dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5572, std. dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/ary2: -10.12% (0.2402 => 0.2159, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8005, std. dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7951, std. dev.: 0.0032) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.55% (17.2379 => 16.7975, std. dev.: 0.0634) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.88% (0.6293 => 0.6175, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5727, std. dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.57% (16.2163 => 15.9623, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 4.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 17:22:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 19:22:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120829002249.CF7D52A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3300?compare_to=3296&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3300, Order: 162801, Start Time: 2012-08-28 23:09:26, End Time: 2012-08-29 00:23:36 To: 3296, Order: 162792, Start Time: 2012-08-28 21:27:11, End Time: 2012-08-28 22:41:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (159 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 965 (709 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.99% (55.2913 => 56.3935, std. dev.: 0.0835) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.85% (78.7742 => 80.2295, std. dev.: 0.4501) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.37% (2.7389 => 2.7015, std. dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.16% (2.0176 => 2.3235, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 12.83% (0.0826 => 0.0932, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.47% (0.1072 => 0.1195, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.16% (0.7061 => 0.7849, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.09% (0.5818 => 0.6463, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.89% (0.5748 => 0.6374, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3578 => 0.3959, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.48% (0.3663 => 0.4047, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3601 => 0.3978, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.43% (0.3623 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.42% (0.3646 => 0.4026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3650 => 0.4027, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 10.27% (0.3789 => 0.4178, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.17% (0.3914 => 0.4312, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.92% (0.4003 => 0.4400, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.90% (0.3940 => 0.4330, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.91% (0.3130 => 0.3409, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.61% (0.7710 => 0.8374, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.49% (0.1413 => 0.1533, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.1819 => 0.1973, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.22% (3.9660 => 4.2920, std. dev.: 0.0118) MultiSource/Applications/hbd/hbd: 7.96% (1.3693 => 1.4783, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.90% (0.2596 => 0.2801, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.81% (0.4328 => 0.4666, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.80% (0.4062 => 0.4379, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.77% (0.2781 => 0.2997, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.62% (0.5265 => 0.5666, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.35% (0.2721 => 0.2921, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7038 => 0.7554, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.32% (1.2193 => 1.3086, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2782 => 0.2984, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4379 => 0.4694, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.13% (0.9199 => 0.9855, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 7.06% (0.2761 => 0.2956, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.98% (0.2607 => 0.2789, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.96% (0.2628 => 0.2811, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.95% (0.3022 => 0.3232, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2655 => 0.2838, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.88% (0.4390 => 0.4692, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.3899 => 0.4167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.85% (0.2760 => 0.2949, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.80% (0.2765 => 0.2953, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.80% (0.6959 => 0.7432, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.72% (1.9828 => 2.1161, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.68% (0.1588 => 0.1694, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.65% (0.3580 => 0.3818, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.63% (0.2127 => 0.2268, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.62% (0.3489 => 0.3720, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.57% (0.3149 => 0.3356, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.57% (0.2696 => 0.2873, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.55% (1.1364 => 1.2108, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (0.3485 => 0.3712, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.46% (0.5577 => 0.5937, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2988 => 0.3180, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 6.37% (13.8202 => 14.7001, std. dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.35% (0.3246 => 0.3452, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.33% (0.5637 => 0.5994, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3192 => 0.3394, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.25% (0.2914 => 0.3096, std. dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.23% (0.2023 => 0.2149, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.17% (1.4563 => 1.5462, std. dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.17% (0.1865 => 0.1980, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 6.11% (0.3453 => 0.3664, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.02% (0.7506 => 0.7958, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 6.01% (0.2995 => 0.3175, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.98% (0.2925 => 0.3100, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.3534 => 0.3745, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.94% (7.2180 => 7.6464, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 5.84% (0.2243 => 0.2374, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.78% (0.7460 => 0.7891, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.78% (0.4016 => 0.4248, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.74% (1.3245 => 1.4005, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (0.3756 => 0.3971, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.64% (0.2945 => 0.3111, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.61% (0.8310 => 0.8776, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.59% (1.1061 => 1.1679, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 5.57% (3.8646 => 4.0800, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.46% (4.3801 => 4.6192, std. dev.: 0.0067) MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.4113 => 0.4336, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.40% (3.6692 => 3.8672, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 5.31% (1.2292 => 1.2945, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 5.24% (1.9270 => 2.0280, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.20% (1.0594 => 1.1145, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.20% (0.4791 => 0.5040, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.3813 => 1.4525, std. dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.11% (4.4433 => 4.6705, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.09% (0.6283 => 0.6603, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.03% (1.3819 => 1.4514, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.97% (0.6135 => 0.6440, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.92% (0.8818 => 0.9252, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.88% (13.2842 => 13.9330, std. dev.: 0.0151) MultiSource/Applications/siod/siod: 4.86% (2.1791 => 2.2851, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std. dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 4.68% (16.6129 => 17.3905, std. dev.: 0.0091) MultiSource/Applications/JM/lencod/lencod: 4.55% (14.8535 => 15.5297, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.26% (1.1333 => 1.1816, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 4.22% (0.3131 => 0.3263, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 4.04% (8.4961 => 8.8396, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.02% (0.8698 => 0.9048, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.91% (0.3245 => 0.3372, std. dev.: 0.0000) MultiSource/Applications/d/make_dparser: 3.90% (3.1889 => 3.3133, std. dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 3.85% (0.2859 => 0.2969, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.68% (6.5754 => 6.8175, std. dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.68% (3.2742 => 3.3946, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.66% (4.6629 => 4.8337, std. dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.9865 => 5.1532, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 3.31% (16.2614 => 16.7990, std. dev.: 0.0125) MultiSource/Applications/ClamAV/clamscan: 3.29% (14.5298 => 15.0077, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.18% (0.9108 => 0.9398, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.13% (1.5188 => 1.5664, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.75% (0.6250 => 0.6422, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.60% (2.1007 => 2.1553, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.31% (6.2785 => 6.4237, std. dev.: 0.0060) MultiSource/Applications/lua/lua: 2.28% (3.7467 => 3.8321, std. dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.4805 => 0.4911, std. dev.: 0.0011) MultiSource/Applications/lemon/lemon: 2.20% (1.0313 => 1.0540, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.08% (0.6744 => 0.6884, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 1.47% (1.2749 => 1.2936, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.37% (33.2944 => 33.7507, std. dev.: 0.0197) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5166, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 25.41% (1.8175 => 2.2793, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: 8.82% (1.2998 => 1.4144, std. dev.: 0.0162) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6591, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7417, std. dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (2.8606 => 2.9631, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std. dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 2.73% (10.7476 => 11.0415, std. dev.: 0.0427) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8168, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3841, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5996, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.04% (1.4298 => 1.4590, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 2.04% (3.2729 => 3.3397, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1844, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2145, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5732, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6838, std. dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.01% (4.5928 => 4.6391, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.68% (22.5627 => 21.2815, std. dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.73% (1.2308 => 1.0864, std. dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.00% (1.0460 => 0.9519, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.32% (2.5089 => 2.3755, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5099, std. dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3152, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.24% (0.3139 => 0.3006, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -3.99% (3.1476 => 3.0221, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.72% (0.4867 => 0.4686, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -3.21% (1.1560 => 1.1189, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.53% (8.8259 => 8.6028, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: -2.44% (1.9762 => 1.9280, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2364, std. dev.: 0.0056) MultiSource/Applications/spiff/spiff: -1.81% (3.0263 => 2.9714, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.3167 => 5.2219, std. dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3305 => 7.2016, std. dev.: 0.0077) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9929, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.30% (20.3410 => 20.0766, std. dev.: 0.0493) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.30% (9.9194 => 9.7908, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4251, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8729, std. dev.: 0.0146) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2379, std. dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: -1.00% (4.4810 => 4.4360, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 17:35:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 19:35:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120829003521.89AC02A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3301?compare_to=3297&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3301, Order: 162801, Start Time: 2012-08-28 23:24:49, End Time: 2012-08-29 00:36:21 To: 3297, Order: 162796, Start Time: 2012-08-28 21:58:09, End Time: 2012-08-28 23:09:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 7 (32 on baseline) Performance Improvements: 3 (27 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 879 (830 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.60% (8.6767 => 9.1622, std. dev.: 0.1019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.29% (4.4663 => 4.6580, std. dev.: 0.0632) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.18% (40.5248 => 41.8151, std. dev.: 0.1025) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.37% (2.7201 => 2.7574, std. dev.: 0.0144) MultiSource/Applications/spiff/spiff: 1.35% (2.7963 => 2.8340, std. dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (3.2194 => 3.2570, std. dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.05% (1.6108 => 1.6277, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.19% (0.7752 => 0.7427, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.63% (0.7980 => 0.7770, std. dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.64% (0.1774 => 0.1674, std. dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (12.6413 => 12.8747, std. dev.: 0.0721) MultiSource/Applications/siod/siod: 1.18% (2.0972 => 2.1219, std. dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 72.97% (1.6538 => 2.8606, std. dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 24.90% (2.4457 => 3.0547, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.65% (0.0499 => 0.0612, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 14.87% (1.7426 => 2.0018, std. dev.: 0.0229) SingleSource/Benchmarks/McGill/queens: 13.98% (1.6261 => 1.8534, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 12.76% (0.3746 => 0.4224, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/methcall: 12.01% (8.5566 => 9.5843, std. dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.83% (3.0256 => 3.3532, std. dev.: 0.0632) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.13% (1.0063 => 1.1082, std. dev.: 0.0141) SingleSource/Benchmarks/Stanford/FloatMM: 8.65% (0.8175 => 0.8882, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.55% (27.1724 => 29.2241, std. dev.: 0.0673) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.15% (0.3301 => 0.3537, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/whetstone: 5.67% (2.3453 => 2.4782, std. dev.: 0.0101) MultiSource/Applications/siod/siod: 5.39% (3.5520 => 3.7434, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: 5.01% (15.2242 => 15.9867, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.52% (62.4126 => 65.2334, std. dev.: 0.1765) SingleSource/Benchmarks/Misc/dt: 4.15% (0.9851 => 1.0260, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.44% (2.6656 => 2.7574, std. dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.30% (40.4792 => 41.8151, std. dev.: 0.1025) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.16% (4.6127 => 4.7585, std. dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.89% (2.4042 => 2.4737, std. dev.: 0.0246) MultiSource/Benchmarks/FreeBench/mason/mason: 2.80% (0.5004 => 0.5144, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.11% (6.6312 => 6.7711, std. dev.: 0.0175) MultiSource/Applications/lua/lua: 1.45% (29.5232 => 29.9519, std. dev.: 0.1375) MultiSource/Benchmarks/Olden/power/power: 1.23% (1.4184 => 1.4359, std. dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 1.16% (2.4013 => 2.4292, std. dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.10% (14.4877 => 14.6474, std. dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.05% (1.6061 => 1.6230, std. dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.04% (1.6110 => 1.6277, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: 1.00% (5.1938 => 5.2459, std. dev.: 0.0189) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.59% (0.7784 => 0.7427, std. dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.22% (0.2654 => 0.2542, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -3.97% (0.2820 => 0.2708, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: -1.65% (3.8796 => 3.8157, std. dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: -1.33% (14.6079 => 14.4134, std. dev.: 0.0233) MultiSource/Applications/lua/lua: -1.21% (3.5980 => 3.5544, std. dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.78% (0.3497 => 0.2071, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.31% (1.4034 => 1.1464, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1603, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -11.25% (1.4441 => 1.2817, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: -11.23% (4.6355 => 4.1149, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -9.56% (7.6833 => 6.9488, std. dev.: 0.0359) SingleSource/Benchmarks/McGill/misr: -7.96% (0.4296 => 0.3954, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (1.1647 => 1.0843, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.64% (3.9413 => 3.6797, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.92% (2.9728 => 2.7967, std. dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.35% (0.4564 => 0.4320, std. dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -4.85% (3.4230 => 3.2570, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.83% (0.4140 => 0.3940, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: -4.50% (0.2664 => 0.2544, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2857, std. dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.46% (25.6658 => 25.0335, std. dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.07% (1.1683 => 1.1441, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -1.84% (1.0926 => 1.0725, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2360, std. dev.: 0.0165) SingleSource/Benchmarks/Misc/oourafft: -1.52% (3.8200 => 3.7619, std. dev.: 0.0114) MultiSource/Benchmarks/NPB-serial/is/is: -1.33% (13.4743 => 13.2947, std. dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 18:07:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 20:07:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120829010746.8A2F72A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/3302?compare_to=3298&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3302, Order: 162801, Start Time: 2012-08-28 23:49:28, End Time: 2012-08-29 01:08:46 To: 3298, Order: 162796, Start Time: 2012-08-28 22:02:32, End Time: 2012-08-28 23:21:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (116 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (732 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 7.38% (19.0983 => 20.5075, std. dev.: 0.0099) MultiSource/Benchmarks/PAQ8p/paq8p: 1.06% (13.5980 => 13.7425, std. dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.80% (11.1869 => 10.9858, std. dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.20% (1.4434 => 1.4117, std. dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.56% (10.3673 => 13.7425, std. dev.: 0.0084) SingleSource/UnitTests/ObjC/trivial-interface: 14.94% (0.3473 => 0.3992, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.58% (0.3497 => 0.4007, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.56% (0.3543 => 0.4059, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.54% (0.3543 => 0.4058, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 14.53% (0.3516 => 0.4027, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.46% (0.3561 => 0.4076, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.08% (0.3694 => 0.4214, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.61% (0.3828 => 0.4349, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3927 => 0.4455, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.28% (0.3886 => 0.4402, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.79% (1.1194 => 1.2514, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.59% (1.7609 => 1.9474, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 9.57% (0.1432 => 0.1569, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.54% (2.2022 => 2.4122, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.2065 => 0.2239, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.88% (0.1892 => 0.2041, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.84% (0.3177 => 0.3426, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.58% (0.5925 => 0.6374, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.38% (0.6030 => 0.6475, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.32% (0.1584 => 0.1700, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.43% (0.3282 => 0.3493, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 6.27% (0.7326 => 0.7785, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.84% (0.4879 => 0.5164, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.4615 => 0.4881, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.75% (7.0540 => 7.4599, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.47% (0.3307 => 0.3488, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.34% (0.8172 => 0.8608, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (4.9449 => 5.2087, std. dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 5.27% (10.4361 => 10.9858, std. dev.: 0.0192) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.15% (0.2271 => 0.2388, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (5.0018 => 5.2586, std. dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: 5.13% (9.4845 => 9.9709, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.03% (0.2107 => 0.2213, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 4.78% (0.7433 => 0.7788, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.75% (4.2646 => 4.4670, std. dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 4.60% (0.3109 => 0.3252, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.54% (0.2554 => 0.2670, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 4.47% (0.4299 => 0.4491, std. dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.45% (0.3121 => 0.3260, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.42% (0.5569 => 0.5815, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.38% (1.3050 => 1.3622, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.35% (8.1363 => 8.4903, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.32% (0.5860 => 0.6113, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.21% (0.7835 => 0.8165, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 4.11% (5.7591 => 5.9959, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.07% (0.2700 => 0.2810, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.05% (0.5105 => 0.5312, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 4.03% (0.3423 => 0.3561, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.00% (1.5415 => 1.6032, std. dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.99% (1.5603 => 1.6226, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.91% (0.9765 => 1.0147, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.86% (0.4636 => 0.4815, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.77% (0.3180 => 0.3300, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.77% (0.2758 => 0.2862, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 3.72% (0.3092 => 0.3207, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.72% (1.1861 => 1.2302, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.61% (0.6675 => 0.6916, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3865 => 0.4000, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.46% (0.3441 => 0.3560, std. dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.45% (0.3387 => 0.3504, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (14.3668 => 14.8568, std. dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.37% (0.3650 => 0.3773, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 3.37% (3.3354 => 3.4477, std. dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.36% (0.6450 => 0.6667, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.36% (0.4289 => 0.4433, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.35% (1.1642 => 1.2032, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wc: 3.34% (0.3052 => 0.3154, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.32% (0.3098 => 0.3201, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.28% (0.3232 => 0.3338, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.22% (0.8067 => 0.8327, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.22% (0.4103 => 0.4235, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 3.21% (0.3422 => 0.3532, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.5981 => 0.6173, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.6456 => 0.6663, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.20% (0.3283 => 0.3388, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.16% (0.3826 => 0.3947, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.15% (2.0665 => 2.1316, std. dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.10% (0.3935 => 0.4057, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.08% (2.0273 => 2.0898, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (0.4064 => 0.4188, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.03% (0.3603 => 0.3712, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 3.00% (3.8723 => 3.9886, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 2.99% (0.3684 => 0.3794, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.86% (0.4620 => 0.4752, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.83% (1.4186 => 1.4588, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8921 => 0.9168, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.4203 => 0.4319, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.74% (0.4048 => 0.4159, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.59% (1.2842 => 1.3174, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.49% (0.5020 => 0.5145, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5859 => 1.6242, std. dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 2.36% (1.1840 => 1.2119, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.33% (2.2969 => 2.3505, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.27% (17.1811 => 17.5704, std. dev.: 0.0248) MultiSource/Applications/minisat/minisat: 2.16% (0.7115 => 0.7269, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.96% (7.9617 => 8.1179, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.2024 => 2.2436, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.65% (1.0722 => 1.0899, std. dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.50% (21.9371 => 22.2657, std. dev.: 0.0225) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.33% (0.8614 => 0.9504, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (4.2280 => 4.4385, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7518, std. dev.: 0.0025) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3397, std. dev.: 0.0021) MultiSource/Applications/lua/lua: 1.64% (26.0924 => 26.5194, std. dev.: 0.0416) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7979, std. dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2329, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 1.28% (3.1578 => 3.1982, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.40% (5.2763 => 3.1976, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.78% (5.3855 => 3.7277, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.21% (5.3526 => 3.7354, std. dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1469, std. dev.: 0.0387) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.21% (2.9384 => 2.5502, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -7.52% (22.1758 => 20.5075, std. dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0958, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel-2: -8.17% (1.5373 => 1.4117, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4678, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.1396 => 1.0699, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.07% (2.7294 => 2.5638, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8050, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0018) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0507, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4692, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.13% (8.6802 => 8.4088, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.58% (10.2830 => 10.0182, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.24% (8.1563 => 7.9737, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6777, std. dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3357, std. dev.: 0.0064) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: -1.15% (1.4460 => 1.4294, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.05% (1.8329 => 1.8136, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std. dev.: 0.0078) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.02% (1.0313 => 1.0208, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 19:02:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 21:02:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120829020204.BD7D22A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3303?compare_to=3301&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3303, Order: 162810, Start Time: 2012-08-29 00:51:59, End Time: 2012-08-29 02:03:03 To: 3301, Order: 162801, Start Time: 2012-08-28 23:24:49, End Time: 2012-08-29 00:36:21 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 5 (27 on baseline) Performance Improvements: 3 (28 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 881 (834 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.36% (0.7835 => 0.8020, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.72% (4.3780 => 4.4531, std. dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.53% (2.4737 => 2.5116, std. dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 1.15% (1.7237 => 1.7436, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.01% (1.6277 => 1.6441, std. dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -17.48% (0.0612 => 0.0505, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.19% (3.2661 => 3.1946, std. dev.: 0.0096) MultiSource/Applications/spiff/spiff: -1.26% (2.8340 => 2.7983, std. dev.: 0.0128) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 73.37% (1.6538 => 2.8672, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 22.72% (2.4457 => 3.0014, std. dev.: 0.0723) SingleSource/Benchmarks/Shootout/ary3: 15.22% (1.7426 => 2.0079, std. dev.: 0.0096) SingleSource/Benchmarks/McGill/queens: 13.46% (1.6261 => 1.8449, std. dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 12.15% (0.3746 => 0.4201, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout/methcall: 12.12% (8.5566 => 9.5936, std. dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.78% (1.0063 => 1.0947, std. dev.: 0.0233) SingleSource/Benchmarks/Stanford/FloatMM: 8.65% (0.8175 => 0.8882, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.45% (27.1724 => 29.1954, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.66% (0.3301 => 0.3521, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.70% (4.2129 => 4.4531, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.40% (0.7609 => 0.8020, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 5.17% (2.3453 => 2.4665, std. dev.: 0.0326) SingleSource/Benchmarks/Misc/fp-convert: 5.00% (15.2242 => 15.9850, std. dev.: 0.0218) MultiSource/Applications/siod/siod: 4.86% (3.5520 => 3.7247, std. dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (2.4042 => 2.5116, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 4.41% (0.9851 => 1.0285, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (62.4126 => 64.9226, std. dev.: 0.1716) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.17% (0.8498 => 0.8767, std. dev.: 0.0060) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.06% (2.6656 => 2.7471, std. dev.: 0.0277) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.82% (4.6127 => 4.7429, std. dev.: 0.0117) MultiSource/Benchmarks/Olden/bisort/bisort: 2.82% (0.6459 => 0.6641, std. dev.: 0.0056) MultiSource/Benchmarks/FreeBench/mason/mason: 2.82% (0.5004 => 0.5145, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.58% (0.6308 => 0.6471, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.05% (1.6110 => 1.6441, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.02% (6.6312 => 6.7654, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: 1.25% (1.4184 => 1.4361, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.81% (1.2742 => 1.2512, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.28% (1.0689 => 1.0552, std. dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std. dev.: 0.0049) SingleSource/Benchmarks/Stanford/Queens: -37.10% (0.0310 => 0.0195, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.59% (1.4034 => 1.1425, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1565, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -11.54% (1.4441 => 1.2774, std. dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/fibo: -11.25% (4.6355 => 4.1141, std. dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -9.65% (7.6833 => 6.9417, std. dev.: 0.0715) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.87% (1.1647 => 1.0847, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.73% (3.9413 => 3.6759, std. dev.: 0.0593) SingleSource/Benchmarks/McGill/misr: -6.26% (0.4296 => 0.4027, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.22% (2.9728 => 2.7879, std. dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.06% (0.4140 => 0.3889, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/distray/distray: -5.52% (0.2664 => 0.2517, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std. dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -4.82% (3.4230 => 3.2580, std. dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.58% (2.3580 => 2.2736, std. dev.: 0.0284) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2855, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.47% (25.6658 => 25.0323, std. dev.: 0.0046) MultiSource/Applications/spiff/spiff: -2.15% (2.8599 => 2.7983, std. dev.: 0.0128) MultiSource/Benchmarks/FreeBench/neural/neural: -1.83% (1.0926 => 1.0726, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2267, std. dev.: 0.0177) MultiSource/Benchmarks/NPB-serial/is/is: -1.44% (13.4743 => 13.2798, std. dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.37% (1.1683 => 1.1523, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.05% (2.3569 => 2.3321, std. dev.: 0.0076) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.2722 => 1.2592, std. dev.: 0.0026) MultiSource/Applications/aha/aha: -1.01% (3.4286 => 3.3939, std. dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 19:05:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 21:05:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120829020512.6CEB82A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3304?compare_to=3300&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3304, Order: 162808, Start Time: 2012-08-29 00:51:48, End Time: 2012-08-29 02:06:10 To: 3300, Order: 162801, Start Time: 2012-08-28 23:09:26, End Time: 2012-08-29 00:23:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (161 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 967 (707 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.20% (80.2295 => 81.1886, std. dev.: 0.2163) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.22% (2.0176 => 2.3247, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 12.71% (0.0826 => 0.0931, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.19% (0.5818 => 0.6469, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.17% (0.7061 => 0.7850, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.98% (0.5748 => 0.6379, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3578 => 0.3959, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.46% (0.3623 => 0.4002, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 10.46% (0.3663 => 0.4046, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3601 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3650 => 0.4031, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.42% (0.3646 => 0.4026, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3914 => 0.4318, std. dev.: 0.0048) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3789 => 0.4176, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 10.03% (0.3940 => 0.4335, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.97% (0.4003 => 0.4402, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.82% (0.3130 => 0.3406, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.63% (0.1819 => 0.1976, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.56% (0.1413 => 0.1534, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.27% (0.7710 => 0.8348, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.26% (3.9660 => 4.2937, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.15% (0.5265 => 0.5694, std. dev.: 0.0074) MultiSource/Applications/hbd/hbd: 7.97% (1.3693 => 1.4785, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.86% (0.2596 => 0.2800, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4328 => 0.4664, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.73% (0.2781 => 0.2996, std. dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 7.62% (0.7038 => 0.7574, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.58% (0.4062 => 0.4370, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.2721 => 0.2923, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.34% (1.2193 => 1.3088, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.29% (0.6959 => 0.7466, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2782 => 0.2984, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.20% (0.9199 => 0.9861, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.01% (0.4379 => 0.4686, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2761 => 0.2954, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3580 => 0.3828, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.91% (0.2690 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.90% (0.2607 => 0.2787, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.87% (0.2765 => 0.2955, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.86% (0.2726 => 0.2913, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.85% (0.3022 => 0.3229, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.85% (0.2628 => 0.2808, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.3899 => 0.4166, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.83% (0.4390 => 0.4690, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 6.81% (0.2760 => 0.2948, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.78% (0.2655 => 0.2835, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3489 => 0.3725, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.76% (0.1789 => 0.1910, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (1.9828 => 2.1167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.71% (0.2937 => 0.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3149 => 0.3360, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.68% (0.1588 => 0.1694, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3107 => 0.3313, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.63% (0.2127 => 0.2268, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.60% (0.3485 => 0.3715, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.57% (1.1364 => 1.2111, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.56% (0.5577 => 0.5943, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.53% (0.2988 => 0.3183, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.47% (13.8202 => 14.7142, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.38% (0.3246 => 0.3453, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.33% (0.5637 => 0.5994, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.32% (1.4563 => 1.5484, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.2925 => 0.3108, std. dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.25% (0.2914 => 0.3096, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.22% (0.1865 => 0.1981, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.20% (0.3453 => 0.3667, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.18% (0.2023 => 0.2148, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.06% (7.2180 => 7.6553, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 6.01% (0.3293 => 0.3491, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3534 => 0.3742, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 5.88% (0.2243 => 0.2375, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.87% (1.3245 => 1.4023, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.80% (0.3756 => 0.3974, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.78% (0.4016 => 0.4248, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.75% (3.8646 => 4.0867, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 5.73% (0.8310 => 0.8786, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 5.65% (0.7506 => 0.7930, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.63% (1.1061 => 1.1684, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 5.61% (0.3868 => 0.4085, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.57% (0.2945 => 0.3109, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.51% (0.2995 => 0.3160, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.47% (0.4113 => 0.4338, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.46% (0.7460 => 0.7867, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.42% (3.6692 => 3.8681, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (1.3813 => 1.4550, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.29% (1.3819 => 1.4550, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 5.28% (1.2292 => 1.2941, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 5.28% (0.3220 => 0.3390, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.28% (4.3801 => 4.6112, std. dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 5.25% (1.0594 => 1.1150, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.24% (0.6283 => 0.6612, std. dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.2140 => 0.2252, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.22% (4.4433 => 4.6753, std. dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.22% (0.4791 => 0.5041, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.19% (0.8818 => 0.9276, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.15% (0.6135 => 0.6451, std. dev.: 0.0008) MultiSource/Applications/treecc/treecc: 5.02% (1.9270 => 2.0237, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (13.2842 => 13.9450, std. dev.: 0.0103) MultiSource/Applications/siod/siod: 4.91% (2.1791 => 2.2861, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.77% (0.3755 => 0.3934, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.70% (16.6129 => 17.3944, std. dev.: 0.0052) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.59% (0.2243 => 0.2346, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 4.55% (14.8535 => 15.5292, std. dev.: 0.0093) MultiSource/Benchmarks/sim/sim: 4.38% (0.3131 => 0.3268, std. dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.1333 => 1.1813, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (8.4961 => 8.8416, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.05% (0.8698 => 0.9050, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.90% (3.1889 => 3.3134, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.88% (0.3245 => 0.3371, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.2859 => 0.2970, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 3.81% (6.5754 => 6.8262, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.70% (3.2742 => 3.3954, std. dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.69% (4.6629 => 4.8348, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (4.9865 => 5.1543, std. dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 3.31% (16.2614 => 16.7994, std. dev.: 0.0217) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.27% (0.9108 => 0.9406, std. dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.24% (14.5298 => 15.0003, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.22% (1.5188 => 1.5677, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.6250 => 0.6419, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1556, std. dev.: 0.0072) MultiSource/Applications/lua/lua: 2.41% (3.7467 => 3.8369, std. dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (6.2785 => 6.4271, std. dev.: 0.0064) MultiSource/Applications/lemon/lemon: 2.26% (1.0313 => 1.0546, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.4805 => 0.4912, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.15% (0.6744 => 0.6889, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.40% (33.2944 => 33.7596, std. dev.: 0.0152) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.2749 => 1.2927, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std. dev.: 0.0438) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 10.03% (1.2998 => 1.4302, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.87% (1.5824 => 1.6594, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.35% (11.2619 => 11.7522, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7761, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9633, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.71% (1.7688 => 1.8167, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3836, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6008, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.23% (10.7476 => 10.9876, std. dev.: 0.0109) MultiSource/Applications/siod/siod: 2.07% (3.2729 => 3.3405, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 2.01% (1.4298 => 1.4586, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5089 => 1.5324, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std. dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.27% (1.0895 => 1.1033, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.12% (5.5130 => 5.5747, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.02% (4.5928 => 4.6396, std. dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.62% (22.5627 => 21.2946, std. dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.17% (1.2308 => 1.0933, std. dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std. dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.17% (0.3139 => 0.3008, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9985, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0213, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.00% (1.3780 => 1.3229, std. dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.43% (0.4867 => 0.4700, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -3.18% (1.1560 => 1.1192, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.77% (4.5947 => 4.4676, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.44% (8.8259 => 8.6107, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std. dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.10% (0.8342 => 0.8167, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2309, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: -1.87% (5.3167 => 5.2175, std. dev.: 0.0052) MultiSource/Applications/spiff/spiff: -1.73% (3.0263 => 2.9738, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3305 => 7.2050, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7910, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.24% (20.3410 => 20.0879, std. dev.: 0.0411) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2212, std. dev.: 0.0192) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (84.4286 => 83.4348, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.05% (6.6320 => 6.5625, std. dev.: 0.0094) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 19:54:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 21:54:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120829025454.73D1C2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3305?compare_to=3302&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3305, Order: 162816, Start Time: 2012-08-29 01:36:32, End Time: 2012-08-29 02:55:52 To: 3302, Order: 162801, Start Time: 2012-08-28 23:49:28, End Time: 2012-08-29 01:08:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (112 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (739 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.10% (13.7425 => 13.1784, std. dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.12% (10.3673 => 13.1784, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 13.85% (0.3473 => 0.3954, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3497 => 0.3973, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.59% (0.3516 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.58% (0.3543 => 0.4024, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.58% (0.3543 => 0.4024, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.45% (0.3561 => 0.4040, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.08% (0.3694 => 0.4177, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.75% (0.3828 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3927 => 0.4415, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.35% (0.3886 => 0.4366, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.58% (1.1194 => 1.2490, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.32% (1.7609 => 1.9427, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.28% (2.2022 => 2.4066, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: 9.01% (0.1432 => 0.1561, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.78% (0.5925 => 0.6386, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.6030 => 0.6496, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.36% (0.2065 => 0.2217, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1892 => 0.2024, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.94% (0.1584 => 0.1694, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.3177 => 0.3388, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.62% (0.7326 => 0.7811, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 6.54% (0.1622 => 0.1728, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.97% (0.3282 => 0.3478, std. dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.76% (0.4615 => 0.4881, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.53% (7.0540 => 7.4444, std. dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.35% (0.4879 => 0.5140, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.29% (0.3307 => 0.3482, std. dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.16% (10.4361 => 10.9749, std. dev.: 0.0130) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.02% (0.2271 => 0.2385, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.98% (0.2107 => 0.2212, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.92% (0.8172 => 0.8574, std. dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.90% (4.9449 => 5.1873, std. dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 4.79% (9.4845 => 9.9391, std. dev.: 0.0126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.75% (5.0018 => 5.2395, std. dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 4.74% (0.7433 => 0.7785, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.58% (0.2554 => 0.2671, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.5569 => 0.5814, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.35% (4.2646 => 4.4502, std. dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 4.31% (0.3109 => 0.3243, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.26% (0.3121 => 0.3254, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.22% (0.5860 => 0.6107, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.21% (1.3050 => 1.3600, std. dev.: 0.0088) MultiSource/Benchmarks/McCat/05-eks/eks: 4.19% (0.4299 => 0.4479, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.10% (8.1363 => 8.4700, std. dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.01% (0.4636 => 0.4822, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.94% (0.3423 => 0.3558, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.91% (0.7835 => 0.8141, std. dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 3.89% (5.7591 => 5.9834, std. dev.: 0.0132) MultiSource/Benchmarks/McCat/09-vor/vor: 3.84% (0.3180 => 0.3302, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.81% (0.9765 => 1.0137, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.74% (1.5415 => 1.5992, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.63% (0.3441 => 0.3566, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.58% (1.1861 => 1.2286, std. dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 3.44% (0.2905 => 0.3005, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.41% (0.6450 => 0.6670, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.33% (1.5603 => 1.6123, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3650 => 0.3769, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.24% (0.4103 => 0.4236, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.22% (0.3387 => 0.3496, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.21% (0.6675 => 0.6889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.16% (0.3865 => 0.3987, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.13% (0.5105 => 0.5265, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.12% (1.1642 => 1.2005, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.07% (0.8067 => 0.8315, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 3.03% (0.4289 => 0.4419, std. dev.: 0.0017) MultiSource/Applications/d/make_dparser: 3.03% (3.3354 => 3.4363, std. dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (14.3668 => 14.8003, std. dev.: 0.0241) MultiSource/Applications/treecc/treecc: 2.99% (2.0273 => 2.0879, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.96% (2.0665 => 2.1277, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 2.95% (0.3422 => 0.3523, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4620 => 0.4756, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.94% (3.8723 => 3.9861, std. dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.93% (0.5981 => 0.6156, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.87% (0.3935 => 0.4048, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.83% (0.3603 => 0.3705, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (0.4064 => 0.4178, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.77% (0.6456 => 0.6635, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 2.74% (0.3684 => 0.3785, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.66% (0.4203 => 0.4315, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.60% (1.4186 => 1.4555, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 2.59% (0.8921 => 0.9152, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.52% (1.2842 => 1.3166, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 2.51% (2.2969 => 2.3545, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.31% (0.5020 => 0.5136, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.19% (1.5859 => 1.6206, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.17% (17.1811 => 17.5543, std. dev.: 0.0502) MultiSource/Benchmarks/nbench/nbench: 1.82% (1.1840 => 1.2056, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.82% (2.2024 => 2.2424, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.81% (0.7115 => 0.7244, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.63% (7.9617 => 8.0911, std. dev.: 0.0111) MultiSource/Applications/lemon/lemon: 1.42% (1.0722 => 1.0874, std. dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.28% (21.9371 => 22.2177, std. dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.45% (2.6778 => 2.9577, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.32% (0.8614 => 0.9503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (4.2280 => 4.4427, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7543, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.72% (3.2827 => 3.3393, std. dev.: 0.0015) MultiSource/Applications/lua/lua: 1.72% (26.0924 => 26.5422, std. dev.: 0.0200) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.37% (1.5086 => 1.5293, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.26% (3.1578 => 3.1975, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2264, std. dev.: 0.0051) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (1.3045 => 1.3186, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1272, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.52% (5.2763 => 3.1911, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.14% (5.3855 => 3.7087, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7178, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1670, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.11% (2.9384 => 2.5533, std. dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: -7.76% (22.1758 => 20.4539, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -8.24% (1.5373 => 1.4107, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -6.09% (1.1396 => 1.0702, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.06% (2.7294 => 2.5639, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std. dev.: 0.0019) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.21% (32.5116 => 31.4696, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4236, std. dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -2.58% (10.2830 => 10.0178, std. dev.: 0.0166) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (8.1563 => 7.9601, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.50% (12.5348 => 12.3471, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.09% (1.8329 => 1.8129, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: -1.02% (1.4460 => 1.4312, std. dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6634, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 20:26:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 22:26:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120829032659.321CB2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3306?compare_to=3299&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3306, Order: 162807, Start Time: 2012-08-29 00:44:20, End Time: 2012-08-29 03:27:58 To: 3299, Order: 162793, Start Time: 2012-08-28 21:32:40, End Time: 2012-08-29 00:16:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (112 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 967 (781 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 9.79% (0.2125 => 0.2333, std. dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 14.68% (0.3446 => 0.3952, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.61% (0.3442 => 0.3945, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 14.60% (0.3465 => 0.3971, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.51% (0.3460 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.50% (0.3496 => 0.4003, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.48% (0.3488 => 0.3993, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.36% (0.3469 => 0.3967, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 13.97% (0.3650 => 0.4160, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.97% (0.3643 => 0.4152, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.61% (0.3724 => 0.4231, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5826 => 0.6319, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.12% (0.5889 => 0.6367, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 7.24% (1.5932 => 1.7085, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.1619 => 0.1736, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.55% (0.7171 => 0.7641, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.29% (0.4994 => 0.5308, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.29% (1.6211 => 1.7230, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.26% (3.5627 => 3.7856, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.01% (1.3152 => 1.3943, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.89% (0.4361 => 0.4618, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.2014 => 0.2128, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.58% (0.5900 => 0.6229, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.55% (0.3930 => 0.4148, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.52% (0.5000 => 0.5276, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.46% (0.4029 => 0.4249, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 5.23% (1.0781 => 1.1345, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.19% (0.5026 => 0.5287, std. dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 5.16% (4.2109 => 4.4283, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.92% (0.2866 => 0.3007, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.87% (0.2566 => 0.2691, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.86% (0.2738 => 0.2871, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.79% (0.2736 => 0.2867, std. dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (2.7292 => 2.8598, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.69% (5.5417 => 5.8014, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.63% (1.9694 => 2.0606, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.63% (0.2875 => 0.3008, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.57% (0.4658 => 0.4871, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.26% (1.9966 => 2.0816, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/fibo: 4.26% (0.2725 => 0.2841, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.26% (0.3195 => 0.3331, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.21% (2.1013 => 2.1897, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 4.20% (0.2714 => 0.2828, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.14% (0.2729 => 0.2842, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.14% (0.3890 => 0.4051, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.08% (0.2792 => 0.2906, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 4.07% (0.2803 => 0.2917, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.06% (0.9909 => 1.0311, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (1.8794 => 1.9552, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 4.03% (0.9697 => 1.0088, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 4.00% (0.2750 => 0.2860, std. dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 3.99% (0.3004 => 0.3124, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 3.98% (0.2811 => 0.2923, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.97% (0.3625 => 0.3769, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.92% (4.4195 => 4.5929, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2780 => 0.2889, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.91% (0.3096 => 0.3217, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.88% (2.0673 => 2.1475, std. dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 3.83% (4.6177 => 4.7947, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.79% (0.3060 => 0.3176, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 3.79% (0.2823 => 0.2930, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.77% (0.3903 => 0.4050, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 3.71% (2.1653 => 2.2457, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.68% (0.2911 => 0.3018, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.67% (0.3267 => 0.3387, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3258 => 0.3376, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.61% (0.3271 => 0.3389, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.61% (0.7875 => 0.8159, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.55% (0.3690 => 0.3821, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.52% (0.3124 => 0.3234, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 3.49% (1.4269 => 1.4767, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.48% (0.3362 => 0.3479, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.48% (0.4139 => 0.4283, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 3.46% (0.3348 => 0.3464, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.46% (0.3726 => 0.3855, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.45% (0.6634 => 0.6863, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.39% (0.3477 => 0.3595, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (0.3845 => 0.3975, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 3.38% (0.3317 => 0.3429, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 3.27% (0.4251 => 0.4390, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4146 => 0.4280, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 3.19% (0.5546 => 0.5723, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.09% (23.5202 => 24.2475, std. dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.94% (0.3981 => 0.4098, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.57% (0.5012 => 0.5141, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.6435 => 0.6592, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.02% (2.0346 => 2.0757, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 9.94% (0.2122 => 0.2333, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6748, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1690, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8878, std. dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6457, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2019, std. dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5036, std. dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std. dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (41.7953 => 42.4540, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2823, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5760, std. dev.: 0.0227) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.03% (11.9555 => 11.8318, std. dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5684, std. dev.: 0.0299) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7993, std. dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.00% (0.2402 => 0.2258, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.69% (3.3665 => 3.2422, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8024, std. dev.: 0.0063) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7779, std. dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5721, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (16.2163 => 15.9574, std. dev.: 0.0128) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4973, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 20:31:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 22:31:29 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120829033129.075C02A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3307?compare_to=3303&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3307, Order: 162820, Start Time: 2012-08-29 02:21:41, End Time: 2012-08-29 03:32:25 To: 3303, Order: 162810, Start Time: 2012-08-29 00:51:59, End Time: 2012-08-29 02:03:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 1 (22 on baseline) Performance Improvements: 4 (31 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 884 (836 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3574 => 0.3712, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.31% (9.0971 => 8.5233, std. dev.: 0.1969) MultiSource/Applications/treecc/treecc: -1.55% (1.8822 => 1.8531, std. dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.95% (1.7318 => 1.6981, std. dev.: 0.0119) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.81% (1.2990 => 1.2755, std. dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 73.37% (1.6538 => 2.8672, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 23.30% (2.4457 => 3.0155, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std. dev.: 0.0245) SingleSource/Benchmarks/McGill/queens: 13.93% (1.6261 => 1.8526, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 12.84% (0.3746 => 0.4227, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/methcall: 11.57% (8.5566 => 9.5468, std. dev.: 0.0511) SingleSource/Benchmarks/Stanford/FloatMM: 8.62% (0.8175 => 0.8880, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.68% (1.0063 => 1.0836, std. dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.46% (27.1724 => 29.1993, std. dev.: 0.0802) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (0.3301 => 0.3533, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 5.81% (2.3453 => 2.4815, std. dev.: 0.0297) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.20% (2.4042 => 2.5291, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/fp-convert: 4.96% (15.2242 => 15.9800, std. dev.: 0.0052) MultiSource/Applications/siod/siod: 4.87% (3.5520 => 3.7251, std. dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 4.53% (62.4126 => 65.2415, std. dev.: 0.1451) SingleSource/Benchmarks/Misc/dt: 4.43% (0.9851 => 1.0287, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.80% (4.2129 => 4.3730, std. dev.: 0.0610) SingleSource/Benchmarks/Misc-C++/bigfib: 3.37% (0.3591 => 0.3712, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.94% (6.6312 => 6.7597, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.90% (1.6110 => 1.6416, std. dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.79% (4.6127 => 4.6951, std. dev.: 0.0301) MultiSource/Benchmarks/Olden/power/power: 1.25% (1.4184 => 1.4362, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.21% (0.9029 => 0.8739, std. dev.: 0.0092) MultiSource/Applications/spiff/spiff: -2.24% (0.7738 => 0.7565, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.95% (1.2742 => 1.2493, std. dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: -1.66% (14.6079 => 14.3659, std. dev.: 0.0658) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.06% (1.0689 => 1.0576, std. dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.78% (0.3497 => 0.2071, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.33% (1.4034 => 1.1461, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1564, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -11.73% (1.4441 => 1.2747, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: -11.31% (4.6355 => 4.1111, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -9.83% (7.6833 => 6.9277, std. dev.: 0.0171) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.87% (1.1647 => 1.0847, std. dev.: 0.0189) MultiSource/Benchmarks/FreeBench/distray/distray: -6.68% (0.2664 => 0.2486, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.64% (3.9413 => 3.6796, std. dev.: 0.0578) SingleSource/Benchmarks/McGill/misr: -6.56% (0.4296 => 0.4014, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: -6.19% (3.4230 => 3.2111, std. dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.03% (0.4140 => 0.3973, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2852, std. dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.46% (25.6658 => 25.0335, std. dev.: 0.0490) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.19% (1.7361 => 1.6981, std. dev.: 0.0119) MultiSource/Benchmarks/FreeBench/neural/neural: -1.87% (1.0926 => 1.0722, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.57% (1.2959 => 1.2755, std. dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: -1.50% (6.7458 => 6.6449, std. dev.: 0.0180) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (13.4743 => 13.2730, std. dev.: 0.0146) MultiSource/Applications/spiff/spiff: -1.49% (2.8599 => 2.8172, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/oourafft: -1.47% (3.8200 => 3.7637, std. dev.: 0.0175) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.46% (9.3855 => 9.2483, std. dev.: 0.0453) SingleSource/Benchmarks/Shootout-C++/methcall: -1.39% (9.2503 => 9.1213, std. dev.: 0.0294) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.1116 => 1.1002, std. dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 4.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 20:47:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 22:47:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120829034725.82EB82A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3308?compare_to=3304&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3308, Order: 162820, Start Time: 2012-08-29 02:33:56, End Time: 2012-08-29 03:48:23 To: 3304, Order: 162808, Start Time: 2012-08-29 00:51:48, End Time: 2012-08-29 02:06:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (160 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 967 (709 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.73% (81.1886 => 79.7807, std. dev.: 0.4693) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.01% (2.0176 => 2.3204, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 12.47% (0.0826 => 0.0929, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.16% (0.5818 => 0.6467, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.13% (0.7061 => 0.7847, std. dev.: 0.0061) SingleSource/UnitTests/ObjC++/Hello: 11.12% (0.5748 => 0.6387, std. dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.15% (0.3578 => 0.3941, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.90% (0.3646 => 0.4007, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.83% (0.3601 => 0.3955, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.73% (0.3650 => 0.4005, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.72% (0.3663 => 0.4019, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 9.69% (0.3623 => 0.3974, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3789 => 0.4150, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 9.50% (0.3914 => 0.4286, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.32% (0.4003 => 0.4376, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.16% (0.3940 => 0.4301, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.80% (0.1819 => 0.1979, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.29% (0.7710 => 0.8349, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.28% (0.1413 => 0.1530, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.27% (3.9660 => 4.2940, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 8.07% (1.3693 => 1.4798, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (0.4328 => 0.4670, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.87% (0.2781 => 0.3000, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4062 => 0.4381, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.70% (0.7038 => 0.7580, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.50% (0.5265 => 0.5660, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2596 => 0.2790, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3489 => 0.3748, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.38% (1.2193 => 1.3093, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.36% (0.2607 => 0.2799, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2761 => 0.2963, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.2721 => 0.2918, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.23% (0.9199 => 0.9864, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2690 => 0.2882, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3022 => 0.3236, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2628 => 0.2814, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3899 => 0.4174, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.05% (0.2765 => 0.2960, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.05% (0.2937 => 0.3144, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.03% (0.2760 => 0.2954, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.02% (1.9828 => 2.1219, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.99% (0.4379 => 0.4685, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.93% (0.2726 => 0.2915, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.91% (0.2966 => 0.3171, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.84% (0.3580 => 0.3825, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.83% (0.6959 => 0.7434, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.1588 => 0.1696, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.79% (0.2696 => 0.2879, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.76% (0.3107 => 0.3317, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.74% (0.3485 => 0.3720, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3149 => 0.3361, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.68% (0.2127 => 0.2269, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.63% (0.4390 => 0.4681, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 6.61% (0.3192 => 0.3403, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.56% (0.2988 => 0.3184, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.53% (1.1364 => 1.2106, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 6.42% (0.1589 => 0.1691, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.28% (0.5577 => 0.5927, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.26% (0.3293 => 0.3499, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3246 => 0.3449, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.25% (1.4563 => 1.5473, std. dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.2914 => 0.3094, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.14% (13.8202 => 14.6683, std. dev.: 0.0140) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.13% (0.2023 => 0.2147, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.13% (0.3868 => 0.4105, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.3756 => 0.3985, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.08% (0.5637 => 0.5980, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.05% (0.4016 => 0.4259, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 5.98% (0.2995 => 0.3174, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.93% (7.2180 => 7.6458, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.81% (0.2925 => 0.3095, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.75% (0.8310 => 0.8788, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.74% (0.1865 => 0.1972, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.60% (0.2945 => 0.3110, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.60% (0.7506 => 0.7926, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 5.57% (0.2243 => 0.2368, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.57% (0.4113 => 0.4342, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.55% (3.6692 => 3.8728, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.48% (1.3245 => 1.3971, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.47% (0.8818 => 0.9300, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 5.44% (3.8646 => 4.0747, std. dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.43% (0.7460 => 0.7865, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.43% (1.2292 => 1.2959, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.34% (1.3819 => 1.4557, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 5.33% (1.0594 => 1.1159, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.31% (1.1061 => 1.1648, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.29% (4.3801 => 4.6117, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.28% (0.4791 => 0.5044, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (1.3813 => 1.4525, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.15% (0.6135 => 0.6451, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.14% (4.4433 => 4.6719, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.12% (0.6283 => 0.6605, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.09% (0.2140 => 0.2249, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.06% (1.9270 => 2.0245, std. dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: 4.91% (0.3220 => 0.3378, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (13.2842 => 13.9300, std. dev.: 0.0190) MultiSource/Applications/siod/siod: 4.83% (2.1791 => 2.2844, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.82% (0.3755 => 0.3936, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.72% (14.8535 => 15.5543, std. dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 4.58% (16.6129 => 17.3731, std. dev.: 0.0086) MultiSource/Benchmarks/sim/sim: 4.31% (0.3131 => 0.3266, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.26% (1.1333 => 1.1816, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (8.4961 => 8.8498, std. dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.15% (0.8698 => 0.9059, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.04% (0.3245 => 0.3376, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 3.88% (6.5754 => 6.8306, std. dev.: 0.0116) MultiSource/Applications/d/make_dparser: 3.86% (3.1889 => 3.3119, std. dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.74% (3.2742 => 3.3966, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 3.73% (4.6629 => 4.8370, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 3.60% (0.2859 => 0.2962, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (4.9865 => 5.1626, std. dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.50% (0.9108 => 0.9427, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.35% (16.2614 => 16.8060, std. dev.: 0.0245) MultiSource/Applications/ClamAV/clamscan: 3.29% (14.5298 => 15.0075, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.11% (1.5188 => 1.5660, std. dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 2.59% (0.6250 => 0.6412, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.56% (0.4805 => 0.4928, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (2.1007 => 2.1497, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.28% (3.7467 => 3.8322, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 2.25% (1.0313 => 1.0545, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.23% (6.2785 => 6.4187, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 2.06% (0.6744 => 0.6883, std. dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 1.66% (33.2944 => 33.8480, std. dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 1.58% (1.2749 => 1.2951, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2670, std. dev.: 0.0396) SingleSource/Benchmarks/Misc/mandel-2: 10.87% (1.2998 => 1.4411, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6592, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0057, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.36% (11.2619 => 11.7525, std. dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (1.7081 => 1.7773, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9870, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8184, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.41% (12.0921 => 12.3834, std. dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9940, std. dev.: 0.0353) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5969, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.06% (3.2729 => 3.3404, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.99% (1.4298 => 1.4583, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5352, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5162, std. dev.: 0.0066) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.29% (1.0895 => 1.1036, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1843, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6469 => 3.6863, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.06% (5.5130 => 5.5717, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.73% (0.2670 => 0.2517, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.54% (22.5627 => 21.3120, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.01% (1.2308 => 1.0953, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2635, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std. dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5118, std. dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3139 => 0.3004, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8054, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.20% (1.3780 => 1.3201, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9987, std. dev.: 0.0003) MultiSource/Applications/aha/aha: -4.00% (3.1476 => 3.0218, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.51% (0.4867 => 0.4696, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -3.19% (1.1560 => 1.1191, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4678, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5841, std. dev.: 0.0224) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (0.8342 => 0.8168, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std. dev.: 0.0041) MultiSource/Applications/spiff/spiff: -1.75% (3.0263 => 2.9732, std. dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3305 => 7.2064, std. dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: -1.67% (5.3167 => 5.2280, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9923, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8619, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7917, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.20% (20.3410 => 20.0967, std. dev.: 0.0409) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4241, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.03% (5.5401 => 5.4829, std. dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 4.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Aug 28 21:57:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 28 Aug 2012 23:57:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120829045757.A43ED2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3309?compare_to=3307&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3309, Order: 162823, Start Time: 2012-08-29 03:47:46, End Time: 2012-08-29 04:58:57 To: 3307, Order: 162820, Start Time: 2012-08-29 02:21:41, End Time: 2012-08-29 03:32:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 10 (26 on baseline) Performance Improvements: 3 (28 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 876 (835 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/kimwitu++/kc: 1.02% (15.2388 => 15.3944, std. dev.: 0.0403) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.07% (2.2829 => 2.6041, std. dev.: 0.0208) MultiSource/Benchmarks/nbench/nbench: 13.75% (20.3892 => 23.1931, std. dev.: 0.5420) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.43% (3.0856 => 3.2841, std. dev.: 0.0280) MultiSource/Applications/SPASS/SPASS: 3.29% (8.1439 => 8.4116, std. dev.: 0.0064) SingleSource/Benchmarks/Misc/ffbench: 2.67% (1.3708 => 1.4074, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.51% (1.6981 => 1.7237, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/methcall: 1.10% (9.5468 => 9.6519, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: 1.03% (9.1213 => 9.2151, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: 1.02% (1.7296 => 1.7472, std. dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/strcat: -7.52% (0.1729 => 0.1599, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.55% (22.2220 => 21.2100, std. dev.: 0.3238) SingleSource/Benchmarks/Misc-C++/bigfib: -4.36% (0.3712 => 0.3550, std. dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 73.37% (1.6538 => 2.8672, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 23.39% (2.4457 => 3.0177, std. dev.: 0.0226) SingleSource/Benchmarks/Shootout/ary3: 15.44% (1.7426 => 2.0117, std. dev.: 0.0097) SingleSource/Benchmarks/McGill/queens: 13.98% (1.6261 => 1.8535, std. dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 12.95% (0.3746 => 0.4231, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/methcall: 12.80% (8.5566 => 9.6519, std. dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.44% (2.3580 => 2.6041, std. dev.: 0.0208) MultiSource/Benchmarks/nbench/nbench: 9.55% (21.1721 => 23.1931, std. dev.: 0.5420) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.94% (1.0063 => 1.0963, std. dev.: 0.0083) SingleSource/Benchmarks/Stanford/FloatMM: 8.72% (0.8175 => 0.8888, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.54% (3.0256 => 3.2841, std. dev.: 0.0280) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.32% (27.1724 => 29.1604, std. dev.: 0.0783) SingleSource/Benchmarks/Misc/whetstone: 5.09% (2.3453 => 2.4647, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/fp-convert: 4.98% (15.2242 => 15.9830, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.3301 => 0.3465, std. dev.: 0.0022) MultiSource/Applications/siod/siod: 4.74% (3.5520 => 3.7203, std. dev.: 0.0327) MultiSource/Benchmarks/mafft/pairlocalalign: 3.84% (62.4126 => 64.8116, std. dev.: 0.4136) SingleSource/Benchmarks/Misc/dt: 3.84% (0.9851 => 1.0229, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.31% (2.6656 => 2.7539, std. dev.: 0.0184) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.97% (4.6127 => 4.7499, std. dev.: 0.0285) MultiSource/Benchmarks/FreeBench/mason/mason: 2.82% (0.5004 => 0.5145, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.03% (6.6312 => 6.7658, std. dev.: 0.0055) MultiSource/Applications/minisat/minisat: 1.91% (6.2244 => 6.3430, std. dev.: 0.0227) MultiSource/Benchmarks/Olden/power/power: 1.24% (1.4184 => 1.4360, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.09% (3.8907 => 3.9332, std. dev.: 0.0129) MultiSource/Benchmarks/BitBench/five11/five11: 1.05% (5.1938 => 5.2483, std. dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.50% (14.6079 => 14.3895, std. dev.: 0.0727) MultiSource/Applications/hbd/hbd: -1.27% (1.3268 => 1.3099, std. dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.15% (0.3497 => 0.2093, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.31% (1.4034 => 1.1464, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std. dev.: 0.0184) SingleSource/Benchmarks/Misc/richards_benchmark: -11.33% (1.4441 => 1.2805, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/fibo: -11.22% (4.6355 => 4.1153, std. dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: -9.92% (7.6833 => 6.9212, std. dev.: 0.0250) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.2664 => 0.2465, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/strcat: -7.41% (0.1727 => 0.1599, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.00% (1.1647 => 1.0832, std. dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.72% (3.9413 => 3.6763, std. dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -6.25% (3.4230 => 3.2092, std. dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.05% (22.3381 => 21.2100, std. dev.: 0.3238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.23% (0.4140 => 0.3965, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2864, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.45% (25.6658 => 25.0358, std. dev.: 0.0572) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.99% (1.8739 => 1.8366, std. dev.: 0.0138) MultiSource/Benchmarks/FreeBench/neural/neural: -1.81% (1.0926 => 1.0728, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: -1.55% (3.8200 => 3.7606, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.54% (1.1683 => 1.1503, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.46% (9.3855 => 9.2485, std. dev.: 0.0147) MultiSource/Benchmarks/NPB-serial/is/is: -1.44% (13.4743 => 13.2806, std. dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: -1.43% (6.7458 => 6.6490, std. dev.: 0.0113) MultiSource/Applications/SPASS/SPASS: -1.41% (8.5323 => 8.4116, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: -1.12% (16.5617 => 16.3756, std. dev.: 0.0513) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 14:56:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 16:56:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120829215618.880F92A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3310?compare_to=3309&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3310, Order: 162852, Start Time: 2012-08-29 20:45:19, End Time: 2012-08-29 21:57:20 To: 3309, Order: 162823, Start Time: 2012-08-29 03:47:46, End Time: 2012-08-29 04:58:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 14 (20 on baseline) Performance Improvements: 1 (25 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 874 (844 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.72% (0.1916 => 0.2064, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.51% (0.7239 => 0.7783, std. dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.04% (0.5451 => 0.5780, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.46% (0.4426 => 0.4579, std. dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.68% (0.7496 => 0.7697, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.59% (0.5365 => 0.5504, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.84% (1.1450 => 1.1661, std. dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.70% (4.2974 => 4.3706, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.34% (0.8835 => 0.8953, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (1.1930 => 1.2058, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.55% (21.2100 => 22.3870, std. dev.: 0.0793) SingleSource/Benchmarks/Shootout/ary3: 1.81% (2.0117 => 2.0481, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.06% (3.7231 => 3.7627, std. dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.05% (1.8366 => 1.8559, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.38% (2.6041 => 2.3338, std. dev.: 0.0615) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 72.51% (1.6538 => 2.8529, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/recursive: 21.33% (2.4457 => 2.9673, std. dev.: 0.0445) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.85% (3.0256 => 3.6263, std. dev.: 0.1416) SingleSource/Benchmarks/Shootout/ary3: 17.53% (1.7426 => 2.0481, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 13.94% (1.6261 => 1.8527, std. dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 13.43% (0.3746 => 0.4249, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout/methcall: 11.62% (8.5566 => 9.5512, std. dev.: 0.0466) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.83% (1.0063 => 1.1052, std. dev.: 0.0101) SingleSource/Benchmarks/Stanford/FloatMM: 8.76% (0.8175 => 0.8891, std. dev.: 0.0135) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.42% (27.1724 => 29.1896, std. dev.: 0.0967) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.76% (0.3301 => 0.3491, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 4.99% (15.2242 => 15.9834, std. dev.: 0.0176) MultiSource/Applications/siod/siod: 4.68% (3.5520 => 3.7184, std. dev.: 0.0168) SingleSource/Benchmarks/Misc/dt: 4.45% (0.9851 => 1.0289, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 3.92% (62.4126 => 64.8618, std. dev.: 0.2454) MultiSource/Benchmarks/FreeBench/mason/mason: 3.02% (0.5004 => 0.5155, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.75% (4.2129 => 4.3287, std. dev.: 0.0322) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.71% (4.6127 => 4.7375, std. dev.: 0.0293) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.01% (6.6312 => 6.7646, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 1.10% (1.4184 => 1.4340, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.15% (0.4880 => 0.4775, std. dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.72% (0.3497 => 0.2108, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.31% (1.4034 => 1.1464, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1616, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: -11.33% (1.4441 => 1.2805, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -11.27% (4.6355 => 4.1131, std. dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: -9.87% (7.6833 => 6.9252, std. dev.: 0.0138) MultiSource/Benchmarks/FreeBench/distray/distray: -7.13% (0.2664 => 0.2474, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.12% (1.1647 => 1.0818, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.77% (3.9413 => 3.6745, std. dev.: 0.0399) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.31% (2.9728 => 2.7851, std. dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.14% (0.4140 => 0.3886, std. dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -6.06% (3.4230 => 3.2156, std. dev.: 0.0256) SingleSource/Benchmarks/McGill/misr: -6.03% (0.4296 => 0.4037, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.00% (0.4564 => 0.4336, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std. dev.: 0.0315) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.56% (61.1734 => 59.6067, std. dev.: 0.5334) SingleSource/Benchmarks/CoyoteBench/huffbench: -2.46% (25.6658 => 25.0342, std. dev.: 0.0324) MultiSource/Benchmarks/FreeBench/neural/neural: -1.84% (1.0926 => 1.0725, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: -1.66% (2.8599 => 2.8125, std. dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod: -1.58% (6.7458 => 6.6389, std. dev.: 0.0345) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2425, std. dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (13.4743 => 13.2731, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7685, std. dev.: 0.0126) MultiSource/Applications/aha/aha: -1.07% (3.4286 => 3.3918, std. dev.: 0.0137) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 15:26:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 17:26:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120829222607.203012A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3311?compare_to=3308&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3311, Order: 162856, Start Time: 2012-08-29 21:12:25, End Time: 2012-08-29 22:27:06 To: 3308, Order: 162820, Start Time: 2012-08-29 02:33:56, End Time: 2012-08-29 03:48:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (157 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 966 (712 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.84% (54.4582 => 56.5482, std. dev.: 0.0652) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.64% (79.7807 => 81.0867, std. dev.: 0.2590) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.59% (2.0176 => 2.3119, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: 12.95% (0.0826 => 0.0933, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.79% (0.5818 => 0.6504, std. dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 11.62% (0.5748 => 0.6416, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.58% (0.7061 => 0.7879, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.84% (0.3578 => 0.3966, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.74% (0.3650 => 0.4042, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3601 => 0.3987, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3646 => 0.4034, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.57% (0.3623 => 0.4006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.54% (0.3663 => 0.4049, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3789 => 0.4182, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3914 => 0.4316, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.04% (0.4003 => 0.4405, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.85% (0.3940 => 0.4328, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.20% (0.3130 => 0.3418, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.87% (1.3693 => 1.4907, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.85% (0.1413 => 0.1538, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4328 => 0.4692, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.40% (0.7710 => 0.8358, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.38% (3.9660 => 4.2982, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.36% (0.5265 => 0.5705, std. dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2781 => 0.3006, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.03% (0.7038 => 0.7603, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.02% (0.2782 => 0.3005, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.97% (0.2596 => 0.2803, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1819 => 0.1963, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.79% (0.4390 => 0.4732, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 7.79% (0.2607 => 0.2810, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.63% (0.4062 => 0.4372, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 7.51% (0.2690 => 0.2892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.50% (0.2655 => 0.2854, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.43% (0.2760 => 0.2965, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.41% (0.2765 => 0.2970, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.41% (0.3022 => 0.3246, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.39% (0.2761 => 0.2965, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2628 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.37% (0.2726 => 0.2927, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.36% (1.2193 => 1.3090, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.32% (0.2937 => 0.3152, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.31% (0.9199 => 0.9871, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.2721 => 0.2919, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.3489 => 0.3742, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.25% (0.2966 => 0.3181, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4379 => 0.4696, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.23% (1.9828 => 2.1262, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.21% (0.3580 => 0.3838, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3107 => 0.3330, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.17% (0.6959 => 0.7458, std. dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.16% (0.3899 => 0.4178, std. dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3485 => 0.3732, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.08% (0.2696 => 0.2887, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.08% (0.3149 => 0.3372, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.96% (0.2988 => 0.3196, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2127 => 0.2275, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.92% (0.3192 => 0.3413, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3453 => 0.3692, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.76% (0.1789 => 0.1910, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.76% (0.5577 => 0.5954, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.70% (1.1364 => 1.2125, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.62% (0.3246 => 0.3461, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.61% (0.1588 => 0.1693, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 6.60% (13.8202 => 14.7325, std. dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.57% (0.2023 => 0.2156, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.50% (0.4016 => 0.4277, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: 6.49% (0.3868 => 0.4119, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.48% (0.5637 => 0.6002, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.47% (0.3756 => 0.3999, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.45% (1.4563 => 1.5503, std. dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.38% (0.1865 => 0.1984, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 6.34% (0.3534 => 0.3758, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.29% (0.2925 => 0.3109, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.21% (0.7506 => 0.7972, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.2914 => 0.3094, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (7.2180 => 7.6638, std. dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 6.11% (0.2243 => 0.2380, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.06% (1.1061 => 1.1731, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.98% (0.2945 => 0.3121, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.84% (1.3245 => 1.4018, std. dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 5.78% (0.8310 => 0.8790, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 5.74% (3.8646 => 4.0863, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 5.72% (1.2292 => 1.2995, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.67% (1.3813 => 1.4596, std. dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.64% (0.7460 => 0.7881, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.53% (1.9270 => 2.0335, std. dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.51% (1.3819 => 1.4581, std. dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 5.51% (0.2995 => 0.3160, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 5.39% (2.1791 => 2.2966, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4113 => 0.4334, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.37% (1.0594 => 1.1163, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.36% (3.6692 => 3.8657, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 5.31% (0.3220 => 0.3391, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.27% (0.3755 => 0.3953, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.14% (4.3801 => 4.6051, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.13% (0.4791 => 0.5037, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.12% (4.4433 => 4.6706, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (13.2842 => 13.9632, std. dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.09% (0.6135 => 0.6447, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.97% (0.6283 => 0.6595, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.73% (1.1333 => 1.1869, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 4.72% (14.8535 => 15.5545, std. dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: 4.71% (16.6129 => 17.3955, std. dev.: 0.0155) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.65% (0.8818 => 0.9228, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.53% (0.3245 => 0.3392, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.38% (0.8698 => 0.9079, std. dev.: 0.0024) MultiSource/Applications/d/make_dparser: 4.30% (3.1889 => 3.3259, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 4.12% (0.3131 => 0.3260, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (8.4961 => 8.8432, std. dev.: 0.0107) MultiSource/Benchmarks/Olden/bh/bh: 3.99% (0.2859 => 0.2973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.9865 => 5.1784, std. dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: 3.82% (6.5754 => 6.8265, std. dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 3.70% (14.5298 => 15.0678, std. dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 3.55% (4.6629 => 4.8282, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.50% (3.2742 => 3.3888, std. dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 3.31% (16.2614 => 16.7993, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.17% (1.5188 => 1.5669, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.03% (0.9108 => 0.9384, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.99% (0.6250 => 0.6437, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1571, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.62% (3.7467 => 3.8449, std. dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.48% (0.6744 => 0.6911, std. dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.38% (6.2785 => 6.4277, std. dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 2.30% (33.2944 => 34.0593, std. dev.: 0.0383) MultiSource/Applications/SIBsim4/SIBsim4: 1.69% (1.2749 => 1.2964, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fbench: 25.89% (1.8175 => 2.2881, std. dev.: 0.0412) SingleSource/Benchmarks/Misc/mandel-2: 10.99% (1.2998 => 1.4427, std. dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.85% (1.5824 => 1.6591, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.28% (11.2619 => 11.7443, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (2.8606 => 2.9635, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.80% (1.7688 => 1.8184, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3844, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5979, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.23% (10.7476 => 10.9878, std. dev.: 0.0149) MultiSource/Applications/siod/siod: 2.07% (3.2729 => 3.3405, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.00% (1.4298 => 1.4584, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5121, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.35% (1.5089 => 1.5293, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1035, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.19% (9.0760 => 9.1837, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.09% (5.5130 => 5.5731, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.06% (4.5928 => 4.6414, std. dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.84% (0.2670 => 0.2514, std. dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.43% (22.5627 => 21.3371, std. dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.35% (1.2308 => 1.0911, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.02% (1.0460 => 0.9517, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8057, std. dev.: 0.0007) MultiSource/Applications/aha/aha: -4.02% (3.1476 => 3.0212, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.01% (6.2497 => 5.9988, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.01% (0.3139 => 0.3013, std. dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -3.20% (1.1560 => 1.1190, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4679, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.55% (8.8259 => 8.6009, std. dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std. dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.25% (0.6589 => 0.6441, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.07% (0.8342 => 0.8169, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2277, std. dev.: 0.0068) MultiSource/Applications/spiff/spiff: -1.84% (3.0263 => 2.9707, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (5.3167 => 5.2218, std. dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3305 => 7.1999, std. dev.: 0.0284) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9930, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.38% (9.3358 => 9.2074, std. dev.: 0.0217) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.28% (9.9194 => 9.7922, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std. dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4226, std. dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.14% (20.3410 => 20.1096, std. dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.12% (5.5401 => 5.4782, std. dev.: 0.0125) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 15:36:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 17:36:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120829223644.18CDF2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3312?compare_to=3305&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3312, Order: 162856, Start Time: 2012-08-29 21:17:46, End Time: 2012-08-29 22:37:46 To: 3305, Order: 162816, Start Time: 2012-08-29 01:36:32, End Time: 2012-08-29 02:55:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (127 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 944 (723 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.56% (13.1784 => 13.6473, std. dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.93% (54.4009 => 56.5382, std. dev.: 0.1503) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.14% (41.9400 => 42.8357, std. dev.: 0.0465) SingleSource/Benchmarks/Misc/mandel-2: 2.12% (1.4107 => 1.4406, std. dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 31.64% (10.3673 => 13.6473, std. dev.: 0.0100) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.03% (0.3543 => 0.4040, std. dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 13.59% (0.3473 => 0.3945, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3497 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.31% (0.3516 => 0.3984, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.28% (0.3561 => 0.4034, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.24% (0.3543 => 0.4012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.86% (0.3694 => 0.4169, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3828 => 0.4309, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3927 => 0.4409, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.20% (0.3886 => 0.4360, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.91% (1.1194 => 1.2415, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.03% (1.7609 => 1.9375, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 9.43% (0.1622 => 0.1775, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 9.08% (0.1432 => 0.1562, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.84% (2.2022 => 2.3968, std. dev.: 0.0119) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5925 => 0.6410, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std. dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 7.37% (0.7326 => 0.7866, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.35% (0.1892 => 0.2031, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.07% (0.1584 => 0.1696, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.15% (0.4615 => 0.4899, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 6.14% (0.1695 => 0.1799, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 6.09% (0.3282 => 0.3482, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.77% (0.2271 => 0.2402, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.74% (7.0540 => 7.4590, std. dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.72% (0.3307 => 0.3496, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.70% (0.8172 => 0.8638, std. dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: 5.56% (10.4361 => 11.0168, std. dev.: 0.0383) MultiSource/Applications/lambda-0_1_3/lambda: 5.53% (0.7433 => 0.7844, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.4879 => 0.5148, std. dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.51% (0.2107 => 0.2223, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 5.29% (0.2554 => 0.2689, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.20% (9.4845 => 9.9777, std. dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.09% (4.9449 => 5.1968, std. dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.06% (5.0018 => 5.2549, std. dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.93% (0.3121 => 0.3275, std. dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.93% (4.2646 => 4.4749, std. dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 4.86% (0.3109 => 0.3260, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.79% (0.5569 => 0.5836, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.66% (0.5860 => 0.6133, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 4.65% (0.4299 => 0.4499, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.60% (8.1363 => 8.5104, std. dev.: 0.0082) SingleSource/Regression/C++/ofstream_ctor: 4.51% (0.2905 => 0.3036, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.50% (1.3050 => 1.3637, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.44% (0.4636 => 0.4842, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.44% (0.7835 => 0.8183, std. dev.: 0.0101) MultiSource/Benchmarks/McCat/18-imp/imp: 4.44% (0.3423 => 0.3575, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.37% (0.3180 => 0.3319, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.32% (5.7591 => 6.0077, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.30% (0.2700 => 0.2816, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.18% (0.9765 => 1.0173, std. dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.08% (1.1861 => 1.2345, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.05% (1.5415 => 1.6039, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.02% (0.8067 => 0.8391, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.92% (0.3441 => 0.3576, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.92% (0.6450 => 0.6703, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.90% (0.4103 => 0.4263, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.5105 => 0.5303, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.87% (0.2891 => 0.3003, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3098 => 0.3218, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.85% (0.2756 => 0.2862, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 3.84% (1.5603 => 1.6202, std. dev.: 0.0118) MultiSource/Applications/Burg/burg: 3.76% (1.1642 => 1.2080, std. dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/except: 3.76% (0.2871 => 0.2979, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.71% (0.4289 => 0.4448, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.70% (0.3650 => 0.3785, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.69% (0.2872 => 0.2978, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.67% (0.3865 => 0.4007, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.66% (0.3387 => 0.3511, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.3092 => 0.3205, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.64% (0.6675 => 0.6918, std. dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.63% (2.0273 => 2.1009, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 3.62% (3.3354 => 3.4561, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.61% (0.3826 => 0.3964, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.60% (2.0665 => 2.1408, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 3.57% (0.2831 => 0.2932, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.51% (0.3136 => 0.3246, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 3.51% (0.3052 => 0.3159, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.47% (0.3603 => 0.3728, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.45% (0.3422 => 0.3540, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.45% (0.3162 => 0.3271, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.5981 => 0.6187, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 3.43% (0.3232 => 0.3343, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.42% (0.6456 => 0.6677, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 3.38% (0.3283 => 0.3394, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.4064 => 0.4200, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3935 => 0.4066, std. dev.: 0.0014) MultiSource/Applications/lua/lua: 3.32% (3.8723 => 4.0010, std. dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.32% (1.4186 => 1.4657, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.4203 => 0.4339, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (14.3668 => 14.8305, std. dev.: 0.0168) MultiSource/Applications/hexxagon/hexxagon: 3.16% (1.2842 => 1.3248, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4620 => 0.4763, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 3.06% (0.8921 => 0.9194, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 2.90% (2.2969 => 2.3634, std. dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 2.89% (0.4048 => 0.4165, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.81% (0.5020 => 0.5161, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.57% (17.1811 => 17.6235, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.56% (1.5859 => 1.6265, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (2.2024 => 2.2563, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 2.37% (1.1840 => 1.2121, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: 2.36% (0.7115 => 0.7283, std. dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.85% (1.0722 => 1.0920, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.67% (21.9371 => 22.3031, std. dev.: 0.0305) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.64% (7.9617 => 8.0924, std. dev.: 0.0192) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9580, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.99% (4.2280 => 4.4389, std. dev.: 0.0108) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (3.6395 => 3.7519, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.03% (1.3045 => 1.3310, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 1.74% (3.2827 => 3.3397, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.71% (26.0924 => 26.5396, std. dev.: 0.0275) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.48% (1.5086 => 1.5309, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7986, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2312, std. dev.: 0.0420) SingleSource/Benchmarks/Shootout-C++/hash2: 1.23% (3.1578 => 3.1965, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (2.6546 => 2.6815, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.13% (6.6874 => 0.1251, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -80.42% (0.8651 => 0.1694, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.79% (5.2763 => 3.1766, std. dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.03% (5.3855 => 3.7146, std. dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7114, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1693, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.49% (2.9384 => 2.5421, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -7.50% (22.1758 => 20.5122, std. dev.: 0.0608) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.58% (1.2373 => 1.0940, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4675, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.29% (1.5373 => 1.4406, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: -6.12% (1.1396 => 1.0698, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.07% (2.7294 => 2.5638, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8049, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std. dev.: 0.0017) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4764, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (8.6802 => 8.4266, std. dev.: 0.0120) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0029, std. dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9634, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4808 => 0.4702, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (12.5348 => 12.3330, std. dev.: 0.0067) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4237, std. dev.: 0.0067) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.11% (1.8329 => 1.8125, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std. dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.6805 => 1.6636, std. dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 16:22:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 18:22:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120829232244.0995F2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3313?compare_to=3310&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3313, Order: 162868, Start Time: 2012-08-29 22:12:51, End Time: 2012-08-29 23:23:46 To: 3310, Order: 162852, Start Time: 2012-08-29 20:45:19, End Time: 2012-08-29 21:57:20 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 31 (33 on baseline) Performance Improvements: 22 (33 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 836 (823 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.25% (0.0685 => 0.0810, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: 3.94% (8.8715 => 9.2206, std. dev.: 0.0611) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.70% (0.0718 => 0.0881, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 21.99% (3.4656 => 4.2276, std. dev.: 0.0120) SingleSource/Benchmarks/McGill/misr: 19.99% (0.4037 => 0.4844, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 12.94% (4.0400 => 4.5628, std. dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 12.52% (6.9252 => 7.7920, std. dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/sieve: 12.05% (3.4518 => 3.8679, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 10.66% (1.2805 => 1.4170, std. dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 9.48% (0.1508 => 0.1651, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 8.99% (21.8209 => 23.7829, std. dev.: 0.1711) SingleSource/Benchmarks/Shootout-C++/fibo: 7.22% (4.1131 => 4.4100, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 6.68% (1.0169 => 1.0848, std. dev.: 0.0106) MultiSource/Benchmarks/FreeBench/distray/distray: 5.38% (0.2474 => 0.2607, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.16% (3.6745 => 3.8273, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.97% (3.4071 => 3.5424, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.75% (0.5554 => 0.5762, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (4.3287 => 4.4896, std. dev.: 0.0156) SingleSource/Benchmarks/Shootout/lists: 3.71% (7.0001 => 7.2597, std. dev.: 0.0389) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (41.4762 => 42.9798, std. dev.: 0.3237) SingleSource/Benchmarks/Misc/ReedSolomon: 3.12% (8.5669 => 8.8345, std. dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 3.01% (0.3787 => 0.3901, std. dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.01% (8.2081 => 8.4549, std. dev.: 0.0247) MultiSource/Applications/aha/aha: 2.75% (3.3918 => 3.4851, std. dev.: 0.0113) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.60% (0.3886 => 0.3987, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.87% (1.0818 => 1.1020, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.74% (5.2140 => 5.3047, std. dev.: 0.0284) SingleSource/Benchmarks/Dhrystone/fldry: 1.70% (2.4890 => 2.5312, std. dev.: 0.0071) MultiSource/Benchmarks/Olden/em3d/em3d: 1.15% (4.6618 => 4.7155, std. dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.01% (6.6389 => 6.7060, std. dev.: 0.0086) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.00% (2.9142 => 2.9434, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/pi: -45.91% (2.8529 => 1.5430, std. dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.88% (5.3039 => 4.0902, std. dev.: 0.1032) SingleSource/Benchmarks/BenchmarkGame/recursive: -20.56% (2.9673 => 2.3573, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: -12.38% (3.7176 => 3.2574, std. dev.: 0.1584) MultiSource/Benchmarks/SciMark2-C/scimark2: -11.33% (29.1896 => 25.8817, std. dev.: 0.1272) MultiSource/Benchmarks/mafft/pairlocalalign: -10.85% (64.8618 => 57.8258, std. dev.: 0.0906) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.46% (3.2067 => 2.9355, std. dev.: 0.0169) SingleSource/Benchmarks/Stanford/FloatMM: -7.79% (0.8891 => 0.8198, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: -6.85% (1.8527 => 1.7258, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: -6.56% (9.2652 => 8.6574, std. dev.: 0.1026) MultiSource/Benchmarks/FreeBench/mason/mason: -4.66% (0.5155 => 0.4915, std. dev.: 0.0043) MultiSource/Applications/siod/siod: -4.42% (3.7184 => 3.5540, std. dev.: 0.0216) SingleSource/Benchmarks/Shootout/methcall: -3.87% (9.5512 => 9.1812, std. dev.: 0.0296) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.75% (1.7320 => 1.6670, std. dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.14% (3.7627 => 3.6446, std. dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.74% (1.2637 => 1.2291, std. dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.47% (1.0665 => 1.0508, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.0342 => 24.7067, std. dev.: 0.0251) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.24% (2.0159 => 1.9910, std. dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.14% (6.7646 => 6.6875, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.09% (15.9834 => 15.8095, std. dev.: 0.0361) MultiSource/Benchmarks/Olden/tsp/tsp: -1.08% (1.7316 => 1.7129, std. dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.48% (8.9977 => 9.2206, std. dev.: 0.0611) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.25% (1.3935 => 1.4109, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0120) SingleSource/Benchmarks/Stanford/Puzzle: 15.21% (0.1433 => 0.1651, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.01% (0.0766 => 0.0881, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 14.92% (0.3746 => 0.4305, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std. dev.: 0.0346) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.78% (4.0101 => 4.5628, std. dev.: 0.0063) SingleSource/Benchmarks/McGill/misr: 12.76% (0.4296 => 0.4844, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 12.42% (3.4406 => 3.8679, std. dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: 12.33% (21.1721 => 23.7829, std. dev.: 0.1711) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.90% (2.4042 => 2.6663, std. dev.: 0.0875) SingleSource/Benchmarks/Shootout/methcall: 7.30% (8.5566 => 9.1812, std. dev.: 0.0296) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.57% (4.2129 => 4.4896, std. dev.: 0.0156) SingleSource/Benchmarks/McGill/chomp: 6.42% (1.0194 => 1.0848, std. dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.18% (40.4792 => 42.9798, std. dev.: 0.3237) SingleSource/Benchmarks/McGill/queens: 6.13% (1.6261 => 1.7258, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (0.3301 => 0.3496, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: 4.92% (2.3453 => 2.4606, std. dev.: 0.0128) SingleSource/Benchmarks/Misc/dt: 4.00% (0.9851 => 1.0245, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.94% (3.4080 => 3.5424, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 3.84% (15.2242 => 15.8095, std. dev.: 0.0361) SingleSource/Benchmarks/Misc/ReedSolomon: 3.80% (8.5113 => 8.8345, std. dev.: 0.0161) SingleSource/Benchmarks/Shootout/lists: 3.67% (7.0025 => 7.2597, std. dev.: 0.0389) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.46% (0.8498 => 0.8792, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.84% (2.6656 => 2.7414, std. dev.: 0.0199) MultiSource/Benchmarks/BitBench/five11/five11: 2.14% (5.1938 => 5.3047, std. dev.: 0.0284) MultiSource/Applications/aha/aha: 1.65% (3.4286 => 3.4851, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/em3d/em3d: 1.60% (4.6414 => 4.7155, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 1.41% (7.6833 => 7.7920, std. dev.: 0.0346) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5312, std. dev.: 0.0071) MultiSource/Applications/lua/lua: 1.36% (29.5232 => 29.9245, std. dev.: 0.1024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.66% (14.6079 => 14.3655, std. dev.: 0.0744) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.64% (0.3497 => 0.2041, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.34% (5.2665 => 4.0902, std. dev.: 0.1032) MultiSource/Benchmarks/Ptrdist/ks/ks: -18.36% (1.4034 => 1.1458, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1594, std. dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.29% (3.2007 => 2.9355, std. dev.: 0.0169) MultiSource/Benchmarks/mafft/pairlocalalign: -7.35% (62.4126 => 57.8258, std. dev.: 0.0906) SingleSource/Benchmarks/Misc/pi: -6.70% (1.6538 => 1.5430, std. dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: -6.62% (3.4230 => 3.1965, std. dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/methcall: -6.41% (9.2503 => 8.6574, std. dev.: 0.1026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.38% (1.1647 => 1.1020, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4100, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.75% (27.1724 => 25.8817, std. dev.: 0.1272) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.98% (1.7361 => 1.6670, std. dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.74% (25.6658 => 24.7067, std. dev.: 0.0251) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.4140 => 0.3987, std. dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.61% (2.4457 => 2.3573, std. dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.39% (1.2722 => 1.2291, std. dev.: 0.0125) MultiSource/Applications/spiff/spiff: -2.93% (2.8599 => 2.7762, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.89% (3.9413 => 3.8273, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.80% (3.7496 => 3.6446, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.77% (1.1683 => 1.1359, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std. dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.60% (61.1734 => 59.5830, std. dev.: 0.1850) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.88% (1.8739 => 1.8387, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/richards_benchmark: -1.88% (1.4441 => 1.4170, std. dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2366, std. dev.: 0.0551) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -1.32% (3.8200 => 3.7695, std. dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: -1.16% (1.7330 => 1.7129, std. dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 17:08:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 19:08:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120830000816.F0E692A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3314?compare_to=3311&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 3314, Order: 162869, Start Time: 2012-08-29 22:54:48, End Time: 2012-08-30 00:09:17 To: 3311, Order: 162856, Start Time: 2012-08-29 21:12:25, End Time: 2012-08-29 22:27:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (164 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 966 (703 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.81% (56.5482 => 55.5242, std. dev.: 0.3829) SingleSource/Benchmarks/Misc/fbench: -1.39% (2.2881 => 2.2562, std. dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.40% (2.0176 => 2.3283, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/flops: 13.08% (0.0826 => 0.0934, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.26% (0.5818 => 0.6473, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.20% (0.7061 => 0.7852, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.06% (0.5748 => 0.6384, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.82% (0.3578 => 0.3965, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3601 => 0.3981, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3646 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.51% (0.3663 => 0.4048, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.46% (0.3623 => 0.4002, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3650 => 0.4031, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 10.35% (0.3914 => 0.4319, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.32% (0.3789 => 0.4180, std. dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.26% (0.1072 => 0.1182, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.19% (0.4003 => 0.4411, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 10.00% (0.3940 => 0.4334, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.65% (0.3130 => 0.3432, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.13% (0.2596 => 0.2833, std. dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.06% (0.1413 => 0.1541, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.75% (3.9660 => 4.3132, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 8.74% (1.3693 => 1.4890, std. dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.69% (0.1819 => 0.1977, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.65% (0.7038 => 0.7647, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.65% (0.7710 => 0.8377, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.64% (0.5265 => 0.5720, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 8.39% (0.4328 => 0.4691, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2781 => 0.3002, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.93% (0.6959 => 0.7511, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.63% (0.4379 => 0.4713, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.61% (0.4062 => 0.4371, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.59% (1.2193 => 1.3118, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2782 => 0.2993, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.57% (0.2721 => 0.2927, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.56% (0.9199 => 0.9894, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4390 => 0.4715, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.37% (0.1588 => 0.1705, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.34% (0.3899 => 0.4185, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.33% (0.2127 => 0.2283, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.31% (0.2628 => 0.2820, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.26% (0.2726 => 0.2924, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3022 => 0.3240, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.20% (0.3485 => 0.3736, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2765 => 0.2964, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2690 => 0.2883, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.17% (0.2607 => 0.2794, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2760 => 0.2957, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (0.2655 => 0.2844, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.11% (0.3489 => 0.3737, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.3580 => 0.3834, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.2966 => 0.3176, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.06% (0.5577 => 0.5971, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.06% (1.9828 => 2.1227, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.05% (0.2937 => 0.3144, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.03% (0.2761 => 0.2955, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3107 => 0.3325, std. dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.93% (0.3246 => 0.3471, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3149 => 0.3367, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.90% (13.8202 => 14.7738, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.90% (0.2696 => 0.2882, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.90% (0.2914 => 0.3115, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.89% (0.2988 => 0.3194, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.87% (1.1364 => 1.2145, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.87% (0.2023 => 0.2162, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.85% (1.4563 => 1.5561, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 6.73% (0.1589 => 0.1696, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.64% (0.3192 => 0.3404, std. dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.63% (0.7506 => 0.8004, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 6.60% (0.2243 => 0.2391, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.58% (7.2180 => 7.6931, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 6.53% (0.2925 => 0.3116, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3453 => 0.3678, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.51% (0.5637 => 0.6004, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.41% (1.1061 => 1.1770, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.39% (0.3756 => 0.3996, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.35% (0.3293 => 0.3502, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.32% (0.4016 => 0.4270, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.28% (0.1657 => 0.1761, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.25% (0.3534 => 0.3755, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.24% (3.8646 => 4.1058, std. dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.22% (0.7460 => 0.7924, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.14% (0.2995 => 0.3179, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.10% (0.3868 => 0.4104, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.3245 => 1.4051, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.00% (1.9270 => 2.0426, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 5.98% (0.8310 => 0.8807, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.87% (1.0594 => 1.1216, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 5.86% (1.2292 => 1.3012, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.2945 => 0.3116, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 5.79% (0.4113 => 0.4351, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 5.77% (2.1791 => 2.3049, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 5.75% (0.3220 => 0.3405, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.75% (3.6692 => 3.8800, std. dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.70% (1.3813 => 1.4600, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.59% (1.3819 => 1.4591, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.54% (4.3801 => 4.6226, std. dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.47% (0.2140 => 0.2257, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.46% (0.6135 => 0.6470, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.44% (4.4433 => 4.6852, std. dev.: 0.0099) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.37% (13.2842 => 13.9975, std. dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 5.29% (16.6129 => 17.4924, std. dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.28% (0.6283 => 0.6615, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.14% (0.3755 => 0.3948, std. dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.96% (14.8535 => 15.5908, std. dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.94% (0.8818 => 0.9254, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.90% (1.1333 => 1.1888, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.68% (0.2243 => 0.2348, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.61% (0.2321 => 0.2428, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 4.54% (8.4961 => 8.8820, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 4.53% (3.1889 => 3.3334, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 4.51% (0.2859 => 0.2988, std. dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 4.47% (0.3131 => 0.3271, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.47% (0.3245 => 0.3390, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.40% (0.8698 => 0.9081, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.23% (6.5754 => 6.8538, std. dev.: 0.0132) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (4.9865 => 5.1951, std. dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.12% (3.2742 => 3.4092, std. dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 3.95% (4.6629 => 4.8472, std. dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 3.91% (14.5298 => 15.0973, std. dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.79% (1.5188 => 1.5764, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 3.51% (16.2614 => 16.8319, std. dev.: 0.0177) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.27% (0.9108 => 0.9406, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.27% (2.1007 => 2.1693, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.12% (0.6250 => 0.6445, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.98% (0.6744 => 0.6945, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.97% (3.7467 => 3.8579, std. dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.94% (6.2785 => 6.4629, std. dev.: 0.0061) MultiSource/Applications/lemon/lemon: 2.82% (1.0313 => 1.0604, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.60% (0.4805 => 0.4930, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.24% (33.2944 => 34.0411, std. dev.: 0.0180) MultiSource/Applications/SIBsim4/SIBsim4: 1.65% (1.2749 => 1.2959, std. dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5205, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2562, std. dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 9.19% (1.2998 => 1.4192, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.84% (1.5824 => 1.6590, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.27% (11.2619 => 11.7429, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (1.7081 => 1.7771, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.59% (2.8606 => 2.9632, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9873, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 2.42% (12.0921 => 12.3847, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4271 => 7.5980, std. dev.: 0.0123) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9933, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/siod/siod: 2.05% (3.2729 => 3.3401, std. dev.: 0.0055) MultiSource/Applications/lemon/lemon: 1.90% (1.4298 => 1.4569, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std. dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.28% (1.0895 => 1.1034, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.10% (5.5130 => 5.5735, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.02% (4.5928 => 4.6395, std. dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.16% (22.5627 => 21.3980, std. dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0972, std. dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.01% (1.0460 => 0.9518, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3139 => 0.3005, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.25% (1.3780 => 1.3194, std. dev.: 0.0046) MultiSource/Benchmarks/sim/sim: -4.21% (5.0168 => 4.8055, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.02% (6.2497 => 5.9986, std. dev.: 0.0001) MultiSource/Applications/aha/aha: -4.01% (3.1476 => 3.0214, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -3.20% (1.1560 => 1.1190, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.76% (4.5947 => 4.4680, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5995, std. dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std. dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (0.8342 => 0.8166, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2238, std. dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.89% (5.3167 => 5.2162, std. dev.: 0.0076) MultiSource/Applications/spiff/spiff: -1.80% (3.0263 => 2.9717, std. dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2035, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.65% (7.1097 => 6.9927, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (9.9194 => 9.7912, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8680, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std. dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (84.4286 => 83.4236, std. dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.13% (20.3410 => 20.1120, std. dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.08% (5.5401 => 5.4803, std. dev.: 0.0174) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2370, std. dev.: 0.0319) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.05% (6.6320 => 6.5624, std. dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 17:24:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 19:24:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120830002409.1D6382A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3315?compare_to=3312&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 3315, Order: 162870, Start Time: 2012-08-29 23:05:35, End Time: 2012-08-30 00:25:10 To: 3312, Order: 162856, Start Time: 2012-08-29 21:17:46, End Time: 2012-08-29 22:37:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (135 on baseline) Performance Improvements: 1 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 947 (716 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.25% (13.6473 => 13.2039, std. dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.36% (10.3673 => 13.2039, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 14.66% (0.3473 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.25% (0.3543 => 0.4048, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.21% (0.3497 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.17% (0.3543 => 0.4045, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3516 => 0.4011, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3561 => 0.4059, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.59% (0.3694 => 0.4196, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.32% (0.3828 => 0.4338, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 13.17% (0.3927 => 0.4444, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.92% (0.3886 => 0.4388, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.38% (1.1194 => 1.2468, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.82% (1.7609 => 1.9514, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 9.50% (0.1432 => 0.1568, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.40% (2.2022 => 2.4092, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (0.1622 => 0.1772, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.22% (0.1117 => 0.1220, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.93% (0.6030 => 0.6508, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5925 => 0.6393, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.88% (0.1892 => 0.2041, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.64% (0.1584 => 0.1705, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.08% (0.3177 => 0.3402, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 6.72% (0.7326 => 0.7818, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.61% (0.4615 => 0.4920, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.3282 => 0.3496, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 6.47% (0.1655 => 0.1762, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.15% (0.4879 => 0.5179, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.95% (7.0540 => 7.4736, std. dev.: 0.0141) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.90% (0.2271 => 0.2405, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.87% (0.3307 => 0.3501, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.84% (0.2107 => 0.2230, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.82% (4.9449 => 5.2327, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 5.76% (10.4361 => 11.0370, std. dev.: 0.0144) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (0.8172 => 0.8640, std. dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 5.64% (9.4845 => 10.0199, std. dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: 5.60% (0.2554 => 0.2697, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.57% (0.7433 => 0.7847, std. dev.: 0.0112) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.43% (5.0018 => 5.2734, std. dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.36% (0.1940 => 0.2044, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.35% (0.4299 => 0.4529, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.26% (0.5569 => 0.5862, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.20% (4.2646 => 4.4862, std. dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.19% (0.3121 => 0.3283, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 5.15% (0.3109 => 0.3269, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 5.14% (0.3423 => 0.3599, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.14% (0.5860 => 0.6161, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (8.1363 => 8.5389, std. dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.94% (1.3050 => 1.3695, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.70% (0.2700 => 0.2827, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.68% (0.7835 => 0.8202, std. dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 4.68% (5.7591 => 6.0287, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.5415 => 1.6136, std. dev.: 0.0120) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.3180 => 0.3328, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3441 => 0.3601, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.64% (0.2758 => 0.2886, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.50% (0.8067 => 0.8430, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.44% (0.9765 => 1.0199, std. dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.43% (1.1861 => 1.2387, std. dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 4.40% (0.3092 => 0.3228, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.31% (0.4636 => 0.4836, std. dev.: 0.0015) MultiSource/Applications/Burg/burg: 4.24% (1.1642 => 1.2136, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 4.22% (1.5603 => 1.6261, std. dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.22% (0.6450 => 0.6722, std. dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 4.20% (0.2905 => 0.3027, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (0.2756 => 0.2869, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.08% (0.2891 => 0.3009, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.05% (0.3650 => 0.3798, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.04% (0.2872 => 0.2988, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.02% (0.4103 => 0.4268, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 3.97% (0.3098 => 0.3221, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.96% (0.4289 => 0.4459, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.94% (2.0273 => 2.1072, std. dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 3.93% (0.3387 => 0.3520, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 3.91% (3.3354 => 3.4658, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3865 => 0.4016, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 3.89% (0.2877 => 0.2989, std. dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.88% (0.6675 => 0.6934, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.5105 => 0.5303, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.87% (0.2871 => 0.2982, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 3.85% (0.2725 => 0.2830, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 3.83% (0.3422 => 0.3553, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.83% (0.3136 => 0.3256, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.81% (0.3232 => 0.3355, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.79% (2.0665 => 2.1448, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 3.77% (0.3052 => 0.3167, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.75% (0.3603 => 0.3738, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.73% (0.5981 => 0.6204, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.71% (0.3826 => 0.3968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.2831 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.70% (0.6456 => 0.6695, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.69% (0.4064 => 0.4214, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 3.68% (3.8723 => 4.0147, std. dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.65% (0.2793 => 0.2895, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3935 => 0.4078, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.57% (1.4186 => 1.4693, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.57% (14.3668 => 14.8798, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists1: 3.50% (0.3684 => 0.3813, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.47% (0.4203 => 0.4349, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 3.44% (0.3283 => 0.3396, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 3.42% (0.8921 => 0.9226, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.42% (0.3162 => 0.3270, std. dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.39% (1.2842 => 1.3277, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (0.4620 => 0.4774, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.27% (2.2969 => 2.3719, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 3.11% (0.4048 => 0.4174, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 3.05% (0.3379 => 0.3482, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.01% (1.5859 => 1.6336, std. dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.01% (0.3427 => 0.3530, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.95% (0.5020 => 0.5168, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.73% (17.1811 => 17.6496, std. dev.: 0.0197) MultiSource/Applications/minisat/minisat: 2.63% (0.7115 => 0.7302, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 2.63% (1.1840 => 1.2151, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.60% (2.2024 => 2.2596, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 2.30% (1.0722 => 1.0969, std. dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.28% (7.9617 => 8.1431, std. dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 1.74% (21.9371 => 22.3189, std. dev.: 0.0288) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.68% (0.8101 => 0.8237, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.46% (2.6778 => 2.9578, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.34% (0.8614 => 0.9505, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (4.2280 => 4.4575, std. dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7546, std. dev.: 0.0019) MultiSource/Applications/siod/siod: 1.76% (3.2827 => 3.3405, std. dev.: 0.0059) MultiSource/Applications/lua/lua: 1.66% (26.0924 => 26.5261, std. dev.: 0.0195) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (1.5086 => 1.5316, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std. dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std. dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 1.13% (3.1578 => 3.1935, std. dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2145, std. dev.: 0.0338) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.06% (2.6546 => 2.6828, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.12% (6.6874 => 0.1258, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.31% (0.8651 => 0.1703, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.48% (5.2763 => 3.1934, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.83% (5.3855 => 3.7249, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.26% (5.3526 => 3.7331, std. dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1833, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.31% (2.9384 => 2.5472, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -7.27% (22.1758 => 20.5638, std. dev.: 0.0288) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -11.05% (1.2373 => 1.1006, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.20% (4.8142 => 4.4677, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -6.28% (1.5373 => 1.4408, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -6.07% (1.1396 => 1.0704, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.07% (2.7294 => 2.5638, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-5: -5.14% (1.5835 => 1.5021, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.82% (5.0483 => 4.8052, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std. dev.: 0.0000) MultiSource/Applications/aha/aha: -3.44% (3.1595 => 3.0508, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4731, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.6802 => 8.4369, std. dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.67% (10.2830 => 10.0087, std. dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (8.1563 => 7.9621, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.60% (12.5348 => 12.3341, std. dev.: 0.0095) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4236, std. dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.04% (1.8329 => 1.8138, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std. dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (1.6805 => 1.6633, std. dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 17:37:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 19:37:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120830003734.9AC812A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3316?compare_to=3306&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 3316, Order: 162859, Start Time: 2012-08-29 21:55:16, End Time: 2012-08-30 00:38:35 To: 3306, Order: 162807, Start Time: 2012-08-29 00:44:20, End Time: 2012-08-29 03:27:58 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 11 (122 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 957 (770 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (2.1897 => 2.2219, std. dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.44% (2.0757 => 2.1056, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.43% (1.3943 => 1.4143, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 1.36% (2.2457 => 2.2762, std. dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 1.32% (4.7947 => 4.8578, std. dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (2.8598 => 2.8955, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.22% (3.7856 => 3.8317, std. dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 1.17% (4.4283 => 4.4803, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.09% (1.7230 => 1.7418, std. dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.05% (1.1345 => 1.1464, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (4.5929 => 4.6397, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 14.48% (0.3460 => 0.3961, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.48% (0.3488 => 0.3993, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 14.47% (0.3442 => 0.3940, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.45% (0.3446 => 0.3944, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.45% (0.3496 => 0.4001, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.43% (0.3465 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.30% (0.3469 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.89% (0.3650 => 0.4157, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.75% (0.3643 => 0.4144, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.64% (0.3724 => 0.4232, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1063 => 0.1167, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.75% (0.5826 => 0.6336, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.5889 => 0.6396, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1620 => 0.1756, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.12% (1.5932 => 1.7226, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (3.5627 => 3.8317, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.53% (1.3152 => 1.4143, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (1.6211 => 1.7418, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 6.97% (0.7171 => 0.7671, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.77% (0.4994 => 0.5332, std. dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.2014 => 0.2150, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.74% (0.4361 => 0.4655, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.48% (0.5000 => 0.5324, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.46% (0.3930 => 0.4184, std. dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 6.40% (4.2109 => 4.4803, std. dev.: 0.0086) MultiSource/Applications/d/make_dparser: 6.34% (1.0781 => 1.1464, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (0.5026 => 0.5341, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.15% (0.1968 => 0.2089, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.09% (2.7292 => 2.8955, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.08% (0.4029 => 0.4274, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.5900 => 0.6254, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.77% (0.2875 => 0.3041, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.74% (2.1013 => 2.2219, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.55% (0.2866 => 0.3025, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 5.49% (5.5417 => 5.8458, std. dev.: 0.0096) MultiSource/Benchmarks/nbench/nbench: 5.46% (0.2566 => 0.2706, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.41% (0.2736 => 0.2884, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.31% (0.2714 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.30% (0.3890 => 0.4096, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.28% (0.2725 => 0.2869, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.25% (0.2040 => 0.2147, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.22% (1.9694 => 2.0723, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.2823 => 0.2970, std. dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.20% (4.6177 => 4.8578, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2803 => 0.2948, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.15% (1.9966 => 2.0995, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.12% (2.1653 => 2.2762, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.05% (0.4658 => 0.4893, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.00% (0.2738 => 0.2875, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (4.4195 => 4.6397, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 4.95% (0.2750 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.95% (0.3195 => 0.3353, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.91% (0.2792 => 0.2929, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.87% (0.2729 => 0.2862, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 4.83% (0.3004 => 0.3149, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2780 => 0.2914, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.81% (0.9909 => 1.0386, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 4.76% (0.2813 => 0.2947, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.71% (0.3903 => 0.4087, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.71% (2.0673 => 2.1646, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 4.70% (0.2811 => 0.2943, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 4.68% (0.3096 => 0.3241, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.63% (0.3258 => 0.3409, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.57% (0.2911 => 0.3044, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 4.54% (0.6634 => 0.6935, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 4.53% (1.8794 => 1.9646, std. dev.: 0.0030) MultiSource/Applications/treecc/treecc: 4.52% (0.7875 => 0.8231, std. dev.: 0.0016) MultiSource/Applications/lua/lua: 4.51% (1.4269 => 1.4912, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.44% (0.3060 => 0.3196, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.42% (0.3124 => 0.3262, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3267 => 0.3411, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.40% (0.4139 => 0.4321, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.37% (0.3317 => 0.3462, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.32% (0.3678 => 0.3837, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.32% (0.3726 => 0.3887, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.31% (0.3362 => 0.3507, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 4.30% (0.3348 => 0.3492, std. dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 4.27% (0.2691 => 0.2806, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.24% (0.3282 => 0.3421, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.23% (0.3477 => 0.3624, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.19% (0.3625 => 0.3777, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.17% (0.5546 => 0.5777, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4146 => 0.4313, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.96% (0.3690 => 0.3836, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.93% (0.9697 => 1.0078, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 3.93% (0.4251 => 0.4418, std. dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.90% (23.5202 => 24.4386, std. dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.89% (0.3981 => 0.4136, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.87% (0.2969 => 0.3084, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.72% (0.3845 => 0.3988, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.66% (0.3084 => 0.3197, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.60% (0.3336 => 0.3456, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.49% (2.0346 => 2.1056, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 3.29% (0.5012 => 0.5177, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.6435 => 0.6646, std. dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 3.09% (0.4847 => 0.4997, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.13% (0.5361 => 0.5475, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (0.7426 => 0.7576, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6688, std. dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1715, std. dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6470, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2093, std. dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5028, std. dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (41.7953 => 42.4579, std. dev.: 0.0146) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std. dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5712, std. dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.11% (2.4764 => 2.3745, std. dev.: 0.0333) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5624, std. dev.: 0.0167) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7926, std. dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.74% (0.2402 => 0.2240, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8003, std. dev.: 0.0146) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std. dev.: 0.0056) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8294, std. dev.: 0.0782) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.45% (16.2163 => 15.9810, std. dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5003, std. dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std. dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 17:49:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 19:49:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120830004913.8D93F2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3317?compare_to=3313&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3317, Order: 162874, Start Time: 2012-08-29 23:39:14, End Time: 2012-08-30 00:50:15 To: 3313, Order: 162868, Start Time: 2012-08-29 22:12:51, End Time: 2012-08-29 23:23:46 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 5 (35 on baseline) Performance Improvements: 3 (34 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 881 (820 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 7.65% (0.1608 => 0.1731, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.97% (7.1594 => 7.3004, std. dev.: 0.0163) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.54% (4.6736 => 4.7456, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.15% (1.6670 => 1.6862, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.10% (3.6446 => 3.6846, std. dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.10% (0.2045 => 0.1859, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.50% (0.2941 => 0.2838, std. dev.: 0.0030) MultiSource/Applications/spiff/spiff: -2.57% (0.7651 => 0.7454, std. dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2296, std. dev.: 0.0417) SingleSource/Benchmarks/Shootout/ary3: 16.17% (1.7426 => 2.0243, std. dev.: 0.0600) SingleSource/Benchmarks/Stanford/Puzzle: 15.98% (0.1433 => 0.1662, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.80% (0.0766 => 0.0887, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 14.98% (0.3746 => 0.4307, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: 13.66% (0.4296 => 0.4883, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.13% (4.0101 => 4.5367, std. dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/sieve: 13.01% (3.4406 => 3.8883, std. dev.: 0.0068) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.76% (0.0917 => 0.1034, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.84% (2.4042 => 2.6649, std. dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.09% (1.0063 => 1.0877, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout/methcall: 7.23% (8.5566 => 9.1754, std. dev.: 0.0476) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.57% (0.3301 => 0.3518, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 6.55% (1.0194 => 1.0862, std. dev.: 0.0094) SingleSource/Benchmarks/McGill/queens: 6.20% (1.6261 => 1.7269, std. dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.25% (40.4792 => 42.6032, std. dev.: 0.4414) SingleSource/Benchmarks/Misc/dt: 4.45% (0.9851 => 1.0289, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 4.40% (15.2242 => 15.8937, std. dev.: 0.0448) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 3.81% (8.5113 => 8.8353, std. dev.: 0.0121) SingleSource/Benchmarks/Shootout/lists: 3.79% (7.0025 => 7.2677, std. dev.: 0.0364) SingleSource/Benchmarks/Misc/whetstone: 3.42% (2.3453 => 2.4256, std. dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.16% (2.6656 => 2.7497, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.88% (4.6127 => 4.7456, std. dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.77% (0.5876 => 0.6039, std. dev.: 0.0032) MultiSource/Applications/lua/lua: 2.29% (29.5232 => 30.1981, std. dev.: 0.1065) MultiSource/Benchmarks/Bullet/bullet: 2.28% (6.9722 => 7.1312, std. dev.: 0.0487) MultiSource/Benchmarks/BitBench/five11/five11: 2.06% (5.1938 => 5.3007, std. dev.: 0.0282) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (7.6833 => 7.8150, std. dev.: 0.0116) MultiSource/Benchmarks/Olden/em3d/em3d: 1.65% (4.6414 => 4.7182, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (2.4971 => 2.5354, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 1.51% (2.5166 => 2.5546, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout/matrix: 1.47% (1.5605 => 1.5835, std. dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: 1.19% (1.4184 => 1.4353, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.67% (0.7738 => 0.7454, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.21% (0.9029 => 0.8739, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.32% (0.4880 => 0.4767, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -1.94% (14.6079 => 14.3244, std. dev.: 0.1035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.27% (4.2815 => 4.2272, std. dev.: 0.0166) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.04% (0.3497 => 0.2062, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.05% (5.2665 => 4.2107, std. dev.: 0.1501) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.71% (1.4034 => 1.1549, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: -10.53% (8.1594 => 7.3004, std. dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.08% (3.2007 => 2.9420, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.98% (3.6023 => 3.3149, std. dev.: 0.1080) MultiSource/Benchmarks/mafft/pairlocalalign: -7.13% (62.4126 => 57.9606, std. dev.: 0.1396) MultiSource/Applications/SIBsim4/SIBsim4: -6.77% (3.4230 => 3.1913, std. dev.: 0.0177) SingleSource/Benchmarks/Misc/pi: -6.32% (1.6538 => 1.5492, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -5.68% (9.2503 => 8.7250, std. dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.38% (1.1647 => 1.1020, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.90% (0.4140 => 0.3937, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: -4.78% (4.6355 => 4.4139, std. dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.52% (27.1724 => 25.9437, std. dev.: 0.0371) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.59% (25.6658 => 24.7452, std. dev.: 0.0746) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.46% (1.1683 => 1.1279, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.92% (2.4457 => 2.3742, std. dev.: 0.0200) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.87% (1.7361 => 1.6862, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.86% (3.9413 => 3.8287, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2891, std. dev.: 0.0079) MultiSource/Applications/spiff/spiff: -2.40% (2.8599 => 2.7914, std. dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: -1.94% (1.4441 => 1.4161, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.73% (3.7496 => 3.6846, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (9.3855 => 9.2499, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7664, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 19:15:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 21:15:53 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120830021553.C20CD2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/3318?compare_to=3317&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3318, Order: 162884, Start Time: 2012-08-30 01:06:11, End Time: 2012-08-30 02:16:55 To: 3317, Order: 162874, Start Time: 2012-08-29 23:39:14, End Time: 2012-08-30 00:50:15 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 22 (31 on baseline) Performance Improvements: 9 (32 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 858 (826 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.98% (0.1859 => 0.2026, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.98% (0.1270 => 0.1384, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.54% (0.7070 => 0.7674, std. dev.: 0.0175) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.87% (0.1924 => 0.2037, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.85% (0.2675 => 0.2778, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.51% (0.3105 => 0.3214, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.39% (3.8154 => 3.9066, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.33% (0.8739 => 0.8943, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.21% (0.7057 => 0.7213, std. dev.: 0.0057) MultiSource/Applications/hbd/hbd: 1.88% (1.3083 => 1.3329, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.47% (1.4041 => 1.4248, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.39% (1.2578 => 1.2753, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.34% (3.9902 => 4.0438, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.1736 => 1.1883, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (8.1835 => 8.2839, std. dev.: 0.0176) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.21% (1.1587 => 1.1727, std. dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (6.1981 => 6.2650, std. dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.03% (4.2175 => 4.2609, std. dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.50% (15.4501 => 18.1546, std. dev.: 0.3317) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.00% (0.3937 => 0.4055, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: 2.35% (2.4256 => 2.4827, std. dev.: 0.0177) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (3.1913 => 3.2297, std. dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.15% (15.4927 => 15.3145, std. dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: -6.56% (3.8883 => 3.6333, std. dev.: 0.0512) MultiSource/Benchmarks/FreeBench/distray/distray: -5.69% (0.2655 => 0.2504, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: -2.76% (1.7777 => 1.7287, std. dev.: 0.0074) MultiSource/Benchmarks/Olden/bisort/bisort: -1.91% (0.6707 => 0.6579, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: -1.90% (7.3004 => 7.1615, std. dev.: 0.0075) SingleSource/Benchmarks/Shootout/hash: -1.82% (4.3702 => 4.2908, std. dev.: 0.0244) SingleSource/Benchmarks/Shootout/ary3: -1.13% (2.0243 => 2.0014, std. dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: -1.02% (1.5835 => 1.5673, std. dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 15.14% (0.1433 => 0.1650, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0014, std. dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.68% (15.8312 => 18.1546, std. dev.: 0.3317) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.33% (4.0101 => 4.5446, std. dev.: 0.1187) SingleSource/Benchmarks/McGill/misr: 13.31% (0.4296 => 0.4868, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 13.05% (0.3746 => 0.4235, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.43% (0.0917 => 0.1031, std. dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.18% (2.4042 => 2.6731, std. dev.: 0.0301) SingleSource/Benchmarks/Shootout/methcall: 7.55% (8.5566 => 9.2027, std. dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.51% (0.3301 => 0.3516, std. dev.: 0.0052) SingleSource/Benchmarks/McGill/queens: 6.11% (1.6261 => 1.7254, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 5.86% (2.3453 => 2.4827, std. dev.: 0.0177) SingleSource/Benchmarks/McGill/chomp: 5.80% (1.0194 => 1.0785, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sieve: 5.60% (3.4406 => 3.6333, std. dev.: 0.0512) SingleSource/Benchmarks/Misc/fp-convert: 4.81% (15.2242 => 15.9569, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/dt: 4.23% (0.9851 => 1.0268, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.14% (0.8498 => 0.8850, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.09% (4.2129 => 4.3854, std. dev.: 0.0533) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.81% (2.6656 => 2.7671, std. dev.: 0.0137) SingleSource/Benchmarks/Shootout/lists: 3.77% (7.0025 => 7.2662, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/ReedSolomon: 3.74% (8.5113 => 8.8300, std. dev.: 0.0250) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.64% (3.4080 => 3.5320, std. dev.: 0.0047) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.85% (0.3508 => 0.3608, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.67% (0.5587 => 0.5736, std. dev.: 0.0051) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.6459 => 0.6579, std. dev.: 0.0039) MultiSource/Applications/lua/lua: 1.72% (29.5232 => 30.0312, std. dev.: 0.1643) MultiSource/Benchmarks/Olden/em3d/em3d: 1.62% (4.6414 => 4.7164, std. dev.: 0.0232) MultiSource/Applications/aha/aha: 1.53% (3.4286 => 3.4809, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5320, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 1.35% (7.6833 => 7.7871, std. dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.07% (14.6079 => 14.4509, std. dev.: 0.0511) MultiSource/Applications/lua/lua: -1.03% (3.5980 => 3.5611, std. dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.32% (0.3497 => 0.2122, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.26% (5.2665 => 4.0943, std. dev.: 0.0479) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.71% (1.4034 => 1.1549, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1615, std. dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.82% (3.2007 => 2.9505, std. dev.: 0.0649) MultiSource/Benchmarks/mafft/pairlocalalign: -7.27% (62.4126 => 57.8754, std. dev.: 0.2343) SingleSource/Benchmarks/Shootout-C++/methcall: -6.74% (9.2503 => 8.6264, std. dev.: 0.0808) SingleSource/Benchmarks/Misc/pi: -6.30% (1.6538 => 1.5496, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: -6.01% (0.2664 => 0.2504, std. dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: -5.65% (3.4230 => 3.2297, std. dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.21% (1.1647 => 1.1040, std. dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (27.1724 => 25.8293, std. dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4077, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.72% (2.4457 => 2.3302, std. dev.: 0.0421) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.80% (25.6658 => 24.6906, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.57% (1.7361 => 1.6741, std. dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.30% (3.7496 => 3.6258, std. dev.: 0.0333) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.12% (1.2722 => 1.2325, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.89% (3.9413 => 3.8272, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std. dev.: 0.0315) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.74% (1.1683 => 1.1363, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.28% (61.1734 => 59.7770, std. dev.: 0.5116) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.24% (1.0686 => 1.0447, std. dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -2.09% (1.0926 => 1.0698, std. dev.: 0.0032) MultiSource/Applications/spiff/spiff: -1.96% (2.8599 => 2.8038, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: -1.78% (1.4441 => 1.4184, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2308, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7653, std. dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Aug 29 20:42:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 29 Aug 2012 22:42:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120830034223.79C272A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3319?compare_to=3318&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3319, Order: 162887, Start Time: 2012-08-30 02:32:24, End Time: 2012-08-30 03:43:23 To: 3318, Order: 162884, Start Time: 2012-08-30 01:06:11, End Time: 2012-08-30 02:16:55 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== Performance Regressions: 13 (31 on baseline) Performance Improvements: 0 (29 on baseline) Existing Failures: 79 (79 on baseline) Unchanged Tests: 876 (829 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 32.05% (0.0312 => 0.0412, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 3.73% (0.2953 => 0.3063, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.02% (0.5667 => 0.5838, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.29% (0.5809 => 0.5942, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.70% (4.2316 => 4.3034, std. dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.43% (1.4063 => 1.4264, std. dev.: 0.0057) MultiSource/Applications/treecc/treecc: 1.36% (1.8682 => 1.8936, std. dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.30% (0.7744 => 0.7845, std. dev.: 0.0033) MultiSource/Applications/hbd/hbd: 1.25% (1.3329 => 1.3495, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.21% (3.5611 => 3.6041, std. dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 7.50% (1.7246 => 1.8540, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 6.74% (3.6333 => 3.8783, std. dev.: 0.0047) MultiSource/Benchmarks/FreeBench/distray/distray: 6.07% (0.2504 => 0.2656, std. dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.71% (1.3268 => 1.3495, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.33% (12.6413 => 12.8097, std. dev.: 0.0119) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.21% (1.5150 => 1.5333, std. dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.59% (0.0263 => 0.0375, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.80% (0.0766 => 0.0933, std. dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 15.42% (0.1433 => 0.1654, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9970, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 14.52% (0.3746 => 0.4290, std. dev.: 0.0091) SingleSource/Benchmarks/McGill/misr: 13.90% (0.4296 => 0.4893, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.48% (4.0101 => 4.5507, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/sieve: 12.72% (3.4406 => 3.8783, std. dev.: 0.0047) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.34% (0.0917 => 0.1021, std. dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.29% (2.4042 => 2.6757, std. dev.: 0.0271) SingleSource/Benchmarks/Shootout/methcall: 6.57% (8.5566 => 9.1189, std. dev.: 0.0352) SingleSource/Benchmarks/McGill/queens: 6.13% (1.6261 => 1.7258, std. dev.: 0.0116) SingleSource/Benchmarks/Misc/whetstone: 4.70% (2.3453 => 2.4555, std. dev.: 0.0416) SingleSource/Benchmarks/Misc/dt: 4.08% (0.9851 => 1.0253, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 3.95% (15.2242 => 15.8259, std. dev.: 0.0490) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.70% (3.4080 => 3.5342, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 3.65% (7.0025 => 7.2583, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.58% (0.5587 => 0.5787, std. dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.57% (0.8498 => 0.8716, std. dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.48% (0.5876 => 0.6022, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/five11/five11: 2.06% (5.1938 => 5.3006, std. dev.: 0.0158) MultiSource/Applications/aha/aha: 1.83% (3.4286 => 3.4914, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.64% (29.5232 => 30.0063, std. dev.: 0.1283) MultiSource/Benchmarks/Olden/em3d/em3d: 1.60% (4.6414 => 4.7156, std. dev.: 0.0154) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5321, std. dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.10% (6.9722 => 7.0492, std. dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.61% (0.3497 => 0.2042, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.41% (5.2665 => 4.0865, std. dev.: 0.0423) MultiSource/Benchmarks/Ptrdist/ks/ks: -17.71% (1.4034 => 1.1548, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1606, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.25% (3.2007 => 2.9366, std. dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: -7.39% (62.4126 => 57.7989, std. dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: -6.39% (3.4230 => 3.2043, std. dev.: 0.0704) SingleSource/Benchmarks/Misc/pi: -6.28% (1.6538 => 1.5500, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -5.99% (9.2503 => 8.6962, std. dev.: 0.0961) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.16% (1.1647 => 1.1046, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (4.6355 => 4.4059, std. dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.71% (27.1724 => 25.8932, std. dev.: 0.0274) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.27% (0.4564 => 0.4369, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.80% (25.6658 => 24.6896, std. dev.: 0.0292) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.04% (0.4140 => 0.4014, std. dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.94% (1.1683 => 1.1339, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.9413 => 3.8290, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/flops: -2.83% (9.5474 => 9.2774, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.82% (1.7361 => 1.6872, std. dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.79% (1.2722 => 1.2367, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.40% (1.0686 => 1.0430, std. dev.: 0.0048) MultiSource/Applications/spiff/spiff: -1.90% (2.8599 => 2.8055, std. dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2240, std. dev.: 0.0158) SingleSource/Benchmarks/Misc/richards_benchmark: -1.70% (1.4441 => 1.4195, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: -1.55% (1.7330 => 1.7061, std. dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0926 => 1.0763, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7665, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.06% (1.8739 => 1.8540, std. dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 30 13:07:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 30 Aug 2012 15:07:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120830200742.8C65B2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3320?compare_to=3319&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3320, Order: 162920, Start Time: 2012-08-30 18:57:49, End Time: 2012-08-30 20:08:45 To: 3319, Order: 162887, Start Time: 2012-08-30 02:32:24, End Time: 2012-08-30 03:43:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 1 (1 on baseline) Performance Regressions: 17 (38 on baseline) Performance Improvements: 17 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 855 (819 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 2.60% (1.0012 => 1.0272, std. dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 2.55% (1.1658 => 1.1955, std. dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 19.67% (57.7989 => 69.1697, std. dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.98% (25.8932 => 28.7360, std. dev.: 0.1312) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.88% (1.1548 => 1.2804, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (3.4957 => 3.7261, std. dev.: 0.0160) MultiSource/Applications/SIBsim4/SIBsim4: 6.40% (3.2043 => 3.4095, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout/lists: 4.58% (7.2583 => 7.5904, std. dev.: 0.0356) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.53% (0.3356 => 0.3508, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.02% (0.7364 => 0.7660, std. dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: 2.50% (24.6896 => 25.3075, std. dev.: 0.0332) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.47% (2.6964 => 2.7629, std. dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.23% (2.4252 => 2.4792, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (6.6870 => 6.8306, std. dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 1.29% (6.7471 => 6.8342, std. dev.: 0.0271) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.19% (2.3207 => 2.3483, std. dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: 1.03% (1.7061 => 1.7237, std. dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.48% (0.2089 => 0.1891, std. dev.: 0.0075) MultiSource/Applications/hbd/hbd: -1.76% (1.3495 => 1.3257, std. dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: -1.47% (6.5054 => 6.4095, std. dev.: 0.0110) MultiSource/Applications/treecc/treecc: -1.15% (1.8936 => 1.8718, std. dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.44% (1.1046 => 0.9893, std. dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.49% (2.6757 => 2.4752, std. dev.: 0.0097) SingleSource/Benchmarks/McGill/queens: -5.20% (1.7258 => 1.6360, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: -3.75% (0.3679 => 0.3541, std. dev.: 0.0017) MultiSource/Applications/aha/aha: -3.57% (3.4914 => 3.3666, std. dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -3.34% (7.7070 => 7.4496, std. dev.: 0.0488) SingleSource/Benchmarks/Misc/whetstone: -2.82% (2.4555 => 2.3862, std. dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (92.2214 => 90.1740, std. dev.: 0.5414) MultiSource/Applications/siod/siod: -2.18% (3.5521 => 3.4748, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.18% (3.8290 => 3.7457, std. dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -1.94% (3.9112 => 3.8355, std. dev.: 0.0198) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.13% (1.6872 => 1.6682, std. dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: -1.04% (16.5313 => 16.3599, std. dev.: 0.0438) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.1653 => 1.1955, std. dev.: 0.0032) MultiSource/Applications/lemon/lemon: 2.25% (1.0046 => 1.0272, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9978, std. dev.: 0.0041) SingleSource/Benchmarks/McGill/misr: 13.76% (0.4296 => 0.4887, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.58% (4.0101 => 4.5546, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/sieve: 12.64% (3.4406 => 3.8756, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 10.83% (62.4126 => 69.1697, std. dev.: 0.0053) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.84% (0.2694 => 0.2959, std. dev.: 0.0085) SingleSource/Benchmarks/Stanford/Puzzle: 8.44% (0.1433 => 0.1554, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 8.40% (7.0025 => 7.5904, std. dev.: 0.0356) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (3.4876 => 3.7261, std. dev.: 0.0160) SingleSource/Benchmarks/McGill/chomp: 6.83% (1.0194 => 1.0890, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout/methcall: 6.74% (8.5566 => 9.1329, std. dev.: 0.0273) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.27% (0.3301 => 0.3508, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.11% (40.4792 => 42.9513, std. dev.: 0.3959) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7360, std. dev.: 0.1312) SingleSource/Benchmarks/Misc/dt: 4.54% (0.9851 => 1.0298, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 4.15% (15.2242 => 15.8559, std. dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.65% (2.6656 => 2.7629, std. dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 3.01% (8.5113 => 8.7677, std. dev.: 0.0408) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.01% (6.6312 => 6.8306, std. dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.95% (2.4042 => 2.4752, std. dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.16% (0.5876 => 0.6003, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 2.08% (5.1938 => 5.3019, std. dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 1.79% (6.9722 => 7.0973, std. dev.: 0.0153) SingleSource/Benchmarks/Misc/whetstone: 1.74% (2.3453 => 2.3862, std. dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash: 1.74% (0.6308 => 0.6418, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.57% (1.2726 => 1.2926, std. dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.40% (14.4877 => 14.6905, std. dev.: 0.0387) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.38% (2.4455 => 2.4792, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.38% (2.4971 => 2.5315, std. dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 1.31% (6.7458 => 6.8342, std. dev.: 0.0271) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (4.6414 => 4.6926, std. dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.07% (0.7738 => 0.7578, std. dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: -1.25% (6.4908 => 6.4095, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.49% (0.3497 => 0.2116, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.33% (5.2665 => 4.1430, std. dev.: 0.2052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.06% (1.1647 => 0.9893, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: -12.31% (8.1594 => 7.1547, std. dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.76% (1.4034 => 1.2804, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.33% (3.2007 => 2.9342, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/pi: -6.85% (1.6538 => 1.5405, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: -6.42% (9.2503 => 8.6562, std. dev.: 0.0871) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.02% (0.4140 => 0.3932, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7457, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4086, std. dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.91% (1.7361 => 1.6682, std. dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: -3.49% (8.5323 => 8.2345, std. dev.: 0.1102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.14% (1.1683 => 1.1316, std. dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4496, std. dev.: 0.0488) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.01% (2.4457 => 2.3720, std. dev.: 0.0110) MultiSource/Benchmarks/PAQ8p/paq8p: -2.77% (92.7467 => 90.1740, std. dev.: 0.5414) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std. dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.43% (3.7496 => 3.6586, std. dev.: 0.0064) MultiSource/Applications/siod/siod: -2.17% (3.5520 => 3.4748, std. dev.: 0.0035) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3666, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2328, std. dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std. dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -1.42% (3.8907 => 3.8355, std. dev.: 0.0198) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3075, std. dev.: 0.0332) SingleSource/Benchmarks/Shootout-C++/lists: -1.22% (16.5617 => 16.3599, std. dev.: 0.0438) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.03% (3.6388 => 3.6015, std. dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 30 14:34:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 30 Aug 2012 16:34:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120830213414.11BCB2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3321?compare_to=3320&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3321, Order: 162936, Start Time: 2012-08-30 20:24:08, End Time: 2012-08-30 21:35:18 To: 3320, Order: 162920, Start Time: 2012-08-30 18:57:49, End Time: 2012-08-30 20:08:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (51 on baseline) Performance Improvements: 1 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 872 (803 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.35% (0.1891 => 0.2030, std. dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.84% (0.5548 => 0.5761, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.63% (0.4463 => 0.4625, std. dev.: 0.0021) MultiSource/Applications/Burg/burg: 3.09% (1.1259 => 1.1607, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.98% (1.1647 => 1.1878, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 1.88% (2.1010 => 2.1406, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.52% (0.7778 => 0.7896, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 1.49% (0.8275 => 0.8398, std. dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.01% (1.1962 => 1.2083, std. dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.75% (20.9903 => 23.8758, std. dev.: 0.5062) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.21% (1.2880 => 1.3938, std. dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.33% (20.8591 => 22.1802, std. dev.: 0.2775) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.79% (0.7660 => 0.7874, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.24% (58.9866 => 60.3054, std. dev.: 0.3446) SingleSource/Benchmarks/Shootout/hash: 1.48% (4.2941 => 4.3578, std. dev.: 0.0162) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.37% (4.6562 => 4.7201, std. dev.: 0.0120) MultiSource/Benchmarks/BitBench/five11/five11: 1.01% (5.3019 => 5.3554, std. dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -1.92% (1.4083 => 1.3812, std. dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.50% (2.1763 => 2.2524, std. dev.: 0.0140) MultiSource/Applications/SIBsim4/SIBsim4: 3.02% (1.1653 => 1.2005, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 2.81% (1.0046 => 1.0328, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.25% (0.7722 => 0.7896, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (12.6413 => 12.9136, std. dev.: 0.0201) MultiSource/Applications/minisat/minisat: 2.14% (0.6173 => 0.6305, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 2.07% (2.0972 => 2.1406, std. dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.76% (1.1672 => 1.1878, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.57% (1.5150 => 1.5388, std. dev.: 0.0071) MultiSource/Applications/Burg/burg: 1.46% (1.1440 => 1.1607, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2292, std. dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.02% (0.0766 => 0.0927, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.97% (1.7426 => 2.0034, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.94% (0.0917 => 0.1054, std. dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.89% (4.0101 => 4.5671, std. dev.: 0.0208) SingleSource/Benchmarks/McGill/misr: 13.57% (0.4296 => 0.4879, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 12.77% (21.1721 => 23.8758, std. dev.: 0.5062) SingleSource/Benchmarks/Shootout-C++/sieve: 12.61% (3.4406 => 3.8745, std. dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 12.49% (0.3746 => 0.4214, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 10.53% (62.4126 => 68.9868, std. dev.: 0.3379) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std. dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (15.8312 => 17.1765, std. dev.: 0.4864) SingleSource/Benchmarks/Shootout/lists: 8.46% (7.0025 => 7.5952, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout/methcall: 7.11% (8.5566 => 9.1649, std. dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.4876 => 3.7201, std. dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7367, std. dev.: 0.0455) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.67% (40.4792 => 42.7745, std. dev.: 0.3661) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.64% (4.2129 => 4.4504, std. dev.: 0.0569) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (0.3301 => 0.3469, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/dt: 4.37% (0.9851 => 1.0281, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8432, std. dev.: 0.0278) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.90% (0.8498 => 0.8829, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8393, std. dev.: 0.0112) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.67% (2.6656 => 2.7634, std. dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.53% (3.4080 => 3.5282, std. dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.48% (0.7609 => 0.7874, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 3.11% (5.1938 => 5.3554, std. dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.10% (6.6312 => 6.8370, std. dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.88% (0.5876 => 0.6045, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.33% (4.6127 => 4.7201, std. dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (2.4042 => 2.4592, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.79% (2.4455 => 2.4892, std. dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (2.4971 => 2.5341, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.34% (6.7458 => 6.8360, std. dev.: 0.0279) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.32% (4.0659 => 4.1197, std. dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: 1.31% (4.3016 => 4.3578, std. dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 1.26% (6.9722 => 7.0598, std. dev.: 0.0293) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6687, std. dev.: 0.0302) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.16% (2.9152 => 2.9489, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.76% (0.7784 => 0.7647, std. dev.: 0.0045) MultiSource/Applications/spiff/spiff: -1.69% (0.7738 => 0.7607, std. dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.68% (5.2665 => 4.1773, std. dev.: 0.0470) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.73% (1.1647 => 0.9931, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1623, std. dev.: 0.0398) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.39% (3.2007 => 2.9321, std. dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -7.13% (1.4441 => 1.3412, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/pi: -6.25% (1.6538 => 1.5504, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.15% (9.2503 => 8.6816, std. dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std. dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7458, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4089, std. dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std. dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -4.87% (8.5323 => 8.1166, std. dev.: 0.1082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.64% (45.4683 => 43.3574, std. dev.: 0.6086) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.30% (1.2722 => 1.2302, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.14% (1.2959 => 1.2552, std. dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -3.05% (7.6833 => 7.4488, std. dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.97% (3.7496 => 3.6384, std. dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.81% (2.4457 => 2.3770, std. dev.: 0.0122) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2866, std. dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.67% (1.1683 => 1.1371, std. dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: -2.61% (92.7467 => 90.3303, std. dev.: 0.5836) MultiSource/Applications/siod/siod: -2.29% (3.5520 => 3.4705, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/ffbench: -2.16% (1.4117 => 1.3812, std. dev.: 0.0070) MultiSource/Applications/aha/aha: -1.72% (3.4286 => 3.3695, std. dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.56% (1.0686 => 1.0519, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -1.49% (3.8200 => 3.7630, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0926 => 1.0764, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.38% (9.3855 => 9.2564, std. dev.: 0.0239) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3148, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.21% (1.8739 => 1.8513, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.17% (2.5669 => 2.5368, std. dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 30 16:00:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 30 Aug 2012 18:00:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120830230045.30D402A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3322?compare_to=3321&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3322, Order: 162940, Start Time: 2012-08-30 21:50:32, End Time: 2012-08-30 23:01:48 To: 3321, Order: 162936, Start Time: 2012-08-30 20:24:08, End Time: 2012-08-30 21:35:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 1 (35 on baseline) Performance Improvements: 3 (29 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 886 (825 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 8.34% (8.6665 => 9.3893, std. dev.: 0.2171) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -12.49% (23.8758 => 20.8935, std. dev.: 1.0207) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.34% (1.1371 => 1.1219, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.12% (2.8676 => 2.8354, std. dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 8.42% (0.1414 => 0.1533, std. dev.: 0.0033) MultiSource/Applications/minisat/minisat: 2.20% (0.6173 => 0.6309, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.63% (1.5150 => 1.5397, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.54% (12.6413 => 12.8357, std. dev.: 0.0265) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0329) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.40% (0.0766 => 0.0884, std. dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.54% (4.0101 => 4.5529, std. dev.: 0.0237) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1433 => 0.1597, std. dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (62.4126 => 69.1251, std. dev.: 0.0165) SingleSource/Benchmarks/McGill/misr: 10.68% (0.4296 => 0.4755, std. dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 8.66% (7.0025 => 7.6090, std. dev.: 0.0596) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.34% (1.0063 => 1.0902, std. dev.: 0.0171) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.42% (0.2694 => 0.2894, std. dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 7.26% (1.0194 => 1.0934, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout/methcall: 7.08% (8.5566 => 9.1626, std. dev.: 0.0576) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.4876 => 3.7205, std. dev.: 0.0153) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7353, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.33% (40.4792 => 42.6354, std. dev.: 0.4257) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.30% (4.2129 => 4.4362, std. dev.: 0.0264) SingleSource/Benchmarks/Misc/fp-convert: 4.02% (15.2242 => 15.8368, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/dt: 3.93% (0.9851 => 1.0238, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5389, std. dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.76% (2.6656 => 2.7657, std. dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.20% (0.5587 => 0.5766, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.01% (6.6312 => 6.8311, std. dev.: 0.0126) SingleSource/Benchmarks/Misc/ReedSolomon: 2.65% (8.5113 => 8.7365, std. dev.: 0.0503) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 2.15% (5.1938 => 5.3056, std. dev.: 0.0300) MultiSource/Applications/JM/lencod/lencod: 1.51% (6.7458 => 6.8476, std. dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 1.20% (14.4877 => 14.6615, std. dev.: 0.0052) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.17% (4.0659 => 4.1133, std. dev.: 0.0123) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (4.6414 => 4.6913, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.05% (3.6254 => 3.6636, std. dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.04% (4.2815 => 4.2369, std. dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.55% (0.3497 => 0.2114, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.47% (5.2665 => 4.0832, std. dev.: 0.1608) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.97% (1.1647 => 0.9903, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std. dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.90% (3.2007 => 2.9477, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.4441 => 1.3421, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/pi: -6.27% (1.6538 => 1.5501, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -6.19% (9.2503 => 8.6775, std. dev.: 0.0598) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7460, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: -4.85% (4.6355 => 4.4106, std. dev.: 0.0278) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.97% (1.1683 => 1.1219, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.78% (1.7361 => 1.6704, std. dev.: 0.0130) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.18% (1.2722 => 1.2317, std. dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -3.08% (7.6833 => 7.4467, std. dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.95% (3.7496 => 3.6391, std. dev.: 0.0222) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std. dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.24% (2.4457 => 2.3908, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.11% (2.8964 => 2.8354, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.97% (1.8739 => 1.8369, std. dev.: 0.0103) MultiSource/Applications/siod/siod: -1.71% (3.5520 => 3.4914, std. dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -1.62% (1.7330 => 1.7049, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: -1.58% (1.0926 => 1.0753, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -1.44% (3.4286 => 3.3791, std. dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3064, std. dev.: 0.0122) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 30 17:28:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 30 Aug 2012 19:28:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831002805.C24D42A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3323?compare_to=3322&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3323, Order: 162950, Start Time: 2012-08-30 23:17:13, End Time: 2012-08-31 00:29:09 To: 3322, Order: 162940, Start Time: 2012-08-30 21:50:32, End Time: 2012-08-30 23:01:48 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (46 on baseline) Performance Improvements: 0 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 884 (812 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.72% (1.4374 => 1.4765, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.69% (2.0423 => 2.0973, std. dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.53% (3.0740 => 3.1517, std. dev.: 0.0272) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 6.45% (0.2495 => 0.2656, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 2.78% (0.4755 => 0.4887, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.00% (4.5100 => 4.5553, std. dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.48% (1.1653 => 1.2059, std. dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.23% (2.0317 => 2.0973, std. dev.: 0.0064) MultiSource/Applications/lemon/lemon: 3.04% (1.0046 => 1.0351, std. dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (2.1763 => 2.2401, std. dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.4408 => 1.4765, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.47% (3.0758 => 3.1517, std. dev.: 0.0272) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.28% (1.5150 => 1.5495, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.08% (0.7639 => 0.7798, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.73% (0.5937 => 0.6040, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (12.6413 => 12.8566, std. dev.: 0.0674) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.03% (1.1827 => 1.1949, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 44.87% (0.0263 => 0.0381, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2283, std. dev.: 0.0209) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.79% (0.0917 => 0.1071, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std. dev.: 0.0268) SingleSource/Benchmarks/McGill/misr: 13.76% (0.4296 => 0.4887, std. dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.50% (4.0101 => 4.5513, std. dev.: 0.1490) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 10.70% (62.4126 => 69.0885, std. dev.: 0.2358) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6124, std. dev.: 0.0125) SingleSource/Benchmarks/McGill/chomp: 7.91% (1.0194 => 1.1000, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 7.65% (0.2694 => 0.2900, std. dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.54% (1.0063 => 1.0822, std. dev.: 0.0260) SingleSource/Benchmarks/Shootout/methcall: 7.49% (8.5566 => 9.1975, std. dev.: 0.0383) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.4876 => 3.7207, std. dev.: 0.0137) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.82% (27.1724 => 28.7525, std. dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (0.3301 => 0.3489, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: 4.28% (15.2242 => 15.8756, std. dev.: 0.0313) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std. dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.95% (3.4080 => 3.5425, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.65% (4.2129 => 4.3665, std. dev.: 0.0313) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.55% (2.6656 => 2.7603, std. dev.: 0.0175) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.36% (0.3508 => 0.3626, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.18% (6.6312 => 6.8422, std. dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: 2.53% (5.1938 => 5.3253, std. dev.: 0.0300) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (2.4042 => 2.4596, std. dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 1.52% (6.7458 => 6.8481, std. dev.: 0.0257) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.41% (2.4455 => 2.4801, std. dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/fldry: 1.36% (2.4971 => 2.5310, std. dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6700, std. dev.: 0.0064) MultiSource/Benchmarks/Olden/power/power: 1.20% (1.4184 => 1.4354, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.17% (3.6254 => 3.6678, std. dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.15% (4.6414 => 4.6948, std. dev.: 0.0076) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.05% (4.0659 => 4.1084, std. dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.98% (0.3497 => 0.2099, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.15% (5.2665 => 4.0999, std. dev.: 0.1375) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.92% (1.1647 => 0.9909, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1599, std. dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.51% (3.6023 => 3.1877, std. dev.: 0.0854) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.23% (1.4034 => 1.2879, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: -6.98% (1.4441 => 1.3433, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.25% (9.2503 => 8.6724, std. dev.: 0.0595) SingleSource/Benchmarks/Misc/pi: -6.21% (1.6538 => 1.5511, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7957, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4087, std. dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.88% (3.9413 => 3.7490, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.02% (2.4457 => 2.3473, std. dev.: 0.0343) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.89% (1.7361 => 1.6685, std. dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.33% (1.1683 => 1.1294, std. dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -3.07% (7.6833 => 7.4474, std. dev.: 0.0312) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -2.43% (9.5474 => 9.3157, std. dev.: 0.0198) MultiSource/Applications/siod/siod: -2.35% (3.5520 => 3.4684, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.00% (2.8964 => 2.8385, std. dev.: 0.0151) MultiSource/Applications/aha/aha: -1.82% (3.4286 => 3.3662, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.79% (1.0686 => 1.0495, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2363, std. dev.: 0.0264) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.57% (2.3569 => 2.3200, std. dev.: 0.0124) MultiSource/Benchmarks/FreeBench/neural/neural: -1.49% (1.0926 => 1.0763, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.41% (25.6658 => 25.3051, std. dev.: 0.0870) SingleSource/Benchmarks/Misc/oourafft: -1.33% (3.8200 => 3.7691, std. dev.: 0.0109) MultiSource/Benchmarks/sim/sim: -1.29% (3.8907 => 3.8406, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.1116 => 1.1002, std. dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: -1.02% (1.7330 => 1.7154, std. dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 30 18:55:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 30 Aug 2012 20:55:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831015556.D4D6E2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3324?compare_to=3323&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3324, Order: 162962, Start Time: 2012-08-31 00:44:43, End Time: 2012-08-31 01:57:00 To: 3323, Order: 162950, Start Time: 2012-08-30 23:17:13, End Time: 2012-08-31 00:29:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (48 on baseline) Performance Improvements: 0 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (809 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 3.09% (0.7511 => 0.7743, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.42% (1.8695 => 1.9148, std. dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 2.01% (13.3860 => 13.6557, std. dev.: 0.0427) MultiSource/Applications/siod/siod: 1.84% (2.1040 => 2.1427, std. dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.41% (14.6698 => 14.8761, std. dev.: 0.0483) MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (2.2401 => 2.2712, std. dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.18% (0.8554 => 0.8655, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (3.6018 => 3.8787, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.71% (1.7801 => 1.8461, std. dev.: 0.0131) SingleSource/Benchmarks/Misc/whetstone: 2.20% (2.3448 => 2.3965, std. dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.40% (1.4203 => 1.4402, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 1.25% (8.7266 => 8.8360, std. dev.: 0.0209) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.06% (2.4801 => 2.5064, std. dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.36% (2.1763 => 2.2712, std. dev.: 0.0081) MultiSource/Applications/lemon/lemon: 2.73% (1.0046 => 1.0320, std. dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 2.49% (13.3238 => 13.6557, std. dev.: 0.0427) MultiSource/Applications/d/make_dparser: 2.43% (3.0225 => 3.0959, std. dev.: 0.0199) MultiSource/Applications/minisat/minisat: 2.37% (0.6173 => 0.6319, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.29% (1.5150 => 1.5497, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.18% (12.6413 => 12.9174, std. dev.: 0.0424) MultiSource/Applications/siod/siod: 2.17% (2.0972 => 2.1427, std. dev.: 0.0048) MultiSource/Applications/treecc/treecc: 1.86% (1.8798 => 1.9148, std. dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.7639 => 0.7772, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.22% (29.3170 => 29.6753, std. dev.: 0.0372) MultiSource/Applications/ClamAV/clamscan: 1.15% (14.6079 => 14.7754, std. dev.: 0.0644) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.1827 => 1.1958, std. dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.02% (14.7256 => 14.8761, std. dev.: 0.0483) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.21% (0.0263 => 0.0374, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.50% (0.0766 => 0.0946, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 22.20% (3.4629 => 4.2318, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout/ary3: 15.80% (1.7426 => 2.0179, std. dev.: 0.0209) SingleSource/Benchmarks/McGill/misr: 13.62% (0.4296 => 0.4881, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.22% (4.0101 => 4.5402, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/sieve: 12.73% (3.4406 => 3.8787, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 11.85% (0.3746 => 0.4190, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 10.74% (62.4126 => 69.1127, std. dev.: 0.0655) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.65% (0.2694 => 0.2954, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.75% (7.0025 => 7.6152, std. dev.: 0.0255) SingleSource/Benchmarks/McGill/chomp: 7.53% (1.0194 => 1.0962, std. dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.44% (1.0063 => 1.0812, std. dev.: 0.0120) SingleSource/Benchmarks/Shootout/methcall: 7.31% (8.5566 => 9.1825, std. dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (3.4876 => 3.7218, std. dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7520, std. dev.: 0.0728) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.04% (4.2129 => 4.4251, std. dev.: 0.0753) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 3.94% (15.2242 => 15.8247, std. dev.: 0.0846) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 3.81% (8.5113 => 8.8360, std. dev.: 0.0209) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.21% (2.6656 => 2.7512, std. dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.11% (6.6312 => 6.8376, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.86% (0.5587 => 0.5747, std. dev.: 0.0040) MultiSource/Benchmarks/BitBench/five11/five11: 2.77% (5.1938 => 5.3379, std. dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.62% (0.5876 => 0.6030, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.49% (2.4455 => 2.5064, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.48% (0.7609 => 0.7798, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: 2.18% (2.3453 => 2.3965, std. dev.: 0.0146) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5326, std. dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.40% (6.9722 => 7.0698, std. dev.: 0.0079) MultiSource/Benchmarks/Olden/em3d/em3d: 1.33% (4.6414 => 4.7029, std. dev.: 0.0238) MultiSource/Applications/hexxagon/hexxagon: 1.23% (14.4877 => 14.6665, std. dev.: 0.0320) MultiSource/Benchmarks/Olden/power/power: 1.19% (1.4184 => 1.4353, std. dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.41% (0.3497 => 0.2119, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.07% (5.2665 => 4.1566, std. dev.: 0.1125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.81% (1.1647 => 0.9922, std. dev.: 0.0085) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1608, std. dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.52% (3.2007 => 2.9279, std. dev.: 0.0325) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.4441 => 1.3422, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: -6.12% (1.6538 => 1.5526, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -5.74% (9.2503 => 8.7195, std. dev.: 0.0490) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7457, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.57% (0.4140 => 0.3951, std. dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.25% (2.4457 => 2.3417, std. dev.: 0.0327) MultiSource/Applications/SPASS/SPASS: -3.53% (8.5323 => 8.2314, std. dev.: 0.0398) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4494, std. dev.: 0.0351) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.04% (1.1683 => 1.1328, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.95% (1.7361 => 1.6848, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.66% (3.7496 => 3.6497, std. dev.: 0.0298) SingleSource/Benchmarks/Misc/flops: -2.62% (9.5474 => 9.2974, std. dev.: 0.0417) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.49% (1.4021 => 1.3672, std. dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: -2.48% (92.7467 => 90.4486, std. dev.: 0.1303) MultiSource/Applications/siod/siod: -2.26% (3.5520 => 3.4719, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (9.3855 => 9.2181, std. dev.: 0.0162) MultiSource/Applications/aha/aha: -1.75% (3.4286 => 3.3687, std. dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.55% (2.3569 => 2.3203, std. dev.: 0.0141) MultiSource/Benchmarks/FreeBench/neural/neural: -1.53% (1.0926 => 1.0759, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.8200 => 3.7680, std. dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3168, std. dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.01% (3.6388 => 3.6019, std. dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 30 20:22:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 30 Aug 2012 22:22:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831032228.68DBD2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3325?compare_to=3324&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3325, Order: 162966, Start Time: 2012-08-31 02:12:16, End Time: 2012-08-31 03:23:32 To: 3324, Order: 162962, Start Time: 2012-08-31 00:44:43, End Time: 2012-08-31 01:57:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (41 on baseline) Performance Improvements: 5 (32 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (816 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/reversefile: 4.22% (0.3010 => 0.3137, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 1.00% (1.3281 => 1.3414, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 4.62% (6.1830 => 6.4687, std. dev.: 0.1102) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (0.3401 => 0.3528, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.54% (1.2577 => 1.2771, std. dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.74% (9.2609 => 9.0997, std. dev.: 0.0166) MultiSource/Benchmarks/PAQ8p/paq8p: -1.34% (2.2712 => 2.2407, std. dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.55% (43.1097 => 41.5801, std. dev.: 0.5207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.84% (22.7685 => 22.3499, std. dev.: 0.1102) SingleSource/Benchmarks/Shootout/ary3: -1.00% (2.0179 => 1.9977, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 5.03% (1.1653 => 1.2239, std. dev.: 0.0028) MultiSource/Applications/lemon/lemon: 4.19% (1.0046 => 1.0467, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3217 => 0.3338, std. dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (2.1763 => 2.2407, std. dev.: 0.0107) MultiSource/Applications/Burg/burg: 1.56% (1.1440 => 1.1619, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.48% (1.1827 => 1.2002, std. dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: 1.13% (8.9977 => 9.0997, std. dev.: 0.0166) MultiSource/Applications/hbd/hbd: 1.10% (1.3268 => 1.3414, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std. dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.88% (0.0766 => 0.0880, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: 14.64% (1.7426 => 1.9977, std. dev.: 0.0049) SingleSource/Benchmarks/McGill/misr: 13.97% (0.4296 => 0.4896, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.11% (4.0101 => 4.5357, std. dev.: 0.1073) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.65% (62.4126 => 69.0625, std. dev.: 0.0391) SingleSource/Benchmarks/Stanford/Puzzle: 10.61% (0.1433 => 0.1585, std. dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.57% (0.2694 => 0.2925, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: 8.52% (7.0025 => 7.5988, std. dev.: 0.0265) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.88% (0.3301 => 0.3528, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout/methcall: 6.74% (8.5566 => 9.1336, std. dev.: 0.0394) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.4876 => 3.7190, std. dev.: 0.0201) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.74% (15.8312 => 16.7405, std. dev.: 0.1857) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.73% (27.1724 => 28.7291, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.71% (4.2129 => 4.4534, std. dev.: 0.0807) SingleSource/Benchmarks/Misc/fp-convert: 4.51% (15.2242 => 15.9101, std. dev.: 0.0307) SingleSource/Benchmarks/Misc/dt: 3.93% (0.9851 => 1.0238, std. dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5392, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.07% (6.6312 => 6.8349, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.99% (0.5587 => 0.5754, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.96% (2.6656 => 2.7444, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: 2.81% (8.5113 => 8.7506, std. dev.: 0.0758) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (2.4455 => 2.4869, std. dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 1.46% (6.9722 => 7.0740, std. dev.: 0.0210) SingleSource/Benchmarks/Dhrystone/fldry: 1.42% (2.4971 => 2.5326, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 1.39% (2.3453 => 2.3780, std. dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.29% (14.4877 => 14.6753, std. dev.: 0.0442) MultiSource/Applications/JM/lencod/lencod: 1.24% (6.7458 => 6.8295, std. dev.: 0.0208) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.18% (4.0659 => 4.1140, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (4.6414 => 4.6912, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.02% (3.6254 => 3.6625, std. dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.34% (5.2665 => 4.0902, std. dev.: 0.0924) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.09% (1.1647 => 0.9890, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1564, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.98% (3.2007 => 2.9454, std. dev.: 0.0541) SingleSource/Benchmarks/Misc/richards_benchmark: -7.02% (1.4441 => 1.3427, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: -6.49% (9.2503 => 8.6498, std. dev.: 0.1345) SingleSource/Benchmarks/Misc/pi: -6.24% (1.6538 => 1.5506, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.89% (3.9413 => 3.7485, std. dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4098, std. dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -3.32% (8.5323 => 8.2490, std. dev.: 0.0957) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.19% (1.1683 => 1.1310, std. dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -2.99% (7.6833 => 7.4537, std. dev.: 0.0257) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.92% (1.2722 => 1.2351, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.79% (3.7496 => 3.6450, std. dev.: 0.0223) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std. dev.: 0.0180) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.72% (1.7361 => 1.6888, std. dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: -2.64% (92.7467 => 90.2968, std. dev.: 0.2086) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.26% (1.0686 => 1.0444, std. dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.92% (2.8964 => 2.8407, std. dev.: 0.0214) MultiSource/Benchmarks/FreeBench/neural/neural: -1.74% (1.0926 => 1.0736, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: -1.71% (1.7330 => 1.7033, std. dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2305, std. dev.: 0.0113) MultiSource/Applications/siod/siod: -1.62% (3.5520 => 3.4946, std. dev.: 0.0191) MultiSource/Applications/aha/aha: -1.61% (3.4286 => 3.3734, std. dev.: 0.0149) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.45% (1.2959 => 1.2771, std. dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7654, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3065, std. dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 30 21:48:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 30 Aug 2012 23:48:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831044842.85E242A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3326?compare_to=3325&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3326, Order: 162974, Start Time: 2012-08-31 03:38:43, End Time: 2012-08-31 04:49:46 To: 3325, Order: 162966, Start Time: 2012-08-31 02:12:16, End Time: 2012-08-31 03:23:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (42 on baseline) Performance Improvements: 4 (28 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (819 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.15% (1.2039 => 1.2177, std. dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/sieve: 6.82% (3.6365 => 3.8845, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.98% (2.3158 => 2.3847, std. dev.: 0.0186) SingleSource/Benchmarks/Misc/ffbench: 1.37% (1.3975 => 1.4166, std. dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.29% (4.5357 => 4.5941, std. dev.: 0.0075) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.14% (4.6662 => 4.7194, std. dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -2.04% (1.3414 => 1.3141, std. dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: -1.76% (1.2239 => 1.2023, std. dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -3.65% (6.4687 => 6.2325, std. dev.: 0.0433) MultiSource/Applications/SIBsim4/SIBsim4: -1.05% (3.4514 => 3.4151, std. dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 3.42% (1.0046 => 1.0390, std. dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 3.18% (1.1653 => 1.2023, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 2.49% (0.6173 => 0.6327, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 1.47% (3.0225 => 3.0670, std. dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.30% (1.2021 => 1.2177, std. dev.: 0.0035) MultiSource/Applications/siod/siod: 1.19% (2.0972 => 2.1222, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std. dev.: 0.0150) SingleSource/Benchmarks/Shootout/ary3: 14.73% (1.7426 => 1.9993, std. dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.56% (4.0101 => 4.5941, std. dev.: 0.0075) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.45% (0.0766 => 0.0869, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: 13.31% (0.4296 => 0.4868, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 12.90% (3.4406 => 3.8845, std. dev.: 0.0064) SingleSource/Benchmarks/Stanford/Puzzle: 12.56% (0.1433 => 0.1613, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 12.49% (0.3746 => 0.4214, std. dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 10.74% (62.4126 => 69.1161, std. dev.: 0.0352) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 8.70% (7.0025 => 7.6118, std. dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.72% (1.0063 => 1.0840, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout/methcall: 7.35% (8.5566 => 9.1853, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash2: 6.87% (3.4876 => 3.7272, std. dev.: 0.0168) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.79% (27.1724 => 28.7450, std. dev.: 0.0235) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.41% (4.2129 => 4.4407, std. dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.23% (40.4792 => 42.1913, std. dev.: 0.5986) SingleSource/Benchmarks/Misc/dt: 4.09% (0.9851 => 1.0254, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 3.99% (15.2242 => 15.8318, std. dev.: 0.0469) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.94% (0.8498 => 0.8833, std. dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.38% (2.6656 => 2.7557, std. dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.14% (6.6312 => 6.8393, std. dev.: 0.0189) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.85% (0.3508 => 0.3608, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5113 => 8.7532, std. dev.: 0.0290) MultiSource/Benchmarks/BitBench/five11/five11: 2.58% (5.1938 => 5.3276, std. dev.: 0.0184) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.31% (4.6127 => 4.7194, std. dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.06% (0.5876 => 0.5997, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.71% (2.4455 => 2.4873, std. dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/fldry: 1.39% (2.4971 => 2.5318, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 1.31% (14.4877 => 14.6771, std. dev.: 0.0289) MultiSource/Applications/JM/lencod/lencod: 1.22% (6.7458 => 6.8283, std. dev.: 0.0081) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.14% (3.6254 => 3.6667, std. dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: 1.03% (2.4013 => 2.4261, std. dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.36% (5.2665 => 4.0887, std. dev.: 0.1139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.03% (1.1647 => 0.9897, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1608, std. dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.25% (1.4034 => 1.2876, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9447, std. dev.: 0.0138) SingleSource/Benchmarks/Misc/richards_benchmark: -7.17% (1.4441 => 1.3406, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/pi: -6.29% (1.6538 => 1.5497, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -5.81% (9.2503 => 8.7127, std. dev.: 0.0464) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7458, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -4.93% (4.6355 => 4.4070, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.51% (0.4564 => 0.4358, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.51% (2.4457 => 2.3598, std. dev.: 0.0146) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.13% (1.2722 => 1.2324, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.04% (1.7361 => 1.6834, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.97% (0.4140 => 0.4017, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (7.6833 => 7.4554, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2858, std. dev.: 0.0328) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.47% (3.7496 => 3.6570, std. dev.: 0.0195) MultiSource/Benchmarks/PAQ8p/paq8p: -2.41% (92.7467 => 90.5130, std. dev.: 0.3089) MultiSource/Applications/siod/siod: -2.20% (3.5520 => 3.4738, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (9.3855 => 9.2389, std. dev.: 0.0365) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std. dev.: 0.0009) MultiSource/Applications/aha/aha: -1.53% (3.4286 => 3.3760, std. dev.: 0.0172) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3178, std. dev.: 0.0216) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.09% (2.3569 => 2.3312, std. dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Aug 30 23:15:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 01:15:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831061504.C45C42A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3327?compare_to=3326&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3327, Order: 162978, Start Time: 2012-08-31 05:04:49, End Time: 2012-08-31 06:16:08 To: 3326, Order: 162974, Start Time: 2012-08-31 03:38:43, End Time: 2012-08-31 04:49:46 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (38 on baseline) Performance Improvements: 2 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (820 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.83% (0.7405 => 0.7763, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.57% (0.8894 => 0.9034, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.18% (1.3999 => 1.4164, std. dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 10.30% (1.6507 => 1.8207, std. dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.55% (0.3266 => 0.3480, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.31% (43.6828 => 44.6900, std. dev.: 0.3228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -33.88% (0.0304 => 0.0201, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: -2.32% (1.4166 => 1.3837, std. dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.43% (0.1414 => 0.1519, std. dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 3.41% (2.1763 => 2.2505, std. dev.: 0.0229) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.1653 => 1.2037, std. dev.: 0.0074) MultiSource/Applications/lemon/lemon: 2.84% (1.0046 => 1.0331, std. dev.: 0.0048) MultiSource/Applications/minisat/minisat: 2.28% (0.6173 => 0.6314, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.64% (1.3935 => 1.4164, std. dev.: 0.0039) MultiSource/Applications/d/make_dparser: 1.17% (3.0225 => 3.0579, std. dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.17% (3.4629 => 4.2305, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0015, std. dev.: 0.0429) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.77% (4.0101 => 4.5623, std. dev.: 0.0777) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 12.74% (3.4406 => 3.8791, std. dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 12.41% (0.3746 => 0.4211, std. dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: 11.01% (0.4296 => 0.4769, std. dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 10.71% (62.4126 => 69.0946, std. dev.: 0.3097) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 9.08% (7.0025 => 7.6380, std. dev.: 0.0482) SingleSource/Benchmarks/Shootout/methcall: 8.07% (8.5566 => 9.2470, std. dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.58% (1.0063 => 1.0826, std. dev.: 0.0094) SingleSource/Benchmarks/McGill/chomp: 7.27% (1.0194 => 1.0935, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.4876 => 3.7200, std. dev.: 0.0127) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7340, std. dev.: 0.0583) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3301 => 0.3480, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.41% (40.4792 => 42.2629, std. dev.: 0.4669) SingleSource/Benchmarks/Misc/dt: 4.31% (0.9851 => 1.0276, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8507, std. dev.: 0.0412) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 3.91% (8.5113 => 8.8442, std. dev.: 0.0387) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.43% (4.2129 => 4.3574, std. dev.: 0.0348) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.17% (2.6656 => 2.7501, std. dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.08% (6.6312 => 6.8357, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.48% (4.6127 => 4.7272, std. dev.: 0.0173) MultiSource/Benchmarks/BitBench/five11/five11: 1.86% (5.1938 => 5.2904, std. dev.: 0.0260) MultiSource/Applications/JM/lencod/lencod: 1.49% (6.7458 => 6.8463, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6673, std. dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.08% (3.6254 => 3.6646, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout/hash: 1.02% (4.3016 => 4.3456, std. dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.16% (5.2665 => 4.2046, std. dev.: 0.0631) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.87% (1.1647 => 0.9915, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: -12.15% (8.1594 => 7.1683, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.73% (3.6023 => 3.2158, std. dev.: 0.1491) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.67% (1.4034 => 1.2817, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.66% (3.2007 => 2.9555, std. dev.: 0.0571) SingleSource/Benchmarks/Misc/richards_benchmark: -7.16% (1.4441 => 1.3407, std. dev.: 0.0205) SingleSource/Benchmarks/Misc/pi: -6.24% (1.6538 => 1.5506, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -5.66% (9.2503 => 8.7264, std. dev.: 0.0499) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7460, std. dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4089, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.46% (1.7361 => 1.6761, std. dev.: 0.0102) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.32% (1.2722 => 1.2300, std. dev.: 0.0151) MultiSource/Applications/lambda-0_1_3/lambda: -2.94% (7.6833 => 7.4573, std. dev.: 0.0633) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.84% (1.8739 => 1.8207, std. dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.73% (3.7496 => 3.6471, std. dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: -2.70% (92.7467 => 90.2412, std. dev.: 0.6230) SingleSource/Benchmarks/Misc/flops: -2.68% (9.5474 => 9.2914, std. dev.: 0.0270) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.57% (1.1683 => 1.1383, std. dev.: 0.0044) MultiSource/Applications/siod/siod: -2.25% (3.5520 => 3.4720, std. dev.: 0.0129) SingleSource/Benchmarks/Misc/ffbench: -1.98% (1.4117 => 1.3837, std. dev.: 0.0051) MultiSource/Applications/aha/aha: -1.76% (3.4286 => 3.3683, std. dev.: 0.0171) MultiSource/Benchmarks/sim/sim: -1.72% (3.8907 => 3.8237, std. dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2277, std. dev.: 0.0284) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -1.50% (1.0926 => 1.0762, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7654, std. dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3106, std. dev.: 0.0307) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 00:40:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 02:40:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831074056.A63E12A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/3328?compare_to=3327&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3328, Order: 162979, Start Time: 2012-08-31 06:31:18, End Time: 2012-08-31 07:41:57 To: 3327, Order: 162978, Start Time: 2012-08-31 05:04:49, End Time: 2012-08-31 06:16:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (35 on baseline) Performance Improvements: 4 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (820 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.5673 => 0.5895, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.34% (1.4001 => 1.4189, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.2247 => 4.2736, std. dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/misr: 2.47% (0.4769 => 0.4887, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.91% (1.8207 => 1.8555, std. dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.37% (22.2860 => 22.5914, std. dev.: 0.1112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -3.09% (4.2046 => 4.0748, std. dev.: 0.0456) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.64% (44.6900 => 43.5109, std. dev.: 0.2619) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.22% (5.9325 => 5.8603, std. dev.: 0.0277) SingleSource/Benchmarks/Shootout/matrix: -1.07% (1.5815 => 1.5645, std. dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.43% (1.1653 => 1.2053, std. dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: 2.86% (2.1763 => 2.2385, std. dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.70% (0.5740 => 0.5895, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.89% (12.6413 => 12.8797, std. dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.28% (1.3935 => 1.4113, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.19% (3.0225 => 3.0585, std. dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.09% (1.1827 => 1.1956, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.59% (0.0917 => 0.1060, std. dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.0766 => 0.0878, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9970, std. dev.: 0.0068) SingleSource/Benchmarks/McGill/misr: 13.76% (0.4296 => 0.4887, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.43% (4.0101 => 4.5488, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 12.73% (3.4406 => 3.8787, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 12.41% (0.3746 => 0.4211, std. dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 10.73% (62.4126 => 69.1075, std. dev.: 0.0588) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: 8.75% (7.0025 => 7.6152, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout/methcall: 6.99% (8.5566 => 9.1551, std. dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/hash2: 6.96% (3.4876 => 3.7305, std. dev.: 0.0237) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7337, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (0.3301 => 0.3464, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/dt: 4.30% (0.9851 => 1.0275, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 4.03% (15.2242 => 15.8380, std. dev.: 0.0358) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.75% (8.5113 => 8.8306, std. dev.: 0.0220) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.52% (2.6656 => 2.7593, std. dev.: 0.0105) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.11% (0.3508 => 0.3617, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.05% (6.6312 => 6.8337, std. dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0034) MultiSource/Benchmarks/BitBench/five11/five11: 2.22% (5.1938 => 5.3089, std. dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.56% (0.7609 => 0.7728, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: 1.48% (2.4971 => 2.5341, std. dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 1.21% (14.4877 => 14.6632, std. dev.: 0.0218) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.62% (8.9977 => 8.6716, std. dev.: 0.0479) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.63% (5.2665 => 4.0748, std. dev.: 0.0456) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.31% (1.1647 => 0.9864, std. dev.: 0.0309) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.59% (1.4034 => 1.2828, std. dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.25% (3.2007 => 2.9367, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/richards_benchmark: -7.08% (1.4441 => 1.3419, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: -6.60% (9.2503 => 8.6394, std. dev.: 0.0967) SingleSource/Benchmarks/Misc/pi: -6.32% (1.6538 => 1.5492, std. dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std. dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.02% (0.4564 => 0.4335, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.97% (3.9413 => 3.7456, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4089, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.39% (2.4457 => 2.3384, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.30% (45.4683 => 43.5109, std. dev.: 0.2619) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.15% (1.7361 => 1.6641, std. dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.40% (3.7496 => 3.6223, std. dev.: 0.0273) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.33% (1.2722 => 1.2298, std. dev.: 0.0096) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4555, std. dev.: 0.0146) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.95% (0.4140 => 0.4018, std. dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -2.81% (92.7467 => 90.1426, std. dev.: 0.2926) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2858, std. dev.: 0.0364) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.36% (1.1683 => 1.1407, std. dev.: 0.0032) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.35% (2.8964 => 2.8284, std. dev.: 0.0132) MultiSource/Applications/siod/siod: -2.30% (3.5520 => 3.4704, std. dev.: 0.0056) MultiSource/Applications/aha/aha: -1.65% (3.4286 => 3.3720, std. dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2324, std. dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -1.62% (3.8200 => 3.7582, std. dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.52% (1.0120 => 0.9966, std. dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -1.50% (1.0926 => 1.0762, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3072, std. dev.: 0.0046) MultiSource/Benchmarks/llubenchmark/llu: -1.35% (2.0192 => 1.9920, std. dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 04:38:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 06:38:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831113815.340832A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/3329?compare_to=3328&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3329, Order: 162983, Start Time: 2012-08-31 10:26:36, End Time: 2012-08-31 11:39:19 To: 3328, Order: 162979, Start Time: 2012-08-31 06:31:18, End Time: 2012-08-31 07:41:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 1 (36 on baseline) Performance Improvements: 1 (36 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 888 (817 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.01% (0.9966 => 1.0067, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.53% (0.5895 => 0.5510, std. dev.: 0.0146) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1414 => 0.1523, std. dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3.24% (1.1653 => 1.2030, std. dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 2.82% (2.1763 => 2.2376, std. dev.: 0.0216) MultiSource/Applications/lemon/lemon: 2.78% (1.0046 => 1.0325, std. dev.: 0.0074) MultiSource/Applications/minisat/minisat: 2.11% (0.6173 => 0.6303, std. dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 43.73% (0.0263 => 0.0378, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.79% (0.0917 => 0.1071, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 14.57% (1.7426 => 1.9965, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.63% (4.0101 => 4.5565, std. dev.: 0.0143) SingleSource/Benchmarks/McGill/misr: 13.55% (0.4296 => 0.4878, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 12.63% (0.3746 => 0.4219, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 12.41% (3.4406 => 3.8676, std. dev.: 0.0113) SingleSource/Benchmarks/Stanford/Puzzle: 11.37% (0.1433 => 0.1596, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1040, std. dev.: 0.0505) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.87% (1.0063 => 1.0956, std. dev.: 0.0148) SingleSource/Benchmarks/Shootout/lists: 8.55% (7.0025 => 7.6014, std. dev.: 0.0190) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.46% (0.2694 => 0.2922, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (3.4876 => 3.7243, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/methcall: 6.78% (8.5566 => 9.1371, std. dev.: 0.0271) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.06% (0.3301 => 0.3501, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7350, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.37% (0.5876 => 0.6133, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/dt: 4.24% (0.9851 => 1.0269, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 4.11% (8.5113 => 8.8613, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/fp-convert: 3.93% (15.2242 => 15.8224, std. dev.: 0.0326) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.14% (0.3508 => 0.3618, std. dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.03% (6.6312 => 6.8320, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 2.20% (5.1938 => 5.3080, std. dev.: 0.0344) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.64% (2.4455 => 2.4857, std. dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.48% (6.9722 => 7.0753, std. dev.: 0.0327) MultiSource/Applications/JM/lencod/lencod: 1.24% (6.7458 => 6.8296, std. dev.: 0.0314) MultiSource/Applications/hexxagon/hexxagon: 1.24% (14.4877 => 14.6672, std. dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.67% (0.2080 => 0.1962, std. dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.38% (0.2467 => 0.2359, std. dev.: 0.0038) MultiSource/Applications/spiff/spiff: -3.01% (0.7738 => 0.7505, std. dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.36% (4.3380 => 4.2790, std. dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.30% (1.2742 => 1.2576, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.92% (0.3497 => 0.2066, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.04% (5.2665 => 4.1058, std. dev.: 0.2352) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.93% (1.1647 => 0.9908, std. dev.: 0.0268) SingleSource/Benchmarks/Shootout/sieve: -12.29% (8.1594 => 7.1569, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.09% (3.2007 => 2.9418, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/richards_benchmark: -7.09% (1.4441 => 1.3417, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -6.58% (9.2503 => 8.6415, std. dev.: 0.1258) SingleSource/Benchmarks/Misc/pi: -6.49% (1.6538 => 1.5464, std. dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7929, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7460, std. dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/fibo: -4.89% (4.6355 => 4.4088, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.63% (1.7361 => 1.6731, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.38% (0.4140 => 0.4000, std. dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.12% (1.1683 => 1.1319, std. dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4494, std. dev.: 0.0276) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.97% (3.7496 => 3.6383, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2846, std. dev.: 0.0182) MultiSource/Benchmarks/PAQ8p/paq8p: -2.28% (92.7467 => 90.6340, std. dev.: 0.1381) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.27% (0.6119 => 0.5980, std. dev.: 0.0052) MultiSource/Applications/siod/siod: -2.21% (3.5520 => 3.4736, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2348, std. dev.: 0.0171) MultiSource/Applications/aha/aha: -1.56% (3.4286 => 3.3751, std. dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std. dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -1.49% (3.8907 => 3.8329, std. dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: -1.40% (1.7330 => 1.7087, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3074, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: -1.33% (3.8200 => 3.7692, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.09% (1.8739 => 1.8535, std. dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 06:05:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 08:05:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831130538.24AD3352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3330?compare_to=3329&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3330, Order: 162986, Start Time: 2012-08-31 11:54:33, End Time: 2012-08-31 13:06:41 To: 3329, Order: 162983, Start Time: 2012-08-31 10:26:36, End Time: 2012-08-31 11:39:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (35 on baseline) Performance Improvements: 1 (28 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (826 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.76% (0.2560 => 0.2733, std. dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: 5.13% (8.5424 => 8.9810, std. dev.: 0.0782) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 13.26% (0.7737 => 0.8763, std. dev.: 0.0197) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.88% (2.3620 => 2.5718, std. dev.: 0.0168) SingleSource/Benchmarks/Dhrystone/fldry: 1.87% (2.4867 => 2.5331, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (1.1319 => 1.1478, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.22% (4.4939 => 4.5489, std. dev.: 0.0067) SingleSource/Benchmarks/Shootout/methcall: 1.01% (9.1371 => 9.2294, std. dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (8.8613 => 8.7322, std. dev.: 0.0491) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.50% (1.1653 => 1.2061, std. dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: 3.34% (2.1763 => 2.2489, std. dev.: 0.0078) MultiSource/Applications/lemon/lemon: 3.19% (1.0046 => 1.0366, std. dev.: 0.0086) MultiSource/Applications/minisat/minisat: 2.66% (0.6173 => 0.6337, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 1.01% (29.3170 => 29.6144, std. dev.: 0.0364) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.07% (3.4629 => 4.2272, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 14.93% (1.7426 => 2.0027, std. dev.: 0.0515) SingleSource/Benchmarks/McGill/misr: 14.25% (0.4296 => 0.4908, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.55% (4.0101 => 4.5533, std. dev.: 0.0282) SingleSource/Benchmarks/Stanford/Puzzle: 13.40% (0.1433 => 0.1625, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 12.73% (0.3746 => 0.4223, std. dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sieve: 12.61% (3.4406 => 3.8746, std. dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (62.4126 => 69.1286, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: 8.58% (7.0025 => 7.6032, std. dev.: 0.0413) SingleSource/Benchmarks/Shootout/methcall: 7.86% (8.5566 => 9.2294, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.4876 => 3.7209, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.92% (27.1724 => 28.7818, std. dev.: 0.0289) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.3301 => 0.3484, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.27% (0.9851 => 1.0272, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8574, std. dev.: 0.0406) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5396, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.81% (0.5587 => 0.5800, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.47% (4.2129 => 4.3590, std. dev.: 0.0304) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (6.6312 => 6.8360, std. dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 3.07% (5.1938 => 5.3533, std. dev.: 0.0208) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.85% (0.3508 => 0.3608, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 2.60% (8.5113 => 8.7322, std. dev.: 0.0491) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.00% (4.6127 => 4.7051, std. dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (2.4971 => 2.5331, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.27% (6.7458 => 6.8315, std. dev.: 0.0185) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.27% (2.4455 => 2.4765, std. dev.: 0.0061) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.26% (4.0659 => 4.1173, std. dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6697, std. dev.: 0.0093) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4348, std. dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (4.6414 => 4.6901, std. dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.04% (0.2080 => 0.1892, std. dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.84% (0.3497 => 0.2069, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.38% (5.2665 => 4.1932, std. dev.: 0.0357) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.96% (1.1647 => 0.9905, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1574, std. dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.26% (1.4034 => 1.2875, std. dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.80% (3.2007 => 2.9512, std. dev.: 0.0356) SingleSource/Benchmarks/Misc/richards_benchmark: -7.08% (1.4441 => 1.3418, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/pi: -6.31% (1.6538 => 1.5494, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.84% (9.2503 => 8.7097, std. dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.77% (2.9728 => 2.8013, std. dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.94% (3.9413 => 3.7465, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/fibo: -4.94% (4.6355 => 4.4065, std. dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.65% (1.7361 => 1.6727, std. dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -2.98% (7.6833 => 7.4542, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2893, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.66% (3.7496 => 3.6497, std. dev.: 0.0094) MultiSource/Benchmarks/PAQ8p/paq8p: -2.55% (92.7467 => 90.3789, std. dev.: 0.3680) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.92% (1.2722 => 1.2478, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.75% (1.1683 => 1.1478, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (9.3855 => 9.2231, std. dev.: 0.0316) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std. dev.: 0.0008) MultiSource/Applications/aha/aha: -1.55% (3.4286 => 3.3756, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: -1.42% (3.8200 => 3.7657, std. dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3139, std. dev.: 0.0420) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.14% (1.8739 => 1.8526, std. dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 07:32:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 09:32:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831143227.41C0B352400F@llvm.org> http://llvm.org/perf/db_default/v4/nts/3331?compare_to=3330&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3331, Order: 162992, Start Time: 2012-08-31 13:22:02, End Time: 2012-08-31 14:33:30 To: 3330, Order: 162986, Start Time: 2012-08-31 11:54:33, End Time: 2012-08-31 13:06:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 19 (46 on baseline) Performance Improvements: 4 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 867 (813 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.72% (0.0705 => 0.0837, std. dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.02% (0.6979 => 0.7888, std. dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 8.58% (0.1201 => 0.1304, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.2892 => 0.3066, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.41% (0.7711 => 0.7974, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.22% (0.4436 => 0.4579, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.11% (0.5594 => 0.5768, std. dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.86% (1.1562 => 1.1893, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.56% (0.5848 => 0.5998, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.8842 => 0.9042, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.38% (4.2841 => 4.3434, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.33% (1.1804 => 1.1961, std. dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.26% (1.0699 => 1.0834, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.25% (1.5363 => 1.5555, std. dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (6.2385 => 6.3144, std. dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.01% (1.4338 => 1.4483, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.45% (2.6574 => 2.7490, std. dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.44% (0.7472 => 0.7729, std. dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.43% (1.5905 => 1.6132, std. dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -2.62% (8.4167 => 8.1961, std. dev.: 0.0217) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.35% (1.6727 => 1.6501, std. dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.26% (1.1478 => 1.1333, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.04% (1.4370 => 1.4220, std. dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (0.1414 => 0.1522, std. dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.60% (1.1653 => 1.2072, std. dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.26% (0.7722 => 0.7974, std. dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 3.10% (2.1763 => 2.2438, std. dev.: 0.0248) MultiSource/Applications/lemon/lemon: 2.99% (1.0046 => 1.0346, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.5150 => 1.5555, std. dev.: 0.0058) MultiSource/Applications/minisat/minisat: 2.61% (0.6173 => 0.6334, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (12.6413 => 12.8821, std. dev.: 0.0503) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.89% (1.1672 => 1.1893, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.19% (29.3170 => 29.6647, std. dev.: 0.1107) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.13% (1.1827 => 1.1961, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 1.08% (1.1440 => 1.1563, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0281) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.67% (0.0766 => 0.0886, std. dev.: 0.0038) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.05% (0.0917 => 0.1055, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std. dev.: 0.0471) SingleSource/Benchmarks/McGill/misr: 13.66% (0.4296 => 0.4883, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.48% (4.0101 => 4.5506, std. dev.: 0.0387) SingleSource/Benchmarks/Shootout-C++/sieve: 11.26% (3.4406 => 3.8279, std. dev.: 0.0296) MultiSource/Applications/sgefa/sgefa: 11.05% (0.3746 => 0.4160, std. dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 10.71% (62.4126 => 69.0965, std. dev.: 0.0474) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.36% (0.2694 => 0.2973, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.45% (7.0025 => 7.5939, std. dev.: 0.0510) SingleSource/Benchmarks/Stanford/Puzzle: 8.03% (0.1433 => 0.1548, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/methcall: 7.90% (8.5566 => 9.2326, std. dev.: 0.0368) SingleSource/Benchmarks/McGill/chomp: 7.22% (1.0194 => 1.0930, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 6.55% (3.4876 => 3.7160, std. dev.: 0.0165) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7347, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.47% (0.8498 => 0.8878, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/dt: 4.39% (0.9851 => 1.0283, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5385, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 3.83% (8.5113 => 8.8369, std. dev.: 0.0543) SingleSource/Benchmarks/Misc/fp-convert: 3.74% (15.2242 => 15.7936, std. dev.: 0.0624) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.71% (2.4042 => 2.4933, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (4.2129 => 4.3616, std. dev.: 0.0423) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std. dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.13% (2.6656 => 2.7490, std. dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.02% (6.6312 => 6.8312, std. dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.21% (0.5876 => 0.6006, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 2.16% (5.1938 => 5.3061, std. dev.: 0.0346) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.66% (2.4455 => 2.4862, std. dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.58% (0.7609 => 0.7729, std. dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5313, std. dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 1.32% (6.9722 => 7.0639, std. dev.: 0.0292) MultiSource/Applications/hexxagon/hexxagon: 1.25% (14.4877 => 14.6684, std. dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.30% (0.7738 => 0.7560, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.38% (0.3497 => 0.2085, std. dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.54% (5.2665 => 4.0796, std. dev.: 0.0794) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.88% (1.1647 => 0.9914, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1571, std. dev.: 0.0450) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std. dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.66% (3.2007 => 2.9554, std. dev.: 0.0317) SingleSource/Benchmarks/Misc/richards_benchmark: -7.13% (1.4441 => 1.3411, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: -6.42% (9.2503 => 8.6560, std. dev.: 0.1352) SingleSource/Benchmarks/Misc/pi: -6.22% (1.6538 => 1.5510, std. dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.97% (3.9413 => 3.7456, std. dev.: 0.0234) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.95% (1.7361 => 1.6501, std. dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.86% (4.6355 => 4.4102, std. dev.: 0.0352) MultiSource/Applications/SPASS/SPASS: -3.94% (8.5323 => 8.1961, std. dev.: 0.0217) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.25% (1.2959 => 1.2538, std. dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -3.03% (7.6833 => 7.4505, std. dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.00% (1.1683 => 1.1333, std. dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -2.79% (92.7467 => 90.1617, std. dev.: 0.6398) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2851, std. dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.72% (1.2722 => 1.2376, std. dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.39% (3.7496 => 3.6600, std. dev.: 0.0275) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.62% (1.8739 => 1.8435, std. dev.: 0.0081) MultiSource/Applications/aha/aha: -1.62% (3.4286 => 3.3730, std. dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2336, std. dev.: 0.0475) MultiSource/Benchmarks/FreeBench/neural/neural: -1.51% (1.0926 => 1.0761, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3077, std. dev.: 0.0193) SingleSource/Benchmarks/Misc/oourafft: -1.31% (3.8200 => 3.7699, std. dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 10:11:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 12:11:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831171130.C8324352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3332?compare_to=3331&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3332, Order: 162998, Start Time: 2012-08-31 16:00:58, End Time: 2012-08-31 17:12:34 To: 3331, Order: 162992, Start Time: 2012-08-31 13:22:02, End Time: 2012-08-31 14:33:30 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (46 on baseline) Performance Improvements: 0 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 879 (809 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.46% (0.7266 => 0.7445, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.40% (1.1961 => 1.2129, std. dev.: 0.0035) MultiSource/Applications/hbd/hbd: 1.21% (1.3094 => 1.3252, std. dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.91% (2.3676 => 2.5785, std. dev.: 0.0490) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.70% (0.3247 => 0.3497, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 3.32% (1.7300 => 1.7874, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.57% (1.6501 => 1.6925, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/ffbench: 2.37% (1.3886 => 1.4215, std. dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.60% (22.3229 => 22.6805, std. dev.: 0.0805) SingleSource/Benchmarks/Shootout-C++/sieve: 1.55% (3.8279 => 3.8872, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 1.17% (8.6560 => 8.7575, std. dev.: 0.0287) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.71% (1.1653 => 1.2085, std. dev.: 0.0077) MultiSource/Applications/minisat/minisat: 3.58% (0.6173 => 0.6394, std. dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 3.48% (2.1763 => 2.2521, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.7226 => 0.7445, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 2.64% (1.0046 => 1.0311, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.55% (1.1827 => 1.2129, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (12.6413 => 12.9237, std. dev.: 0.0827) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.15% (1.5150 => 1.5475, std. dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.88% (4.2616 => 4.3417, std. dev.: 0.0295) MultiSource/Applications/kimwitu++/kc: 1.82% (15.3105 => 15.5896, std. dev.: 0.0984) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.22% (3.4629 => 4.2322, std. dev.: 0.0100) SingleSource/Benchmarks/Shootout/ary3: 14.74% (1.7426 => 1.9994, std. dev.: 0.0282) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.71% (4.0101 => 4.5597, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/sieve: 12.98% (3.4406 => 3.8872, std. dev.: 0.0035) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.76% (0.0917 => 0.1034, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 12.52% (0.3746 => 0.4215, std. dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 11.65% (0.1433 => 0.1600, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: 11.31% (0.4296 => 0.4782, std. dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 10.72% (62.4126 => 69.1061, std. dev.: 0.0325) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 8.81% (7.0025 => 7.6195, std. dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.40% (1.0063 => 1.0908, std. dev.: 0.0139) SingleSource/Benchmarks/Shootout/methcall: 7.56% (8.5566 => 9.2037, std. dev.: 0.0189) SingleSource/Benchmarks/McGill/chomp: 7.34% (1.0194 => 1.0942, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.4876 => 3.7200, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (0.3301 => 0.3497, std. dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7521, std. dev.: 0.0730) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.70% (40.4792 => 42.7845, std. dev.: 0.6406) SingleSource/Benchmarks/Misc/dt: 4.48% (0.9851 => 1.0292, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: 4.41% (15.2242 => 15.8963, std. dev.: 0.0225) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.01% (2.6656 => 2.7724, std. dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5376, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.10% (6.6312 => 6.8369, std. dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 2.71% (5.1938 => 5.3345, std. dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/ary3: 2.29% (1.7473 => 1.7874, std. dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.65% (6.7458 => 6.8574, std. dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.53% (22.3381 => 22.6805, std. dev.: 0.0805) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (2.4971 => 2.5337, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 1.39% (29.5232 => 29.9348, std. dev.: 0.0516) MultiSource/Benchmarks/Olden/em3d/em3d: 1.23% (4.6414 => 4.6987, std. dev.: 0.0191) MultiSource/Applications/hexxagon/hexxagon: 1.22% (14.4877 => 14.6647, std. dev.: 0.0270) SingleSource/Benchmarks/Shootout/hash: 1.21% (4.3016 => 4.3536, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.08% (3.6254 => 3.6645, std. dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/dry: 1.02% (2.4013 => 2.4257, std. dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.61% (0.7738 => 0.7459, std. dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.15% (0.3497 => 0.2093, std. dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.82% (5.2665 => 4.1176, std. dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9918, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std. dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.34% (3.6023 => 3.3020, std. dev.: 0.0460) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std. dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.93% (3.2007 => 2.9470, std. dev.: 0.0201) SingleSource/Benchmarks/Misc/richards_benchmark: -7.15% (1.4441 => 1.3409, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5502, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7940, std. dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/methcall: -5.33% (9.2503 => 8.7575, std. dev.: 0.0287) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.00% (0.4564 => 0.4336, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.94% (3.9413 => 3.7465, std. dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.86% (0.4140 => 0.3939, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: -4.78% (4.6355 => 4.4138, std. dev.: 0.0375) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.64% (45.4683 => 43.8138, std. dev.: 0.6104) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.10% (2.4457 => 2.3700, std. dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.05% (1.1683 => 1.1327, std. dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.80% (3.7496 => 3.6447, std. dev.: 0.0191) MultiSource/Benchmarks/PAQ8p/paq8p: -2.60% (92.7467 => 90.3368, std. dev.: 0.3229) SingleSource/Benchmarks/Misc/flops: -2.59% (9.5474 => 9.3004, std. dev.: 0.0212) MultiSource/Applications/lambda-0_1_3/lambda: -2.52% (7.6833 => 7.4896, std. dev.: 0.0118) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.51% (1.7361 => 1.6925, std. dev.: 0.0135) MultiSource/Applications/siod/siod: -2.30% (3.5520 => 3.4703, std. dev.: 0.0050) MultiSource/Applications/aha/aha: -1.66% (3.4286 => 3.3716, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2350, std. dev.: 0.0141) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.3569 => 2.3215, std. dev.: 0.0108) MultiSource/Benchmarks/sim/sim: -1.45% (3.8907 => 3.8344, std. dev.: 0.0111) SingleSource/Benchmarks/Misc/oourafft: -1.40% (3.8200 => 3.7665, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.37% (2.8964 => 2.8568, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3233, std. dev.: 0.0311) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 11:39:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 13:39:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831183923.EE38C352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3333?compare_to=3332&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3333, Order: 163003, Start Time: 2012-08-31 17:28:03, End Time: 2012-08-31 18:40:27 To: 3332, Order: 162998, Start Time: 2012-08-31 16:00:58, End Time: 2012-08-31 17:12:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (39 on baseline) Performance Improvements: 8 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 877 (820 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.32% (0.3053 => 0.3185, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.35% (1.4032 => 1.4222, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.63% (15.3127 => 16.7880, std. dev.: 0.1014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.92% (2.3074 => 2.3979, std. dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.12% (1.4227 => 1.4387, std. dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.64% (0.2887 => 0.2753, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: -2.07% (3.9185 => 3.8373, std. dev.: 0.0314) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.96% (4.3417 => 4.2566, std. dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.87% (0.7445 => 0.7306, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.57% (1.2129 => 1.1938, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.36% (1.0848 => 1.0701, std. dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -2.24% (1.4215 => 1.3896, std. dev.: 0.0059) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.84% (2.7724 => 2.7213, std. dev.: 0.0196) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 4.12% (1.1653 => 1.2133, std. dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: 3.60% (2.1763 => 2.2546, std. dev.: 0.0120) MultiSource/Applications/lemon/lemon: 3.19% (1.0046 => 1.0366, std. dev.: 0.0124) MultiSource/Applications/minisat/minisat: 2.95% (0.6173 => 0.6355, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.5150 => 1.5578, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.04% (12.6413 => 12.8991, std. dev.: 0.0924) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (0.7639 => 0.7770, std. dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 14.93% (1.7426 => 2.0028, std. dev.: 0.0222) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.65% (4.0101 => 4.5573, std. dev.: 0.0132) SingleSource/Benchmarks/McGill/misr: 13.62% (0.4296 => 0.4881, std. dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 13.47% (0.1433 => 0.1626, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sieve: 12.76% (3.4406 => 3.8797, std. dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.34% (0.0917 => 0.1021, std. dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 10.71% (62.4126 => 69.0986, std. dev.: 0.1394) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.58% (0.2694 => 0.2979, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.91% (7.0025 => 7.6266, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.58% (1.0063 => 1.0926, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout/methcall: 7.46% (8.5566 => 9.1952, std. dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 7.28% (1.0194 => 1.0936, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (3.4876 => 3.7174, std. dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.04% (15.8312 => 16.7880, std. dev.: 0.1014) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.76% (27.1724 => 28.7377, std. dev.: 0.0461) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.27% (40.4792 => 42.6111, std. dev.: 0.1372) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (0.3301 => 0.3448, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/dt: 4.26% (0.9851 => 1.0271, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8504, std. dev.: 0.0345) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5379, std. dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.01% (6.6312 => 6.8307, std. dev.: 0.0150) SingleSource/Benchmarks/Misc/ReedSolomon: 2.48% (8.5113 => 8.7226, std. dev.: 0.0800) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.09% (2.6656 => 2.7213, std. dev.: 0.0196) MultiSource/Benchmarks/BitBench/five11/five11: 2.04% (5.1938 => 5.2998, std. dev.: 0.0216) SingleSource/Benchmarks/Dhrystone/fldry: 1.89% (2.4971 => 2.5442, std. dev.: 0.0143) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.84% (1.6110 => 1.6407, std. dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 1.21% (14.4877 => 14.6631, std. dev.: 0.0170) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.06% (3.6254 => 3.6638, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.69% (5.2665 => 4.1768, std. dev.: 0.0770) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.94% (1.1647 => 0.9907, std. dev.: 0.0252) SingleSource/Benchmarks/Shootout/sieve: -12.20% (8.1594 => 7.1637, std. dev.: 0.0236) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std. dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.14% (3.2007 => 2.9401, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -7.15% (1.4441 => 1.3409, std. dev.: 0.0051) SingleSource/Benchmarks/Misc/pi: -6.19% (1.6538 => 1.5515, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7457, std. dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/fibo: -4.93% (4.6355 => 4.4069, std. dev.: 0.0359) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.73% (0.4140 => 0.3944, std. dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.28% (1.2722 => 1.2305, std. dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -3.02% (7.6833 => 7.4509, std. dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: -2.80% (92.7467 => 90.1493, std. dev.: 0.1916) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2859, std. dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.41% (1.1683 => 1.1402, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.18% (2.4457 => 2.3923, std. dev.: 0.0130) MultiSource/Applications/siod/siod: -2.15% (3.5520 => 3.4758, std. dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.09% (3.7496 => 3.6714, std. dev.: 0.0222) MultiSource/Applications/aha/aha: -1.76% (3.4286 => 3.3681, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (9.3855 => 9.2279, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/ffbench: -1.57% (1.4117 => 1.3896, std. dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: -1.52% (1.7330 => 1.7067, std. dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3177, std. dev.: 0.0513) SingleSource/Benchmarks/Misc/oourafft: -1.33% (3.8200 => 3.7692, std. dev.: 0.0103) MultiSource/Benchmarks/sim/sim: -1.13% (3.8907 => 3.8466, std. dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 13:07:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 15:07:50 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831200750.EE04A352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3334?compare_to=3333&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3334, Order: 163012, Start Time: 2012-08-31 18:57:54, End Time: 2012-08-31 20:08:49 To: 3333, Order: 163003, Start Time: 2012-08-31 17:28:03, End Time: 2012-08-31 18:40:27 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (43 on baseline) Performance Improvements: 1 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 883 (816 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 2.21% (3.8373 => 3.9221, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.03% (0.8831 => 0.9010, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.65% (1.4018 => 1.4249, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.38% (8.2647 => 8.3790, std. dev.: 0.0163) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.24% (1.1673 => 1.1818, std. dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: 1.51% (8.7226 => 8.8542, std. dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6407 => 1.6223, std. dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lemon/lemon: 2.91% (1.0046 => 1.0338, std. dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.7639 => 0.7858, std. dev.: 0.0034) MultiSource/Applications/minisat/minisat: 2.64% (0.6173 => 0.6336, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.5309 => 0.5417, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.97% (1.3935 => 1.4210, std. dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.84% (12.6413 => 12.8745, std. dev.: 0.0776) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.76% (1.5150 => 1.5417, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.49% (8.2559 => 8.3790, std. dev.: 0.0163) MultiSource/Applications/Burg/burg: 1.44% (1.1440 => 1.1605, std. dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.36% (3.0225 => 3.0636, std. dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.25% (1.1672 => 1.1818, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.24% (1.1827 => 1.1974, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 1.10% (3.8796 => 3.9221, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.54% (0.0766 => 0.0931, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 15.02% (1.7426 => 2.0044, std. dev.: 0.0067) SingleSource/Benchmarks/McGill/misr: 13.83% (0.4296 => 0.4890, std. dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5473, std. dev.: 0.0586) MultiSource/Applications/sgefa/sgefa: 12.73% (0.3746 => 0.4223, std. dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.93% (0.1433 => 0.1604, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 10.77% (62.4126 => 69.1326, std. dev.: 0.0201) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sieve: 9.89% (3.4406 => 3.7810, std. dev.: 0.0552) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.47% (1.0063 => 1.1016, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6039, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout/methcall: 6.60% (8.5566 => 9.1216, std. dev.: 0.0469) SingleSource/Benchmarks/Shootout-C++/hash2: 6.55% (3.4876 => 3.7161, std. dev.: 0.0396) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7414, std. dev.: 0.0421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.41% (40.4792 => 42.6686, std. dev.: 0.4484) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (0.3301 => 0.3463, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.41% (0.9851 => 1.0285, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 4.03% (8.5113 => 8.8542, std. dev.: 0.0240) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.89% (0.7609 => 0.7905, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/fp-convert: 3.47% (15.2242 => 15.7528, std. dev.: 0.0840) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.09% (6.6312 => 6.8360, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.59% (0.5876 => 0.6028, std. dev.: 0.0048) MultiSource/Benchmarks/BitBench/five11/five11: 2.04% (5.1938 => 5.2996, std. dev.: 0.0259) MultiSource/Benchmarks/Bullet/bullet: 1.43% (6.9722 => 7.0719, std. dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: 1.21% (14.4877 => 14.6635, std. dev.: 0.0413) MultiSource/Benchmarks/Olden/power/power: 1.16% (1.4184 => 1.4349, std. dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.11% (4.6414 => 4.6931, std. dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.03% (0.7738 => 0.7581, std. dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.95% (0.3497 => 0.2100, std. dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.33% (5.2665 => 4.0903, std. dev.: 0.0393) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.92% (1.1647 => 0.9909, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9415, std. dev.: 0.0522) SingleSource/Benchmarks/Misc/richards_benchmark: -6.95% (1.4441 => 1.3438, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: -6.31% (9.2503 => 8.6666, std. dev.: 0.0248) SingleSource/Benchmarks/Misc/pi: -6.23% (1.6538 => 1.5508, std. dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.97% (3.9413 => 3.7454, std. dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4080, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.61% (1.7361 => 1.6735, std. dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.29% (1.2959 => 1.2533, std. dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.18% (1.1683 => 1.1311, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -3.06% (7.6833 => 7.4479, std. dev.: 0.0466) MultiSource/Benchmarks/PAQ8p/paq8p: -2.83% (92.7467 => 90.1238, std. dev.: 0.3800) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2844, std. dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.63% (3.7496 => 3.6510, std. dev.: 0.0349) MultiSource/Applications/siod/siod: -2.31% (3.5520 => 3.4701, std. dev.: 0.0146) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.85% (2.8964 => 2.8427, std. dev.: 0.0034) MultiSource/Applications/aha/aha: -1.84% (3.4286 => 3.3656, std. dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2314, std. dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.8200 => 3.7647, std. dev.: 0.0156) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3070, std. dev.: 0.0337) SingleSource/Benchmarks/Shootout-C++/lists: -1.08% (16.5617 => 16.3834, std. dev.: 0.0184) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 7.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 14:35:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 16:35:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831213556.99BCB352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3335?compare_to=3334&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3335, Order: 163013, Start Time: 2012-08-31 20:24:12, End Time: 2012-08-31 21:36:53 To: 3334, Order: 163012, Start Time: 2012-08-31 18:57:54, End Time: 2012-08-31 20:08:49 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (50 on baseline) Performance Improvements: 3 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (808 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 6.12% (0.2502 => 0.2655, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.90% (2.6578 => 2.7615, std. dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/sieve: 2.63% (3.7810 => 3.8806, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: 1.58% (2.3587 => 2.3960, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout/hash: 1.45% (4.3116 => 4.3743, std. dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.25% (1.2742 => 1.2901, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: 1.08% (15.7528 => 15.9229, std. dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.40% (1.4210 => 1.4011, std. dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.29% (0.7858 => 0.7757, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -1.20% (3.9221 => 3.8752, std. dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.24% (1.1653 => 1.2031, std. dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: 3.14% (2.1763 => 2.2447, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (12.6413 => 13.0135, std. dev.: 0.1119) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.5150 => 1.5548, std. dev.: 0.0146) MultiSource/Applications/minisat/minisat: 2.51% (0.6173 => 0.6328, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.75% (0.5937 => 0.6041, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.62% (1.4113 => 1.4342, std. dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.54% (0.7639 => 0.7757, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.29% (6.2546 => 6.3352, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.15% (1.2021 => 1.2159, std. dev.: 0.0043) MultiSource/Applications/d/make_dparser: 1.10% (3.0225 => 3.0557, std. dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 1.02% (29.3170 => 29.6164, std. dev.: 0.0274) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.15% (3.4629 => 4.2300, std. dev.: 0.0303) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.23% (0.0917 => 0.1075, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 15.12% (1.7426 => 2.0060, std. dev.: 0.0204) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.10% (0.0766 => 0.0874, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.87% (4.0101 => 4.5663, std. dev.: 0.0251) SingleSource/Benchmarks/McGill/misr: 13.59% (0.4296 => 0.4880, std. dev.: 0.0016) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 12.79% (3.4406 => 3.8806, std. dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 12.71% (0.3746 => 0.4222, std. dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 10.69% (62.4126 => 69.0872, std. dev.: 0.0297) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.44% (15.8312 => 17.4841, std. dev.: 0.4812) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6245, std. dev.: 0.0118) SingleSource/Benchmarks/Shootout/methcall: 7.51% (8.5566 => 9.1993, std. dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.4876 => 3.7223, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.54% (0.3301 => 0.3517, std. dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.89% (27.1724 => 28.7735, std. dev.: 0.0950) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (2.4042 => 2.5211, std. dev.: 0.0429) SingleSource/Benchmarks/Misc/fp-convert: 4.59% (15.2242 => 15.9229, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/dt: 4.25% (0.9851 => 1.0270, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.73% (3.4080 => 3.5351, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.60% (2.6656 => 2.7615, std. dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.12% (6.6312 => 6.8382, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 3.06% (5.1938 => 5.3526, std. dev.: 0.0456) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.94% (0.5587 => 0.5751, std. dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.89% (0.5876 => 0.6046, std. dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.88% (0.3508 => 0.3609, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 2.53% (8.5113 => 8.7268, std. dev.: 0.0513) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.36% (4.6127 => 4.7215, std. dev.: 0.0385) SingleSource/Benchmarks/Misc/whetstone: 2.16% (2.3453 => 2.3960, std. dev.: 0.0095) SingleSource/Benchmarks/Shootout/hash: 1.69% (4.3016 => 4.3743, std. dev.: 0.0132) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4455 => 2.4828, std. dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 1.48% (6.9722 => 7.0756, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.38% (1.2726 => 1.2901, std. dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 1.36% (6.7458 => 6.8377, std. dev.: 0.0296) MultiSource/Applications/hexxagon/hexxagon: 1.26% (14.4877 => 14.6709, std. dev.: 0.0162) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0052) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (4.6414 => 4.6940, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.05% (3.6254 => 3.6636, std. dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.00% (0.7738 => 0.7583, std. dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.06% (0.3497 => 0.2096, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.49% (5.2665 => 4.1873, std. dev.: 0.0741) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.88% (1.1647 => 0.9914, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: -12.22% (8.1594 => 7.1623, std. dev.: 0.0306) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.24% (1.4034 => 1.2877, std. dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.65% (3.2007 => 2.9558, std. dev.: 0.0163) SingleSource/Benchmarks/Misc/richards_benchmark: -6.99% (1.4441 => 1.3431, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: -6.24% (1.6538 => 1.5506, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/methcall: -5.69% (9.2503 => 8.7238, std. dev.: 0.0680) SingleSource/Benchmarks/Shootout-C++/fibo: -4.96% (4.6355 => 4.4058, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.95% (3.9413 => 3.7462, std. dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.72% (1.7361 => 1.6715, std. dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (7.6833 => 7.4554, std. dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.93% (2.4457 => 2.3741, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/flops: -2.73% (9.5474 => 9.2871, std. dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -2.63% (92.7467 => 90.3100, std. dev.: 0.1187) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.50% (1.2722 => 1.2404, std. dev.: 0.0103) MultiSource/Applications/siod/siod: -2.30% (3.5520 => 3.4703, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.18% (1.1683 => 1.1428, std. dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.09% (3.7496 => 3.6714, std. dev.: 0.0241) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2292, std. dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std. dev.: 0.0002) MultiSource/Applications/aha/aha: -1.61% (3.4286 => 3.3734, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/oourafft: -1.44% (3.8200 => 3.7651, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.42% (2.3569 => 2.3235, std. dev.: 0.0119) MultiSource/Benchmarks/FreeBench/neural/neural: -1.40% (1.0926 => 1.0773, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.32% (25.6658 => 25.3272, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists: -1.08% (16.5617 => 16.3836, std. dev.: 0.0498) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 7.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 16:03:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 18:03:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120831230306.4123D352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3336?compare_to=3335&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3336, Order: 163022, Start Time: 2012-08-31 21:52:42, End Time: 2012-08-31 23:04:09 To: 3335, Order: 163013, Start Time: 2012-08-31 20:24:12, End Time: 2012-08-31 21:36:53 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (44 on baseline) Performance Improvements: 2 (31 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (814 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.7605 => 0.7793, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.85% (0.5679 => 0.5784, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.80% (0.5618 => 0.5719, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.2600 => 1.2776, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 1.34% (1.3229 => 1.3406, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.09% (2.4795 => 2.5313, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.29% (1.6715 => 1.6931, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.57% (41.0891 => 39.2122, std. dev.: 0.0678) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.26% (17.4841 => 16.9138, std. dev.: 0.1231) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: 3.61% (1.1653 => 1.2074, std. dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (12.6413 => 13.0797, std. dev.: 0.0809) MultiSource/Benchmarks/McCat/18-imp/imp: 3.14% (0.3217 => 0.3318, std. dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 3.13% (2.1763 => 2.2445, std. dev.: 0.0162) MultiSource/Applications/minisat/minisat: 3.05% (0.6173 => 0.6361, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.04% (0.7722 => 0.7957, std. dev.: 0.0036) MultiSource/Applications/lemon/lemon: 2.87% (1.0046 => 1.0334, std. dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.18% (4.0318 => 4.0793, std. dev.: 0.0092) MultiSource/Applications/hbd/hbd: 1.04% (1.3268 => 1.3406, std. dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.77% (0.0263 => 0.0386, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std. dev.: 0.0194) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.54% (0.0766 => 0.0931, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std. dev.: 0.0047) SingleSource/Benchmarks/McGill/misr: 13.78% (0.4296 => 0.4888, std. dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.21% (4.0101 => 4.5397, std. dev.: 0.0255) MultiSource/Applications/sgefa/sgefa: 12.73% (0.3746 => 0.4223, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sieve: 12.73% (3.4406 => 3.8786, std. dev.: 0.0160) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.65% (0.0917 => 0.1033, std. dev.: 0.0023) SingleSource/Benchmarks/Stanford/Puzzle: 12.14% (0.1433 => 0.1607, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 10.70% (62.4126 => 69.0897, std. dev.: 0.0297) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 8.83% (7.0025 => 7.6205, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout/methcall: 7.27% (8.5566 => 9.1783, std. dev.: 0.0300) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.21% (0.3301 => 0.3539, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.94% (1.0063 => 1.0761, std. dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash2: 6.88% (3.4876 => 3.7275, std. dev.: 0.0376) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.84% (15.8312 => 16.9138, std. dev.: 0.1231) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.81% (27.1724 => 28.7511, std. dev.: 0.0776) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: 4.00% (15.2242 => 15.8339, std. dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std. dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.49% (2.3580 => 2.4404, std. dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.14% (6.6312 => 6.8391, std. dev.: 0.0058) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.08% (0.3508 => 0.3616, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.06% (2.6656 => 2.7471, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5113 => 8.7576, std. dev.: 0.0447) MultiSource/Benchmarks/BitBench/five11/five11: 2.87% (5.1938 => 5.3430, std. dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.85% (0.5587 => 0.5746, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.58% (2.4455 => 2.5087, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/whetstone: 1.67% (2.3453 => 2.3845, std. dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (2.4971 => 2.5313, std. dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 1.28% (14.4877 => 14.6726, std. dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.11% (4.6414 => 4.6928, std. dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.96% (0.2080 => 0.1956, std. dev.: 0.0034) MultiSource/Applications/spiff/spiff: -1.96% (0.7738 => 0.7586, std. dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.09% (0.3497 => 0.2095, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.66% (5.2665 => 4.1787, std. dev.: 0.1128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.80% (1.1647 => 0.9923, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std. dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.24% (3.2007 => 2.9371, std. dev.: 0.0245) SingleSource/Benchmarks/Misc/richards_benchmark: -7.12% (1.4441 => 1.3413, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/methcall: -6.41% (9.2503 => 8.6571, std. dev.: 0.1443) SingleSource/Benchmarks/Misc/pi: -6.29% (1.6538 => 1.5498, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7457, std. dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -4.87% (4.6355 => 4.4096, std. dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.35% (1.2722 => 1.2296, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -2.96% (7.6833 => 7.4555, std. dev.: 0.0094) SingleSource/Benchmarks/Misc/flops: -2.83% (9.5474 => 9.2771, std. dev.: 0.0520) MultiSource/Benchmarks/nbench/nbench: -2.83% (21.1721 => 20.5727, std. dev.: 0.1956) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.72% (1.1683 => 1.1365, std. dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.68% (3.7496 => 3.6492, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.48% (1.7361 => 1.6931, std. dev.: 0.0027) MultiSource/Applications/siod/siod: -2.27% (3.5520 => 3.4715, std. dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: -2.06% (92.7467 => 90.8370, std. dev.: 0.6083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.03% (61.1734 => 59.9339, std. dev.: 0.4465) MultiSource/Applications/aha/aha: -1.72% (3.4286 => 3.3695, std. dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2285, std. dev.: 0.0289) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3131, std. dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -1.35% (3.8907 => 3.8381, std. dev.: 0.0178) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 17:30:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 19:30:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901003003.27A26352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3337?compare_to=3336&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3337, Order: 163034, Start Time: 2012-08-31 23:20:08, End Time: 2012-09-01 00:31:05 To: 3336, Order: 163022, Start Time: 2012-08-31 21:52:42, End Time: 2012-08-31 23:04:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (36 on baseline) Performance Improvements: 6 (33 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 882 (820 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.53% (1.8132 => 1.8590, std. dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.73% (2.4912 => 2.5342, std. dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: -1.87% (0.5454 => 0.5352, std. dev.: 0.0023) MultiSource/Applications/lua/lua: -1.34% (3.6076 => 3.5594, std. dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.33% (0.7816 => 0.7712, std. dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -3.20% (2.4219 => 2.3444, std. dev.: 0.0125) MultiSource/Applications/minisat/minisat: -1.68% (6.3098 => 6.2036, std. dev.: 0.0133) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.03% (2.5087 => 2.4828, std. dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (2.1763 => 2.2407, std. dev.: 0.0186) MultiSource/Applications/minisat/minisat: 1.88% (0.6173 => 0.6289, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.77% (0.0263 => 0.0386, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2274, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std. dev.: 0.0233) SingleSource/Benchmarks/McGill/misr: 13.59% (0.4296 => 0.4880, std. dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5494, std. dev.: 0.0165) SingleSource/Benchmarks/Stanford/Puzzle: 12.91% (0.1433 => 0.1618, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 12.71% (0.3746 => 0.4222, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 12.38% (3.4406 => 3.8665, std. dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 10.81% (62.4126 => 69.1615, std. dev.: 0.0602) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.43% (0.2694 => 0.2975, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6255, std. dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: 8.28% (1.0194 => 1.1038, std. dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.85% (1.0063 => 1.0853, std. dev.: 0.0202) SingleSource/Benchmarks/Shootout/methcall: 7.16% (8.5566 => 9.1693, std. dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (3.4876 => 3.7254, std. dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (27.1724 => 28.7359, std. dev.: 0.1504) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std. dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.41% (2.4042 => 2.5342, std. dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.95% (40.4792 => 42.4829, std. dev.: 0.5543) SingleSource/Benchmarks/Misc/dt: 4.43% (0.9851 => 1.0287, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8514, std. dev.: 0.0530) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 3.85% (8.5113 => 8.8386, std. dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.05% (6.6312 => 6.8332, std. dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.68% (0.5587 => 0.5737, std. dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.40% (0.5876 => 0.6017, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.6308 => 0.6455, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.04% (4.6127 => 4.7069, std. dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.53% (2.4455 => 2.4828, std. dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/fldry: 1.40% (2.4971 => 2.5321, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.30% (6.7458 => 6.8337, std. dev.: 0.0186) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6714, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (4.6414 => 4.6895, std. dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lua/lua: -1.07% (3.5980 => 3.5594, std. dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.35% (0.3497 => 0.2121, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.39% (5.2665 => 4.1401, std. dev.: 0.1301) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.06% (1.1647 => 0.9893, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std. dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std. dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.79% (3.2007 => 2.9513, std. dev.: 0.0542) SingleSource/Benchmarks/Misc/richards_benchmark: -6.91% (1.4441 => 1.3443, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: -6.26% (1.6538 => 1.5502, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7928, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -5.81% (9.2503 => 8.7126, std. dev.: 0.0452) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.02% (0.4564 => 0.4335, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.93% (3.9413 => 3.7471, std. dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/fibo: -4.83% (4.6355 => 4.4115, std. dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.14% (2.4457 => 2.3444, std. dev.: 0.0125) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.82% (1.7361 => 1.6697, std. dev.: 0.0117) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.37% (1.2722 => 1.2293, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -3.04% (7.6833 => 7.4496, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2845, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.58% (1.1683 => 1.1381, std. dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.38% (3.7496 => 3.6603, std. dev.: 0.0239) MultiSource/Applications/siod/siod: -2.30% (3.5520 => 3.4704, std. dev.: 0.0197) MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (92.7467 => 90.8026, std. dev.: 0.4798) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.04% (0.6119 => 0.5994, std. dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (9.3855 => 9.2198, std. dev.: 0.0267) MultiSource/Applications/aha/aha: -1.76% (3.4286 => 3.3682, std. dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: -1.57% (1.7330 => 1.7058, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.55% (3.8907 => 3.8303, std. dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3106, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: -1.32% (3.8200 => 3.7695, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: -1.19% (16.5617 => 16.3650, std. dev.: 0.0275) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 18:57:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 20:57:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901015705.31FE8352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3338?compare_to=3337&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3338, Order: 163040, Start Time: 2012-09-01 00:46:57, End Time: 2012-09-01 01:58:07 To: 3337, Order: 163034, Start Time: 2012-08-31 23:20:08, End Time: 2012-09-01 00:31:05 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (53 on baseline) Performance Improvements: 0 (35 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 875 (801 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.96% (0.7846 => 0.8078, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 2.72% (0.8221 => 0.8445, std. dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.86% (4.2135 => 4.2917, std. dev.: 0.0148) MultiSource/Applications/hbd/hbd: 1.82% (1.3220 => 1.3461, std. dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.56% (1.4004 => 1.4223, std. dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 1.56% (13.3459 => 13.5542, std. dev.: 0.0698) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.41% (8.2137 => 8.3293, std. dev.: 0.0234) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (6.2325 => 6.3078, std. dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 6.56% (3.0681 => 3.2694, std. dev.: 0.0675) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.56% (1.3388 => 1.3998, std. dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.17% (2.2754 => 2.3702, std. dev.: 0.0362) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.10% (3.3775 => 3.5161, std. dev.: 0.0195) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.22% (2.6714 => 2.7575, std. dev.: 0.0088) MultiSource/Applications/minisat/minisat: 1.41% (6.2036 => 6.2910, std. dev.: 0.0170) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.22% (4.0745 => 4.1241, std. dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.61% (0.7722 => 0.8078, std. dev.: 0.0047) MultiSource/Applications/lemon/lemon: 3.83% (1.0046 => 1.0431, std. dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 3.33% (1.1653 => 1.2041, std. dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: 3.03% (2.1763 => 2.2422, std. dev.: 0.0083) MultiSource/Applications/minisat/minisat: 2.51% (0.6173 => 0.6328, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (12.6413 => 12.9355, std. dev.: 0.0386) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.07% (1.3935 => 1.4223, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.95% (1.5150 => 1.5445, std. dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 1.73% (13.3238 => 13.5542, std. dev.: 0.0698) MultiSource/Applications/d/make_dparser: 1.70% (3.0225 => 3.0738, std. dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 1.52% (29.3170 => 29.7629, std. dev.: 0.1030) MultiSource/Applications/hbd/hbd: 1.45% (1.3268 => 1.3461, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.44% (0.7639 => 0.7749, std. dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 40.30% (0.0263 => 0.0369, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std. dev.: 0.0101) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.58% (0.0766 => 0.0893, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 15.10% (1.7426 => 2.0057, std. dev.: 0.0224) SingleSource/Benchmarks/McGill/misr: 13.48% (0.4296 => 0.4875, std. dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5463, std. dev.: 0.0375) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.93% (3.4406 => 3.8853, std. dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 11.61% (0.3746 => 0.4181, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 10.80% (62.4126 => 69.1545, std. dev.: 0.0883) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.47% (0.2694 => 0.2976, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6085, std. dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.06% (3.0256 => 3.2694, std. dev.: 0.0675) SingleSource/Benchmarks/Shootout/methcall: 7.48% (8.5566 => 9.1970, std. dev.: 0.0094) SingleSource/Benchmarks/McGill/chomp: 7.09% (1.0194 => 1.0917, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (3.4876 => 3.7261, std. dev.: 0.0209) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (27.1724 => 28.7404, std. dev.: 0.0695) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.43% (1.0063 => 1.0609, std. dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.34% (40.4792 => 42.6426, std. dev.: 0.5097) SingleSource/Benchmarks/Misc/fp-convert: 4.46% (15.2242 => 15.9039, std. dev.: 0.0136) SingleSource/Benchmarks/Misc/ReedSolomon: 4.03% (8.5113 => 8.8539, std. dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: 3.89% (0.9851 => 1.0234, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.45% (2.6656 => 2.7575, std. dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.12% (6.6312 => 6.8381, std. dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.62% (0.5876 => 0.6030, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.57% (0.8498 => 0.8716, std. dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.6127 => 4.7081, std. dev.: 0.0033) MultiSource/Benchmarks/BitBench/five11/five11: 1.81% (5.1938 => 5.2880, std. dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/hash: 1.59% (0.6308 => 0.6408, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.57% (2.4971 => 2.5364, std. dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.55% (2.4455 => 2.4835, std. dev.: 0.0022) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.43% (4.0659 => 4.1241, std. dev.: 0.0020) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.32% (2.9152 => 2.9536, std. dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6722, std. dev.: 0.0174) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.12% (3.6254 => 3.6659, std. dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (4.6414 => 4.6920, std. dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.07% (6.2244 => 6.2910, std. dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.24% (0.2080 => 0.1971, std. dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.13% (4.2815 => 4.2331, std. dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.81% (0.3497 => 0.2070, std. dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.31% (5.2665 => 4.0915, std. dev.: 0.0555) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -15.01% (1.1647 => 0.9899, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1609, std. dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.38% (3.2007 => 2.9326, std. dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -7.04% (1.4441 => 1.3425, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/pi: -6.28% (1.6538 => 1.5500, std. dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7960, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.71% (9.2503 => 8.7223, std. dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7457, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.84% (4.6355 => 4.4111, std. dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.76% (0.4140 => 0.3943, std. dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.93% (1.7361 => 1.6678, std. dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.31% (1.2722 => 1.2301, std. dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -3.03% (7.6833 => 7.4504, std. dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.87% (1.2959 => 1.2587, std. dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.75% (3.7496 => 3.6464, std. dev.: 0.0234) SingleSource/Benchmarks/Misc/flops: -2.71% (9.5474 => 9.2888, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.66% (1.1683 => 1.1372, std. dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -2.53% (92.7467 => 90.3975, std. dev.: 0.5112) SingleSource/Benchmarks/Shootout-C++/ackermann: -2.39% (3.6023 => 3.5161, std. dev.: 0.0195) MultiSource/Applications/siod/siod: -2.20% (3.5520 => 3.4738, std. dev.: 0.0146) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2246, std. dev.: 0.0234) MultiSource/Applications/aha/aha: -1.71% (3.4286 => 3.3699, std. dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -1.37% (1.7330 => 1.7093, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3154, std. dev.: 0.0466) SingleSource/Benchmarks/Misc/oourafft: -1.35% (3.8200 => 3.7684, std. dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -1.29% (3.8907 => 3.8407, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.00% (3.6388 => 3.6024, std. dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 20:24:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 31 Aug 2012 22:24:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901032401.BF437352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3339?compare_to=3338&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3339, Order: 163041, Start Time: 2012-09-01 02:13:53, End Time: 2012-09-01 03:25:03 To: 3338, Order: 163040, Start Time: 2012-09-01 00:46:57, End Time: 2012-09-01 01:58:07 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (54 on baseline) Performance Improvements: 0 (30 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 880 (805 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.57% (0.5450 => 0.5808, std. dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.06% (0.2955 => 0.3075, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.57% (0.7510 => 0.7778, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.35% (0.8801 => 0.9096, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.52% (0.5466 => 0.5604, std. dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.5869 => 0.5993, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.92% (0.5635 => 0.5743, std. dev.: 0.0022) MultiSource/Applications/lua/lua: 1.37% (3.5711 => 3.6199, std. dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.0652 => 1.0776, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: 4.37% (4.0915 => 4.2703, std. dev.: 0.0145) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 9.41% (0.1414 => 0.1547, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.24% (0.7722 => 0.8127, std. dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 3.96% (1.1653 => 1.2114, std. dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.67% (0.3217 => 0.3335, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.93% (1.5150 => 1.5594, std. dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 2.91% (2.1763 => 2.2397, std. dev.: 0.0137) MultiSource/Applications/lemon/lemon: 2.91% (1.0046 => 1.0338, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 2.76% (1.1440 => 1.1756, std. dev.: 0.0084) MultiSource/Applications/minisat/minisat: 2.45% (0.6173 => 0.6324, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (12.6413 => 12.9273, std. dev.: 0.0636) MultiSource/Applications/hbd/hbd: 2.20% (1.3268 => 1.3560, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.90% (0.5636 => 0.5743, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.84% (3.0225 => 3.0780, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.73% (1.1827 => 1.2032, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.71% (8.2559 => 8.3974, std. dev.: 0.0192) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.71% (1.1672 => 1.1872, std. dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 1.36% (13.3238 => 13.5044, std. dev.: 0.0574) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.6079 => 14.7777, std. dev.: 0.0196) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2546 => 6.3238, std. dev.: 0.0087) MultiSource/Applications/kimwitu++/kc: 1.01% (15.3105 => 15.4645, std. dev.: 0.0482) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std. dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.84% (0.0766 => 0.0895, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std. dev.: 0.0511) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.53% (4.0101 => 4.5528, std. dev.: 0.0497) MultiSource/Applications/sgefa/sgefa: 12.57% (0.3746 => 0.4217, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: 11.78% (0.4296 => 0.4802, std. dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 10.69% (62.4126 => 69.0848, std. dev.: 0.0321) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.59% (1.0063 => 1.1129, std. dev.: 0.0274) MultiSource/Benchmarks/BitBench/drop3/drop3: 10.39% (0.2694 => 0.2974, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 10.31% (3.4406 => 3.7952, std. dev.: 0.0484) SingleSource/Benchmarks/Shootout/lists: 8.93% (7.0025 => 7.6277, std. dev.: 0.0373) SingleSource/Benchmarks/McGill/chomp: 7.79% (1.0194 => 1.0988, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout/methcall: 7.28% (8.5566 => 9.1794, std. dev.: 0.0583) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.4876 => 3.7223, std. dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (27.1724 => 28.7325, std. dev.: 0.0729) SingleSource/Benchmarks/Misc/dt: 4.17% (0.9851 => 1.0262, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.03% (4.2129 => 4.3825, std. dev.: 0.0432) SingleSource/Benchmarks/Misc/fp-convert: 3.98% (15.2242 => 15.8303, std. dev.: 0.0438) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.66% (0.8498 => 0.8809, std. dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.38% (0.5587 => 0.5776, std. dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.99% (6.6312 => 6.8292, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5113 => 8.7560, std. dev.: 0.0410) MultiSource/Benchmarks/BitBench/five11/five11: 2.06% (5.1938 => 5.3009, std. dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/hash: 1.62% (0.6308 => 0.6410, std. dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 1.39% (6.9722 => 7.0690, std. dev.: 0.0144) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (2.4971 => 2.5309, std. dev.: 0.0098) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.27% (2.9152 => 2.9523, std. dev.: 0.0116) MultiSource/Applications/hexxagon/hexxagon: 1.21% (14.4877 => 14.6635, std. dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.21% (2.4455 => 2.4750, std. dev.: 0.0110) MultiSource/Benchmarks/Olden/power/power: 1.15% (1.4184 => 1.4347, std. dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.10% (1.6110 => 1.6288, std. dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6906, std. dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.46% (0.3497 => 0.2117, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.92% (5.2665 => 4.2703, std. dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9918, std. dev.: 0.0280) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std. dev.: 0.0393) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.56% (3.2007 => 2.9266, std. dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -7.06% (1.4441 => 1.3421, std. dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: -6.52% (9.2503 => 8.6470, std. dev.: 0.1377) SingleSource/Benchmarks/Misc/pi: -6.23% (1.6538 => 1.5508, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std. dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.02% (0.4564 => 0.4335, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7458, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4080, std. dev.: 0.0121) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.82% (1.7361 => 1.6698, std. dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.4140 => 0.3987, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -3.11% (7.6833 => 7.4442, std. dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -2.75% (92.7467 => 90.2004, std. dev.: 0.2864) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2853, std. dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.60% (3.7496 => 3.6521, std. dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.45% (1.1683 => 1.1397, std. dev.: 0.0039) MultiSource/Applications/siod/siod: -2.03% (3.5520 => 3.4798, std. dev.: 0.0076) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3634, std. dev.: 0.0113) MultiSource/Benchmarks/Olden/tsp/tsp: -1.89% (1.7330 => 1.7003, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2287, std. dev.: 0.0130) MultiSource/Benchmarks/FreeBench/neural/neural: -1.63% (1.0926 => 1.0748, std. dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std. dev.: 0.0042) MultiSource/Benchmarks/sim/sim: -1.46% (3.8907 => 3.8339, std. dev.: 0.0132) SingleSource/Benchmarks/Misc/oourafft: -1.39% (3.8200 => 3.7669, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3105, std. dev.: 0.0861) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.15% (1.8739 => 1.8523, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 3.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Aug 31 22:47:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 1 Sep 2012 00:47:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20120901054734.87831352400E@llvm.org> http://llvm.org/perf/db_default/v4/nts/3340?compare_to=3339&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 3340, Order: 163049, Start Time: 2012-09-01 04:36:30, End Time: 2012-09-01 05:48:40 To: 3339, Order: 163041, Start Time: 2012-09-01 02:13:53, End Time: 2012-09-01 03:25:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (49 on baseline) Performance Improvements: 2 (34 on baseline) Existing Failures: 78 (78 on baseline) Unchanged Tests: 881 (806 on baseline) Total Tests: 968 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 3.85% (8.8424 => 9.1829, std. dev.: 0.0396) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.37% (14.7946 => 17.2164, std. dev.: 0.6463) MultiSource/Benchmarks/FreeBench/distray/distray: 5.63% (0.2506 => 0.2647, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.76% (1.3580 => 1.4227, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sieve: 2.18% (3.7952 => 3.8778, std. dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.04% (1.5881 => 1.6205, std. dev.: 0.0038) MultiSource/Applications/minisat/minisat: 1.65% (6.1999 => 6.3022, std. dev.: 0.0284) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -20.34% (4.0213 => 3.2034, std. dev.: 0.2767) SingleSource/Benchmarks/Shootout/heapsort: -13.89% (3.5349 => 3.0438, std. dev.: 0.1876) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std. dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 3.49% (2.1763 => 2.2522, std. dev.: 0.0026) MultiSource/Applications/lemon/lemon: 2.79% (1.0046 => 1.0326, std. dev.: 0.0060) MultiSource/Applications/minisat/minisat: 2.43% (0.6173 => 0.6323, std. dev.: 0.0035) MultiSource/Applications/Burg/burg: 2.34% (1.1440 => 1.1708, std. dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.26% (12.6413 => 12.9268, std. dev.: 0.0526) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.15% (1.3935 => 1.4234, std. dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: 2.06% (8.9977 => 9.1829, std. dev.: 0.0396) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.1827 => 1.2060, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.7639 => 0.7779, std. dev.: 0.0033) MultiSource/Applications/d/make_dparser: 1.80% (3.0225 => 3.0769, std. dev.: 0.0156) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.51% (1.4113 => 1.4326, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.2559 => 8.3733, std. dev.: 0.0427) MultiSource/Benchmarks/Bullet/bullet: 1.36% (29.3170 => 29.7147, std. dev.: 0.0185) MultiSource/Applications/hbd/hbd: 1.35% (1.3268 => 1.3447, std. dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std. dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.28% (0.0766 => 0.0929, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9981, std. dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.02% (4.0101 => 4.5723, std. dev.: 0.0252) SingleSource/Benchmarks/McGill/misr: 13.66% (0.4296 => 0.4883, std. dev.: 0.0016) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.87% (0.0917 => 0.1035, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 12.71% (3.4406 => 3.8778, std. dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 12.60% (0.3746 => 0.4218, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 10.70% (62.4126 => 69.0921, std. dev.: 0.0457) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.93% (1.0063 => 1.0962, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6127, std. dev.: 0.0130) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.57% (0.2694 => 0.2925, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout/methcall: 7.49% (8.5566 => 9.1973, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.4876 => 3.7213, std. dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (27.1724 => 28.8270, std. dev.: 0.0387) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 4.02% (15.2242 => 15.8358, std. dev.: 0.0652) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5388, std. dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.44% (2.6656 => 2.7574, std. dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.19% (6.6312 => 6.8426, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5113 => 8.7576, std. dev.: 0.0712) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.55% (0.5876 => 0.6026, std. dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (2.4042 => 2.4595, std. dev.: 0.0138) MultiSource/Benchmarks/BitBench/five11/five11: 2.19% (5.1938 => 5.3075, std. dev.: 0.0376) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.65% (4.6127 => 4.6886, std. dev.: 0.0113) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.59% (2.4455 => 2.4844, std. dev.: 0.0107) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.58% (1.2726 => 1.2927, std. dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (2.4971 => 2.5332, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.27% (14.4877 => 14.6722, std. dev.: 0.0044) MultiSource/Applications/minisat/minisat: 1.25% (6.2244 => 6.3022, std. dev.: 0.0284) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std. dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 1.16% (6.7458 => 6.8240, std. dev.: 0.0264) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.46% (0.3497 => 0.2117, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.40% (5.2665 => 4.1919, std. dev.: 0.0549) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -14.85% (1.1647 => 0.9917, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1609, std. dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std. dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.06% (3.2007 => 2.9428, std. dev.: 0.0087) SingleSource/Benchmarks/Misc/pi: -6.05% (1.6538 => 1.5537, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -5.98% (1.4441 => 1.3577, std. dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std. dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/methcall: -5.97% (9.2503 => 8.6982, std. dev.: 0.0745) MultiSource/Applications/SPASS/SPASS: -5.22% (8.5323 => 8.0867, std. dev.: 0.1229) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.96% (3.9413 => 3.7459, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (4.6355 => 4.4077, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.08% (0.4140 => 0.3971, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.67% (1.7361 => 1.6724, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.33% (2.4457 => 2.3643, std. dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.12% (45.4683 => 44.0518, std. dev.: 0.4935) MultiSource/Applications/lambda-0_1_3/lambda: -3.00% (7.6833 => 7.4526, std. dev.: 0.0616) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.85% (1.1683 => 1.1350, std. dev.: 0.0124) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.81% (1.2959 => 1.2595, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2859, std. dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: -2.60% (92.7467 => 90.3345, std. dev.: 0.2694) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.22% (3.7496 => 3.6664, std. dev.: 0.0211) MultiSource/Applications/siod/siod: -2.15% (3.5520 => 3.4755, std. dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2307, std. dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std. dev.: 0.0015) MultiSource/Applications/aha/aha: -1.48% (3.4286 => 3.3777, std. dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: -1.47% (1.0926 => 1.0765, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -1.43% (3.8200 => 3.7655, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3183, std. dev.: 0.0150) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.27% (1.8739 => 1.8501, std. dev.: 0.0085) MultiSource/Benchmarks/sim/sim: -1.23% (3.8907 => 3.8427, std. dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.10% (2.5669 => 2.5386, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: